Feed-Forward Networks

Linear Transformation Matrices

Weights W1 and W2 of the FFN transforming respectively to the expanded dimension and returning to the original model dimension.

← Zurück