Encoder-Decoder Architecture

Feed-Forward Network

Fully connected neural network applied to each position independently after the attention mechanism, enabling nonlinear transformation and higher-dimensional projection.

← Geri