Encoder-Decoder Architecture

Causal Masking

Technique applied in the decoder to prevent each position from attending to future positions, thus ensuring the autoregressive nature of generation and preventing information leakage.

← Indietro