Seq2Seq (Sequence-to-Sequence)

Masking

Procedure consisting of masking certain positions of sequences to prevent the model from processing irrelevant or future information. Masking is essential for managing variable-length sequences and preventing cheating during auto-regressive training.

← Indietro