Transformer-based Generative Models

Masked Language Models

Self-supervised approach where tokens are masked in the input and the model must predict them, enabling bidirectional context learning.

← Kembali