Autoregressive Models

Next Token Prediction

Fundamental objective of autoregressive models consisting of maximizing the conditional probability P(token_t|tokens_1...t-1).

← Zurück