AI Glossary
The complete dictionary of Artificial Intelligence
162
categories
2,032
subcategories
23,060
terms
terms
Masked Language Model (MLM)
Training objective where the model predicts randomly masked words in a sentence, forcing the model to understand the bidirectional context of language.
terms
Sequence to Sequence Encoding (Seq2Seq)
Neural network architecture composed of two parts, an encoder that processes an input sequence and a decoder that generates an output sequence, used for translation and text synthesis.
terms
Layer Normalization
Regularization technique that stabilizes the training of deep neural networks by normalizing the activations of each layer, accelerating convergence and improving performance.
terms
Subword Tokenization
Tokenization method that divides words into smaller units (subwords), allowing to manage a finite vocabulary while representing rare or unknown words by concatenation of known subwords.
🔍