Słownik AI
Kompletny słownik sztucznej inteligencji
162
kategorie
2 032
podkategorie
23 060
pojęcia
pojęcia
Attention Layer Normalization
Normalization applied before or after the attention mechanism to stabilize training, typically implemented as pre-norm in modern architectures.
pojęcia
ALiBi Position Embedding
Positional encoding method that applies linearly decreasing biases based on distance, enabling better extrapolation to longer sequence lengths.
🔍