KI-Glossar
Das vollständige Wörterbuch der Künstlichen Intelligenz
162
Kategorien
2.032
Unterkategorien
23.060
Begriffe
Begriffe
Attention Layer Normalization
Normalization applied before or after the attention mechanism to stabilize training, typically implemented as pre-norm in modern architectures.
Begriffe
ALiBi Position Embedding
Positional encoding method that applies linearly decreasing biases based on distance, enabling better extrapolation to longer sequence lengths.
🔍