KI-Glossar
Das vollständige Wörterbuch der Künstlichen Intelligenz
162
Kategorien
2.032
Unterkategorien
23.060
Begriffe
Begriffe
Key-Query-Value (KQV)
Triple of projected vectors from the input of an attention mechanism, where keys and queries compute attention weights and values are aggregated according to these weights.
Begriffe
Relative Positional Attention
Attention mechanism that directly incorporates relative distances between positions in the calculation of attention scores, providing better generalization to variable sequence lengths.
🔍