AI Glossary
The complete dictionary of Artificial Intelligence
162
categories
2,032
subcategories
23,060
terms
terms
Key-Query-Value (KQV)
Triple of projected vectors from the input of an attention mechanism, where keys and queries compute attention weights and values are aggregated according to these weights.
terms
Relative Positional Attention
Attention mechanism that directly incorporates relative distances between positions in the calculation of attention scores, providing better generalization to variable sequence lengths.
🔍