Słownik AI
Kompletny słownik sztucznej inteligencji
162
kategorie
2 032
podkategorie
23 060
pojęcia
pojęcia
Key-Query-Value (KQV)
Triple of projected vectors from the input of an attention mechanism, where keys and queries compute attention weights and values are aggregated according to these weights.
pojęcia
Relative Positional Attention
Attention mechanism that directly incorporates relative distances between positions in the calculation of attention scores, providing better generalization to variable sequence lengths.
🔍