Triple of projected vectors from the input of an attention mechanism, where keys and queries compute attention weights and values are aggregated according to these weights.

📖

termen

Relative Positional Attention

Attention mechanism that directly incorporates relative distances between positions in the calculation of attention scores, providing better generalization to variable sequence lengths.

🔍

AI-woordenlijst

Key-Query-Value (KQV)

Relative Positional Attention

Geen resultaten gevonden