Triple of projected vectors from the input of an attention mechanism, where keys and queries compute attention weights and values are aggregated according to these weights.

📖

istilah

Relative Positional Attention

Attention mechanism that directly incorporates relative distances between positions in the calculation of attention scores, providing better generalization to variable sequence lengths.

🔍

Glosarium AI

Key-Query-Value (KQV)

Relative Positional Attention

Tidak ada hasil ditemukan