Sparse Attention

Pattern-based Attention

Strategy applying predefined sparse attention patterns (like fixed or learned patterns) to determine which query-key pairs to compute.

← Back