Sparse Attention

Routing Attention

Mechanism that learns to route queries to the most relevant keys using content-based routing functions, avoiding unnecessary computations.

← Geri