Sparse Attention

Sinkhorn Sorting

Algorithm using Sinkhorn iteration to transform attention into a differentiable permutation, applied in sparse attention architectures.

← Terug