Sparse attention approach organized in blocks, where the attention matrix is divided into blocks and only certain blocks are computed to optimize hardware parallelism.

📖

istilah

LSH Attention

Attention mechanism using locality-sensitive hashing to group similar queries and keys, computing attention only within these groups.

🔍

Glosarium AI

Block Sparse Attention

LSH Attention

Tidak ada hasil ditemukan