AI 용어집

📖

용어

Block Sparse Attention

Sparse attention approach organized in blocks, where the attention matrix is divided into blocks and only certain blocks are computed to optimize hardware parallelism.

📖

용어

LSH Attention

Attention mechanism using locality-sensitive hashing to group similar queries and keys, computing attention only within these groups.