AI Glossary
The complete dictionary of Artificial Intelligence
162
categories
2,032
subcategories
23,060
terms
terms
Block Sparse Attention
Sparse attention approach organized in blocks, where the attention matrix is divided into blocks and only certain blocks are computed to optimize hardware parallelism.
terms
LSH Attention
Attention mechanism using locality-sensitive hashing to group similar queries and keys, computing attention only within these groups.
🔍