AI-ordlista
Den kompletta ordlistan över AI
Tree-Structured Attention
Attention mechanism that operates on representations organized in a tree structure, allowing explicit modeling of hierarchical syntactic or semantic relationships in data.
Hierarchical Contextual Attention
Attention mechanism that integrates context at multiple hierarchical levels, allowing each unit to receive local and global contextual information in a structured manner.
Hierarchical Multi-Head Attention
Extension of multi-head attention where each head can specialize on different hierarchical levels of the input structure, capturing dependencies at different scales.
Hierarchical Co-Attention
Mutual attention mechanism applied between two hierarchical modalities, where attention is calculated at each level of the hierarchy to model complex interactions.
Adaptive Hierarchical Attention
Hierarchical attention system where the depth and structure of the hierarchy are dynamically adapted based on the characteristics of the input data.
Hierarchical Sparse Attention
Hierarchical attention variant using sparsity patterns to reduce computational complexity, by calculating attention only on the most relevant pairs at each hierarchical level.
Recurrent Hierarchical Attention
Architecture combining recurrent mechanisms with hierarchical attention, where hidden states at each level are sequentially updated while maintaining a hierarchical structure.
Hierarchical Attention with Memory
Hierarchical attention system integrating external memories at different levels, allowing storage and retrieval of relevant information at each scale of the hierarchy.
Dynamic Hierarchical Attention
Mechanism where the hierarchical structure of attention is dynamically modified during inference based on processing needs, optimizing the use of computational resources.