Thuật ngữ AI
Từ điển đầy đủ về Trí tuệ nhân tạo
162
danh mục
2.032
danh mục con
23.060
thuật ngữ
thuật ngữ
ALiBi (Attention with Linear Biases)
Alternative to positional encoding using linear biases directly in attention scores to represent distances between tokens.
thuật ngữ
Disentangled Attention
Attention mechanism that explicitly separates content and position contributions in attention score computation.
thuật ngữ
Multi-scale Positional Encoding
Approach combining multiple scales of positional representation to capture both local and global sequence structures.
thuật ngữ
Position Dropout
Regularization technique applied specifically to position embeddings to prevent model over-reliance on positional information.
🔍