AI 용어집
인공지능 완전 사전
162
카테고리
2,032
하위 카테고리
23,060
용어
용어
ALiBi (Attention with Linear Biases)
Alternative to positional encoding using linear biases directly in attention scores to represent distances between tokens.
용어
Disentangled Attention
Attention mechanism that explicitly separates content and position contributions in attention score computation.
용어
Multi-scale Positional Encoding
Approach combining multiple scales of positional representation to capture both local and global sequence structures.
용어
Position Dropout
Regularization technique applied specifically to position embeddings to prevent model over-reliance on positional information.
🔍