AI 용어집
인공지능 완전 사전
162
카테고리
2,032
하위 카테고리
23,060
용어
용어
Contrastive Loss Function
Objective function that penalizes representations of negative pairs that are too similar and rewards high similarity between positive pairs.
용어
Momentum Encoder
Secondary encoder whose weights are updated with an exponential moving average of the main encoder's weights to ensure representation consistency.
용어
MoCo
Momentum Contrast technique that uses a momentum encoder and a memory queue to maintain consistent negatives while allowing a large dictionary.
용어
VICReg
Approach based on regularization of variance, invariance, and covariance of representations without explicitly requiring negative pairs.
용어
Representation Collapse
Phenomenon where the model produces identical or constant representations for all inputs, thereby losing all discriminative information.
🔍