Knowledge Distillation

Proxy task

Artificially designed pretext task for generating supervised learning signals from unlabeled data, serving as an intermediate objective for self-supervision.

← Back