Generative Self-Supervision

Self-Supervised Pre-training

Initial training phase where a model learns general representations on large amounts of unlabeled data before fine-tuning on specific tasks.

← 뒤로