Knowledge Distillation

Progressive Distillation

Iterative distillation method where the student gradually becomes the teacher for even more compact models.

← Back