Knowledge Distillation

Attention Transfer

Transfer of attention maps from the teacher to the student to preserve the important regions identified by the complex model.

← Back