Logan Frank, Jim Davis

A Unified Revisit of Temperature in Classification-Based Knowledge Distillation

arXiv:2603.02430v1 Announce Type: new Abstract: A central idea of knowledge distillation is to expose relational structure embedded in the teacher's weights for the student to …