Insights into the mechanism behind reusing Teacher's classifier in Knowledge Distillation.

Kinshuk Dua

Browse the full ICLR paper archive.