Rethinking Soft Labels for Knowledge Distillation: A Bias-Variance Tradeoff Perspective.

Helong Zhou, Liangchen Song, Jiajie Chen, Ye Zhou, Guoli Wang, Junsong Yuan, Qian Zhang

Browse the full ICLR paper archive.