Knowledge Distillation with Perturbed Loss: From a Vanilla Teacher to a Proxy Teacher.

Rongzhi Zhang, Jiaming Shen, Tianqi Liu, Jialu Liu, Michael Bendersky, Marc Najork, Chao Zhang

Browse the full KDD paper archive.