Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning.

Zeyuan Allen-Zhu, Yuanzhi Li

Browse the full ICLR paper archive.