Knowledge Distillation as Efficient Pre-training: Faster Convergence, Higher Data-efficiency, and Better Transferability.

Ruifei He, Shuyang Sun, Jihan Yang, Song Bai, Xiaojuan Qi

Browse the full CVPR paper archive.