Rethinking the Dark Knowledge and Kullback-Leibler Divergence Loss in Knowledge Distillation Under Capacity Mismatching.

Yingchao Wang, Wenqi Niu, Xingshan Yao, Li You, Weilun Fei

Browse the full AAAI paper archive.