How to Trade Off the Quantity and Capacity of Teacher Ensemble: Learning Categorical Distribution to Stochastically Employ a Teacher for Distillation.

Zixiang Ding, Guoqing Jiang, Shuai Zhang, Lin Guo, Wei Lin

Browse the full AAAI paper archive.