Sparse Distillation: Speeding Up Text Classification by Using Bigger Student Models.

Qinyuan Ye, Madian Khabsa, Mike Lewis, Sinong Wang, Xiang Ren, Aaron Jaech

Browse the full NAACL paper archive.