Revisiting Knowledge Distillation for Autoregressive Language Models.

Qihuang Zhong, Liang Ding, Li Shen, Juhua Liu, Bo Du, Dacheng Tao

Browse the full ACL paper archive.