Dynamic Knowledge Distillation for Pre-trained Language Models.

Lei Li, Yankai Lin, Shuhuai Ren, Peng Li, Jie Zhou, Xu Sun

Browse the full EMNLP paper archive.