MiniPLM: Knowledge Distillation for Pre-training Language Models.

Yuxian Gu, Hao Zhou, Fandong Meng, Jie Zhou, Minlie Huang

Browse the full ICLR paper archive.