One Teacher is Enough? Pre-trained Language Model Distillation from Multiple Teachers.

Chuhan Wu, Fangzhao Wu, Yongfeng Huang

Browse the full ACL paper archive.