Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model.

Mingqi Li, Fei Ding, Dan Zhang, Long Cheng, Hongxin Hu, Feng Luo

Browse the full EMNLP paper archive.