EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation.

Chenhe Dong, Guangrun Wang, Hang Xu, Jiefeng Peng, Xiaozhe Ren, Xiaodan Liang

Browse the full EMNLP paper archive.