Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains.

Yunzhi Yao, Shaohan Huang, Wenhui Wang, Li Dong, Furu Wei

Browse the full ACL paper archive.