Weight-Inherited Distillation for Task-Agnostic BERT Compression.

Taiqiang Wu, Cheng Hou, Shanshan Lao, Jiayi Li, Ngai Wong, Zhe Zhao, Yujiu Yang

Browse the full NAACL paper archive.