Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation.

Yuanxin Liu, Fandong Meng, Zheng Lin, Weiping Wang, Jie Zhou

Browse the full ACL paper archive.