Towards the Law of Capacity Gap in Distilling Language Models.

Chen Zhang, Qiuchi Li, Dawei Song, Zheyu Ye, Yan Gao, Yao Hu

Browse the full ACL paper archive.