Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models.

Qinhong Zhou, Zonghan Yang, Peng Li, Yang Liu

Browse the full ACL paper archive.