Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models.

Taiqiang Wu, Chaofan Tao, Jiahao Wang, Runming Yang, Zhe Zhao, Ngai Wong

Browse the full COLING paper archive.