Learning with Less: Knowledge Distillation from Large Language Models via Unlabeled Data.

Juanhui Li, Sreyashi Nag, Hui Liu, Xianfeng Tang, Sheikh Muhammad Sarwar, Limeng Cui, Hansu Gu, Suhang Wang, Qi He, Jiliang Tang

Browse the full NAACL paper archive.