ReAugKD: Retrieval-Augmented Knowledge Distillation For Pre-trained Language Models.

Jianyi Zhang, Aashiq Muhamed, Aditya Anantharaman, Guoyin Wang, Changyou Chen, Kai Zhong, Qingjun Cui, Yi Xu, Belinda Zeng, Trishul Chilimbi, Yiran Chen

Browse the full ACL paper archive.