Universal-KD: Attention-based Output-Grounded Intermediate Layer Knowledge Distillation.

Yimeng Wu, Mehdi Rezagholizadeh, Abbas Ghaddar, Md. Akmal Haidar, Ali Ghodsi

Browse the full EMNLP paper archive.