Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective.

Jongwoo Ko, Seungjoon Park, Minchan Jeong, Sukjin Hong, Euijai Ahn, Du-Seong Chang, Se-Young Yun

Browse the full EACL paper archive.