Revisiting Intermediate-Layer Matching in Knowledge Distillation: Layer-Selection Strategy Doesn't Matter (Much).

Zony Yu, Yuqiao Wen, Lili Mou

Browse the full IJCNLP paper archive.