Iterative Structured Knowledge Distillation: Optimizing Language Models Through Layer-by-Layer Distillation.

Malthe Have Musaeus, Rob van der Goot

Browse the full COLING paper archive.