On Teacher Hacking in Language Model Distillation.

Daniil Tiapkin, Daniele Calandriello, Johan Ferret, Sarah Perrin, Nino Vieillard, Alexandre Ram, Mathieu Blondel

Browse the full ICML paper archive.