A Comparative Analysis of Task-Agnostic Distillation Methods for Compressing Transformer Language Models.

Takuma Udagawa, Aashka Trivedi, Michele Merler, Bishwaranjan Bhattacharjee

Browse the full EMNLP paper archive.