HomoDistil: Homotopic Task-Agnostic Distillation of Pre-trained Transformers.

Chen Liang, Haoming Jiang, Zheng Li, Xianfeng Tang, Bing Yin, Tuo Zhao

Browse the full ICLR paper archive.