Towards Non-task-specific Distillation of BERT via Sentence Representation Approximation.

Bowen Wu, Huan Zhang, Mengyuan Li, Zongsheng Wang, Qihang Feng, Junhong Huang, Baoxun Wang

Browse the full IJCNLP paper archive.