LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understanding.

Hao Fu, Shaojun Zhou, Qihong Yang, Junjie Tang, Guiquan Liu, Kaikui Liu, Xiaolong Li

Browse the full AAAI paper archive.