Exploring extreme parameter compression for pre-trained language models.

Benyou Wang, Yuxin Ren, Lifeng Shang, Xin Jiang, Qun Liu

Browse the full ICLR paper archive.