Efficient Training of BERT by Progressively Stacking.

Linyuan Gong, Di He, Zhuohan Li, Tao Qin, Liwei Wang, Tie-Yan Liu

Browse the full ICML paper archive.