Staged Training for Transformer Language Models.

Sheng Shen, Pete Walsh, Kurt Keutzer, Jesse Dodge, Matthew E. Peters, Iz Beltagy

Browse the full ICML paper archive.