Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling.

Pratyush Maini, Skyler Seto, Richard He Bai, David Grangier, Yizhe Zhang, Navdeep Jaitly

Browse the full ACL paper archive.