Promises and Pitfalls of Generative Masked Language Modeling: Theoretical Framework and Practical Guidelines.
Yuchen Li, Alexandre Kirchmeyer, Aashay Mehta, Yilong Qin, Boris Dadachev, Kishore Papineni, Sanjiv Kumar, Andrej Risteski
Browse the full ICML paper archive.