Frustratingly Simple Pretraining Alternatives to Masked Language Modeling.

Atsuki Yamaguchi, George Chrysostomou, Katerina Margatina, Nikolaos Aletras

Browse the full EMNLP paper archive.