Cloze-driven Pretraining of Self-attention Networks.

Alexei Baevski, Sergey Edunov, Yinhan Liu, Luke Zettlemoyer, Michael Auli

Browse the full EMNLP paper archive.