Pre-Training Transformers as Energy-Based Cloze Models.

Kevin Clark, Minh-Thang Luong, Quoc V. Le, Christopher D. Manning

Browse the full EMNLP paper archive.