P3LM: Probabilistically Permuted Prophet Language Modeling for Generative Pre-Training.

Junwei Bao, Yifan Wang, Ying Jiangyong, Yeyun Gong, Jing Zhao, Youzheng Wu, Xiaodong He

Browse the full EMNLP paper archive.