Understand and Modularize Generator Optimization in ELECTRA-style Pretraining.

Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu

Browse the full ICML paper archive.