Decoder-Only LLMs can be Masked Auto-Encoders.

Dan Qiao, Yuan Gao, Zheming Yang, Di Yang, Ziheng Wu, Pengcheng Lu, Minghui Qiu, Juntao Li, Min Zhang

Browse the full ACL paper archive.