Preference Curriculum: LLMs Should Always Be Pretrained on Their Preferred Data.

Xuemiao Zhang, Liangyu Xu, Feiyu Duan, Yongwei Zhou, Sirui Wang, Rongxiang Weng, Jingang Wang, Xunliang Cai

Browse the full ACL paper archive.