Is DPO Superior to PPO for LLM Alignment? A Comprehensive Study.

Shusheng Xu, Wei Fu, Jiaxuan Gao, Wenjie Ye, Weilin Liu, Zhiyu Mei, Guangju Wang, Chao Yu, Yi Wu

Browse the full ICML paper archive.