2D-DPO: Scaling Direct Preference Optimization with 2-Dimensional Supervision.

Shilong Li, Yancheng He, Hui Huang, Xingyuan Bu, Jiaheng Liu, Hangyu Guo, Weixun Wang, Jihao Gu, Wenbo Su, Bo Zheng

Browse the full NAACL paper archive.