Pre-DPO: Improving Data Utilization in Direct Preference Optimization Using a Guiding Reference Model.

Junshu Pan, Wei Shen, Shulin Huang, Qiji Zhou, Yue Zhang

Browse the full AAAI paper archive.