Eliminating Biased Length Reliance of Direct Preference Optimization via Down-Sampled KL Divergence.

Junru Lu, Jiazheng Li, Siyu An, Meng Zhao, Yulan He, Di Yin, Xing Sun

Browse the full EMNLP paper archive.