TIS-DPO: Token-level Importance Sampling for Direct Preference Optimization With Estimated Weights.

Aiwei Liu, Haoping Bai, Zhiyun Lu, Yanchao Sun, Xiang Kong, Xiaoming Simon Wang, Jiulong Shan, Albin Madappally Jose, Xiaojiang Liu, Lijie Wen, Philip S. Yu, Meng Cao

Browse the full ICLR paper archive.