Revisiting Self-Play Preference Optimization: On the Role of Prompt Difficulty.

Yao Xiao, Jung-jae Kim, Roy Ka-Wei Lee, Lidong Bing

Browse the full ACL paper archive.