A Common Pitfall of Margin-based Language Model Alignment: Gradient Entanglement.

Hui Yuan, Yifan Zeng, Yue Wu, Huazheng Wang, Mengdi Wang, Liu Leqi

Browse the full ICLR paper archive.