On Extending Direct Preference Optimization to Accommodate Ties

Published in NeurIPS, 2025

Recommended citation: Jinghong Chen, Guangyu Yang, Weizhe Lin, Jingbiao Mei, Chenxu Lyu, Bill Byrne. (2025). On Extending Direct Preference Optimization to Accommodate Ties. Advances in Neural Information Processing Systems, 38, 53932–53977. https://doi.org/10.52202/085713-1801 https://proceedings.neurips.cc/paper_files/paper/2025/hash/4dbf3488a8da908a8177d525ede1a43a-Abstract-Conference.html