[cateye]

Odds Ratio Preference Optimization (ORPO): https://arxiv.org/abs/2403.07691