TY - RPRT TI - Aligning Language Models with General Preferences: An Empirical Study of Direct Nash Optimization AU - Austin Tsai AU - Saurav Nanda AU - Ganapathy Parthasarathy AU - Bhuvnesh Kumar AU - Parivesh Choudhary PY - 2026 UR - https://arxiv.org/abs/2611.05373 ID - 2611.05373 ER -