Preference Reasoning under Indeterminacy in Large Language Models

2026-08-19

AI Summary

研究解决了大型语言模型在偏好推理中的不确定性问题，通过定义认知和结构不确定性，并展示了当前模型在此方面的系统性失败。

Abstract

As large language models evolve into decision-making agents, the ability to reason over preferences becomes fundamental to alignment, coordination, and collective intelligence. Yet, unlike standard benchmarks, real-world preference reasoning is inherently indeterminate: information may be incomplete, and valid solutions may not exist. We argue that indeterminacy, rather than correctness alone, is a central challenge for AI reasoning. We formalize this challenge along two axes, (i) epistemic indeterminacy, arising from incomplete, partial, or expressive preferences, and (ii) structural indeterminacy, arising from the non-existence of solutions under standard social choice concepts. Across a hierarchy of tasks, we show that state-of-the-art language models systematically fail to distinguish between determined and undetermined instances, exhibiting miscalibrated reasoning even in verification settings.

Problem

• Preference Reasoning
• Indeterminacy
• Large Language Models

Innovation

• indeterminacy
• preference reasoning
• epistemic indeterminacy
• structural indeterminacy