Clueing up LLMs with Tool-Augmented Deductive Reasoning

📅 2026-09-16
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究通过在经典桌游Clue的多代理版本中引入工具增强的方法,使用可能性矩阵来提高大型语言模型在多步骤推理任务中的逻辑一致性和表现。
📝 Abstract
Despite recent advances in large language models (LLMs), performing logically consistent deductive reasoning over extended interactions remains challenging. Tasks that require integrating evidence across multiple reasoning steps, maintaining consistency with prior inferences, and updating beliefs under new constraints can surface limitations in current models while providing a useful testbed for evaluating reasoning enhancements. In this paper, we implement a text-based, multi-agent version of the classic board game Clue as an environment to evaluate multi-step, agentic deductive reasoning. In this setting, agents must infer hidden information from a sequence of observations, maintain consistency across turns, and reason over an evolving set of logical constraints. We instantiate six LLM-based agents (GPT-4o-mini and Gemini-2.5-Flash) as players that engage in turn-based gameplay; using three agents per model family, we establish baseline performance across repeated games. We then introduce a tool-augmented approach in which a structured possibility matrix converts implicit game state from generated reasoning logs into an explicit representation of remaining possibilities. The possibility matrix encodes extended-turn memory and deductive constraints, offloading these tasks from the agent. We compare this approach against the baseline to evaluate how tool augmentation supports reasoning quality and task success for autonomous agents in a strategic reasoning environment.
Problem

Research questions and friction points this paper is trying to address.

large language models
deductive reasoning
multi-step reasoning
consistency
belief updating
Innovation

Methods, ideas, or system contributions that make the work stand out.

tool-augmented approach
possibility matrix
deductive reasoning
structured representation
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
R
Rebecca Ansell
Georgetown University
A
Autumn Toney-Wails
Syntheos, Corp and UNU-MERIT