🤖 AI Summary
This work addresses the challenge of verifying mathematical proofs generated by large language models, which stems from insufficient coverage of formal knowledge bases such as combinatorics theory. To bridge this gap, the paper presents the first systematic formalization of combinatorics theory—encompassing 93 core definitions and lemmas—and integrates it into Lean 4. Building upon this foundation, the authors propose LAMP, a multi-agent framework that, without fine-tuning, leverages the Model Context Protocol (MCP) to coordinate a planner, builder, and verifier. By explicitly supplying structured domain knowledge through a formal ontology, LAMP synthesizes proofs verifiable by the Lean kernel. Evaluated on a benchmark of 90 theorems spanning eight modules and three difficulty levels, LAMP successfully generates correct proofs for 96.7% of the problems, substantially outperforming baseline methods and existing specialized provers, with ablation studies confirming the efficacy of its architectural design.
📝 Abstract
Large language models are increasingly capable of mathematical reasoning, but the proofs they generate are often unreliable and hard to verify. Interactive theorem provers such as Lean 4 address this by accepting only kernel-checked proofs; however, their reach is bounded by the formalized knowledge available. While Mathlib, a repository of formalized Lean 4 theorems that covers diverse mathematical areas, certain specialized areas remain underrepresented; notably, the domain of Combinatorics on Words (CoW). CoW studies sequences, exploring their properties such as periodicity, borders, conjugacy, and morphisms. As a result, specialized provers, trained on Mathlib-centered data, lack the lemmas to operate in CoW. We present two contributions. First, we introduce a Lean 4 formalization of CoW containing eight modules and \textbf{93} declarations of core definitions and foundational lemmas. Second, we present LAMP, a multi-agent framework that synthesizes kernel-verified Lean 4 proofs by providing explicit, structured domain knowledge at inference time through an ontology, rather than by fine-tuning a prover. LAMP coordinates a Planner, Builder, and Verifier with Model Context Protocol based access to a domain-specific CoW ontology. In a suite of 90 CoW theorems that span all eight modules and three difficulty levels, LAMP synthesizes verified proofs for 96.7% of theorems, substantially exceeding both an unscaffolded baseline and existing specialized provers. An ablation shows that removing LAMP's tool-grounded architecture or its Planner/Builder separation each cost roughly 12 percentage points, even with the backbone model held fixed.