Proof-of-Perception: Certified Tool-Using Multimodal Reasoning with Compositional Conformal Guarantees
This work addresses the unreliability of multimodal reasoning, which often leads to error propagation and hallucination due to insufficient uncertainty calibration. The authors propose a novel executable reasoning graph framework that models perceptual and logical operations as nodes producing conformal prediction sets, thereby providing calibrated, stepwise uncertainty guarantees. A lightweight controller dynamically schedules tool invocations based on available computational budget. This approach establishes, for the first time, a compositional conformal guarantee mechanism that enables verifiable, evidence-backed reasoning, suppresses error accumulation, and allows controllable trade-offs between computation and accuracy. Experiments demonstrate consistent superiority over strong baselines across document, chart, and multi-image question-answering benchmarks in terms of performance, reliability, and computational efficiency.