Medical Model Synthesis Architectures: A Case Study

2026-05-10

AI Summary

Current clinical AI systems often lack proper calibration under uncertainty and suffer from opaque decision-making, limiting their reliability in high-stakes medical judgments. This work proposes MedMSA, a novel framework that uniquely integrates large language models with formal probabilistic graphical models. By retrieving relevant prior knowledge and constructing a verifiable probabilistic reasoning mechanism, MedMSA enables calibrated and interpretable quantification of uncertainty. The approach generates a differential diagnosis list weighted by uncertainty estimates, preserving clinical utility while ensuring formal transparency in the reasoning process. This advancement lays a foundational pathway toward safe, trustworthy AI-assisted clinical decision support systems.

Abstract

Medicine is rife with high-stakes uncertainty. Doctors routinely make clinical judgments and decisions that juggle many fundamental unknowns, like predictions about what might be causing a patients' symptoms or decisions about what treatment to try next. Despite increasing interest in developing AI systems that aid or even replace doctors in clinical settings, current systems struggle with calibrated reasoning under uncertainty, and are often deeply opaque about their reasoning. We propose a framework for AI systems that can make practically useful but formally transparent clinical predictions under uncertainty. Given a clinical situation, our framework (MedMSA) uses language models to retrieve relevant prior knowledge, but constructs a formal probabilistic model to support calibrated and verifiable inferences under uncertainty. We show how an initial proof-of-concept of this framework can be used for differential diagnosis, producing an uncertainty-weighted list of potential diagnoses that could explain a patients' symptoms, and discuss future applications and directions for applying this framework more generally for safe clinical collaborations.

Problem

• medical uncertainty
• AI transparency
• clinical decision-making
• calibrated reasoning
• differential diagnosis

Innovation

• Medical Model Synthesis
• probabilistic reasoning
• uncertainty calibration
• transparent AI
• differential diagnosis