Med-CAM: Minimal Evidence for Explaining Medical Decision Making

2026-04-15

AI Summary

This study addresses the limited interpretability of existing medical AI systems, which often fail to provide transparent and reliable diagnostic justifications. To overcome this challenge, the authors propose Med-CAM, a novel framework that trains segmentation networks from scratch using a Classifier Activation Matching mechanism, augmented with spatial constraints to produce minimal, precise evidence maps aligned with model activations. This approach achieves, for the first time, compact and diagnostically coherent minimal explanations, substantially enhancing spatial awareness and clinical interpretability. In contrast to conventional methods like Grad-CAM that yield diffuse and imprecise visualizations, Med-CAM generates sharp-boundary explanation maps that faithfully reflect the model’s decision logic, thereby fostering greater trust among clinicians in high-stakes applications such as pathology and radiology.

Technology Category

• Computer Vision: Interpretability, Explainability, and Transparency
• Machine Learning: Transparent, Interpretable, Explainable ML
• Knowledge Representation and Reasoning: Diagnosis and Abductive Reasoning

Application Category

• User Modeling, Personalization and Recommendation: Explainable and interpretable methods for personalization
• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking
• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions

Abstract

Reliable and interpretable decision-making is essential in medical imaging, where diagnostic outcomes directly influence patient care. Despite advances in deep learning, most medical AI systems operate as opaque black boxes, providing little insight into why a particular diagnosis was reached. In this paper, we introduce Med-CAM, a framework for generating minimal and sharp maps as evidence-based explanations for Medical decision making via Classifier Activation Matching. Med-CAM trains a segmentation network from scratch to produce a mask that highlights the minimal evidence critical to model's decision for any seen or unseen image. This ensures that the explanation is both faithful to the network's behaviour and interpretable to clinicians. Experiments show, unlike prior spatial explanation methods, such as Grad-CAM and attention maps, which yield only fuzzy regions of relative importance, Med-CAM with its superior spatial awareness to shapes, textures, and boundaries, delivers conclusive, evidence-based explanations that faithfully replicate the model's prediction for any given image. By explicitly constraining explanations to be compact, consistent with model activations, and diagnostic alignment, Med-CAM advances transparent AI to foster clinician understanding and trust in high-stakes medical applications such as pathology and radiology.

Problem

• medical imaging
• interpretable AI
• decision explanation
• black-box models
• clinical trust

Innovation

• Med-CAM
• evidence-based explanation
• minimal evidence
• classifier activation matching
• interpretable AI