Explainable Uncertainty Estimation for Reliable Medical AI

2026-08-28

AI Summary

为了解决医疗AI中的信任问题，本文提出了一种可解释的不确定性估计方法egRUE，该方法结合了不确定性的量化与特征级贡献的解释，从而提高预测的可靠性和可解释性。

Abstract

Artificial intelligence has strong potential to support clinical decision-making, yet its adoption in healthcare remains limited due to a lack of trust. Uncertainty estimation can signal unreliable predictions, and explainable AI (XAI) can clarify how predictions are made but existing methods treat them separately, providing no feature-level insight into why a prediction is uncertain or which tests to prioritize to reduce it. To address this gap, we propose explainable uncertainty estimation, which unifies uncertainty estimation and XAI to both quantify uncertainty and explain feature-level contributions. We introduce the Expected Gradients Reconstruction Uncertainty Estimate (egRUE), which incorporates prediction explanations into its uncertainty computation and decomposes uncertainty into feature-wise contributions. We prove theoretical properties of egRUE and show through experiments that it improves reliability and interpretability compared to existing methods. A user study with medical experts further demonstrates that egRUE's explanations improve calibrated trust over uncertainty scores alone, increasing confidence in correct predictions and reducing confidence in incorrect ones. By combining prediction uncertainty with feature-level explanations, egRUE strengthens decision-making support in safety-critical healthcare settings, clarifying both when predictions may be unreliable and which features drive that uncertainty.

Problem

• Uncertainty Estimation
• Explainable AI
• Clinical Decision-Making
• Reliability
• Healthcare

Innovation

• Explainable Uncertainty Estimation
• Expected Gradients Reconstruction Uncertainty Estimate (egRUE)
• Feature-level Contributions