Improving Robustness and Reliability in Medical Image Classification with Latent-Guided Diffusion and Nested-Ensembles

📅 2023-10-24
🏛️ arXiv.org
📈 Citations: 4
Influential: 0
📄 PDF
🤖 AI Summary
Medical image classification models often exhibit poor robustness and miscalibrated confidence in clinical deployment due to unknown noise, corruptions, and domain shifts. Existing approaches typically address only one challenge—e.g., adversarial robustness or confidence calibration—lacking a unified solution. This paper proposes LaDiNE, a novel framework featuring (i) latent-space-guided diffusion modeling to learn covariate-shift-invariant latent representations, and (ii) distribution-free nested ensembling for robust predictive distribution estimation. By avoiding assumptions about parametric output distributions, LaDiNE simultaneously enhances generalization and confidence calibration. Evaluated on tuberculosis chest X-ray and melanoma skin lesion datasets, LaDiNE outperforms state-of-the-art methods under diverse distributional shifts—including label noise, adversarial perturbations, and domain mismatches—while maintaining high accuracy and superior calibration performance.
📝 Abstract
Ensemble deep learning has been shown to achieve high predictive accuracy and uncertainty estimation in a wide variety of medical imaging contexts. However, perturbations in the input images at test time (e.g. noise, domain shifts) can still lead to significant performance degradation, posing challenges for trustworthy clinical deployment. In order to address this, we propose LaDiNE, a novel and robust probabilistic method that is capable of inferring informative and invariant latent variables from the input images. These latent variables are then used to recover the robust predictive distribution without relying on a predefined functional-form. This results in improved (i) generalization capabilities and (ii) calibration of prediction confidence. Extensive experiments were performed on the task of disease classification based on the Tuberculosis chest X-ray and the ISIC Melanoma skin cancer datasets. Here the performance of LaDiNE was analysed under a range of challenging covariate shift conditions, where training was based on"clean"images, and unseen noisy inputs and adversarial perturbations were presented at test time. Results show that LaDiNE outperforms existing state-of-the-art baseline methods in terms of accuracy and confidence calibration. This increases the feasibility of deploying reliable medical machine learning models in real clinical settings, where accurate and trustworthy predictions are crucial for patient care and clinical decision support.
Problem

Research questions and friction points this paper is trying to address.

Addresses unreliable predictions in medical image classification
Improves robustness to noise and adversarial perturbations
Enhances confidence calibration under unexpected image corruptions
Innovation

Methods, ideas, or system contributions that make the work stand out.

Combines Vision Transformers with diffusion models
Uses transformer encoders for robust feature extraction
Employs diffusion models for calibrated confidence estimation
🔎 Similar Papers
No similar papers found.