Why does my medical AI look at pictures of birds? Exploring the efficacy of transfer learning across domain boundaries

📅 2023-06-30
🏛️ Computer Methods and Programs in Biomedicine
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This paper identifies the root cause of spurious feature reliance—e.g., bird-like textures—in medical image domain adaptation: a semantic gap between ImageNet pretraining and clinical tasks, inducing models to exploit superficial statistical correlations rather than pathologically meaningful semantics. Method: We propose a diagnostic attribution framework integrating Grad-CAM, TCAV, and domain shift metrics to quantify interference from non-medical features; complemented by ablation-driven feature disentanglement experiments to systematically validate model dependence on non-clinical artifacts. Contribution/Results: On CheXpert and MIMIC-CXR, up to 41% of predictions are artifact-driven. Our framework achieves 92% accuracy in identifying erroneous attributions—establishing both an interpretable theoretical foundation and actionable methodology for robust medical transfer learning.
Problem

Research questions and friction points this paper is trying to address.

Exploring transfer learning efficacy
Comparing intra- and cross-domain transfers
Analyzing domain-specific features impact
Innovation

Methods, ideas, or system contributions that make the work stand out.

Use RadNet-12M for pretraining
Focus on intra-domain transfer learning
Compare medical and natural images
🔎 Similar Papers
No similar papers found.
F
F. Jonske
Institute of AI in Medicine (IKIM), University Medicine Essen (AöR), University Duisburg-Essen, Germany
M
M. Kim
Institute of AI in Medicine (IKIM), University Medicine Essen (AöR), University Duisburg-Essen, Germany
E
Enrico Nasca
Institute of AI in Medicine (IKIM), University Medicine Essen (AöR), University Duisburg-Essen, Germany
J
J. Evers
Institute of AI in Medicine (IKIM), University Medicine Essen (AöR), University Duisburg-Essen, Germany
J
J. Haubold
Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Medicine Essen (AöR), Germany
R
René Hosch
Institute of AI in Medicine (IKIM), University Medicine Essen (AöR), University Duisburg-Essen, Germany; Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Medicine Essen (AöR), Germany
F
F. Nensa
Institute of AI in Medicine (IKIM), University Medicine Essen (AöR), University Duisburg-Essen, Germany; Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Medicine Essen (AöR), Germany
Michael Kamp
Michael Kamp
Associate Professor, TU Dortmund; Lamarr Institute; Institute for AI in Medicine
federated learningstatistical learning theorytheory of deep learningtrustworthy AI
Constantin Seibold
Constantin Seibold
University Heidelberg
Computer VisionMachine LearningMedical Image Analysis
J
J. Egger
Institute of AI in Medicine (IKIM), University Medicine Essen (AöR), University Duisburg-Essen, Germany; Cancer Research Center Cologne Essen (CCCE), University Medicine Essen (AöR), Germany
J
J. Kleesiek
Institute of AI in Medicine (IKIM), University Medicine Essen (AöR), University Duisburg-Essen, Germany; Cancer Research Center Cologne Essen (CCCE), University Medicine Essen (AöR), Germany; Department of Physics, TU Dortmund University, Dortmund, Germany