Establishing Causal Relationship Between Whole Slide Image Predictions and Diagnostic Evidence Subregions in Deep Learning

📅 2024-07-24
📈 Citations: 1
Influential: 0
📄 PDF

career value

186K/year
🤖 AI Summary
Weak causal interpretability and high attribution noise due to the absence of pixel-level annotations hinder diagnostic reliability in digital pathology whole-slide image (WSI) analysis. To address this, we propose CI-MIL—a novel framework that pioneers the integration of causal inference into the multi-instance learning (MIL) paradigm. CI-MIL achieves out-of-distribution generalization and confounder correction via decorrelated reweighting and cross-correlation minimization in a random Fourier feature space, all without requiring pixel-level supervision. This significantly enhances the determinacy and clinical interpretability of evidence subregion attribution. Evaluated on Camelyon16 and TCGA-NSCLC, CI-MIL achieves 92.25% accuracy / 95.28% AUC and 94.29% accuracy / 98.07% AUC, respectively. Attribution heatmaps exhibit strong spatial alignment with ground-truth annotations, empirically validating its robust causal modeling capability.

Technology Category

Application Category

📝 Abstract
Due to the lack of fine-grained annotation guidance, current Multiple Instance Learning (MIL) struggles to establish a robust causal relationship between Whole Slide Image (WSI) diagnosis and evidence sub-images, just like fully supervised learning. So many noisy images can undermine the network's prediction. The proposed Causal Inference Multiple Instance Learning (CI-MIL), uses out-of-distribution generalization to reduce the recognition confusion of sub-images by MIL network, without requiring pixelwise annotations. Specifically, feature distillation is introduced to roughly identify the feature representation of lesion patches. Then, in the random Fourier feature space, these features are re-weighted to minimize the cross-correlation, effectively correcting the feature distribution deviation. These processes reduce the uncertainty when tracing the prediction results back to patches. Predicted diagnoses are more direct and reliable because the causal relationship between them and diagnostic evidence images is more clearly recognized by the network. Experimental results demonstrate that CI-MIL outperforms state-of-the-art methods, achieving 92.25% accuracy and 95.28% AUC on the Camelyon16 dataset (breast cancer), while 94.29% accuracy and 98.07% AUC on the TCGA-NSCLC dataset (non-small cell lung cancer). Additionally, CI-MIL exhibits superior interpretability, as its selected regions demonstrate high consistency with ground truth annotations, promising more reliable diagnostic assistance for pathologists.
Problem

Research questions and friction points this paper is trying to address.

Lack of fine-grained annotation in WSI diagnosis
Noisy sub-images impair network prediction accuracy
Unclear causal link between predictions and evidence
Innovation

Methods, ideas, or system contributions that make the work stand out.

Uses causal inference to link WSI predictions to evidence subregions
Employs feature distillation for rough lesion patch identification
Re-weights features in Fourier space to minimize cross-correlation
🔎 Similar Papers
No similar papers found.
T
Tianhang Nan
College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, CO 110000 China
Y
Yong Ding
College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, CO 110000 China
H
Hao Quan
College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, CO 110000 China
D
Deliang Li
College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, CO 110000 China
M
Mingchen Zou
College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, CO 110000 China
X
Xiaoyu Cui
College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, CO 110000 China and The Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Beijing, CO 100000 China