ARC-CT: Anatomy-Routed Contrastive Vision-Language Learning for 3D Chest CT

📅 2026-08-28
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
为解决3D胸部CT中小异常特征易被忽视及共阳性样本误判问题,提出基于解剖路由的对比视觉-语言学习方法ARC-CT,无需手动标注。
📝 Abstract
Contrastive vision-language learning uses paired chest CT volumes and radiology reports to learn abnormality classifiers without manually annotated labels. However, two characteristics of chest CT challenge conventional global contrastive learning. First, many critical abnormalities are small or anatomically localized, and pooling an en- tire volume into a single embedding may dilute their visual evidence. Second, the standard contrastive objective treats every other scan in a batch as a negative. Because many chest CTs share abnormalities, this objective incorrectly pushes co-positive pairs apart. We propose Anatomy-Routed Contrastive Learning for 3D Chest CT (ARC-CT), a region-aware framework that addresses these limitations using only la- bels extracted from reports by an LLM, with no manual annotations or bounding boxes. ARC-CT combines three components: (1) an Anato- myQFormer localizing evidence via queries constrained by automatically generated organ masks; (2) a label-Jaccard soft InfoNCE objective in- tegrating the standard one-hot target with the label-set overlap of each pair, which reduces false-negative penalties between studies that share clinical findings; and (3) an organ-level alignment loss connecting mask- pooled visual features to organ-specific report text extracted offline with a large language model. ARC-CT achieves a 0.86 mask-free macro AUC across 18 abnormalities using a compact 3D ResNet-18 backbone. Over- all, ARC-CT outperforms both comparable efficient baselines and sev- eral larger transformer models. Our code and weights are available at https://github.com/arc-ct/arc-ct.
Problem

Research questions and friction points this paper is trying to address.

Contrastive Learning
Chest CT
Anatomy Localization
Abnormality Classification
False-Negative Penalties
Innovation

Methods, ideas, or system contributions that make the work stand out.

Anatomy-Routed Contrastive Learning
Label-Jaccard Soft InfoNCE
Organ-Level Alignment Loss
H
Huseyin Umut Isik
Department of Computer Engineering, METU, Ankara, Turkey
M
Mehmet Alp Ozaydin
Department of Computer Engineering, METU, Ankara, Turkey
S
Sila Kurugol
Quantitative Intelligent Imaging Lab, Boston Children’s Hospital and Harvard Medical School, Boston, MA, USA
Ş
Şeyda Ertekin
Department of Computer Engineering, METU, Ankara, Turkey