Extending the Horizon of Early Diagnosis: Lung Cancer Prediction with Vision Transformers

📅 2026-08-21
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究使用Vision Transformers预测早期肺癌,通过处理数据不平衡和采用预训练模型提高了预测性能,尽管未达临床应用标准,但支持进一步开发以标记高风险患者。
📝 Abstract
Lung cancer remains a leading cause of cancer-related mortality worldwide, and early diagnosis is critical for improving survival. However, early-stage malignancies can be subtle on chest X-rays, creating challenges for radiologists. This study evaluates Vision Transformers (ViTs) for predicting lung cancer one to two years before clinical diagnosis. We analyzed 259,361 chest X-rays from 91,020 imaging studies at the Jamaica Plains VA Hospital in Boston, MA. The dataset showed extreme class imbalance, approximately 1:150 cancer to non-cancer, which was addressed using hybrid under- and over-sampling and class-weighted loss optimization. Three ViT configurations were evaluated: a model trained from scratch, an ImageNet-pretrained model, and a Corona-pretrained model fine-tuned on the lung cancer dataset. Transfer learning improved performance, with pretrained models exceeding the scratch baseline by 6-10 percentage points in AUC and about 10-12 percent in balanced accuracy. ImageNet-pretrained models showed the most stable overall performance, while Corona-pretrained models achieved higher sensitivity in some settings but greater variability. Moderate resampling ratios, including 1:1 undersampling and 1.5:2 oversampling, provided favorable trade-offs between sensitivity, precision, and computational efficiency, reducing runtime by up to 70 percent without major performance loss. These findings demonstrate the potential of ViTs for early lung cancer risk prediction from routine chest X-rays. Although performance remains below clinical deployment thresholds, the results support further development of ViT-based triage systems to flag high-risk patients for earlier evaluation.
Problem

Research questions and friction points this paper is trying to address.

Lung Cancer
Early Diagnosis
Chest X-rays
Vision Transformers
Prediction
Innovation

Methods, ideas, or system contributions that make the work stand out.

Vision Transformers
early lung cancer prediction
class imbalance
transfer learning
resampling
O
Olivera Kotevska
Mathematics in Computation, Computer Science and Mathematics Division, Oak Ridge National Laboratory
I
Ian Goethert
Research Computing Support Division, Oak Ridge National Laboratory
M
Michael McGee
Research Computing Support Division, Oak Ridge National Laboratory
M
Maria Mahbub
Advanced Intelligent Systems, Cyber Resilience and Intelligence Division, Oak Ridge National Laboratory
Sean R. Wilkinson
Sean R. Wilkinson
Research Scientist, Oak Ridge National Laboratory
BioinformaticsData ScienceHigh Performance ComputingFAIRWorkflows
R
Rowena Yip
Icahn School of Medicine at Mount Sinai
M
Myvizhi Esai Selvan
Icahn School of Medicine at Mount Sinai
Z
Zeynep H. Gumus
Icahn School of Medicine at Mount Sinai
C
Claudia Henschke
Icahn School of Medicine at Mount Sinai
R
Robert J. Klein
Icahn School of Medicine at Mount Sinai
P
Providencia Morales
Phoenix VA Medical Center
S
Samuel M Aguayo
Phoenix VA Medical Center
I
Ioana Danciu
Advanced Intelligent Systems, Cyber Resilience and Intelligence Division, Oak Ridge National Laboratory; Department of Biomedical Informatics, Vanderbilt University Medical Center
Mayanka Chandrashekar
Mayanka Chandrashekar
Research Scientist in Biomedical NLP, Oak Ridge National Laboratory
Natural Language ProcessingHigh Performance ComputingBio-informaticsBig Data AnalyticsImage Processing