Problem
Research questions and friction points this paper is trying to address.
longitudinal interpretation
visual grounding
chest X-ray
anatomical regions
temporal reasoning
CheXGround: Anatomical Region Tokens for Grounded Longitudinal Chest X-ray Interpretation
🤖 AI Summary
本文提出CheXGround模型，通过解剖区域标记方法支持纵向胸部X光解读，提高临床语言质量、时间推理及定位准确性。
📝 Abstract
Recent radiology multi-modal language models have made substantial progress in chest X-ray report generation, visual question answering, and temporal reasoning. While longitudinal chest X-ray interpretation compares sequential examinations to describe change, visual grounding aims to connect clinical language with localized image evidence. Although longitudinal modeling and visual grounding have each advanced radiology language models, how localized visual evidence can support longitudinal interpretation remains under-explored. We introduce CheXGround, a region-grounded longitudinal chest X-ray language model that represents paired studies through corresponding anatomical regions. CheXGround extracts anatomical regions from current and prior radiographs, encodes them as temporally enhanced Region-of-Interest (ROI) tokens, and combines them with global temporal image context during generation. To connect these region tokens with clinical text, we propose Temporal Region--Phrase Alignment, a pretraining objective that aligns temporal anatomical representations with localized report phrases. We evaluate CheXGround on single-study and longitudinal Visual Question Answering (VQA), longitudinal findings generation, temporal grounded VQA, and anatomical grounding. Across these tasks, CheXGround improves clinical language quality, temporal reasoning, and localization accuracy over recent baselines. Our results suggest that organizing longitudinal evidence at the anatomical level is a strong representation for grounded radiology language modeling. Project page: https://adonaydem.github.io/chexground-website
Innovation
Methods, ideas, or system contributions that make the work stand out.
anatomical region tokens
temporal ROI tokens
Temporal Region--Phrase Alignment
🔎 Similar Papers
No similar papers found.
