Problem
Research questions and friction points this paper is trying to address.
change captioning
visual cues
specialized reasoning
Different Changes Require Different Reasoning: Change-Type-Specialized Experts for Robust Change Captioning
๐ค AI Summary
ๆฌๆ้ๅฏนๅๅๆ่ฟฐไปปๅกไธญไธๅ็ฑปๅ็ๅๅ้่ฆไธๅ็ๆจ็่ฟ็จ็้ฎ้ข๏ผๆๅบไบไธ็งๅไธบMEDIC็ๆฐๆกๆถ๏ผ้่ฟ็ฑปๅ็นๅ็่ฎฐๅฟไธๅฎถๅจๆๆๅ็ธๅ
ณ่ง่งๆจกๅผๆฅๆ้ซๆ่ฟฐ็ๅ็กฎๆงๅ็ฑปๅๆๆๆงใ
๐ Abstract
Change captioning is the task of generating natural language descriptions that explain the changes between a pair of images. Although different change types (e.g., color shifts, object additions) exhibit distinct visual cues and require specialized reasoning processes, existing methods often overlook these distinctions. To address this limitation, we propose Multi-Expert Diagnosis for Image Change (MEDIC), a novel framework that introduces change-type awareness by explicitly modeling change categories. MEDIC employs type-specialized memory experts that dynamically retrieve type-relevant visual patterns conditioned on the input. This design enables each expert to capture diverse variations within its change type while focusing on the most informative visual cues. By softly routing inputs across type-specialized experts and learning dedicated representations for each change category, MEDIC generates more precise and type-aware change descriptions. Extensive experiments demonstrate that the proposed MEDIC consistently outperforms existing methods across diverse and challenging datasets. The code is available at \href{https://github.com/VisualAIKHU/MEDIC}{GitHub}.
Innovation
Methods, ideas, or system contributions that make the work stand out.
Multi-Expert Diagnosis for Image Change (MEDIC)
type-specialized memory experts
change-type awareness
dynamic retrieval of visual patterns
type-aware change descriptions
๐ Similar Papers
No similar papers found.
