Problem
Research questions and friction points this paper is trying to address.
Cross-Spectral
Dense Correspondence
Multimodal Spectral Medical Imaging
Spectral Mismatch
Cross-Spectral Dense Correspondence for Multimodal Spectral Medical Imaging
🤖 AI Summary
本文针对多模态光谱医学成像中不同波长范围融合问题，通过引入跨光谱调制协议和合成基准来提高密集对应精度。
📝 Abstract
Precise dense correspondence is a fundamental prerequisite for multimodal spectral imaging systems that fuse disparate wavelength ranges for subsequent analysis in medical and scientific imaging. Corresponding image points are often observed with non-overlapping spectral sensitivities, leading to wavelength-dependent contrast changes, intensity inversions, and appearance shifts for which dense ground truth is difficult to obtain and conventional RGB-based training data provides only limited supervision. We address this data gap by introducing a sensor-agnostic cross-spectral modulation protocol on established correspondence benchmarks with intensity input projection, and by proposing a synthetic cross-spectral correspondence benchmark simulating physically plausible radiometric differences. Evaluation on several modern dense correspondence backbones trained with our unified cross-spectral protocol showed substantial improvements under severe spectral mismatch while maintaining performance on standard RGB benchmarks. Ablation experiments show that view-dependent channel selection and nonlinear radiometric transformations provide complementary robustness, indicating that the primary limitation of existing models is not their structural matching capacity but the mismatch between training distribution and spectral characteristics of the target image pair. Qualitative evaluations on heterogeneous medical spectral acquisition systems demonstrate the practical relevance of the proposed training data augmentation protocol as an enabler for spatially coherent spectral fusion in HSI workflows.
Innovation
Methods, ideas, or system contributions that make the work stand out.
cross-spectral modulation protocol
synthetic cross-spectral correspondence benchmark
view-dependent channel selection
nonlinear radiometric transformations
🔎 Similar Papers
No similar papers found.
