Snapshot multi-spectral imaging through defocusing and a Fourier imager network
🤖 AI Summary
Multi-spectral imaging (MSI) typically relies on specialized hardware—such as filter wheels, coded apertures, or custom sensors—leading to high cost and slow acquisition. To address this, we propose a novel single-shot monochrome-camera MSI paradigm leveraging inherent axial chromatic aberration (ACA) as a built-in physical encoding mechanism, eliminating the need for additional filters or optical modifications. We introduce an end-to-end differentiable multi-spectral Fourier imaging network (mFIN), which explicitly models the encoding–decoding process in the Fourier domain for efficient and robust spectral reconstruction. Evaluated under six-band illumination, our method achieves 92.98% channel identification accuracy, significantly improving reconstruction fidelity and cross-scene generalization. This approach enables low-cost, high-speed, hardware-agnostic MSI, with broad applicability in Earth observation, precision agriculture, and biomedical sensing.
Application Category
📝 Abstract
Multi-spectral imaging, which simultaneously captures the spatial and spectral information of a scene, is widely used across diverse fields, including remote sensing, biomedical imaging, and agricultural monitoring. Here, we introduce a snapshot multi-spectral imaging approach employing a standard monochrome image sensor with no additional spectral filters or customized components. Our system leverages the inherent chromatic aberration of wavelength-dependent defocusing as a natural source of physical encoding of multi-spectral information; this encoded image information is rapidly decoded via a deep learning-based multi-spectral Fourier Imager Network (mFIN). We experimentally tested our method with six illumination bands and demonstrated an overall accuracy of 92.98% for predicting the illumination channels at the input and achieved a robust multi-spectral image reconstruction on various test objects. This deep learning-powered framework achieves high-quality multi-spectral image reconstruction using snapshot image acquisition with a monochrome image sensor and could be useful for applications in biomedicine, industrial quality control, and agriculture, among others.
Problem
Research questions and friction points this paper is trying to address.
Multispectral Imaging
Black and White Camera
Earth Observation
Innovation
Methods, ideas, or system contributions that make the work stand out.
Multispectral Imaging
Depth Learning
Chromatic Aberration Utilization
🔎 Similar Papers
No similar papers found.
