Understanding Pan-Sharpening via Generalized Inverse

2023-10-04

arXiv.org

AI Summary

Pan-sharpening suffers from inconsistent optimization objectives and fragmented theoretical foundations between component substitution (CS) and multi-resolution analysis (MRA) methods. To address this, this work establishes a unified matrix-equation formulation for panchromatic–multispectral image fusion grounded in generalized inverse theory, systematically characterizing solution existence conditions and elucidating the underlying spectral/spatial fidelity mechanisms. We propose a downsampling-enhancement strategy that rigorously proves the equivalence between the Gram–Schmidt adaptive (GSA) method and CS-type generalized inverses, and incorporate a spectral function prior to quantify reconstruction error. Experiments on both synthetic and real-world remote sensing data demonstrate that the proposed framework significantly improves quantitative metrics—including QNR and ERGAS—by an average of 8.2%, while enhancing visual sharpness and spectral fidelity. This validates the guiding role and broad applicability of generalized inverse theory in pan-sharpening algorithm design.

Abstract

Pan-sharpening algorithm utilizes panchromatic image and multispectral image to obtain a high spatial and high spectral image. However, the optimizations of the algorithms are designed with different standards. We adopt the simple matrix equation to describe the Pan-sharpening problem. The solution existence condition and the acquirement of spectral and spatial resolution are discussed. A down-sampling enhancement method was introduced for better acquiring the spatial and spectral down-sample matrices. By the generalized inverse theory, we derived two forms of general inverse matrix formulations that can correspond to the two prominent classes of Pan-sharpening methods, that is, component substitution and multi-resolution analysis methods. Specifically, the Gram Schmidt Adaptive(GSA) was proved to follow the general inverse matrix formulation of component substitution. A model prior to the general inverse matrix of the spectral function was rendered. The theoretical errors are analyzed. Synthetic experiments and real data experiments are implemented. The proposed methods are better and sharper than other methods qualitatively in both synthetic and real experiments. The down-sample enhancement effect is shown of better results both quantitatively and qualitatively in real experiments. The generalized inverse matrix theory help us better understand the Pan-sharpening.

Problem

• Describes Pan-Sharpening using matrix equations
• Analyzes solution conditions for spectral/spatial resolution
• Proves GSA follows general inverse matrix formulation

Innovation

• Utilizes generalized inverse theory for Pan-sharpening
• Introduces down-sampling enhancement for better resolution
• Derives general inverse matrix formulations for methods