Learning to adapt unknown noise for hyperspectral image denoising

πŸ“… 2022-12-09
πŸ“ˆ Citations: 3
✨ Influential: 0
πŸ“„ PDF
πŸ€– AI Summary
Existing variational models for hyperspectral image denoising lack noise adaptivity due to fixed weights in the data-fidelity term, rendering them inadequate for complex, unknown mixed noise (e.g., impulse, stripe, and coupled noise). To address this, we propose a learnable pixel-wise weighted data-fidelity term and design a Hyper-Weight Network (HWnet) that dynamically predicts spatially varying noise intensity maps. Within a bi-level optimization framework, weight prediction and denoising are decoupled. This work is the first to formulate noise intensity estimation as a hypernetwork learning problem, introduces a model-level noise knowledge transfer mechanism, and provides preliminary theoretical analysis of generalizability. Experiments demonstrate consistent PSNR improvements of 2.1–4.7 dB over mainstream model-driven frameworks (e.g., LRMR, LRTV). Moreover, HWnet exhibits strong cross-model and cross-noise-type generalization capability.
πŸ“ Abstract
For hyperspectral image (HSI) denoising task, the causes of noise embeded in an HSI are typically complex and uncontrollable. Thus, it remains a challenge for model-based HSI denoising methods to handle complex noise. To enhance the noise-handling capabilities of existing model-based methods, we resort to design a general weighted data fidelity term. The weight in this term is used to assess the noise intensity and thus elementwisely adjust the contribution of the observed noisy HSI in a denoising model. The similar concept of"weighting"has been hinted in several methods. Due to the unknown nature of the noise distribution, the implementation of"weighting"in these works are usually achieved via empirical formula for specific denoising method. In this work, we propose to predict the weight by a hyper-weight network (i.e., HWnet). The HWnet is learned exactly from several model-based HSI denoising methods in a bi-level optimization framework based on the data-driven methodology. For a noisy HSI, the learned HWnet outputs its corresponding weight. Then the weighted data fidelity term implemented with the predicted weight can be explicitly combined with a target model-based HSI denoising method. In this way, our HWnet achieves the goal of enhancing the noise adaptation ability of model-based HSI denoising methods for different noisy HSIs. Extensive experiments verify that the proposed HWnet can effecitvely help to improve the ability of an HSI denoising model to handle different complex noises. This further implies that our HWnet could transfer the noise knowledge at the model level and we also study the corresponding generalization theory for simple illustration.
Problem

Research questions and friction points this paper is trying to address.

Assigning optimal weights for diverse noise patterns in denoising
Balancing data fidelity and regularization terms effectively
Transferring noise knowledge across heterogeneous denoising tasks
Innovation

Methods, ideas, or system contributions that make the work stand out.

Data-driven loss weighting for image denoising
Neural network maps noisy images to weights
Bilevel optimization balances fidelity and regularization
πŸ”Ž Similar Papers
No similar papers found.
πŸ’Ό Related Jobs
No related jobs found.
Xiangyu Rui
Xiangyu Rui
Xi'an Jiaotong University
X
Xiangyong Cao
School of Computer Science and Technology and the Ministry of Education Key Laboratory for Intelligent Networks and Network Security, Xi’an Jiaotong University, Xi’an, Shaanxi, China
X
Xile Zhao
School of Mathematical Sciences, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
Deyu Meng
Deyu Meng
Professor, Xi'an Jiaotong University
Machine LearningApplied MathematicsComputer VisionArtificial Intelligence
M
Michael K. Ng
Department of Mathematics, Hong Kong Baptist University, Kowloon Tong, Hong Kong