All-in-One Image Restoration via Causal-Deconfounding Wavelet-Disentangled Prompt Network

📅 2026-03-04
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
Existing unified image restoration methods often suffer from limited generalization due to spurious correlations between semantic features and degradation patterns, as well as biases in degradation estimation. To address this, this work proposes CWP-Net, which introduces a causal disentanglement mechanism into the wavelet domain for the first time. Specifically, a wavelet attention module is employed to decouple semantic and degradation-related features, while a wavelet prompt block generates proxy variables to enable causal intervention. This approach effectively eliminates spurious associations and corrects degradation estimation bias. Extensive experiments under two All-in-One image restoration settings demonstrate that CWP-Net significantly outperforms current state-of-the-art methods, validating its effectiveness and superiority.

Technology Category

Application Category

📝 Abstract
Image restoration represents a promising approach for addressing the inherent defects of image content distortion. Standard image restoration approaches suffer from high storage cost and the requirement towards the known degradation pattern, including type and degree, which can barely be satisfied in dynamic practical scenarios. In contrast, all-in-one image restoration (AiOIR) eliminates multiple degradations within a unified model to circumvent the aforementioned issues. However, according to our causal analysis, we disclose that two significant defects still exacerbate the effectiveness and generalization of AiOIR models: 1) the spurious correlation between non-degradation semantic features and degradation patterns; 2) the biased estimation of degradation patterns. To obtain the true causation between degraded images and restored images, we propose Causal-deconfounding Wavelet-disentangled Prompt Network (CWP-Net) to perform effective AiOIR. CWP-Net introduces two modules for decoupling, i.e., wavelet attention module of encoder and wavelet attention module of decoder. These modules explicitly disentangle the degradation and semantic features to tackle the issue of spurious correlation. To address the issue stemming from the biased estimation of degradation patterns, CWP-Net leverages a wavelet prompt block to generate the alternative variable for causal deconfounding. Extensive experiments on two all-in-one settings prove the effectiveness and superior performance of our proposed CWP-Net over the state-of-the-art AiOIR methods.
Problem

Research questions and friction points this paper is trying to address.

all-in-one image restoration
spurious correlation
biased estimation
degradation pattern
image restoration
Innovation

Methods, ideas, or system contributions that make the work stand out.

causal deconfounding
wavelet disentanglement
all-in-one image restoration
spurious correlation
prompt network
🔎 Similar Papers
No similar papers found.
Bingnan Wang
Bingnan Wang
Mitsubishi Electric Research Laboratories (MERL)
ElectromagneticsElectric MachinesWireless PowerMetamaterialsPhotonics
Bin Qin
Bin Qin
Institute of Software Chinese Academy of Sciences
Machine LearningCausal Inference
Jiangmeng Li
Jiangmeng Li
Institute of Software, Chinese Academy of Science
Multi-modal learningSelf-supervised learningDomain generalizationCausal learning
F
Fanjiang Xu
University of Chinese Academy of Sciences, Beijing 100190, China, and also with Institute of Software, Chinese Academy of Science, Beijing 100190, China
F
Fuchun Sun
Department of Computer Science and Technology, Tsinghua University, Beijing National Research Center for Information Science and Technology (BNRist), Beijing 100084, China
Hui Xiong
Hui Xiong
Senior Scientist, Candela Corporation
Ultrafast dynamicsatomic molecular physicsfree electron laser