CARNet: Collaborative Adversarial Resilience for Robust Underwater Image Enhancement and Perception

📅 2023-09-03
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
Underwater images suffer from low visibility and severe color distortion due to spectral-selective light absorption; while learning-based enhancement methods improve visual quality, they are vulnerable to adversarial attacks, degrading downstream detection performance. To address this, we propose a collaborative adversarial training framework integrating a reversible perturbation-aware network and an attack-pattern discriminator. We introduce the first vision-driven and perception-driven dual-level adversarial optimization strategy, enabling adaptive robust suppression against diverse attack types. The enhancement process is modeled using an invertible neural network, jointly ensuring fidelity and reversibility. Under maintained visual quality of enhanced images, our method achieves an average 6.71% mAP improvement over state-of-the-art underwater object detection methods, significantly enhancing the robustness of underwater perception systems in adversarial environments.
📝 Abstract
Due to the uneven absorption of different light wavelengths in aquatic environments, underwater images suffer from low visibility and clear color deviations. With the advancement of autonomous underwater vehicles, extensive research has been conducted on learning-based underwater enhancement algorithms. These works can generate visually pleasing enhanced images and mitigate the adverse effects of degraded images on subsequent perception tasks. However, learning-based methods are susceptible to the inherent fragility of adversarial attacks, causing significant disruption in enhanced results. In this work, we introduce a collaborative adversarial resilience network, dubbed CARNet, for underwater image enhancement and subsequent detection tasks. Concretely, we first introduce an invertible network with strong perturbation-perceptual abilities to isolate attacks from underwater images, preventing interference with visual quality enhancement and perceptual tasks. Furthermore, an attack pattern discriminator is introduced to adaptively identify and eliminate various types of attacks. Additionally, we propose a bilevel attack optimization strategy to heighten the robustness of the network against different types of attacks under the collaborative adversarial training of vision-driven and perception-driven attacks. Extensive experiments demonstrate that the proposed method outputs visually appealing enhancement images and performs an average 6.71% higher detection mAP than state-of-the-art methods.
Problem

Research questions and friction points this paper is trying to address.

Enhance underwater images with low visibility and color deviations
Improve robustness against adversarial attacks in enhancement tasks
Boost detection accuracy in subsequent perception tasks
Innovation

Methods, ideas, or system contributions that make the work stand out.

Invertible network isolates adversarial attacks
Attack pattern discriminator identifies and eliminates attacks
Bilevel attack optimization enhances network robustness
🔎 Similar Papers
No similar papers found.
Z
Zengxi Zhang
Dalian University of Technology, China
Zhiying Jiang
Zhiying Jiang
University of Waterloo
Natural Language ProcessingMachine Learning
Z
Zeru Shi
Dalian University of Technology, China
J
Jinyuan Liu
Dalian University of Technology, China
Risheng Liu
Risheng Liu
Professor, Dalian University of Technology
computer visionmachine learningoptimization