Adaptive Convolutional Sparse Coding via Information Bottleneck for Robust Visual Signal Representation

📅 2026-09-16
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文提出一种自适应卷积稀疏编码框架,通过将稀疏系数作为可学习参数,结合信息瓶颈理论优化视觉信号表示,提高对扰动输入的鲁棒性。
📝 Abstract
Visual signals require compact yet sufficient representations for robust downstream prediction. Convolutional sparse coding (CSC) provides an explicit mechanism for suppressing redundant components while preserving signal content, but its sparsity coefficient is typically fixed and manually selected. We propose an adaptive convolutional sparse coding framework for robust visual signal representation. Specifically, we unfold the CSC optimization with the Fast Iterative Shrinkage-Thresholding Algorithm (FISTA) and treat the sparsity coefficient as a differentiable variable jointly learned with the network parameters. From the information bottleneck perspective, this coefficient controls the trade-off between information retention and compression: the sparsity term promotes compact representations, while the reconstruction term together with task loss preserves task-relevant signal content. We further introduce a label-free post-training strategy that adjusts the compression strength for corrupted inputs with the main network parameters fixed. Experiments on CIFAR and ImageNet demonstrate competitive clean-data recognition and greatly improved robustness under different input perturbations.
Problem

Research questions and friction points this paper is trying to address.

Visual Signal Representation
Convolutional Sparse Coding
Sparsity Coefficient
Innovation

Methods, ideas, or system contributions that make the work stand out.

Adaptive Convolutional Sparse Coding
Information Bottleneck
FISTA
Label-free Post-training Strategy
M
Meng'en Qin
Faculty of Computer Science and Artificial Intelligence, Shenzhen University of Advanced Technology, Shenzhen, China
Y
Yinchen Liu
School of Mathematical Sciences, University of Electronic Science and Technology of China, Chengdu, China
M
Mingxuan Cui
School of Mathematics, Shandong University, Jinan, China
Y
Youlu Xing
Faculty of Computer Science and Artificial Intelligence, Shenzhen University of Advanced Technology, Shenzhen, China