Neural Variability Enhances Artificial Network Robustness
This work addresses the limited robustness of artificial neural networks under adversarial attacks and natural image corruptions, a challenge often exacerbated by the neglect of structured noise in neural activations. The authors propose a biologically inspired local noise mechanism that models structured noise by analyzing the covariance structure of activations induced by clean and perturbed inputs. Relying solely on local information, this approach is the first to systematically reveal how structured noise differentially enhances robustness across perturbation types. Experimental results demonstrate that the proposed strategy significantly improves model robustness against natural corruptions, and notably, the noise structures learned under adversarial attacks exhibit strong generalization to other attack variants.