Exponentially many initializations to avoid barren plateaus

2026-06-16

AI Summary

This work addresses the barren plateau problem in quantum neural network training caused by poor parameter initialization by proposing a first-moment–based analytical framework. Combining operator concentration theory with numerical experiments, the study systematically evaluates and compares the efficacy of various initialization strategies—including identity, Gaussian, and several shifted or asymmetric distributions. For the first time, it establishes an operator-level criterion for initialization validity, demonstrating that viable initializations avoiding barren plateaus are highly non-unique and form exponentially many inequivalent families. Moreover, the research reveals that initializations with distinct first moments can converge to different local minima, indicating that intelligent initialization effectively transforms the exponential concentration challenge into a selection problem among numerous trainable regions.

Abstract

Barren plateaus are stated as an average-case phenomenon: pick an ansatz, initialize it naively, and concentration follows. This has led to the common view that a potential cure for barren plateaus is simply to initialize the parameters more carefully. Here we show that the situation is subtler. We introduce a first-moment framework that gives a simple operator-level diagnostic for when an initialization may escape the fully concentrated barren-plateau fixed point, and for comparing the biases induced by different initialization strategies. Our framework recovers several known initialization schemes such as identity and Gaussian initialization, but also shows that barren-plateau avoidance is highly non-unique. Indeed, many shifted, biased, and non-symmetric parameter distributions can avoid concentration, and these choices need not be equivalent. In fact, our results show that one can generate exponentially many families of inequivalent initialization strategies. Then, our numerics indicate that different first-moment-distinct initializations can lead to different attained minima, suggesting that avoiding barren plateaus via smart initializations can trade the exponential concentration problem for the challenge of selecting the right trainable pocket amongst many options.

Problem

• barren plateaus
• initialization strategies
• variational quantum algorithms
• parameter initialization
• optimization landscape

Innovation

• barren plateaus
• initialization strategies
• first-moment framework
• parameter concentration
• quantum optimization