Large-System Analysis of Sparse Bayesian Learning

📅 2026-09-06
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文研究了稀疏贝叶斯学习在大型系统中的平稳行为,通过重新优化超参数和利用Karush-Kuhn-Tucker条件,解决了其在欠定线性模型中信号估计的问题。
📝 Abstract
Sparse Bayesian learning is widely used for sparse linear inverse problems, yet its large-system stationary behavior remains poorly understood because all variance hyperparameters are estimated from the same data. We study classical sparse Bayesian learning, formulated as evidence maximization (type-II maximum likelihood), for underdetermined linear models with sensing matrices having independent and identically distributed Gaussian entries, Gaussian measurement noise, and an unknown deterministic signal sequence. Hyperparameter reoptimization induces a nonvanishing feedback term: a typical coordinate obeys a reoptimization-corrected scalar Gaussian law whose signal coefficient is governed by the normalized adaptive response rather than the frozen resolvent trace. A one-coordinate leave-one-out construction gives an exact conditional Gaussian law, which is transferred to a selected full stationary branch without assuming asymptotic closeness of the reduced and full stationary vectors. Combining this law with the Karush--Kuhn--Tucker conditions of the evidence objective yields a generally set-valued scalar relation and three branchwise large-system consistency relations. If the model noise variance is jointly estimated by evidence maximization, interior joint stationarity yields an exact finite-dimensional equality between the normalized residual energy and normalized resolvent trace. When the limiting signal law has nonzero mass at zero, this identity further yields a parameter-free asymptotic chi-square null law. Under an additional differentiability condition on the selected scalar branch, the large-system characterization also gives a closed relation for the reconstruction error of the posterior mean. The analysis is stationary-point based and permits multiple stationary branches.
Problem

Research questions and friction points this paper is trying to address.

Sparse Bayesian learning
large-system analysis
stationary behavior
variance hyperparameters
evidence maximization
Innovation

Methods, ideas, or system contributions that make the work stand out.

reoptimization-corrected scalar Gaussian law
one-coordinate leave-one-out construction
large-system consistency relations
normalized residual energy and resolvent trace equality
asymptotic chi-square null law
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
F
Fangqing Xiao
School of Information Science and Engineering, Yunnan University, Kunming 650091, China
D
Dirk T. M. Slock
Communication Systems Department, EURECOM, 06410 Biot, France