Quantitative Target Convergence and Uniform-in-Time Propagation of Chaos for Langevin-Regularized SVGD

📅 2026-08-28
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文解决了Langevin-正则化SVGD的定量收敛和混沌传播问题,通过建立熵恒等式和采用同步耦合方法,在不同几何结构中实现了目标收敛。
📝 Abstract
We establish quantitative convergence to the target and uniform-in-time propagation of chaos for Langevin-regularized Stein variational gradient descent. The Stein interaction need not be small relative to the confining Langevin drift and does not generally yield a contractive particle coupling. At the mean-field level, the Stein and Langevin components dissipate the same relative entropy in the kernel-induced Stein and $2$-Wasserstein geometries, producing the squared kernel Stein discrepancy and relative Fisher information. Under a log-Sobolev inequality for the target, this yields exponential last-iterate convergence. We also derive a finite-particle entropy identity relative to the product target, giving exponential-in-time convergence of the empirical measure up to polynomial sampling errors. For propagation of chaos, we develop two complementary finite-time approaches. A synchronous coupling, combined with exponential moment estimates for the nonlinear mean-field diffusion, yields explicit single-exponential bounds in Wasserstein distance and kernel Stein discrepancy (KSD). Moving-product entropy gives joint-law relative entropy control relative to the evolving mean-field product law and, through entropy superadditivity and concentration, fixed-marginal relative entropy and total variation bounds and empirical KSD estimates. Under an additional $T_2$ inequality for the initial law, it also yields Wasserstein bounds. Combining these finite-time estimates with target convergence at a logarithmic cutoff time gives polynomial uniform-in-time propagation of chaos rates in expectation for empirical KSD and $W_2^2$, and for fixed-marginal total variation and $W_2^2$. All bounds control the last iterate in physical time. We also compare the two finite-time mechanisms and identify regimes in which each gives the sharper polynomial exponent.
Problem

Research questions and friction points this paper is trying to address.

Quantitative Convergence
Uniform-in-Time Propagation of Chaos
Langevin-regularized SVGD
Relative Entropy
Kernel Stein Discrepancy
Innovation

Methods, ideas, or system contributions that make the work stand out.

Langevin-regularized SVGD
uniform-in-time propagation of chaos
kernel Stein discrepancy (KSD)
synchronous coupling
moving-product entropy
Sayan Banerjee
Sayan Banerjee
Associate Professor of Statistics, University of North Carolina, Chapel Hill
Probability Theory
D
Dohyeon Kim
Department of Computing and Mathematical Sciences, California Institute of Technology, 1200 East California Boulevard, MC 305-16, Pasadena, CA 91125, USA