A Direct Route to Markov Chain Convergence via Asymptotic Equivalence with the Target

2026-08-04

AI Summary

This work establishes necessary and sufficient conditions for the convergence of Markov chains to a target distribution on general measurable spaces, without relying on classical assumptions such as irreducibility or aperiodicity. The core contribution is the introduction of an “asymptotic equivalence to the target” criterion: convergence occurs precisely when the singular component in the Lebesgue decomposition of the transition kernel with respect to the target measure vanishes asymptotically. This approach bypasses traditional tools like small sets or coupling constructions, providing a unified framework that accommodates a broad class of sampling algorithms and yields a strong law of large numbers. As illustrations, the criterion is verified for Gibbs random-scan and parallel tempering algorithms, delivering convergence guarantees under remarkably weak assumptions and thus ensuring wide applicability.

Abstract

For a Markov kernel $T$ with an invariant probability measure $π$, we give a self-contained proof of the Markov chain convergence theorem via a criterion called asymptotic equivalence with the target. It assumes two parts about the Lebesgue decompositions of $T^{n}_{x}$ and $π$ for every starting point $x$: 1.) asymptotic absolute continuity: the singular mass sing$(T^{n}_{x}\midπ)$ tends to $0$; 2.) asymptotic domination of the target: the singular mass sing$(π\mid T^{n}_{x})$ tends to $0$, as $n \to \infty$. This criterion, on countably generated measurable spaces, is both sufficient and necessary for the Markov chain convergence. A density version of this criterion is verified on general measurable spaces in three cases: (i) $T$ has a positive transition density wrt $π$; (ii) $T$ consists of an absolutely continuous part with positive transition density together with an atom at the starting point, which covers the Metropolis--Hastings algorithm; (iii) the transition density is positive only after a finite number of steps that may depend on the starting point $x$. To demonstrate our general criterion, we investigate the Gibbs sampler with random scan and the parallel tempering algorithm. Furthermore, we show that in all mentioned settings Birkhoff's ergodic theorem applies, so as to obtain the strong law of large numbers. Throughout this paper, neither irreducibility, nor aperiodicity, nor recurrence, nor couplings, nor splitting constructions, nor small sets are used. In most results, the state space is a general measurable space, which carries no structure beyond a $σ$-algebra. Countable generation is only assumed where the density-free form of the criterion is stated. None of the theorems proved here is new; what is offered is a short route to a single, widely applicable Markov chain convergence criterion, which is both sufficient and necessary.

Problem

• Markov chain convergence
• asymptotic equivalence
• invariant measure
• measurable space
• ergodic theorem

Innovation

• asymptotic equivalence
• Markov chain convergence
• Lebesgue decomposition
• ergodic theorem
• general measurable space