On the limitations of single-step drift and minorization in Markov chain convergence analysis

03/21/2020
by   Qian Qin, et al.
0

Over the last three decades, there has been a considerable effort within the applied probability community to develop techniques for bounding the convergence rates of general state space Markov chains. Most of these results assume the existence of drift and minorization (d&m) conditions. It has often been observed that convergence rate bounds based on single-step d&m tend to be overly conservative, especially in high-dimensional situations. This article builds a framework for studying this phenomenon. It is shown that any convergence rate bound based on a set of d&m conditions cannot do better than a certain unknown optimal bound. Strategies are designed to put bounds on the optimal bound itself, and this allows one to quantify the extent to which a d&m-based convergence rate bound can be sharp. The new theory is applied to several examples, including a Gaussian autoregressive process (whose true convergence rate is known), and a Metropolis adjusted Langevin algorithm. The results strongly suggest that convergence rate bounds based on single-step d&m conditions are quite inadequate in high-dimensional settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/24/2017

Asymptotically Stable Drift and Minorization for Markov Chains with Application to Albert and Chib's Algorithm

The use of MCMC algorithms in high dimensional Bayesian problems has bec...
research
08/06/2020

Exact Convergence Rate Analysis of the Independent Metropolis-Hastings Algorithms

A well-known difficult problem regarding Metropolis-Hastings algorithms ...
research
12/09/2013

A Unified Markov Chain Approach to Analysing Randomised Search Heuristics

The convergence, convergence rate and expected hitting time play fundame...
research
07/12/2023

Low complexity convergence rate bounds for the synchronous gossip subclass of push-sum algorithms

We develop easily accessible quantities for bounding the almost sure exp...
research
12/07/2021

Convergence rate bounds for iterative random functions using one-shot coupling

One-shot coupling is a method of bounding the convergence rate between t...
research
08/18/2019

Quantitative convergence rates for reversible Markov chains via strong random times

Let (X_t) be a discrete time Markov chain on a general state space. It i...
research
11/16/2017

Bounding the convergence time of local probabilistic evolution

Isoperimetric inequalities form a very intuitive yet powerful characteri...

Please sign up or login with your details

Forgot password? Click here to reset