Stability of Partially Implicit Langevin Schemes and Their MCMC Variants
A broad class of implicit or partially implicit time discretizations for the Langevin diffusion are considered and used as proposals for the Metropolis–Hastings algorithm. Ergodic properties of our proposed schemes are studied. We show that introducing implicitness in the discretization leads to a process that often inherits the convergence rate of the continuous time process. These contrast with the behavior of the naive or Euler–Maruyama discretization, which can behave badly even in simple cases. We also show that our proposed chains, when used as proposals for the Metropolis–Hastings algorithm, preserve geometric ergodicity of their implicit Langevin schemes and thus behave better than the local linearization of the Langevin diffusion. We illustrate the behavior of our proposed schemes with examples. Our results are described in detail in one dimension only, although extensions to higher dimensions are also described and illustrated.
KeywordsLangevin diffusions Ergodicity Implicit Euler schemes: discrete approximation
AMS 2000 Subject Classifications60J60 60Jxx
Unable to display preview. Download preview PDF.
- Besag JE (1994) Comments on “representation of knowledge in complex systems” by U. Grenander and M.I. Miller. J R Stat Soc, Ser B 56:591–592Google Scholar
- Kloeden P, Platen E (1992) Numerical solutions of stochastic differential equations. Springer, BerlinGoogle Scholar
- Meyn SP, Tweedie RL (1993) Markov chains and stochastic stability. In: Communications and control engineering series. Springer London Ltd., LondonGoogle Scholar
- Stuart AM, Humphries AR (1996) Dynamical systems and numerical analysis. In: Cambridge monographs on applied and computational mathematics, vol 2. Cambridge University Press, CambridgeGoogle Scholar