Methodology And Computing In Applied Probability

, Volume 1, Issue 3, pp 283–306

Langevin-Type Models I: Diffusions with Given Stationary Distributions and their Discretizations*

  • O. Stramer
  • R. L. Tweedie

DOI: 10.1023/A:1010086427957

Cite this article as:
Stramer, O. & Tweedie, R.L. Methodology and Computing in Applied Probability (1999) 1: 283. doi:10.1023/A:1010086427957


We describe algorithms for estimating a given measure π known up to a constant of proportionality, based on a large class of diffusions (extending the Langevin model) for which π is invariant. We show that under weak conditions one can choose from this class in such a way that the diffusions converge at exponential rate to π, and one can even ensure that convergence is independent of the starting point of the algorithm. When convergence is less than exponential we show that it is often polynomial at verifiable rates. We then consider methods of discretizing the diffusion in time, and find methods which inherit the convergence rates of the continuous time process. These contrast with the behavior of the naive or Euler discretization, which can behave badly even in simple cases. Our results are described in detail in one dimension only, although extensions to higher dimensions are also briefly described.

Markov chain Monte CarlodiffusionsLangevin modelsposterior distributionsirreducible Markov processesexponential ergodicityuniform ergodicityEuler schemes

Copyright information

© Kluwer Academic Publishers 1999

Authors and Affiliations

  • O. Stramer
    • 1
  • R. L. Tweedie
    • 2
  1. 1.Department of Statistics and Actuarial ScienceUniversity of IowaIowa CityUSA
  2. 2.Division of BiostatisticsUniversity of MinnesotaMinneapolisUSA