Statistics and Computing

, Volume 6, Issue 4, pp 353–366

Sampling from multimodal distributions using tempered transitions

  • Radford M. Neal

DOI: 10.1007/BF00143556

Cite this article as:
Neal, R.M. Stat Comput (1996) 6: 353. doi:10.1007/BF00143556


I present a new Markov chain sampling method appropriate for distributions with isolated modes. Like the recently developed method of ‘simulated tempering’, the ‘tempered transition’ method uses a series of distributions that interpolate between the distribution of interest and a distribution for which sampling is easier. The new method has the advantage that it does not require approximate values for the normalizing constants of these distributions, which are needed for simulated tempering, and can be tedious to estimate. Simulated tempering performs a random walk along the series of distributions used. In contrast, the tempered transitions of the new method move systematically from the desired distribution, to the easily-sampled distribution, and back to the desired distribution. This systematic movement avoids the inefficiency of a random walk, an advantage that is unfortunately cancelled by an increase in the number of interpolating distributions required. Because of this, the sampling efficiency of the tempered transition method in simple problems is similar to that of simulated tempering. On more complex distributions, however, simulated tempering and tempered transitions may perform differently. Which is better depends on the ways in which the interpolating distributions are ‘deceptive’.


Markov chain Monte Carlo simulated tempering simulated annealing 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Chapman & Hall 1996

Authors and Affiliations

  • Radford M. Neal
    • 1
  1. 1.Department of Statistics Department of Computer ScienceUniversity of TorontoTorontoCanada

Personalised recommendations