Markov Chain Monte Carlo in small worlds
As the number of applications for Markov Chain Monte Carlo (MCMC) grows, the power of these methods as well as their shortcomings become more apparent. While MCMC yields an almost automatic way to sample a space according to some distribution, its implementations often fall short of this task as they may lead to chains which converge too slowly or get trapped within one mode of a multi-modal space. Moreover, it may be difficult to determine if a chain is only sampling a certain area of the space or if it has indeed reached stationarity.
In this paper, we show how a simple modification of the proposal mechanism results in faster convergence of the chain and helps to circumvent the problems described above. This mechanism, which is based on an idea from the field of “small-world” networks, amounts to adding occasional “wild” proposals to any local proposal scheme. We demonstrate through both theory and extensive simulations, that these new proposal distributions can greatly outperform the traditional local proposals when it comes to exploring complex heterogenous spaces and multi-modal distributions. Our method can easily be applied to most, if not all, problems involving MCMC and unlike many other remedies which improve the performance of MCMC it preserves the simplicity of the underlying algorithm.
KeywordsMarkov Chain Monte Carlo Metropolis-Hastings algorithm Proposal distributions Small-world networks Importance sampling
- Gamerman D. 1997, M arkov C hain M onte C arlo. Chapman & Hall, London.Google Scholar
- Geyer C. J. 1991, M arkov chain M onte C arlo maximum likelihood. In: E. M. Keramides (Ed.): Computing Science and Statistics: Proceedings of the 23rd Symposium on the Interface . Interface Foundation, Fairfax Station, pp. 156–163.Google Scholar
- Geyer C. J. 1992, Practical M arkov chain M onte C arlo. Statist. Sci. 7 : 473–483.Google Scholar
- Gilks W. R., Richardson S., and Spiegelhalter D. J. 1996, M arkov C hain M onte C arlo in practice. Chapman & Hall, London, 1st edition.Google Scholar
- Jarner S. F. and Roberts G. O. 2001, Convergence of heavy tailed MCMC algorithms (preprint).Google Scholar
- Larget B. and Simon D. 1999, Markov chain Monte Carlo algorithms for the Bayesian analysis of phylogenetic trees. Mol. Biol. Evol. 16 : 750–759.Google Scholar
- Meyn S. P. and Tweedie R. L. 1996, Markov Chains and Stochastic Stability . Springer, New York.Google Scholar
- Press W. H., Flannery B. P., Teukolsky S. A., and Vetterling W. T. 1992, Numerical Recipes in C : The Art of Scientific Computing. Cambridge University Press, Cambridge.Google Scholar
- Rice J. A. 1994, Mathematical statistics and data analysis . Duxbury Press, Pacific Grove, 2nd edition.Google Scholar