On the flexibility of the design of multiple try Metropolis schemes
The multiple try Metropolis (MTM) method is a generalization of the classical Metropolis–Hastings algorithm in which the next state of the chain is chosen among a set of samples, according to normalized weights. In the literature, several extensions have been proposed. In this work, we show and remark upon the flexibility of the design of MTM-type methods, fulfilling the detailed balance condition. We discuss several possibilities, show different numerical simulations and discuss the implications of the results.
KeywordsMetropolis–Hasting method Multiple try Metropolis algorithm Multi-point Metropolis algorithm MCMC techniques
We would like to thank the Reviewers for their comments which have helped us to improve the first version of manuscript. Moreover, this work has been partially supported by Ministerio de Ciencia e Innovacin and by the Ministerio de Economía of Spain (project MONIN, ref. TEC-2006-13514-C02- 01/TCM, project COMONSENS, id. CSD2008-00010, project DEIPRO ref. TEC2009-14504-C02-01, project ALCIT, id. TEC2012-38800-C03-01 and project COMPREHENSION, id. TEC2012-38883-C02-01) and Comunidad Autonoma de Madrid (project PROMULTIDIS-CM, ref. S-0505/TIC/0233).
- Gamerman D, Lopes HF (2006) Markov Chain Monte Carlo: stochastic simulation for Bayesian inference. Chapman and Hall/CRC, Boca RatonGoogle Scholar
- Gilks WR, Richardson S, Spiegelhalter D (1995) Markov Chain Monte Carlo in practice: interdisciplinary statistics. Taylor & Francis, Inc., UKGoogle Scholar
- Lan S, Stathopoulosy V, Shahbaba B, Girolami M (2012) Langrangian dynamical Monte Carlo. arXiv:1211.3759v1Google Scholar
- Liang F, Liu C, Caroll R (2010) Advanced Markov Chain Monte Carlo methods: learning from past samples. Wiley Series in Computational Statistics, EnglandGoogle Scholar
- Martino L, Read J, Luengo D (2012b) Improved adaptive rejection Metropolis sampling algorithms. arXiv:1205.5494v4Google Scholar
- Pandolfi S, Bartolucci F, Friel N (2010) A generalization of the multiple-try Metropolis algorithm for Bayesian estimation and model selection. J Mach Learn Res (Workshop and conference proceedings volume 9: AISTATS 2010) 9:581–588Google Scholar
- Robert CP (2012) “Xi’ An’s Og, an attempt at bloggin... ” Blog (by Christian P. Robert). http://xianblog.wordpress.com/2012/01/23/multiple-trypoint-metropolis-algorithm/
- Zhang Y, Zhang W (2012) Improved generic acceptance function for multi-point Metropolis algorithm. In: 2nd International conference on electronic and mechanical engineering and information technology (EMEIT-2012)Google Scholar