Abstract
This is a short account of the major highlights of Markov Chain Monte Carlo, with pointers to what lies beyond.
Similar content being viewed by others
Suggested Reading
R. L. Karandikar, On the Markov chain Monte Carlo (MCMC) method, Sadhana, 31(2), pp.81–104, 2006.
J. S. Liu, Monte Carlo Strategies in Scientific Computing, Springer Verlag, 2001.
V. S. Borkar, How low can you sink?, Resonance, 2(2), pp.52–63, 1997.
J. Moussouris, Gibbs and Markov random systems with constraints, Journal of Statistical Physics, 10(1), pp.11–33, 1974.
K. B. Athreya, M. Delampady and T. Krishnan, Markov Chain Monte Carlo methods I. simple Monte Carlo, II. the Markov chain case, III statistical concepts, Resonance, 17(4), pp.17–26/17(7), pp.63–75/17(10), pp.8–19, 2003.
C. P. Robert and G. Casella, Monte Carlo Statistical Methods (2nd edition), Springer, New York, 2004.
R. W. Shonkwiler and F. Mendivil, Explorations in Monte Carlo Methods, Springer Verlag, 2009.
S. Brooks, A. Gelman, G. L. Jones and X.-L. Meng, Handbook of Markov Chain Monte Carlo, Chapman and Hall/CRC, Boca Raton, FL, 2011.
D. A. Levin and Y. Peres, Markov Chains and Mixing Times (2nd ed.), American Math. Society, Providence, RI.
N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller and E. Teller, Equation of state calculations by fast computing machines, J. Chemical Physics, 21(6), pp.1087–1902, 1953.
Acknowledgement
The author thanks Piyush Srivastava of TIFR, Mumbai, for a critical reading and valuable suggestions.
Author information
Authors and Affiliations
Additional information
Vivek Borkar is Emeritus Fellow at the Department of Electrical Engineering, Indian Institute of Technology Bombay. He works on stochastic optimization and control, learning control theory and random processes.
Rights and permissions
About this article
Cite this article
Borkar, V.S. Markov Chain Monte Carlo (MCMC). Reson 27, 1107–1115 (2022). https://doi.org/10.1007/s12045-022-1407-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12045-022-1407-1