Abstract
Markov Chain Monte-Carlo methods produce a random sample of a given distribution by simulating a Markov chain for which the desired distribution is a reversible measure. In order to generate a sample of size n, we propose to run n independent copies of the chain all starting from the same initial state. If n is large enough, the cutoff phenomenon yields a natural stopping rule. Indeed, the access to equilibrium can be detected using empirical estimates for the expectation of a state function. The method is illustrated by the generation of random samples of stable sets on an undirected graph.
Similar content being viewed by others
References
G. Chartrand and L. Lesniak, Graphs and Digraphs, Second ed. Wadsworth & Brooks/Cole, Mathematics Series, Pacific Grove, 1986.
P. Diaconis, “The cutoff phenomenon in finite Markov chains,” Proc. Natl. Acad. Sci. USA vol. 93 pp. 1659-1664, 1996.
D. Chauveau and J. Diébolt, “MCMC convergence diagnostic via the central limit theorem,” Research report 22/ 97, équipe AMA, Université de Marne la Vallée, 1997.
P. Doukhan, Mixing, Properties and Examples, Number 85 in L.N. in Stat. Springer-Verlag: New York, 1994.
Q. Elhaik, M. C. Rousset, and B. Ycart, “Generating random benchmarks for description logics,” Proceedings of the 1998 Int. Workshop on Description Logics (DL'98), Trento, 95-99, 1998.
G. S. Fishman, Monte-Carlo concepts algorithms and applications, Springer-Verlag: New York, 1996.
F. Forbes and B. Ycart, “Counting stable sets on Cartesian products of graphs,” Discrete Mathematics vol. 186 pp. 105-116, 1998.
E. Giné, “Lectures on some aspects of the bootstrap,” In P. Bernard, editor, Ecole d'été de probabilité de Saint-Flour XXVI, number 1664 in L.N. in Math., pages 37-151. Springer-Verlag: New York, 1997.
A. W. Massey, “Stochastic orderings for Markov processes on partially ordered spaces,” Math. Oper. Research vol. 12(2) pp. 350-367, 1987.
V. V. Petrov, Sums of Independent Random Variables, Springer-Verlag: Berlin, 1975.
J. Propp, and D. B. Wilson, “Exact sampling with coupled Markov chains and applications to statistical mechanics,” Rand. Struct. Algorithms vol. 9(1–2) pp. 223-252, 1996.
A. E. Raftery, and S. Lewis, “Implementing MCMC,” in W.R. Gilks, S.T. Richardson, and D.J. Spiegelhalter, editors, Markov Chain Monte-Carlo in Practice, pages 115-130. Chapman and Hall: London, 1992.
C. P. Robert, Méthodes de Monte-Carlo par chaines de Markov, Economica: Paris, 1996.
B. Ycart, “Cutoff for samples of Markov chains,” ESAIM Probab-Stat, to appear, 1998.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Ycart, B. Stopping Tests for Markov Chain Monte-Carlo Methods. Methodology and Computing in Applied Probability 2, 23–36 (2000). https://doi.org/10.1023/A:1010003117070
Issue Date:
DOI: https://doi.org/10.1023/A:1010003117070