Abstract
We link two phenomena concerning the asymptotical behavior of stochastic processes: (i) abrupt convergence or cut-off phenomenon, and (ii) the escape behavior usually associated to exit from metastability. The former is characterized by convergence at asymptotically deterministic times, while the convergence times for the latter are exponentially distributed. We compare and study both phenomena for discrete-time birth-and-death chains on ℤ with drift towards zero. In particular, this includes energy-driven evolutions with energy functions in the form of a single well. Under suitable drift hypotheses, we show that there is both an abrupt convergence towards zero and escape behavior in the other direction. Furthermore, as the evolutions are reversible, the law of the final escape trajectory coincides with the time reverse of the law of cut-off paths. Thus, for evolutions defined by one-dimensional energy wells with sufficiently steep walls, cut-off and escape behavior are related by time inversion.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Aldous, D.: Random walks on finite groups and rapidly mixing Markov chains. In: Seminar on Probability, XVII. Lecture Notes in Math., vol. 986, pp. 243–297. Springer, Berlin (1983)
Aldous, D., Diaconis, P.: Shuffling cards and stopping times. Am. Math. Mon. 93(5), 333–348 (1986)
Aldous, D., Diaconis, P.: Strong uniform times and finite random walks. Adv. Appl. Math. 8(1), 69–97 (1987)
Barrera, J., Lachaud, B., Ycart, B.: Cut-off for n-tuples of exponentially converging processes. Stoch. Process. Appl. 116(10), 1433–1446 (2006)
Bayer, D., Diaconis, P.: Trailing the dovetail shuffle to its lair. Ann. Appl. Probab. 2(2), 294–313 (1992)
Bellman, R., Harris, T.: Recurrence times for the Ehrenfest model. Pac. J. Math. 1, 179–193 (1951)
Ben Arous, G., Bovier, A., Gayrard, V.: Glauber dynamics of the random energy model. I. Metastable motion on the extreme states. Commun. Math. Phys. 235(3), 379–425 (2003)
Bertoncini, O.: Convergence abrupte et métastabilité. Ph.D. thesis, Université de Rouen (2007)
Bertoncini, O., Barrera, J., Fernández, R.: Cut-off and exit from metastability: two sides of the same coin. C. R. Acad. Sci. Paris, Ser. I 346, 691–696 (2008)
Billingsley, P.: Convergence of Probability Measures. Wiley, New York (1968)
Bingham, N.H.: Fluctuation theory for the Ehrenfest urn. Adv. Appl. Probab. 23(3), 598–611 (1991)
Bovier, A.: Metastability and ageing in stochastic dynamics. In: Dynamics and Randomness II. Nonlinear Phenom. Complex Systems, vol. 10, pp. 17–79. Kluwer Academic, Dordrecht (2004)
Bovier, A.: Markov processes and metastability. Lecture notes TUB, available online at http://www.wias-berlin.de/people/bovier/files/metastab.html (2005)
Bovier, A.: Metastability: a potential theoretic approach. In: International Congress of Mathematicians, vol. III, pp. 499–518. Eur. Math. Soc., Zürich (2006)
Bovier, A., Eckhoff, M., Gayrard, V., Klein, M.: Metastability and small eigenvalues in Markov chains. J. Phys. A 33(46), L447–L451 (2000)
Bovier, A., Eckhoff, M., Gayrard, V., Klein, M.: Metastability in stochastic dynamics of disordered mean-field models. Probab. Theory Relat. Fields 119(1), 99–161 (2001)
Bovier, A., Eckhoff, M., Gayrard, V., Klein, M.: Metastability and low lying spectra in reversible Markov chains. Commun. Math. Phys. 228(2), 219–255 (2002)
Bovier, A., Eckhoff, M., Gayrard, V., Klein, M.: Metastability in reversible diffusion processes. I. Sharp asymptotics for capacities and exit times. J. Eur. Math. Soc. (JEMS) 6(4), 399–424 (2004)
Bovier, A., Gayrard, V., Klein, M.: Metastability in reversible diffusion processes. II. Precise asymptotics for small eigenvalues. J. Eur. Math. Soc. (JEMS) 7(1), 69–99 (2005)
Bovier, A., Manzo, F.: Metastability in Glauber dynamics in the low-temperature limit: beyond exponential asymptotics. J. Stat. Phys. 107(3–4), 757–779 (2002)
Cassandro, M., Galves, A., Olivieri, E., Vares, M.E.: Metastable behavior of stochastic dynamics: a pathwise approach. J. Stat. Phys. 35(5–6), 603–634 (1984)
Chen, G.Y., Saloff-Coste, L.: The cutoff phenomenon for ergodic Markov processes. Electron. J. Probab. 13(3), 26–78 (2008)
Chung, F.R.K., Diaconis, P., Graham, R.L.: Random walks arising in random number generation. Ann. Probab. 15(3), 1148–1165 (1987)
Chung, K.L.: A Course in Probability Theory, 2nd edn. Probability and Mathematical Statistics, vol. 21. Academic Press, New York (1974). A subsidiary of Harcourt Brace Jovanovich, Publishers
Diaconis, P.: Group Representations in Probability and Statistics. Institute of Mathematical Statistics Lecture Notes—Monograph Series, vol. 11. Institute of Mathematical Statistics, Hayward (1988)
Diaconis, P.: The cutoff phenomenon in finite Markov chains. Proc. Nat. Acad. Sci. USA 93(4), 1659–1664 (1996)
Diaconis, P., Fill, J.A., Pitman, J.: Analysis of top to random shuffles. Comb. Probab. Comput. 1(2), 135–155 (1992)
Diaconis, P., Graham, R.L., Morrison, J.A.: Asymptotic analysis of a random walk on a hypercube with many dimensions. Random Struct. Algorithms 1(1), 51–72 (1990)
Diaconis, P., Saloff-Coste, L.: Separation cut-offs for birth and death chains. Ann. Appl. Probab. 16(4), 2098–2122 (2006)
Diaconis, P., Shahshahani, M.: Time to reach stationarity in the Bernoulli-Laplace diffusion model. SIAM J. Math. Anal. 18(1), 208–218 (1987)
Ding, J., Lubetzky, E., Peres, Y.: Total-variation cutoff in birth-and-death chains. http://arxiv.org/abs/0801.2625 (2008)
Feller, W.: An Introduction to Probability Theory and Its Applications, vol. I, 3rd edn. Wiley, New York (1968)
Freidlin, M.I., Wentzell, A.D.: Random Perturbations of Dynamical Systems. Grundlehren der Mathematischen Wissenschaften, vol. 260. Springer, New York (1984). [Fundamental Principles of Mathematical Sciences] Translated from the Russian by Joseph Szücs
den Hollander, F., Olivieri, E., Scoppola, E.: Metastability and nucleation for conservative dynamics. J. Math. Phys. 41(3), 1424–1498 (2000). Probabilistic techniques in equilibrium and nonequilibrium statistical physics
Kotecký, R., Olivieri, E.: Droplet dynamics for asymmetric Ising model. J. Stat. Phys. 70(5–6), 1121–1148 (1993)
Lachaud, B.: Cut-off and hitting times of a sample of Ornstein-Uhlenbeck processes and its average. J. Appl. Probab. 42(4), 1069–1080 (2005)
Lachaud, B., Ycart, B.: Convergence times for parallel Markov chains. In: Positive Systems. Lecture Notes in Control and Inform. Sci., vol. 341, pp. 169–176. Springer, Berlin (2006)
Levin, D.A., Luczak, M.J., Peres, Y.: Glauber dynamics for the mean-field Ising model: cut-off, critical power law, and metastability. arXiv:0712.0790v2 [math.PR] (2007)
Manzo, F., Nardi, F.R., Olivieri, E., Scoppola, E.: On the essential features of metastability: tunnelling time and critical configurations. J. Stat. Phys. 115(1–2), 591–642 (2004)
Martínez, S., Ycart, B.: Decay rates and cutoff for convergence and hitting times of Markov chains with countably infinite state space. Adv. Appl. Probab. 33(1), 188–205 (2001)
Neves, E.J., Schonmann, R.H.: Critical droplets and metastability for a Glauber dynamics at very low temperatures. Commun. Math. Phys. 137(2), 209–230 (1991)
Neves, E.J., Schonmann, R.H.: Behavior of droplets for a class of Glauber dynamics at very low temperature. Probab. Theory Relat. Fields 91(3–4), 331–354 (1992)
Olivieri, E., Scoppola, E.: Markov chains with exponentially small transition probabilities: first exit problem from a general domain. I. The reversible case. J. Stat. Phys. 79(3–4), 613–647 (1995)
Olivieri, E., Scoppola, E.: Markov chains with exponentially small transition probabilities: first exit problem from a general domain. II. The general case. J. Stat. Phys. 84(5–6), 987–1041 (1996)
Olivieri, E., Scoppola, E.: Metastability and typical exit paths in stochastic dynamics. In: European Congress of Mathematics, vol. II, Budapest, 1996. Progr. Math., vol. 169, pp. 124–150. Birkhäuser, Basel (1998)
Olivieri, E., Vares, M.E.: Large Deviations and Metastability. Encyclopedia of Mathematics and Its Applications, vol. 100. Cambridge University Press, Cambridge (2005)
Saloff-Coste, L.: Lectures on finite Markov chains. In: Lectures on Probability Theory and Statistics, Saint-Flour, 1996. Lecture Notes in Math., vol. 1665, pp. 301–413. Springer, Berlin (1997)
Saloff-Coste, L.: Random walks on finite groups. In: Probability on Discrete Structures. Encyclopaedia Math. Sci., vol. 110, pp. 263–346. Springer, Berlin (2004)
Schonmann, R.H.: An approach to characterize metastability and critical droplets in stochastic Ising models. Ann. Inst. H. Poincaré Phys. Théor. 55(2), 591–600 (1991). Multiscale phenomena (São Paulo, 1990)
Schonmann, R.H.: The pattern of escape from metastability of a stochastic Ising model. Commun. Math. Phys. 147(2), 231–240 (1992)
Scoppola, E.: Metastability for Markov chains: a general procedure based on renormalization group ideas. In: Probability and Phase Transition, Cambridge, 1993. NATO Adv. Sci. Inst. Ser. C Math. Phys. Sci., vol. 420, pp. 303–322. Kluwer Academic, Dordrecht (1994)
Ycart, B.: Cutoff for samples of Markov chains. ESAIM, Probab. Stat. 3, 89–106 (1999) (electronic)
Ycart, B.: Stopping tests for Markov chain Monte-Carlo methods. Methodol. Comput. Appl. Probab. 2(1), 23–36 (2000)
Ycart, B.: Cutoff for Markov chains: some examples and applications. In: Complex Systems, Santiago, 1998. Nonlinear Phenom. Complex Systems, vol. 6, pp. 261–300. Kluwer Academic, Dordrecht (2001)
Ycart, B.: Modèles et Algorithmes Markoviens, Mathématiques & Applications (Berlin), vol. 39. Springer, Berlin (2002). Mathematics & Applications
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Barrera, J., Bertoncini, O. & Fernández, R. Abrupt Convergence and Escape Behavior for Birth and Death Chains. J Stat Phys 137, 595–623 (2009). https://doi.org/10.1007/s10955-009-9861-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10955-009-9861-7