Abstract
LetX(t), 0≤t<∞, be an ergodic continuous-time Markov chain with finite or countably infinite state space. We construct astrong stationary dual chainX * whose first hitting times yield bounds on the convergence to stationarity forX. The development follows closely the discrete-time theory of Diaconis and Fill.(2,3) However, for applicability it is important that we formulate our results in terms of infinitesimal rates, and this raises new issues.
Similar content being viewed by others
References
Diaconis, P. (1988).Group Representations in Probability and Statistics. Institute of Mathematical Statistics, Hayward, CA.
Diaconis, P., and Fill, J. A. (1990a). Strong stationary times via a new form of duality.Ann. Prob. 18, 1483–1522.
Diaconis, P., and Fill, J. A. (1990b). Examples for the theory of strong stationary duality with countable state spaces.Prob. Eng. Inform. Sci. 4, 157–180.
Diaconis, P., and Stroock, D. (1991). Geometric bounds for eigenvalues of Markov chains.Ann. Appl. Prob. 1, 36–61.
Fill, J. A. (1991a). Eigenvalue bounds on convergence to stationarity for nonreversible Markov chains, with an application to the exclusion process.Ann. Appl. Prob. 1, 62–87.
Fill, J. A. (1991b). Time to stationarity for a continuous-time Markov chain.Prob. Eng. Info. Sci. 5, 45–70.
Horn, R. A., and Johnson, C. R. (1990).Topics in Matrix Analysis. Cambridge University Press, Cambridge, England.
Reuter, G. E. H. (1957). Denumerable Markov processes and the associated contraction semigroups onl.Acta Math. 97, 1–46.
Siegmund, D. (1976). The equivalence of absorbing and reflecting barrier problems for stochastically monotone Markov processes.Ann. Prob. 4, 914–924.
Van Doorn, E. A. (1980). Stochastic monotonicity of birth-death processes.Adv. Appl. Prob. 12, 59–80.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Fill, J.A. Strong stationary duality for continuous-time Markov chains. Part I: Theory. J Theor Probab 5, 45–70 (1992). https://doi.org/10.1007/BF01046778
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF01046778