Summary
A technique is presented, which enables the state space of a Harris recurrent Markov chain to be “split” in a way, which introduces into the split state space an “atom”. Hence the full force of renewal theory can be used in the analysis of Markov chains on a general state space. As a first illustration of the method we show how Derman's construction for the invariant measure works in the general state space. The Splitting Technique is also applied to the study of sums of transition probabilities.
Article PDF
Similar content being viewed by others
References
Cogburn, R.: A uniform theory for sums of Markov chain transition probabilities. Ann. Probability 3, 191–214 (1975)
Derman, C.: A solution to a set of fundamental equations in Markov chains. Proc. Amer. Math. Soc. 5, 332–334 (1954)
Erdös, P., Feller, W. and Pollard, H.: A theorem on power series. Bull. Amer. Math. Soc. 55, 201–204 (1949)
Feller, W.: An Introduction to Probability Theory and. Its Applications. Vol.I. New York: Wiley 1957
Griffeath, D.S.: Coupling methods for Markov processes. Ph. D. thesis. Cornell University (1976)
Harris, T.E.: The existence of stationary measures for certain Markov processes. Proc. 3rd Berkeley Sympos. Math. Statist. Probab. 2, 113–214, Univ. Calif. (1956)
Kemeny, J.G., Snell, J.L. and Knapp, A.W.: Denumerable Markov Chains. Princeton: Van Nostrand 1966
Metivier, M.: Théorème limit quotient pour les chaines de Markov récurrentes au sense de Harris. Ann. Inst. H. Poincaré 8 (2), 93–105 (1972)
Neveu, J.: Généralisation d'un théorème limite-quotient. Trans. 6th Prague Conf. on Information Theory, Statistical Decision Functions, Random Processes (1973)
Nummelin, E.: Uniform and ratio limit theorems for Markov renewal processes on a general state space (1977) [To appear in Ann. Inst. H. Poincaré]
Nummelin, E. and Tweedie, R.L.: Geometric ergodicity and R-positivity for general Markov chains (1976). [To appear in Ann. Probability]
Orey, S.: Limit Theorems for Markov Chain Transition Probabilities. New York: Van Nostrand 1971
Pitman, J.W.: Uniform rates of convergence for Markov chain transition probabilities. Z. Wahrscheinlichkeitsth. und verw. Gebiete 29, 193–227 (1974)
Revuz, D.: Markov Chains. Amsterdam: North-Holland 1975
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Nummelin, E. A splitting technique for Harris recurrent Markov chains. Z. Wahrscheinlichkeitstheorie verw Gebiete 43, 309–318 (1978). https://doi.org/10.1007/BF00534764
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF00534764