Abstract
This paper describes the role of continuous components in linking the topological and measuretheoretic (or regenerative) analysis of Markov chains and processes. Under Condition\(\mathcal{T}\) below we show the following parallel results for both discrete and continuous time models:
-
(i)
when the model is open set irreducible it is ϕ-irreducible;
-
(ii)
under (i), the measure-theoretic classification of the model as Harris recurrent or positive Harris recurrent is equivalent to a topological classification in terms of not leaving compact sets or of tightness of transition kernels;
-
(iii)
under (i), the ‘global’ classification of the model as transient, recurrent or positive recurrent is given by a “local’ classification of any individual reachable point;
-
(iv)
under (i), every compact set is a small set, so that through the Nummelin splitting there is pseudo-regeneration within compact sets, and compact sets are ‘test sets’ for stability;
-
(v)
even without irreducibility, there is always a Doeblin decomposition into a countable disjoint collection of Harris sets and a transient set. We conclude with a guide to verifying Condition\(\mathcal{T}\) and indicate that it holds under very mild constraints for a wide range of specific models: in particular a ϕ-irreducible Feller chain satisfies Condition\(\mathcal{T}\) provided only that the support of ϕ has nonempty interior.
Similar content being viewed by others
References
Azéma, J., Kaplan-Duflo, M. and Revuz, D.: Measure invariante sur les classes récurrentes des processus de Markov,Z. Wahrsch. verw. Gebiete 8 (1967), 157–181.
Down, D., Meyn, S. P. and Tweedie, R. L.: Exponential and uniform ergodicity of Markov processes, 1993. Submitted for publication.
Ichihara, K. and Kunita, H.: A classification of the second order degenerate elliptic operator and its probabilistic characterization,Z. Wahrsch. verw, Gebiete 30 (1974), 235–254.
Kaspi, H. and Mandelbaum, A.: On Harris recurrence in continuous time, Technical report, Technion-Israel Institute of Technology, 1992. Submitted for publication.
Kliemann, W.: Recurrence and invariant measures for degenerate diffusions,Ann. Probab. 15 (1987), 690–707.
Meyn, S. P. and Tweedie, R. L.: Stability of Markovian processes, I: Discrete time chains,Adv. Appl. Probab. 24 (1992), 542–574.
Meyn, S. P. and Tweedie, R. L.: Generalized resolvents and Harris recurrence of Markov processes,Contemp. Math. 149 (1993), 227–250.
Meyn, S. P. and Tweedie, R. L.:Markov Chains and Stochastic Stability, Springer-Verlag, London, 1993.
Meyn, S. P. and Tweedie, R. L.: Stability of Markovian processes, II: Continuous time processes and sampled chains,Adv. Appl. Probab. 25 (1993), 487–517.
Meyn, S. P. and Tweedie, R. L.: Stability of Markovian processes, III: Foster-Lyapunov criteria for continuous time processes,Adv. Appl. Probab. 25 (1993), 518–548.
Nummelin, E.:General Irreducible Markov Chains and Nonnegative Operators, Cambridge University Press, Cambridge, 1984.
Orey, S.:Limit Theorems for Markov Chain Transition Probabilities, Van Nostrand-Reinhold, London, 1971.
Pollard, D. B. and Tweedie, R. L.: R-theory for Markov chains on a topological state space, I,J. London Math. Soc. 10 (1975), 389–400.
Pollard, D. B. and Tweedie, R. L.: R-theory for Markov chains on a topological state space, II,Z. Wahrsch. verw. Gebiete 34 (1976), 269–278.
Sharpe, M.:General Theory of Markov Processes, Academic Press, New York, 1988.
Tuominen, P. and Tweedie, R. L.: Markov chains with continuous components,Proc. London Math. Soc. (3),38 (1979), 89–114.
Tuominen, P. and Tweedie, R. L.: The recurrence structure of general Markov processes,Proc. London Math. Soc. (3) 39 (1979), 554–576.
Tweedie, R. L.: Criteria for classifying general Markov chains,Adv. Appl. Probab. 8 (1976), 737–771.
Author information
Authors and Affiliations
Additional information
Work supported in part by NSF Grant DMS-9205687.
Rights and permissions
About this article
Cite this article
Tweedie, R.L. Topological conditions enabling use of harris methods in discrete and continuous time. Acta Applicandae Mathematicae 34, 175–188 (1994). https://doi.org/10.1007/BF00994264
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF00994264