Abstract
We are concerned with solidarity and a Doeblin decomposition for a class of non-Markovian discrete parameter stochastic processes. Since any such process is associated with a certain general Markov chain whose transition probability function has a special form, we use the theory of Markov chains with continuous components to this particular chain in order to get properties of the non-Markovian process. We illustrate our results on a model closely related to learning theory.
Similar content being viewed by others
References
Bush, R., andF. Mosteller: Stochastic models for learning. New York 1955.
Doeblin, W., andR. Fortet: Sur les chaînes à liaisons complètes. Bull. Soc. Math. France65, 1937, 132–148.
Herkenrath, U., andR. Theodorescu: A mathematical framework for learning and adaption: (generalized) random systems with complete connections. Trabajos Estadist. Investigacion Op.32, 1981, 116–129.
Iosifescu, M., andR. Theodorescu: Random processes and learning. New York 1969.
Ismail, M.E.H., andR. Theodorescu: Asymptotic and explicit formulae for a non-Markovian model with linear transition rule. Biom. J.22, 1980, 67–71.
Lecalvé, G., andR. Theodorescu: Systèmesaleatoires généralisés à liaisons complètes. Z. Wahrscheinlichkeitstheorie Verw. Gebiete19, 1971, 19–28.
Norman, M.F.: Markov processes and learning models. New York 1972.
Nummelin, E.: A splitting technique for ϕ-recurrent Markov chains. Preprint, Helsinki University of Technology, 1976.
Onicescu, O., andG. Mihoc: Sur les chaînes de variables statistiques. Bull. Soc. Math. France59, 1935, 174–192.
Orey, S.: Lecture notes on limit theorems for Markov chain transition probabilities. London 1971.
Pruscha, H., andR. Theodorescu: Recurrence and transience for discrete parameter stochastic processes. Trans. Eighth Prague Conf. Information Theory, Statistical Decision Functions, Random Processes, Prague Aug. 28.–Sept. 1, 1978, Volume B. Prague 1978, 97–105.
—: On a non-Markovian model with linear transition rule Coll. Math.44, 1981, 165–173.
Tweedie, R.L.: R-theory for Markov chains on a general state space I: Solidarity properties and R-recurrent chains. Ann. Probability2, 1974, 840–864.
Tuominen, P., andR.L. Tweedie: Markov chains with continuous components. Proc. London Math. Soc.38 (3), 1979, 89–114.
Author information
Authors and Affiliations
Additional information
Work supported by the Natural Sciences and Engineering Council Canada grant A-7223, by the Québec Action Concertée grant EQ-1023, and the C.S.I.R.O. Division of Mathematics and Statistics Australia.
Rights and permissions
About this article
Cite this article
Theodorescu, R., Tweedie, R.L. Solidarity properties and a Doeblin decomposition for a class of non-Markovian stochastic processes. Metrika 30, 37–47 (1983). https://doi.org/10.1007/BF02056899
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/BF02056899