Abstract
Based on the resolvent decomposition theorems presented very recently by Chen (J Theor Probab 33:2089–2118, 2020), in this paper we focus on investigating the fundamental problems of existence and uniqueness criteria for Denumerable Markov Processes with finitely many instantaneous states. Some elegant sufficient and necessary conditions are obtained for this less-investigated topic. A few important examples including the generalized Kolmogorov models are presented to illustrate our general results.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
References openly available in a public repository.
References
Blackwell, D.: Another countable Markov process with only instantaneous states. Ann. Math. Stat. 29, 313–316 (1958)
Chen, A.Y.: Resolvent decomposition theorems and their application in denumerable Markov processes with instantaneous states. J. Theor. Probab. 33(4), 2089–2118 (2020)
Chen, A.Y., Renshaw, E.: Markov branching processes with instantaneous immigration. Probab. Theor. Relat. Fields 87, 209–240 (1990)
Chen, A.Y., Renshaw, E.: Existence and uniqueness criteria for conservative uni-instantaneous denumerable Markov processes. Probab. Theor. Relat. Fields 94, 427–456 (1993)
Chen, A.Y., Renshaw, E.: Recurrence of Markov branching processes with immigration. Stoch. Process. Appl. 45, 231–242 (1993)
Chen, A.Y., Renshaw, E.: Markov branching processes regulated by emigration and large immigration. Stoch. Process. Appl. 57, 339–359 (1995)
Chen, A.Y., Renshaw, E.: Existence, recurrence and equilibrium properties of Markov branching processes with instantaneous immigration. Stoch. Process. Appl. 88, 177–193 (2000)
Chen, A.Y., Zhang, H.J., Liu, K., Rennolls, K.: Birth-death processes with disaster and instantaneous resurrection. Adv. Appl. Probab. 36, 267–292 (2004)
Chen, M.F.: From Markov Chains to Non-equilibrium Particle Systems, 2nd edn. World Scientific, Singapore (2004)
Chung, K.L.: Markov Chains with Stationary Transition Probabilities, 2nd edn. Springer, New York (1967)
Doob, J.L.: Markov chains–denumerable case. Trans. Am. Math. Soc. 58, 455–473 (1945)
Feller, W.: On the integro-differential equations of purely discontinuous Markov processes. Trans. Am. Math. Soc. 48, 488–515 (1940)
Freedman, D.: Approximating Countable Markov Chains. Springer, Berlin, Heidelberg, New York (1983)
Hou, Z.T.: The uniqueness criterion for \(Q\)-processes (in Chinese). Sinica 2, 115–130 (1974)
Hou, Z.T., Guo, Q.F.: Homogeneous Denumerable Markov Processes. Springer-Verlag, Berlin (1988)
Kendall, D.G.: A totally unstable denumerable Markov process. Q. J. Math. 9, 149–160 (1958)
Kendall, D.G., Reuter, G.E.H.: Some pathological Markov processes with a denumerable infinity of states and the associated semigroups of operators on \({\cal{L}}\). In: Proceedings of the International Congress of Mathematicians Amsterdam, vol. III, pp. 377–415. Amsterdam, North-Holland (1954)
Kolmogorov, A.N.: On the differentiability of the transition probabilities in stationary Markov processes with a denumerable number of states (in Runssian). Moskov. Gos. Univ. Ucenye Zapiski Mat. 148, 53–59 (1951)
Lamb, C.W.: Decomposition and construction of Markov Chains. Z. Wahrscheinlichkeitstheorie view. Geb. 19, 213–224 (1971)
Reuter, G.E.H.: Denumerable Markov processes and the associated semigroup on \({\cal{L} }\). Acta. Math. 97, 1–46 (1957)
Reuter, G.E.H.: Denumerable Markov processes (II). J. Lond. Math. Soc. 34, 81–91 (1959)
Reuter, G.E.H.: Denumerable Markov processes (III). J. Lond. Math. Soc. 37, 63–73 (1962)
Reuter, G.E.H.: Remarks on a Markov chain example of Kolmogorov. Z. Wabrscheinlichkeits-theor. Verw. Geb. 13, 315–320 (1969)
Reuter, G.E.H.: Denumerable Markov processes (IV). On C.T. Hou’s uniqueness theorm for \(Q\)-semigroups. Z. Wabrscheinlichkeitstheor. Verw. Geb. 33, 309–315 (1976)
Rogers, L.C.G., Williams, D.: Construction and approximation of transition matrix functions. Adv. Appl. Probab. Suppl. 18, 133–160 (1986)
Rogers, L.C.G., Williams, D.: Diffusions, Markov Processes and Martingales, vol. 1, 2nd edn. Wiley, Chichester (1994)
Williams, D.: A note on the \(Q\)-matrices of Markov chains. Z. Wabrscheinlichkeitstheor. Verw. Geb. 7, 116–121 (1967)
Yang, X.Q.: The Construction Theory of Denumerable Markov Proceses. Wiley, New York (1990)
Funding
The work of Junping Li is substantially supported by the National Natural Sciences Foundation of China (No. 11771452, No. 11971486).
Author information
Authors and Affiliations
Contributions
All authors participated in the discussion of this article, wrote the manuscript text and reviewed the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors have no competing interests as defined by Springer, or other interests that might be perceived to influence the results and/or discussion reported in this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wu, X., Chen, A. & Li, J. Existence and Uniqueness of Denumerable Markov Processes with Instantaneous States. J Theor Probab 37, 511–532 (2024). https://doi.org/10.1007/s10959-023-01299-w
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10959-023-01299-w