Abstract
In the present we establish Laws of Large Numbers for Non-Homogeneous Markov Systems and Cyclic Non-homogeneous Markov systems. We start with a theorem, where we establish, that for a NHMS under certain conditions, the fraction of time that a membership is in a certain state, asymptotically converges in mean square to the limit of the relative population structure of memberships in that state. We continue by proving a theorem which provides the conditions under which the mode of covergence is almost surely. We continue by proving under which conditions a Cyclic NHMS is Cesaro strongly ergodic. We then proceed to prove, that for a Cyclic NHMS under certain conditions the fraction of time that a membership is in a certain state, asymptotically converges in mean square to the limit of the relative population structure in the strongly Cesaro sense of memberships in that state. We then proceed to establish a founding Theorem, which provides the conditions under which, the relative population structure asymptotically converges in the strongly Cesaro sense with geometrical rate. This theorem is the basic instrument missing to prove, under what conditions the Law of Large Numbers for a Cycl-NHMS is with almost surely mode of convergence. Finally, we present two applications firstly for geriatric and stroke patients in a hospital and secondly for the population of students in a University system.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Bartholomew DJ (1963) A multistage renewal process. J R Stat Soc Soc B25:150–168
Bartholomew DJ (1967) Stochastic models for Social processes, 1st edn. Wiley, New York
Bartholomew DJ (1982) Stochastic models for Social processes, 3rd edn. Wiley, New York
Faddy M, McClean SI (2005) Markov chain modeling for geriartic patient care. Methods Archive 44(3):369–373
Foucher Y, Mathew E, Saint Pierre P, Durand J-F, Daures JP (2005) A semi-Markov model based on Weibull distribution with an illustration for HIV disease. Biometrical J 47(6):1–9
Gani J (1963) Formula for projecting enrollments and degrees awarded in Universities. J R Stat Soc A 126:400–409
Garg L, McClean SI, Meenan B, Millard P (2009) Non homogeneous Markov models for sequential pattern mining of health care data. IMA J Manag Math 20(4):327–344
Garg L, McClean SI, Meenan B, Millard P (2010) A non-homogeneous discrete time Markov model for admission scheduling and resource planning in a cost capacity constraint healthcare system. Health care Management Science 13(2):155–169
Georgiou AC, Vassiliou P-CG (1992) Periodicity of asymptotically attainable structures in nonhomogeneous Markov systems. Linear Algebra Appl 176:137–174
Georgiou AC, Tsantas N (1996) Non-stationary cyclic behavior in Markov systems. Linear Algebra Appl 237:549–587
Grimmett G, Stirzaker D (2001) Probability and random processes, 3rd edn. Oxford University Press, Oxford
Hall P, Heyde CC (1980) Martingale limit theorem and its applications. Academic Press, New York
Huang C, Isaacson DL, Vinograde B (1976) The rate of convergence of certain nonhomogeneous Markov chains. Z Wahrscheinlichkeitstheorie verw Gabiete 35:141–146
Isaacson DL, Madsen RW (1976) Markov Chains Theory and Applications. Wiley, New York
Kemeny JG, Snell JL (1981) Finite Markov chains. Springer, New York
Kemeny JG, Snell JL, Knapp AW (1976) Denumerable Markov Chains. Springer, New York
Mathiew E, Foucher Y, Dellamonica P, Daures J-P (2006) Parametric and non-homogeneous semi-Markov process for HIV control. Working paper Archer Hospital, Nice
Lalit G, McClean SI, Meenan B, Millard P (2010) A non-homogeneous discrete time Markov model for admission scheduling and resource planning in a cost or capacity constrained healthcare system. Health Care Management Science 13:155–169
Marshall AH, McClean SI, Shapcott CM, Millard P (2002) Modelling patient duration of stay to facilitate resource management of geriatric hospitals. Health Care Management Science 5:313–319
Marshall AH, McClean SI (2003) Conditional phase-type distributions for modelling patient length of stay in hospital. Int Trans Op Res 10:565–576
Marshall AH, McClean SI (2004) Using coxian Phase-Type distributions to identify patient characteristics for duration of stay in hospital. Health Care Management Science 7:285–289
McClean SI, Millard P (1998a) A three compartment model of the patient flows in a geriatric department: a decision support approach. Health Care Management Science 1:159–163
McClean SI, McAlea B, Millard P (1998b) Using a Markov reward model to estimate spend-down costs for geriatric department. J Oper Res Soc 49:1021–1025
McClean SI, Scotney B, Robinson S (2003) Conceptual clustering of heterogeneous gene expressions sequences. Artif Intell Rev 20:53–73
McClean SI, Millard P (2007) Where to treat the older patient? Can Markov models help us better understand the relationship between hospital and community care? J Oper Res Soc 58(2):255–261
McClean SI, Gillespie J, Garg L, Barton M, Scotney B, Fullerton K (2014a) Using phase-type models to cost stroke patient care across health, social and community services. Eur J Oper Res 236(1):190–199
McClean SI, Garg L, Fullerton K (2014b) Costing mixed Coxian phase-type systems with Poisson arrivals. Communications in Statistics-Theory and Methods 43 (7):1437–1452
Meyn S, Tweedie R (2009) Markov chains and stochastic stability. Cambridge University Press, Cambridge
Vadori N, Swishchuk A (2015) Strong Law of Large Numbers and Central Limit theorems for functionals of inhomogeneous Semi-Markov Processe. Stoch Anal Appl 33:213–243
Taylor GJ, McClean SI, Millard P (2000) Stochastic models of geriatric patient bed occupancy behaviour. J R Statist Soc A 163:Part 1, 39–48
Vassiliou P-CG (1982) Asymptotic behavior of Markov systems. J Appl Prob 19:851–857
Vassiliou P-CG (1984) Cyclic behavior and asymptotic stability of non-homogeneous Markov systems. J Appl Probab 21:315–325
Vassiliou P-CG (1986) Asymptotic variability of nonhomogeneous Markov systems under cyclic behavior. Eur J Oper Res 27:215–228
Vassiliou P-CG, Georgiou AC (1990) Asymptotically attainable structures in nonhomogeneous Markov systems. Oper Res 38(3):537–545
Vassiliou P-CG (1981) On the limiting behavior of a nonhomogeneous Markov chain model in manpower systems. Biometrika 68(2):557–561
Vassiliou P-CG, Tsantas N (1984) Maintainability of structures in nonhomogeneous Markov systems under cyclic behavior and input control. SIAM J Appl Math 44 (5):1014–1022
Vassiliou P-CG (1997) The evolution of the theory of non-homogeneous Markov systems. Applied Stochastic Models Data Anal 13:159–176
Ugwuowo FI, McClean SI (2000) Modelling heterogeneity in a manpower system : a review. Appl Stoch Models Bus Ind 2:99–100
Young A, Almond G (1961) Predicting distributions of staff. Comp J 3:246–250
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Vassiliou, PC.G. Laws of Large Numbers for Non-Homogeneous Markov Systems. Methodol Comput Appl Probab 22, 1631–1658 (2020). https://doi.org/10.1007/s11009-017-9612-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11009-017-9612-1