Abstract
The evolution of the state sizes of a closed continuous-time homogeneous Markov system is determined by the convolution of multinomial distributions expressing the number of transitions between the states of the system. In order to investigate the distributions of the state sizes, we provide the computation of their moments, at any time point, via a recursive formula concerning the derivative of the moments. The basic result is given by means of a new vector product which is similar to the Kronecker product. Finally, a formula for the computation of the state sizes distributions is given.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bartholomew DJ (1982) Stochastic models for social processes, 3rd edn. Wiley, New York
Gani J (1963) Formulae for projecting enrolments and degrees awarded in universities. J R Stat Soc A 126:400–409
Horn AR, Johnson CR (1985) Matrix analysis. Cambridge University Press, New York
Horn AR, Johnson CR (1991) Topics in matrix analysis. Cambridge University Press, New York
Isaacson DL, Madsen RW (1976) Markov chains: theory and applications. Wiley, New York
Janssen J, Manca R (2006) Applied semi-Markov processes. Springer, New York
Johnson NL, Kotz S (1969) Discrete distributions. Wiley, New York
Kipouridis I, Tsaklidis G (2001) The size order of the state vector of continuous-time homogeneous Markov systems. J Appl Probab 38:357–368
Lancaster P, Tismenetsky M (1985) The theory of matrices. Academic, Orlando, Florida
Limnios N (2004) Semi-Markov processes: theory and applications. Commun Stat Theory Methods 33:419–768
McClean SI, Millard P (2006) Using Markov models to manage high occupancy hospital care. 3rd international IEEE conference on intelligent systems, 2006, pp 256–260
McClean SI, McAlea B, Millard P (1998) Using a Markov reward model to estimate spend-down costs for a geriatric department. J Oper Res Soc 10:1021–1025
Patoucheas PD, Stamou G (1993) Non-homogeneous Markovian models in ecological modelling: a study of the zoobenthos dynamics in Thermaikos gulf, Greece. Ecol Model 66:197–215
Taylor GJ, McClean SI, Millard P (2000) Stochastic model of geriatric patient bed occupancy behaviour. J R Stat Soc 163(1):39–48
Tsaklidis G (1994) The evolution of the attainable structures of a homogeneous Markov system with fixed size. J Appl Probab 31, 348–361
Tsaklidis G, Soldatos KP (2003) Modelling of continuous time homogeneous Markov system with fixed size as elastic solid. Appl Math Model 27:877–887
Vasiliadis G, Tsaklidis G (to appear) On the distributions of the state sizes of discrete time Homogeneous Markov System. Methodol Comput Appl Probab
Vassiliou P-CG (1982) Asymptotic behaviour of Markov systems. J Appl Probab 19:851–857
Vassiliou P-CG (1997) The evolution of the theory of non-homogeneous Markov systems. Appl Stoch Models Data Anal 13(3–4):159–176
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was partially supported by the State Scholarships Foundation of Greece.
Rights and permissions
About this article
Cite this article
Vasiliadis, G., Tsaklidis, G. On the Distributions of the State Sizes of Closed Continuous Time Homogeneous Markov Systems. Methodol Comput Appl Probab 11, 561–582 (2009). https://doi.org/10.1007/s11009-008-9074-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11009-008-9074-6