Abstract
We consider a discrete time semi-Markov process where the characteristics defining the process depend on a small perturbation parameter. It is assumed that the state space consists of one finite communicating class of states and, in addition, one absorbing state. Our main object of interest is the asymptotic behavior of the joint probabilities of the position of the semi-Markov process and the event of non-absorption as time tends to infinity and the perturbation parameter tends to zero. The main result gives exponential expansions of these probabilities together with a recursive algorithm for computing the coefficients in the expansions. An application to perturbed epidemic SIS models is discussed.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Allen LJS, Burgin AM (2000) Comparison of deterministic and stochastic SIS and SIR models in discrete time. Math Biosci 163:1–33
Altman E, Avrachenkov KE, Núñez-Queija R (2004) Perturbation analysis for denumerable Markov chains with application to queueing models. Adv Appl Prob 36:839–853
Avrachenkov KE, Filar JA, Howlett PG (2013) Analytic perturbation theory and its applications. SIAM, Philadelphia
Avrachenkov KE, Haviv M (2004) The first Laurent series coefficients for singularly perturbed stochastic matrices. Linear Algebra Appl 386:243–259
Blanchet J, Zwart B (2010) Asymptotic expansions of defective renewal equations with applications to perturbed risk models and processor sharing queues. Math Meth Oper Res 72:311–326
Cavender JA (1978) Quasi-stationary distributions of birth-and-death processes. Adv Appl Prob 10:570–586
Cheong CK (1970) Quasi-stationary distributions in semi-Markov processes. J Appl Prob 7:388–399. (Correction in J. Appl. Prob., 7, 788)
Çinlar E (1974) Periodicity in Markov renewal theory. Adv Appl Prob 6:61–78
Collet P, Martínez S, San Martín J (2013) Quasi-stationary distributions. Markov chains, diffusions and dynamical systems. Springer, Heidelberg
Darroch JN, Seneta E (1965) On quasi-stationary distributions in absorbing discrete-time finite Markov chains. J Appl Prob 2:88–100
van Doorn EA, Pollett PK (2013) Quasi-stationary distributions for discrete-state models. Eur J Oper Res 230:1–14
Drozdenko M (2007) Weak convergence of first-rare-event times for semi-Markov processes. PhD Thesis, Mälardalen University. School of Education, Culture and Communication, Västerås
Englund E (2001) Nonlinearly perturbed renewal equations with applications. PhD Thesis, Umeå University
Englund E, Silvestrov DS (1997) Mixed large deviation and ergodic theorems for regenerative processes with discrete time. In: Jagers P., Kulldorff G., Portenko N., Silvestrov D (eds) Proceedings of the second Scandinavian-Ukrainian conference in mathematical statistics, vol I. Umeå. Theory Stoch. Process., 3(19), no. 1.2, 164–176 (1997)
Flaspohler DC, Holmes PT (1972) Additional quasi-stationary distributions for semi-Markov processes. J Appl Prob 9:671–676
Gyllenberg M, Silvestrov DS (1994) Quasi-stationary distributions of stochastic metapopulation model. J Math Biol 33:35–70
Gyllenberg M, Silvestrov DS (1999) Quasi-stationary phenomena for semi-Markov processes. In: Janssen J., Limnios N (eds) Semi-Markov models and applications. Kluwer, Dordrecht, pp 33–60
Gyllenberg M, Silvestrov DS (2000) Cramér-Lundberg approximation for nonlinearly perturbed risk processes. Insur Math Econom 26:75–90
Gyllenberg M, Silvestrov DS (2008) Quasi-stationary phenomena in nonlinearly perturbed stochastic systems. De Gruyter Expositions in Mathematics, vol 44. Walter de Gruyter, Berlin
Hassin R, Haviv M (1992) Mean passage times and nearly uncoupled Markov chains. SIAM J Discrete Math 5(3):386–397
Jung B (2013) Exit times for multivariate autoregressive processes. Stoch Process Appl 123:3052–3063
Keilson J (1966) A limit theorem for passage times in ergodic regenerative processes. Ann Math Statist 37:866–870
Kryscio RJ, Lefévre C (1989) On the extinction of the S-I-S stochastic logistic epidemic. J Appl Prob 27:685–694
Latouche G (1991) First passage times in nearly decomposable Markov chains. In: Stewart W J (ed) Numerical solution of Markov chains. probability: pure and applied, vol 8. Marcel Dekker, New York, pp 401–411
Latouche G, Louchard G (1978) Return times in nearly-completely decomposable stochastic processes. J Appl Prob 15:251–267
Longini IM Jr (1980) A chain binomial model of endemicity. Math Biosci 50:85–93
Nåsell I (1996) The quasi-stationary distribution of the closed endemic SIS model. Adv Appl Prob 28:895–932
Ni Y (2011) Nonlinearly perturbed renewal equations: asymptotic results and applications. PhD Thesis, Mälardalen University, School of Education, Culture and Communication, Västerås
Ni Y (2014) Exponential asymptotical expansions for ruin probability in a classical risk process with non-polynomial perturbations. In: Silvestrov D., Martin-Löf A (eds) Modern problems in insurance mathematics, EAA Series. Springer international, pp 69–93
Petersson M (2014a) Quasi-stationary distributions for perturbed discrete time regenerative processes. Theory Probab Math Stat 89:153–168
Petersson M (2014b) Asymptotics of ruin probabilities for perturbed discrete time risk processes. In: Silvestrov D, Martin-Löf A (eds) Modern problems in insurance mathematics, EAA Series. Springer, Cham, pp 95–112
Schweitzer PJ (1968) Perturbation theory and finite Markov chains. J Appl Prob 5:401–413
Seneta E, Vere-Jones D (1966) On quasi-stationary distributions in discrete-time Markov chains with a denumerable infinity of states. J Appl Prob 3:403–434
Silvestrov DS, Petersson M (2013) Exponential expansions for perturbed discrete time renewal equations. In: Frenkel I, Karagrigoriou A, Lisnianski A, Kleyner A (eds) Applied reliability engineering and risk analysis: probabilistic models and statistical inference. Wiley, Chichester, pp 349–362
Simon HA, Ando A (1961) Aggregation of variables in dynamic systems. Econometrica 29:111–138
Stewart GW (1991) On the sensitivity of nearly uncoupled Markov chains. In: Stewart W J (ed) Numerical solution of Markov chains. Probability: pure and applied, vol 8. Marcel Dekker, New York, pp 105–119
Weiss GH, Dishon M (1971) On the asymptotic behavior of the stochastic and deterministic models of an epidemic. Math Biosci 11:261–265
Yin G, Zhang Q (1998) Continuous-time Markov Chains and applications. A singular perturbation approach. Applications of Mathematics, vol 37. Springer, New York
Yin G, Zhang Q (2003) Discrete-time singularly perturbed Markov chains. In: Stochastic modelling and optimization. Springer, New York, pp 1–42
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Petersson, M. Quasi-Stationary Asymptotics for Perturbed Semi-Markov Processes in Discrete Time. Methodol Comput Appl Probab 19, 1047–1074 (2017). https://doi.org/10.1007/s11009-016-9530-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11009-016-9530-7
Keywords
- Semi-Markov process
- Perturbation
- Asymptotic expansion
- Regenerative process
- Renewal equation
- Solidarity property
- First hitting time