Abstract
We analyse singularly perturbed Markov chains. Most previous research has been done under the assumption that the perturbed Markov chain is either ergodic or unichain. In this paper we do not impose any restrictions on the ergodic structure of the perturbed chain. The present approach is based on the inversion of analytic matrix-valued functions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Altman, E., and Gaitsgory, V.G. (1993). “Stability and Singular Perturbations in Constrained Markov Decision Problems”, IEEE Trans. Autom. Control, v.38, 971–975.
Avrachenkov, K.E. (1999). Analytic perturbation theory and its applications, PhD Thesis, University of South Australia.
Avrachenkov, K.E., Haviv, M., and Howlett, P.G. (1998). “Inversion of analytic matrix functions that are singular at the origin”, submitted to SIAM J. Matr. Anal. Appl.
Avrachenkov, K.E., and Lasserre, J.B. (1999) “The fundamental matrix of singularly perturbed Markov chains”, Adv. Appl. Prob., v.31, 679–697.
Bielecki, T.R., and Filar, J.A. (1991). “Singularly perturbed Markov control problem: Limiting average cost”, Annals O.R., v.28, 153–168.
Courtois, P.J., and Louchard, G. (1976). “Approximation of eigencharacteristics in nearly-completely decomposable stochastic systems”, Stoch. Process. Appl., v.4, 283–296.
Delebecque, F., and Quadrat, J.P. (1981) “Optimal control of Markov chains admitting strong and weak interactions”, Automatica, v.17, 281–296.
Delebecque, F. (1983) “A reduction process for perturbed Markov chain”, SIAM J. Appl. Math., v.43, 325–350.
Gaitsgori, V.G., and Pervozvanskii, A.A. (1988). Theory of Suboptimal Decisions, Kluwer Academic Publishers.
Haviv, M., and Ritov, Y. (1993). “On series expansions for stochastic matrices”, SIAM Journal on Matrix Analysis and Applications, v. 14, 670–677.
Kato, T. (1966) Perturbation theory for linear operators, Berlin: Springer-Verlag.
Louchard, G., and Latouche, G. (1990). “Geometric bounds on iterative approximations for nearly completely decomposable Markov chains”, J. Appl. Prob., v.27, 521–529.
Schweitzer, P.J. (1986). “Perturbation series expansion of nearly completely-decomposable Markov chains”, in Teletraffic Analysis and Computer Performance Evaluation, O.J. Boxma, J.W. Cohen and H.C. Tijms (eds), Elsevier, 319–328.
Schweitzer, P.J., and Stewart, G.W. (1993). “The Laurent expansion of pencils that are singular at the origin”, Lin. Alg. Appl., v.183, 237–254.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer Science+Business Media New York
About this chapter
Cite this chapter
Avrachenkov, K.E. (2000). Singularly Perturbed Finite Markov Chains with General Ergodic Structure. In: Boel, R., Stremersch, G. (eds) Discrete Event Systems. The Springer International Series in Engineering and Computer Science, vol 569. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-4493-7_45
Download citation
DOI: https://doi.org/10.1007/978-1-4615-4493-7_45
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4613-7025-3
Online ISBN: 978-1-4615-4493-7
eBook Packages: Springer Book Archive