Skip to main content
SpringerLink
Log in

Algorithm of State Stationary Probability Computing for Continuous-Time Finite Markov Chain Modulated by Semi-Markov Process

  • Conference paper
  • First Online:
Distributed Computer and Communication Networks (DCCN 2015)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 601))

Abstract

This paper presents the description of the method for computing of state stationary probabilities for Markovian systems operating in the random environment. These systems are described as semi-Markov processes. The method generalizes some other results in this area.

This research was financially supported by the Ministry of Education and Science of the Russian Federation in the framework of the applied research project №14.613.21.0020 of 22.10.2014 (RFMEFI61314X0020).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  1. Andronov, A.M.: Markov-modulated birth-death processes. Autom. Control Comput. Sci. 45(3), 123–132 (2011)

    Article  Google Scholar 

  2. Andronov, A., Gertsbakh, I.B.: Signatures in Markov-modulated processes. Stoch. Models 30, 1–15 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  3. Bellman, R.: Introduction to Matrix Analysis. Mcgraw-Hill Book Company Inc., New York (1969)

    MATH  Google Scholar 

  4. Kim, C.S., Dudin, A., Klimenok, V., Khramova, V.: Erlang loss queueing system with butch arrivals operating in a random environment. Comput. Oper. Res. 36(3), 674–697 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  5. Kim, C.S., Klimenok, V., Mushko, V., Dudin, A.: The BMAP/PH/N retrial queueing system operating in Markovian random environment. Comput. Oper. Res. 37(7), 1228–1237 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  6. Grabski, F.: Semi-Markov Processes: Application in System Reliability and Maintenance. Elsevier, Amsterdam (2014)

    MATH  Google Scholar 

  7. Kopoci’nska, I., Kopoci’nski, B.: On system reliability under random load of elements. Aplicationes Math. XVI(1), 5–14 (1980)

    Article  MathSciNet  Google Scholar 

  8. Kopoci’nska, I.: The reliability of an element with alternating failure rate. Zastosowania Matematki (Aplicationes Math.) XVIII(2), 187–194 (1984)

    MathSciNet  Google Scholar 

  9. Kijima, M.: Markov Processes for Stochastic Modelling. Chapman & Hall, London (1997)

    Book  MATH  Google Scholar 

  10. Leri, M.: Forest fire model for configuration graphs in a random environment. In: Rasch, D., Melas, V., Pilz, J., Moder, K., Spangl, B. (eds.) Eighth International Workshop on Simulation. Book of Abstracts. Institute of Applied Statistics and Computing, University of Natural Resources and Life Sciences, Vienna, pp. 125–126 (2015). ISBN 978-3-900932-28-2

    Google Scholar 

  11. Pacheco, A., Tang, L.C., Prabhu, N.U.: Markov-Modulated Processes & Semiregenerative Phenomena. World Scientific, New Jersey (2009)

    MATH  Google Scholar 

  12. Sleeper, A.: Six Sigma Distribution Modeling. McGraw Hill, New York (2007)

    Google Scholar 

  13. Vishnevsky, V.M., Semenova, O.V., Sharov, S.Y.: Modeling and analysis of a hybrid communication channel. Autom. Remote Control 72, 345–352 (2013)

    Google Scholar 

Download references

Acknowledgment

This research was financially supported by the Ministry of Education and Science of the Russian Federation in the framework of the applied research project №14.613.21.0020 of 22.10.2014 (RFMEFI61314X0020).

Author information

Authors and Affiliations

  1. Transport and Telecommunication Institute, Lomonosov, 1, Riga, 1019, Latvia

    Alexander M. Andronov

  2. V.A. Trapeznikov Institute of Control Sciences of Russian Academy of Sciences, 65 Profsoyuznaya Street, Moscow, 117997, Russia

    Vladimir M. Vishnevsky

Authors
  1. Alexander M. Andronov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vladimir M. Vishnevsky
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vladimir M. Vishnevsky .

Editor information

Editors and Affiliations

  1. V.A. Trapeznikov Institute of Control Sc, Russian Academy of Sciences V.A. Trapeznikov Institute of Control Sc, Moscow, Russia

    Vladimir Vishnevsky

  2. V.A. Trapeznikov Inst. of Control Scienc, Russian Academy of Sciences V.A. Trapeznikov Inst. of Control Scienc, Moscow, Russia

    Dmitry Kozyrev

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Andronov, A.M., Vishnevsky, V.M. (2016). Algorithm of State Stationary Probability Computing for Continuous-Time Finite Markov Chain Modulated by Semi-Markov Process. In: Vishnevsky, V., Kozyrev, D. (eds) Distributed Computer and Communication Networks. DCCN 2015. Communications in Computer and Information Science, vol 601. Springer, Cham. https://doi.org/10.1007/978-3-319-30843-2_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-30843-2_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-30842-5

  • Online ISBN: 978-3-319-30843-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation