Skip to main content
SpringerLink
Log in

Finite Markov Chains II

  • Chapter
  • First Online:
Informal Introduction to Stochastic Processes with Maple

Part of the book series: Universitext ((UTX))

  • 3229 Accesses

Abstract

We continue the study of finite Markov chains (FMCs) by considering models with one or more absorbing states. As their name implies, these are states that cannot be left once entered. Thus, a process entering an absorbing state is stuck there for good.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 16.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. M. S. Bartlett. An Introduction to Stochastic Processes, with Special Reference to Methods and Applications. Cambridge University Press, Cambridge/New York, 1980.

    Google Scholar 

  2. U. Narayan Bhat and G. K. Miller. Elements of Applied Stochastic Processes. Wiley-Interscience, Hoboken, N.J. 2002.

    Google Scholar 

  3. R. Bronson. Schaum’s Outline of Theory and Problems of Matrix Operations. McGraw-Hill, New York, 1989.

    Google Scholar 

  4. W. Feller. An Introduction to Probability Theory and Its Applications. Wiley, New York, 1968.

    Google Scholar 

  5. S. Goldberg. Introduction to Difference Equations. Dover, New York, 1986.

    Google Scholar 

  6. S. Karlin. A First Course in Stochastic Processes. Academic, New York, 1975.

    Google Scholar 

  7. S. Karlin and H. M. Taylor. A Second Course in Stochastic Processes. Academic, New York, 1981.

    Google Scholar 

  8. J. G. Kemeny and J. L. Snell. Finite Markov Chains. Springer, New York, 1976.

    Google Scholar 

  9. J. Medhi. Stochastic Processes. Wiley, New York, 1994.

    Google Scholar 

  10. J. Medhi. Stochastic Models in Queueing Theory. Academic, Amsterdam, 2003.

    Google Scholar 

  11. S. Ross. Stochastic Processes. Wiley, New York, 1996.

    Google Scholar 

  12. A. Stuart. Kendall’s Advanced Theory of Statistics. Wiley, Chichester, 1994.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics, Brock University, St Catharines, Ontario, Canada

    Jan Vrbik

  2. Department of Computer Science, The University of Western Ontario, London, Ontario, Canada

    Paul Vrbik

Authors
  1. Jan Vrbik
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Paul Vrbik
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Vrbik, J., Vrbik, P. (2013). Finite Markov Chains II. In: Informal Introduction to Stochastic Processes with Maple. Universitext. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-4057-4_3

Download citation

Publish with us

Policies and ethics

Search

Navigation