Stochastic Processes (iii): Markov Chains

  • Warren J. Ewens
  • Gregory R. Grant
Part of the Statistics for Biology and Health book series (SBH)


Introductory aspects of the theory of Markov chains were discussed in Chapter 4. In the present chapter further details of the theory of Markov chains will be discussed, first for Markov chains with no absorbing states and second for Markov chains with absorbing states. Our analysis of finite Markov chain theory is often oversimplified, since an examination of some of the subtleties involved in the full theory is not appropriate for bioinformatics. A recent and more complete exposition of the theory can be found in Norris (1997).


Markov Chain Stationary Distribution Transition Matrix Relative Entropy Spectral Expansion 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer Science+Business Media New York 2001

Authors and Affiliations

  • Warren J. Ewens
    • 1
  • Gregory R. Grant
    • 2
  1. 1.Department of BiologyUniversity of PennsylvaniaPhiladelphiaUSA
  2. 2.Penn Center for Computational BiologyUniversity of PennsylvaniaPhiladelphiaUSA

Personalised recommendations