Abstract
In this section we define a homogeneous Markov process with values in a finite state space. We can assume that the state space X is the set of the first r positive integers, that is \(X =\{ 1,\ldots, r\}\).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Koralov, L., Sinai, Y.G. (2012). Markov Processes with a Finite State Space. In: Theory of Probability and Random Processes. Universitext. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-68829-7_14
Download citation
DOI: https://doi.org/10.1007/978-3-540-68829-7_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25484-3
Online ISBN: 978-3-540-68829-7
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)