Long Run Behavior
Consider an HMC that is irreducible and positive recurrent. In particular, if its initial distribution is the stationary distribution, it keeps the same distribution at all times. The chain is then said to be in the stationary regime, or in equilibrium, or in steady state.
KeywordsTransition Matrix Transient State Fundamental Matrix Renewal Time Renewal Equation
Unable to display preview. Download preview PDF.