Lyapunov Functions and Martingales
The present chapter contains a potpourri of topics around potential theory and martingale theory. More exactly, it is a brief introduction to these topics, with the limited purpose of showing the power of martingale theory and the rich interplay between probability and analysis. An important aspect of this chapter concerns the various results complementing the study of recurrence of Chapter 3. In this respect, the single most important result is Foster’s theorem below.
KeywordsLyapunov Function Transition Matrix Repair Shop Martingale Theory Symmetric Random Walk
Unable to display preview. Download preview PDF.