Chapter

Markov Chains

Volume 31 of the series Texts in Applied Mathematics pp 167-193

Lyapunov Functions and Martingales

  • Pierre BrémaudAffiliated withLaboratoire des Signaux et Systèmes, CNRS-ESE

* Final gross prices may vary according to local VAT.

Get Access

Abstract

The present chapter contains a potpourri of topics around potential theory and martingale theory. More exactly, it is a brief introduction to these topics, with the limited purpose of showing the power of martingale theory and the rich interplay between probability and analysis. An important aspect of this chapter concerns the various results complementing the study of recurrence of Chapter 3. In this respect, the single most important result is Foster’s theorem below.