Skip to main content

Markov Processes

  • Reference work entry
  • First Online:
The New Palgrave Dictionary of Economics
  • 52 Accesses

Abstract

In this article the theory of Markov processes is described as an evolution on the space of probability measures. Following a brief historical account of its origins in physics, a mathematical formulation of the theory is given. Emphasis has been placed on the ergodic properties of Markov processes, and their presence is checked in a simple example.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 6,499.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 8,499.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Bibliography

Elementary Texts

  • Karlin, S., and H. Taylor. 1975. A first course in stochastic processes. 2nd ed. New York: Academic Press.

    Google Scholar 

  • Norris, J. 1997. Markov chains. Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge: Cambridge University Press.

    Google Scholar 

  • Stroock, D. 2005. An introduction to Markov processes. Graduate Text Series No. 230. Heidelberg: Springer-Verlag.

    Google Scholar 

Advanced Texts

  • Dynkin, E. 1965. Markov processes, vols. 1 and 2. Grundlehren Nos. 121 and 122. Heidelberg: Springer-Verlag.

    Google Scholar 

  • Ethier, S., and T. Kurtz. 1986. Markov processes: Characterization and convergence. New York: Wiley.

    Book  Google Scholar 

  • Revuz, D. 1984. Markov chains. North-Holland Mathematical Library, vol. 11. Amsterdam and New York: North-Holland.

    Google Scholar 

  • Stroock, D. 2003. Markov processes from K. Itôs perspective. Annals of Mathematical Studies No. 155. Princeton: Princeton University Press.

    Google Scholar 

Physics Texts

  • Boltzmann, L. 1896, 1898. Lectures on gas theory,vols. 2, Trans. S. Brush. New York: Dover Publications, 1995.

    Google Scholar 

  • Gibbs, J. 1902. Elementary principles in statistical mechanics. New York: Scribner.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Copyright information

© 2018 Macmillan Publishers Ltd.

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Stroock, D.W. (2018). Markov Processes. In: The New Palgrave Dictionary of Economics. Palgrave Macmillan, London. https://doi.org/10.1057/978-1-349-95189-5_2668

Download citation

Publish with us

Policies and ethics