Skip to main content

Average Optimality for Unbounded Rewards

  • Chapter
  • First Online:
Continuous-Time Markov Decision Processes

Part of the book series: Stochastic Modelling and Applied Probability ((SMAP,volume 62))

  • 3452 Accesses

Abstract

In Chap. 7, we study the EAR criterion for the same MDP model as in Chap. 6. After briefly introducing some basic facts in Sect. 7.2, we establish the average reward optimality equation and the existence of EAR optimal policies in Sect. 7.3. In Sect. 7.4, we provide a policy iteration algorithm for computing or at least approximating an EAR optimal policy. Finally, we illustrate the results in this chapter with several examples in Sect. 7.5.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 119.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Xianping Guo or Onésimo Hernández-Lerma .

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Guo, X., Hernández-Lerma, O. (2009). Average Optimality for Unbounded Rewards. In: Continuous-Time Markov Decision Processes. Stochastic Modelling and Applied Probability, vol 62. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02547-1_7

Download citation

Publish with us

Policies and ethics