Simulation-Based Optimization pp 133-210 | Cite as

Control Optimization with Stochastic Dynamic Programming

• Authors
• Authors and affiliations

• Abhijit Gosavi

Chapter

• 1k Downloads

Part of the Operations Research/Computer Science Interfaces Series book series (ORCS, volume 25)

Abstract

This chapter focuses on a problem of control optimization — namely, the Markov decision problem. Our discussions will be at a very elementary level, and we will not attempt to prove any theorems.

Keywords

Transition Probability Matrix Stochastic Game Bellman Equation Policy Iteration Average Reward 

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Copyright information

© Springer Science+Business Media New York 2003

Authors and Affiliations

• Abhijit Gosavi
  • 1

1. 1.Department of Industrial EngineeringThe State University of New YorkBuffaloUSA