Abstract
In this chapter we investigate several examples and models with finite transition law: an allocation problem with random investment, an inventory problem, MDPs with an absorbing set of states, MDPs with random initial state, stopping problems and terminating MDPs. Finally, stationary MDPs are generalized to non-stationary MDPs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ahlswede, R., & Wegener, I. (1979). Suchprobleme. Stuttgart: B. G. Teubner.
Cairns, S. S. (1963). Balance scale sorting. The American Mathematical Monthly, 70, 136–148.
Coolidge, J. L. (1909). The gambler’s ruin. Annals of Mathematics (2), 10, 181–192.
Dubins, L. E., & Savage, L. J. (1976). Inequalities for stochastic processes (how to gamble if you must). New York: Dover Publications Inc. Corrected republication of the 1965 edition.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this chapter
Cite this chapter
Hinderer, K., Rieder, U., Stieglitz, M. (2016). Examples of Markovian Decision Processes with Finite Transition Law. In: Dynamic Optimization. Universitext. Springer, Cham. https://doi.org/10.1007/978-3-319-48814-1_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-48814-1_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-48813-4
Online ISBN: 978-3-319-48814-1
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)