Article PDF
References
Ash, R.B.: Real Analysis and Probability. New York: Academic Press 1972
Blackwell, D.: Discounted dynamic programming. Ann. Math. Statist. 36, 226–235 (1965)
Blackwell, D.: On stationary policies. J. Royal Statist. Soc. 133, 33–37 (1971)
Dubins, L.E., Savage, L.J.: How to gamble if you must. New York: McGraw-Hill 1965
Furukawa, N.: Markovian decision processes with compact action spaces. Ann. Math. Statist. 43, 1612–1622 (1972)
Hinderer, K.: Foundations of non-stationary dynamic programming with discrete time-parameter. Lecture Notes in Operations Research and Mathematical Systems, vol. 33. Berlin-Heidelberg-New York: Springer 1970
Hinderer, K.: InstationÄre dynamische Optimierung bei schwachen Voraussetzungen über die Gewinnfunktionen. Abh. math. Sem. Univ. Hamburg 36, 208–223 (1971)
Hordijk, A.: Dynamic Programming and Markov Potential Theory. Amsterdam: Mathematical Centre Tracts 51, 1974
Kuratowski, K.: Topology I. New York: Academic Press 1966
Kuratowski, K.: Topology II. New York: Academic Press 1968
Maitra, A.: Discounted dynamic programming on compact metric spaces. Sankhya 30, Ser. A, 211–216 (1968)
Michael, E.: Topologies on spaces of subsets. Trans. Amer. Math. Soc. 71, 152–182 (1951)
Rieder, U.: Bayesian dynamic programming (To be published)
Rieder, U.: On stopped decision processes with discrete time parameter (To be published)
SchÄl, M.: Ein verallgemeinertes stationÄres Entscheidungsmodell der dynamischen Optimierung. Vol. X, 145–162: Methods of operations research, ed. R. Henn. Meisenheim: Anton Hain 1971
SchÄl, M.: On continuous dynamic programming with discrete time-parameter. Z. Wahrscheinlichkeitstheorie verw. Geb. 21, 279–288 (1972)
SchÄl, M.: Dynamische Optimierung unter Stetigkeits- und Kompaktheitsbedingungen. Habilitationsschrift, Univ. Hamburg 1972
SchÄl, M.: A selection theorem for optimization problems. Arch. Math. XXV, 219–224 (1974)
SchÄl, M.: On dynamic programming: compactness of the space of policies (To appear in Stochastic Processes Appl. A summary of this paper may be found in [20])
SchÄl, M.: Dynamic programming under continuity and compactness assumptions. Advances Appl. Probability 5, 28–29 (1973)
Strauch, R.E.: Negative dynamic programming. Ann. Math. Statist. 37, 871–890 (1966)
Sudderth, W.D.: On the Dubins and Savage characterization of optimal strategies. Ann. Math. Statist. 43, 498–507 (1972)
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
SchÄl, M. Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal. Z. Wahrscheinlichkeitstheorie verw Gebiete 32, 179–196 (1975). https://doi.org/10.1007/BF00532612
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF00532612