Abstract
In this paper, we consider the stochastic games of Shapley, when the state and action spaces are all infinite. We prove that, under certain conditions, the stochastic game has a value and that both players have optimal strategies.
Similar content being viewed by others
References
Shapley, L. S.,Stochastic Games, Proceedings of the National Academy of Sciences, Vol. 39, No. 10, 1953.
Gillette, D.,Stochastic Games with Zero-Stop Probabilities, Annals of Mathematical Studies, No. 39, Princeton University Press, Princeton, New Jersey, 1957.
Hoffmann, A. J., andKarp, R. M.,On Non-Terminating Stochastic Games, Management Science, Vol. 12, No. 6, 1966.
Takahashi, M.,Stochastic Games with Infinitely Many Strategies, Journal of Sciences, Hiroshima University, Vol. 26, No. 2, 1962.
Dubins, L. E., andSavage, L. J.,How to Gamble, If you Must, McGraw-Hill Book Company, New York, 1965.
Maitra, A.,Discounted Dynamic Programming on Compact Metric Spaces, Sankhya, Series A., Vol. 30, No. 2, 1968.
Sion, M.,On General Minimax Theorems, Pacific Journal of Mathematics, Vol. 8, No. 1, 1958.
Blackwell, D.,Discounted Dynamic Programming, Annals of Mathematical Statistics, Vol. 36, No. 1, 1965.
Strauch, R. E.,Negative Dynamic Programming, Annals of Mathematical Statistics, Vol. 37, No. 4, 1966.
Author information
Authors and Affiliations
Additional information
Communicated by D. R. Fulkerson
Part of this research was supported by NSF grant. The authors are indebted to L. S. Shapley for the useful discussions on this and related topics. The authors thank the referee for pointing out an ambiguity in the formulation of Lemma 2.4 in an earlier draft of this article.
Rights and permissions
About this article
Cite this article
Maitra, A., Parthasarathy, T. On stochastic games. J Optim Theory Appl 5, 289–300 (1970). https://doi.org/10.1007/BF00927915
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF00927915