Abstract
This paper considers discounted noncooperative stochastic games with uncountable state space and compact metric action spaces. We assume that the transition law is absolutely continuous with respect to some probability measure defined on the state space. We prove, under certain additional continuity and integrability conditions, that such games have ε-equilibrium stationary strategies for each ε>0. To prove this fact, we provide a method for approximating the original game by a sequence of finite or countable state games. The main result of this paper answers partially a question raised by Parthasarathy in Ref. 1.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Parthasarathy, T.,Existence of Equilibrium Stationary Strategies in Discounted Stochastic Games, Sankhyā: The Indian Journal of Statistics, Vol. 44, pp. 114–127, 1982.
Himmelberg, C. J., Parthasarathy, T., Raghavan, T. E. S., andVan Vleck, F. S.,Existence of p-Equilibrium and Optimal Stationary Strategies in Stochastic Games, Proceedings of the American Mathematical Society, Vol. 60, pp. 245–251, 1976.
Rieder, U.,Equilibrium Plans for Nonzero-Sum Markov Games, Game Theory and Related Topics, Edited by O. Moeschlin and D. Pallaschke, North-Holland, Amsterdam, Holland, 1979.
Whitt, W.,Representation and Approximation of Noncooperative Sequential Games, SIAM Journal on Control and Optimization, Vol. 18, pp. 33–48, 1980.
Dubins, L. E., andFreedman, D.,Measurable Sets of Measures, Pacific Journal of Mathematics, Vol. 14, pp. 1211–1222, 1965.
Neveu, J.,Mathematical Foundations of the Calculus of Probability, Holden-Day, San Francisco, California, 1965.
Nowak, A. S.,On Zero-Sum Stochastic Games with General State Space, I, Probability and Mathematical Statistics, Vol. 4, pp. 13–32, 1984.
Blackwell, D.,Discounted Dynamic Programming, Annals of Mathematical Statistics, Vol. 36, pp. 226–235, 1965.
Parthasarathy, T., andStern, M.,Markov Games: A Survey, University of Illinois, Chicago, Illinois, 1976.
Tijs, S. H.,Stochastic Games with One Big Action Space in Each State, Methods of Operations Research, Vol. 38, pp. 161–173, 1980.
Takahashi, M.,Equilibrium Points of Stochastic Noncooperative n-Person Games, Journal of Science of the Hiroshima University, Ser. A-I, Vol. 28, pp. 95–99, 1964.
Federgruen, A.,On N-Person Stochastic Games with Denumerable State Space, Advances in Applied Probability, Vol. 10, pp. 452–471, 1978.
Parthasarathy, K. R.,Probability Measures on Metric Spaces, Academic Press, New York, New York, 1967.
Author information
Authors and Affiliations
Additional information
Communicated by Y. C. Ho
Rights and permissions
About this article
Cite this article
Nowak, A.S. Existence of equilibrium stationary strategies in discounted noncooperative stochastic games with uncountable state space. J Optim Theory Appl 45, 591–602 (1985). https://doi.org/10.1007/BF00939136
Issue Date:
DOI: https://doi.org/10.1007/BF00939136