Abstract
This paper discusses the problem regarding the existence of optimal or nearly optimal stationary strategies for a player engaged in a nonleavable stochastic game. It is known that, for these games, player I need not have an ɛ-optimal stationary strategy even when the state space of the game is finite. On the contrary, we show that uniformly ɛ-optimal stationary strategies are available to player II for nonleavable stochastic games with finite state space. Our methods will also yield sufficient conditions for the existence of optimal and ɛ-optimal stationary strategies for player II for games with countably infinite state space. With the purpose of introducing and explaining the main results of the paper, special consideration is given to a particular class of nonleavable games whose utility is equal to the indicator of a subset of the state space of the game.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Breiman L (1968) Probability. Addison-Wesley, Reading, Massachusetts
Doob JL (1953) Stochastic processes. Wiley, New York
Dubins L, Savage L (1976) Inequalities for stochastic processes: How to gamble if you must. Dover, New York
Everett H (1957) Recursive games. In: Dresher M et al. (ed.) Contributions to the theory of games. III, volume 39 of Annals of Mathematical Studies, Princeton University Press, New Jersey, pp. 47–78
Kumar PR, Shiau TH (1981) Existence of value and randomized strategies in zero-sum discrete time stochastic dynamic games. Siam J. Control and Optimization 19(5):617–634
Maitra A, Sudderth W (1992) An operator solution of stochastic games. Israel Journal of Mathematics 78:33–49
— (1996) Discrete gambling and stochastic games. Springer-Verlag, New York
Nowak AS, Raghavan TES (1991) Positive stochastic games and a theorem of Ornstein. In: Raghavan TES et al. (ed.) Stochastic games and related topics, Kluwer Academic Press. The Netherlands, pp. 127–134
Sudderth WD (1969) On measurable, nonleavable gambling houses with a goal. The Annals of Mathematical Statistics 40(1):66–70
— (1971) On measurable gambling problems. Annals of Mathematical Statistics 42:260–269
Thuijsman F, Vrieze K (1992) Note on recursive games. In: Dutta B et al. (ed.) Game theory and economic applications, volume 389 of Lecture Notes in Economics and Mathematical Systems, Springer-Verlag, Berlin, pp. 133–145
von Neumann J, Morgenstern O (1947) Theory of games and economic behavior. Princeton University Press, New Jersey
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Secchi, P. On the existence of good stationary strategies for nonleavable stochastic games. Int J Game Theory 27, 61–81 (1998). https://doi.org/10.1007/BF01243195
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF01243195