Abstract
We study infinite stochastic games played by n-players on a finite graph with goals given by sets of infinite traces. The games are stochastic (each player simultaneously and independently chooses an action at each round, and the next state is determined by a probability distribution depending on the current state and the chosen actions), infinite (the game continues for an infinite number of rounds), nonzero sum (the players’ goals are not necessarily conflicting), and undiscounted. We show that if each player has a reachability objective, that is, if the goal for each player i is to visit some subset R i of the states, then there exists an ε-Nash equilibrium in memoryless strategies, for every ε >0. However, exact Nash equilibria need not exist. We study the complexity of finding such Nash equilibria, and show that the payoff of some ε-Nash equilibrium in memoryless strategies can be ε-approximated in NP.
We study the important subclass of n-player turn-based probabilistic games, where at each state at most one player has a nontrivial choice of moves. For turn-based probabilistic games, we show the existence of ε-Nash equilibria in pure strategies for games where the objective of player i is a Borel set B i of infinite traces. However, exact Nash equilibria may not exist. For the special case of ω-regular objectives, we show exact Nash equilibria exist, and can be computed in NP when the ω-regular objectives are expressed as parity objectives.
This research was supported in part by the AFOSR MURI grant F49620-00-1-0327, ONR grant N00014-02-1-0671, NSF grants CCR-9988172 and CCR-0225610.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Blackwell, D., Ferguson, T.S.: The big match. Annals of Mathematical Statistics 39, 159–163 (1968)
Chatterjee, K., Jurdziński, M., Henzinger, T.A.: Quantitative stochastic parity games. In: SODA 2004, pp. 114–123 (2004)
Condon, A.: The complexity of stochastic games. Information and Computation 96(2), 203–224 (1992)
Conitzer, V., Sandholm, T.: Complexity results about Nash equilibria. In: IJCAI 2003, pp. 765–771 (2003)
de Alfaro, L., Henzinger, T.A., Kupferman, O.: Concurrent reachability games. In: FOCS 1998, pp. 564–575. IEEE Computer Society Press, Los Alamitos (1998)
de Alfaro, L., Majumdar, R.: Quantitative solution of omega-regular games. In: STOC 2001, pp. 675–683. ACM Press, New York (2001)
Emerson, E.A., Jutla, C.: Tree automata, mu-calculus and determinacy. In: FOCS 1991, pp. 368–377. IEEE Computer Society Press, Los Alamitos (1991)
Everett, H.: Recursive games. Contributions to the Theory of Games III. Annals of Mathematical Studies 39, 47–78 (1957)
Filar, J., Vrieze, K.: Competitive Markov Decision Processes. Springer, Heidelberg (1997)
Fink, A.M.: Equilibrium in a stochastic n-person game. Journal of Science of Hiroshima University 28, 89–93 (1964)
Nash Jr., J.F.: Equilibrium points in n-person games. In: Proceedings of the National Academny of Sciences, USA, vol. 36, pp. 48–49 (1950)
Kechris, A.: Classical Descriptive Set Theory. Springer, Heidelberg (1995)
Kumar, P.R., Shiau, T.H.: Existence of value and randomized strategies in zero-sum discrete-time stochastic dynamic games. SIAM J. Control and Optimization 19(5), 617–634 (1981)
Lipton, R.J., Markakis, E., Mehta, A.: Playing large games using simple strategies. In: EC 2003, pp. 36–41. ACM Press, New York (2003)
Maitra, A., Sudderth, W.D.: Borel stay-in-a-set games. International Journal of Game Theory 32, 97–108 (2003)
Manna, Z., Pnueli, A.: The Temporal Logic of Reactive and Concurrent Systems: Specification. Springer, Heidelberg (1992)
Martin, D.A.: Borel determinacy. Annals of Mathematics 102(2), 363–371 (1975)
Martin, D.A.: The determinacy of Blackwell games. The Journal of Symbolic Logic 63(4), 1565–1581 (1998)
Owen, G.: Game Theory. Academic Press, London (1995)
Papadimitriou, C.H.: On the complexity of the parity argument and other inefficient proofs of existence. JCSS 48(3), 498–532 (1994)
Papadimitriou, C.H.: Algorithms, games, and the internet. In: STOC 2001, pp. 749–753. ACM Press, New York (2001)
Raghavan, T.E.S., Filar, J.A.: Algorithms for stochastic games — a survey. ZOR — Methods and Models of Operations Research 35, 437–472 (1991)
Secchi, P., Sudderth, W.D.: Stay-in-a-set games. International Journal of Game Theory 30, 479–490 (2001)
Shapley, L.S.: Stochastic games. Proc. Nat. Acad. Sci. 39, 1095–1100 (1953)
Sobel, M.: Noncooperative stochastic games. Ann. Math. Stat. 42, 1930–1935 (1971)
Thuijsman, F.: Optimality and Equilibria in Stochastic Games. In: CWI-Tract 82, CWI, Amsterdam (1992)
Thuijsman, F., Raghavan, T.E.S.: Perfect information stochastic games and related classes. International Journal of Game Theory 26, 403–408 (1997)
Vieille, N.: Two player stochastic games I: a reduction. Israel Journal of Mathematics 119, 55–91 (2000)
Vieille, N.: Two player stochastic games II: the case of recursive games. Israel Journal of Mathematics 119, 93–126 (2000)
von Neumann, J., Morgenstern, O.: Theory of games and economic behavior. Princeton University Press, Princeton (1947)
von Stengel, B.: Computing equilibria for two-person games. In: Aumann, R.J., Hart, S. (eds.) Chapter 45, Handbook of Game Theory, ch. 45, vol. 3, pp. 1723–1759 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chatterjee, K., Majumdar, R., Jurdziński, M. (2004). On Nash Equilibria in Stochastic Games . In: Marcinkowski, J., Tarlecki, A. (eds) Computer Science Logic. CSL 2004. Lecture Notes in Computer Science, vol 3210. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30124-0_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-30124-0_6
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23024-3
Online ISBN: 978-3-540-30124-0
eBook Packages: Springer Book Archive