Abstract
In this paper we study the problem of the existence of Nash equilibria in pure and mixed stationary strategies for average stochastic positional games. We prove the existence of Nash equilibria in pure stationary strategies for an arbitrary two-player zero-sum average stochastic positional game and for an m-player average stochastic positional game in the case when the probability transition matrices induced by any profile of stationary strategies of the players are unichain. For the general case of an m-player average stochastic positional game we show that a Nash equilibrium in pure stationary strategies may not exist, however a Nash equilibrium always exists in mixed stationary strategies. Based on the proof of these results we present conditions for determining the optimal strategies of the players in the considered average stochastic positional games.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alpern, S.: Cycles in extensive form perfect information games. J. Math. Anal. Appl. 159, 1–17 (1991)
Codon, A.: The complexity of stochastic games. Inf. Comput. 96(2), 203–224 (1992)
Dasgupta, P., Maskin, E.: The existence of equilibrium in discontinuous economic games. Rev. Econ. Stud. 53, 1–26 (1986)
Ehrenfeucht, A., Mycielski, J.: Positional strategies for mean payoff games. Int. J. Game Theory 8, 109–113 (1979)
Fan, K.: Application of a theorem concerned sets with convex sections. Math. Ann. 1963, 189–203 (1966)
Flesch, J., Thuijsman, F., Vrieze, K.: Cyclic Markov equilibria in stochastic games. Int. J. Game Theory 26, 303–314 (1997)
Gurvich, V., Karzaniv, A., Khachyan, L.: Cyclic games and an algorithm to find minimax mean cyclles in directed graphs. USSR Comput. Math. Math. Phys. 28, 85–91 (1988)
Lozovanu, D.: The game theoretical approach to Markov decision problems and determining Nash equilibria for stochastic positional games. Int. J. Math. Model. Numer. Optim. 2(2), 162–174 (2011)
Lozovanu, D.: Stationary Nash equilibria for average stochastic positional games. In: Petrosyan, L.A., et al. (eds), Frontiers of Dynamic Games, Static and Dynamic Games Theory: Fondation and Applications, pp. 139–163. Springer, Birkhauser (2018)
Lozovanu, D., Pickl, S.: Nash equilibria conditions for cyclic games with p players. Electron Notes Discrete Math. 25, 117–124 (2006)
Lozovanu, D., Pickl, S.: Optimization and Multiobjective Control of Time-Discrete Systems. Springer, Berlin (2009)
Lozovanu, D., Pickl, S.: Determining the optimal strategies for zero-sum average stochastic positional games. Electron Notes Discrete Math. 55, 155–159 (2016)
Lozovanu, D., Pickl, S.: Nash equilibria in mixed stationary strategies for m-player mean payoff games on networks. Contrib. Game Theory Manag. 11, 103–112 (2018)
Nash, J.: Non-cooperative games. Ann. Math. 54, 286–293 (1953)
Puterman, M.: Markov Decision Processes: Discrete Dynamic Programming. Wiley, Hoboken (2005)
Rogers, P.: Nonzero-Sum Stochastic Games. Report ORC, PhD thesis, University of California, Berkeley, pp. 69–8 (1966)
Shapley, L.: Stochastic games. Proc. Natl. Acad. Sci. U. S. A. 39, 1095–1100 (1953)
White, D. : Markov Decision processes. Wiley, New York (1993)
Zwick, U., Paterson, M.: The complexity of mean payoff games on graphs. Theor. Comput. Sci. 158, 343–359 (1996)
Acknowledgements
The author is grateful to the referee for useful suggestions and remarks contributing to improve the presentation of the paper.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Lozovanu, D. (2019). Pure and Mixed Stationary Nash Equilibria for Average Stochastic Positional Games. In: Petrosyan, L., Mazalov, V., Zenkevich, N. (eds) Frontiers of Dynamic Games. Static & Dynamic Game Theory: Foundations & Applications. Birkhäuser, Cham. https://doi.org/10.1007/978-3-030-23699-1_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-23699-1_8
Published:
Publisher Name: Birkhäuser, Cham
Print ISBN: 978-3-030-23698-4
Online ISBN: 978-3-030-23699-1
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)