Abstract
Bewley and Kohlberg (Math Oper Res 1(3):197–208, 1976) and Mertens and Neyman (Int J Game Theory 10(2):53–66, 1981) have respectively proved the existence of the asymptotic value and the uniform value in zero-sum stochastic games with finite state space and finite action sets. In their work, the total payoff in a stochastic game is defined either as a Cesaro mean or an Abel mean of the stage payoffs. The contribution of this paper is twofold: first, it generalizes the result of Bewley and Kohlberg (1976) to a more general class of payoff evaluations, and it proves with an example that this new result is tight. It also investigates the particular case of absorbing games. Second, for the uniform approach of Mertens and Neyman, this paper provides an example of absorbing game to demonstrate that there is no natural way to generalize their result to a wider class of payoff evaluations.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bewley T, Kohlberg E (1976) The asymptotic theory of stochastic games. Math Oper Res 1(3):197–208
Blackwell D, Ferguson T (1968) The big match. Ann Math Stat 39(1):159–163
Cardaliaguet P, Laraki R, Sorin S (2012) A continuous time approach for the asymptotic value in two-person zero-sum repeated games. SIAM J Control Optim 50(3):1573–1596
Gillette (1957) Stochastic games with zero stop probabilities. In: Contributions to the theory of games. Princeton University Press, Princeton, pp 179–187
Maitra A, Parthasarathy T (1970) On stochastic games. J Optim Theory Appl 5(4):289–300
Mertens J, Neyman A (1981) Stochastic games. Int J Game Theory 10(2):53–66
Mertens J-F, Neyman A, Rosenberg D (2009) Absorbing games with compact action spaces. Math Oper Res 34(2):257–262
Neyman A, Sorin S (2010) Repeated games with public uncertain duration process. Int J Game Theory 39(1):29–52
Oliu-Barton M (2014) The asymptotic value in finite stochastic games. Math Oper Res 39(3):712–721
Renault J, Venel X (2012) A distance for probability spaces, and long-term values in markov decision processes and repeated games. arXiv:1202.6259
Shapley L (1953) Stochastic games. Proc Natl Acad Sci USA 39(10):1095
Sorin S (2002) A first course on zero-sum repeated games, vol 37. Springer, Berlin
Vigeral G (2013) A zero-sum stochastic game with compact action sets and no asymptotic value. Dyn Games Appl 3(2):172–186
Ziliotto B (2013) Zero-sum repeated games: counterexamples to the existence of the asymptotic value and the conjecture \(\text{ maxmin }= \text{ lim }\, \text{ v }(\text{ n })\). Ann. Probab. arXiv:1305.4778 (2015, to appear)
Acknowledgments
I would like to thank Jérôme Renault, Sylvain Sorin, Rida Laraki, and Fabien Gensbittel for their interesting suggestions.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ziliotto, B. General limit value in zero-sum stochastic games. Int J Game Theory 45, 353–374 (2016). https://doi.org/10.1007/s00182-015-0509-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00182-015-0509-3