Skip to main content
Log in

The challenge of non-zero-sum stochastic games

  • Original Paper
  • Published:
International Journal of Game Theory Aims and scope Submit manuscript

Abstract

For a broad definition of time-discrete stochastic games, their zero-sum varieties have values. But the existence of \(\epsilon \)-equilibrium for the corresponding non-zero-sum games has proven elusive. We present the problems associated with \(\epsilon \)-equilibria in non-zero-sum stochastic games, from both the perspectives of proving existence and demonstrating a counter-example.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Everett H (1957) “Recursive Games”, in Dresher, M., Tucker, A., and Wolfe, P. (Eds), Contributions to the Theory of Games III, (Annals of Mathematical Studies), 39:47-78

  • Flesch J, Thuijsman F, Vrieze OJ (1997) Cyclic Markov equilibria in a cubic game. Int J Game Theory 26:303–314

    Article  Google Scholar 

  • Flesch J, Thuijsman F, Vrieze OJ (2000) Almost stationary epsilon-equilibria in zero-sum stochastic games. J Optim Theory Appl 105(2):371–389

    Article  Google Scholar 

  • Gale D, Stewart F (1953) Infinite games with perfect information, In: Contributions to the Theory of Games II. Princeton University Press, Princeton

  • Gobbino M, Simon RS (2013) How many times can a function be iterated? J Differ Equ Appl 19(2):332–354

    Article  Google Scholar 

  • Kohlberg E, Mertens J-F (1986) On the strategic stability of equilibria. Econometrica 54(5):1003–1037

    Article  Google Scholar 

  • Laraki R, Solan E, Vielle N (2005) Continuous-time games of timing. J Econ Theory 120(2):206–238

    Article  Google Scholar 

  • Maitra A, Sudderth W (1998) Finitely additive stochastic games with borel measurable payoffs. Int J Game Theory 27(2):257–267

    Article  Google Scholar 

  • Maitra A, Sudderth W (2003) Stochastic games with borel payoffs. In: Neyman A, Sorin S (eds) Stochastic games and applications, NATO Science Series C, Mathematical and Physical Sciences, vol 570, Chapter 24, pp 367–373

  • Martin D (1975) Borel determinacy. Ann Math 102:363–371

    Article  Google Scholar 

  • Martin D (1998) The determinacy of blackwell games. J Symbol Logic 63:1565–1581

    Article  Google Scholar 

  • Mertens J-F (1986) Repeated games. In: Proceedings of the International Congress of Mathematicians, Berkeley. American Mathematical Society, Providence, pp 1528–1577

  • Mertens JF, Neyman A (1981) Stochastic games. Int J Game Theory 10:53–66

    Article  Google Scholar 

  • Shapley LS (1953) Stochastic games. Proc Natl Acad Sci USA 39:1095–1100

    Article  Google Scholar 

  • Simon RS (2012) A topological approach to quitting games. Math Oper Res 37(1):180–195

    Article  Google Scholar 

  • Simon RS (2007) The structure of non-zero-sum stochastic games. Adv Appl Math 38(1):1–26

    Article  Google Scholar 

  • Simon RS (2006) Value and perfection in stochastic games. Isr J Math 156(1):285–310

    Article  Google Scholar 

  • Shmaya E, Solan E (2004) Two-player non zerosum stopping games in discrete time. Ann Probab 32(3B):2733–2764

    Article  Google Scholar 

  • Solan E (1999) Three-player absorbing games. Math Oper Res 24:669–698

    Article  Google Scholar 

  • Solan E (2001) The dynamics of the Nash correspondence and n-player stochastic games. Int Game Theory Rev 3(4):291–299

    Article  Google Scholar 

  • Solan E, Vieille N (2001) Quitting games. Math Oper Res 26:265–285

    Article  Google Scholar 

  • Solan E, Vieille N (2003) Quitting games—an example. Int J Game Theory 31:365–381

    Article  Google Scholar 

  • Thuijsman F, Vrieze (1989) On equilibria in repeated games with absorbing states. Int J Game Theory 18(3):293–310

    Article  Google Scholar 

  • Vieille N (2000a) Two-player stochastic games I: a reduction. Isr J Math 119:55–91

    Article  Google Scholar 

  • Vieille N (2000b) Two-player stochastic games II: the case of recursive games. Isr J Math 119:92–126

    Google Scholar 

  • Vieille N (2000c) Small perturbations and stochastic games. Isr J Math 119:127–142

    Article  Google Scholar 

  • Xu Z (2011) A stochastic Ramsey theorem. J Combin Theory Ser A 118(4):1392–1409

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Robert Samuel Simon.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Simon, R.S. The challenge of non-zero-sum stochastic games. Int J Game Theory 45, 191–204 (2016). https://doi.org/10.1007/s00182-015-0497-3

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00182-015-0497-3

Keywords

Navigation