Advertisement

International Journal of Game Theory

, Volume 26, Issue 3, pp 303–314 | Cite as

Cyclic Markov equilibria in stochastic games

  • Janos Flesch
  • Frank Thuijsman
  • Koos Vrieze
Article

Abstract

We examine a three-person stochastic game where the only existing equilibria consist of cyclic Markov strategies. Unlike in two-person games of a similar type, stationary ε-equilibria (ε > 0) do not exist for this game. Besides we characterize the set of feasible equilibrium rewards.

Keywords

Economic Theory Game Theory Similar Type Stochastic Game Markov Strategy 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Blackwell D (1962) Discrete dynamic programming. Ann Math Statist 33: 719–726Google Scholar
  2. Evangelista FS, Raghavan TES, Vrieze OJ (1994) ARAT repeated games with absorbing states. Mimeo, University of Illinois at ChicagoGoogle Scholar
  3. Filar JA (1984) On stationary equilibria of a single controller stochastic game. Mathematical Programming 30: 313–325Google Scholar
  4. Flesch J, Thuijsman F, Vrieze OJ (1995) Recursive repeated games with absorbing states. Report M95-05, University of Limburg, MaastrichtGoogle Scholar
  5. Hordijk A, Vrieze OJ, Wanrooij GL (1983) Semi-Markov strategies in stochastic games. Int J Game Theory 12: 81–89Google Scholar
  6. Mertens JF, Neyman A (1981) Stochastic games. Int J Game Theory 10: 53–66Google Scholar
  7. Parthasarathy T, Tijs SH, Vrieze OJ (1984) Stochastic games with state independent transitions and separable rewards. In: Hammer G, Palaschke D (eds.) Selected Topics in Operations Research and Mathematical Economics, Springer Verlag, Berlin 262–271Google Scholar
  8. Rogers PD (1969) Non-zerosum stochastic games. PhD thesis, report ORC 69-8, Operations Research Center, University of California, BerkeleyGoogle Scholar
  9. Sobel MJ (1971) Noncooperative stochastic games. Ann Math Statist 42: 1930–1935Google Scholar
  10. Stern MA (1975) On stochastic games with limiting average payoff. PhD thesis, University of Illinois at ChicagoGoogle Scholar
  11. Thuijsman F, Raghavan TES (1994) Stochastic games with switching control or ARAT structure. Report M94-06, University of Limburg, MaastrichtGoogle Scholar
  12. Thuijsman F, Vrieze OJ (1991) Easy initial states in stochastic games. In: Raghavan TES et al (eds) Stochastic Games and Related Topics. Kluwer Academic Publishers, Dordrecht 85–100Google Scholar
  13. Thuijsman F, Vrieze OJ (1994) The power of threats in stochastic games. Report M94-05, University of Limburg, MaastrichtGoogle Scholar
  14. Vrieze OJ, Thuijsman F (1989) On equilibria in repeated games with absorbing states. Int J Game Theory 18: 293–310Google Scholar

Copyright information

© Physica-Verlag 1997

Authors and Affiliations

  • Janos Flesch
    • 1
  • Frank Thuijsman
    • 1
  • Koos Vrieze
    • 1
  1. 1.Department of MathematicsUniversity of LimburgMD MaastrichtThe Netherlands

Personalised recommendations