Abstract
A class of stochastic games with additive reward and transition structure is studied. For zero-sum games under some ergodicity assumptions 1-equilibria are shown to exist. They correspond to so-called sensitive optimal policies in dynamic programming. For a class of nonzero-sum stochastic games with nonatomic transitions nonrandomized Nash equilibrium points with respect to the average payoff criterion are also obtained. Included examples show that the results of this paper can not be extented to more general payoff or transition structure.
Similar content being viewed by others
References
Basar T, Olsder GJ (1995) Dynamic noncooperative games. Academic Press, New York
Blackwell D (1962) Discrete dynamic programming. Ann Math Statist 33: 719–726
Brown LD, Purves R (1973) Measurable selections of extrema. Ann Statist 1: 902–912
Cavazos-Cadena R, Lasserre JB (1988) Strong 1-optimal stationary policies in denumerable Markov decision processes. Syst Control Lett 11: 65–71
Flynn J (1976) Conditions for the equivalence of optimality criteria in dynamic programming. Ann Statist 4: 936–953
Hernández-Lerma O, Lasserre JB (1999) Further topics on discrete-time markov control process. Springer-Verlag, Berlin Heidelberg New York
Himmelberg CJ, Parthasarathy T, Raghavan TES, van Vleck FS (1976) Existence of p-equilibrium and optimal stationary strategies in stochastic games. Proc Amer Math Soc 60: 245–251
Jaśkiewicz A (2000) On strong 1-optimal policies in Markov control processes with Borel state spaces. Bull Polish Acad Sci, Ser Math 48: 439–450
Küenle H-U (1999) Equilibrium strategies in stochastic games with additive cost and transition structure. Internat. Game Theory Rev 1: 131–147
Meyn SP, Tweedie RL (1993) Markov chains and stochastic stability. Springer-Verlag, Berlin Heidelberg New York
Nowak AS (1999a) Sensitive equilibria for ergodic stochastic games with countable state spaces. Math Meth Oper Res 50: 65–76
Nowak AS (1999b) Optimal strategies in a class of zero-sum ergodic stochastic games. Math Meth Oper Res 50: 399–419
Nowak AS (2006) A note on an equilibrium in the great fish war game. Econ Bull 17(2): 1–10
Nowak AS, Jaśkiewicz A (2005) Nonzero-sum semi-Markov games with the expected average payoffs. Math Meth Oper Res 62: 23–40
Nowak AS, Raghavan TES (1992) Existence of stationary correlated equilibria with symmetric information for discounted stochastic games. Math Oper Res 17: 519–526
Raghavan TES, Tijs SH, Vrieze OJ (1985) On stochastic games with additive reward and transition structure. J Optim Theory Appl 47: 451–464
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Nowak, A.S. Remarks on sensitive equilibria in stochastic games with additive reward and transition structure. Math Meth Oper Res 64, 481–494 (2006). https://doi.org/10.1007/s00186-006-0090-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00186-006-0090-4