Skip to main content

Zero-Sum Stochastic Games with Borel State Spaces

  • Conference paper
Stochastic Games and Applications

Part of the book series: NATO Science Series ((ASIC,volume 570))

Abstract

The finite state space stochastic game model by Shapley [31] covered in [33] was generalized among others by Maitra and Parthasarathy [17], [33] who considered compact metric state spaces. They imposed rather strong regularity conditions on the reward and transition structure in the game and considered the discounted payoff criterion only. Their results have been generalized by many authors. For a good survey of the results which are not reported here the reader is referred to [14], [23], [25], [27], [13].

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ash, R.B. (1972)Real Analysis and ProbabilityAcademic Press, New York.

    Google Scholar 

  2. Berge, C. (1963)Topological SpacesMcMillan, New York.

    MATH  Google Scholar 

  3. Bertsekas, D.P. and Shreve, S.E. (1978)Stochastic Optimal Control: The Discrete Time CaseAcademic Press, New York.

    MATH  Google Scholar 

  4. Blackwell, D., Freedman, D. and Orkin, M. (1974) The optimal reward operator in dynamic programmingAnnals of Probability2, 926–941.

    Article  MathSciNet  MATH  Google Scholar 

  5. Brown, L.D. and Purves, R. (1973) Measurable selections of extremaAnnals of Statistics 1902–912.

    Article  MathSciNet  MATH  Google Scholar 

  6. Couwenbergh, H.A.M. (1980) Stochastic games with metric state spaceInternational Journal of Game Theory9, 25–36.

    Article  MathSciNet  MATH  Google Scholar 

  7. Fan, K. (1953) Minimax theoremsProceedings of the National Academy of Sciences of the U.S.A.39, 42–47.

    Article  MATH  Google Scholar 

  8. Gödel, K. (1938) The consistency of the axiom of choice and of the generalized continuum hypothesisProceedings of the National Academy of Sciences of the U.S.A.24, 556–557.

    Article  Google Scholar 

  9. Himmelberg, C.J. (1975) Measurable relationsFundamenta Mathematicae87, 5372.

    MathSciNet  Google Scholar 

  10. Himmelberg, C.J. and Van Vleck, F.S. (1975) Multifunctions with values in a space of probability measuresJournal of Mathematical Analysis and Applications50, 108–112.

    Article  MathSciNet  MATH  Google Scholar 

  11. Himmelberg, C.J., Parthasarathy, T. and Van Vleck, F.S. (1976) Optimal plans for dynamic programming problemsMathematics of Operations Research 1390–394.

    Article  MathSciNet  MATH  Google Scholar 

  12. Jaskiewicz, A. (2000) On strong 1-optimal policies in Markov control processes with Borel state spacesBulletin of the Polish Academy of Sciences (ser. Mathematics)48,439–450.

    MathSciNet  MATH  Google Scholar 

  13. Jaskiewicz, A. (2002) Zero-sum semi-Markov gamesSIAM Journal on Control and Optimization41, 723–739.

    Article  MathSciNet  MATH  Google Scholar 

  14. Jaskiewicz, A. and Nowak, A.S. (2001) On the optimality equation for zero-sum ergodic stochastic gamesMathematical Methods of Operations Research54, 291–301.

    Article  MathSciNet  MATH  Google Scholar 

  15. Küenle, H.-U. (1986)Stochastische Spiele und EntscheidungsmodelleTeubnerTexte zur Mathematik 89, Teubner-Verlag, Leipzig.

    Google Scholar 

  16. Leese, S.J. (1978) Measurable selections and the uniformization of the Souslin setsAmerican Journal of Mathematics 10019–41.

    Article  MathSciNet  MATH  Google Scholar 

  17. Maitra, A. and Parthasarathy, T. (1970) On stochastic gamesJournal of Optimization Theory and Applications5, 289–300.

    Article  MathSciNet  MATH  Google Scholar 

  18. Maitra, A. and Parthasarathy, T. (1970) On stochastic games IIJournal of Optimization Theory and Applications8, 154–160.

    Article  MathSciNet  Google Scholar 

  19. Maitra, A. and Sudderth, W.D. (1993) Borel stochastic games with limsup payoffAnnals of Probability21, 861–885.

    Article  MathSciNet  MATH  Google Scholar 

  20. Maitra, A. and Sudderth, W.D. (1993) Finitely additive and measurable stochastic gamesInternational Journal of Game Theory22, 201–223.

    Article  MathSciNet  MATH  Google Scholar 

  21. Maitra, A. and Sudderth, W.D. (1996)Discrete Gambling and Stochastic GamesSpringer—Verlag, New York.

    Book  MATH  Google Scholar 

  22. Nowak, A.S. (1985) Measurable selection theorems for minimax stochastic optimization problemsSIAM Journal on Control and Optimization23, 466–476.

    Article  MathSciNet  MATH  Google Scholar 

  23. Nowak, A.S. (1985) Universally measurable strategies in zero-sum stochastic gamesAnnals of Probability13, 269–287.

    Article  MathSciNet  MATH  Google Scholar 

  24. Nowak, A.S. (1986) Semicontinuous nonstationary stochastic gamesJournal of Mathematical Analysis and Applications117, 84–99.

    Article  MathSciNet  MATH  Google Scholar 

  25. Nowak, A.S. (1990) Semicontinuous nonstationary stochastic games IIJournal of Mathematical Analysis and Applications148, 22–43.

    Article  MathSciNet  MATH  Google Scholar 

  26. Nowak, A.S. (1999) Sensitive equilibria for ergodic stochastic games with countable state spacesMathematical Methods of Operations Research50, 65–76.

    Article  MathSciNet  MATH  Google Scholar 

  27. Nowak, A.S. (1999) Optimal strategies in a class of zero-sum ergodic stochastic gamesMathematical Methods of Operations Research50, 399–419.

    Article  MathSciNet  MATH  Google Scholar 

  28. Nowak, A.S. and Raghavan, T.E.S. (1991) Positive stochastic games and a theorem of Ornstein, in T.E.S. Raghavan et al. (eds.)Stochastic Games and Related Topics Essays in Honor of L.S. Shapley Kluwer Academic Publishers, Dordrecht, pp. 127–134.

    Google Scholar 

  29. Parthasarathy, K.R. (1967)Probability Measures on Metric SpacesAcademic Press, New York.

    MATH  Google Scholar 

  30. Rieder, U. (1978) On semicontinuous dynamic games, Technical Report, Department of Mathematics, University of Karlsruhe, Germany.

    Google Scholar 

  31. Shapley, L.S. (1953) Stochastic gamesProceedings of the National Academy of Sciences of the U.S.A.39, 1095–1100 (Chapter 1 in this volume).

    Article  MathSciNet  MATH  Google Scholar 

  32. Sorin, S. (2003) Classification and basic tools, in A. Neymanand S. Sorin (eds.),Stochastic Games and Applications, NATO Science Series C, Mathematical and Physical Sciences, Vol. 570, Kluwer Academic Publishers, Dordrecht, Chapter 3, pp. 27–35.

    Google Scholar 

  33. Sorin, S. (2003) Discounted stochastic games: The finite case, in A. Neyman and S. Sorin (eds.)Stochastic Games and ApplicationsNATO Science Series C, Mathematical and Physical Sciences, Vol. 570, Kluwer Academic Publishers, Dordrecht, Chapter 5, pp. 51–55.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer Science+Business Media New York

About this paper

Cite this paper

Nowak, A.S. (2003). Zero-Sum Stochastic Games with Borel State Spaces. In: Neyman, A., Sorin, S. (eds) Stochastic Games and Applications. NATO Science Series, vol 570. Springer, Dordrecht. https://doi.org/10.1007/978-94-010-0189-2_7

Download citation

  • DOI: https://doi.org/10.1007/978-94-010-0189-2_7

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-1-4020-1493-2

  • Online ISBN: 978-94-010-0189-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics