Skip to main content

Positive Stochastic Games and a Theorem of Ornstein

  • Chapter
Stochastic Games And Related Topics

Part of the book series: Theory and Decision Library ((TDLC,volume 7))

Abstract

Stochastic games were first formulated by Shapley in 1953. In his fundamental paper Shapley [13] established the existence of value and optimal stationary strategies for zero-sum β-discounted stochastic games with finitely many states and actions for the two players.

*

This research was partially supported by the N.S.F. Grant DMS 8601403

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Blackwell, D. (1967). Positive Dynamic Programming. Proc. Fifth Berkeley Symp. Math. Stat. Prob., 2, 415–418. University of California Press.

    Google Scholar 

  2. Blackwell, D. and T. S. Ferguson (1968). The Big Match, Ann. Math. Stat., 39, 159–163.

    Article  Google Scholar 

  3. Bromwich, T. J. I. A. (1926). “An Introduction to the Theory of Infinite Series”, 2nd Edition, McMillan and Company, London.

    Google Scholar 

  4. Van Dawen, R. (1984). On Stationary Strategies in Positive Stochastic One and Two Person Games with General State Space. Z. Angew. Math. Mech., 64, 327–328.

    Article  Google Scholar 

  5. Frid, E. B. (1973). On Stochastic Games. Theory Probability and Appl., 18, 389–393.

    Article  Google Scholar 

  6. Himmelberg, C. J., T. Parthasarathy, T. E. S. Raghavan and F. S. Van Vleck (1976). Existence of p-Equilibrium and Optimal Stationary Strategies in Stochastic Games. Proc. Amer. Math. Soc., 60, 245–251.

    Google Scholar 

  7. Kamerud. D. B. (1975). Repeated Games and Positive Stochastic Games, Ph.D. Dissertation, University of Minnesota.

    Google Scholar 

  8. Kumar, P. R. and T. H. Shiau (1981). Existence of Value and Randomized Strategies in Zero-Sum Discrete Time Stochastic Dynamic games. SIAM J. Control Optim., 19, 617–634.

    Article  Google Scholar 

  9. Nowak, A. S. (1985). Universally Measurable Strategies in Zero-Sum Stochastic Games. Am. Prob., 13, 269–287.

    Article  Google Scholar 

  10. Ornstein, D. (1969). On the Existence of Stationary Optimal Strategies. Proc. Amer. Math. Soc, 20, 563–569.

    Article  Google Scholar 

  11. Rieder, U. (1978). On Semi-Continuous Dynamic Games. Technical Report, University of Karlsruhe.

    Google Scholar 

  12. Ross, S.M. (1981). Introduction to Probability Models. Academic Press, New York.

    Google Scholar 

  13. Shapley, L. S. (1953). Stochastic Games, Proc. Nat. Acad. Sci., U.S.A., 39, 1095–1100.

    Article  Google Scholar 

  14. Van der Wal, J. (1981). Stochastic Dynamic Programming. Math. Centre Tract, 139, Mathematische Centrum, Amsterdam.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1991 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Nowak, A.S., Raghavan, T.E.S. (1991). Positive Stochastic Games and a Theorem of Ornstein. In: Raghavan, T.E.S., Ferguson, T.S., Parthasarathy, T., Vrieze, O.J. (eds) Stochastic Games And Related Topics. Theory and Decision Library, vol 7. Springer, Dordrecht. https://doi.org/10.1007/978-94-011-3760-7_11

Download citation

  • DOI: https://doi.org/10.1007/978-94-011-3760-7_11

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-010-5673-1

  • Online ISBN: 978-94-011-3760-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics