Skip to main content

Easy Initial States in Stochastic Games

  • Chapter
Stochastic Games And Related Topics

Part of the book series: Theory and Decision Library ((TDLC,volume 7))

Abstract

In this paper we deal with limiting average stochastic games with finite state and action spaces. For any nonzero-sum stochastic game of this type, there exists a subset of initial states for which an almost stationary ∈-equilibrium exists. For any zero-sum stochastic game there exists for each player a subset of initial states for which this player has an optimal stationary strategy.

Support was provided by the Netherlands Foundation for Mathematics SMC with financial support by the Netherlands Organization for Scientific Research NWO (project 10-64-10).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bewley, T. and E. Kohlberg (1976). The Asymptotic Theory of Stochastic Games, Math. Oper. Res., 1, 197–208.

    Article  Google Scholar 

  2. Blackwell, D. (1962). Discrete Dynamic Programming, Ann. of Math. Stat., 33, 719–726.

    Article  Google Scholar 

  3. Blackwell, D. and T.S. Ferguson (1968). The Big Match, Ann. of Math. Stat., 39, 159–163.

    Article  Google Scholar 

  4. Fink, A. M. (1964). Equilibrium in a Stochastic n-Person Game, J. of Sci. of Hiroshima Univ., Series A-I 28, 89–93.

    Google Scholar 

  5. Gillette, D. (1957). Stochastic Games with Zero Stop Probabilities, In: M. Dresher, A. W. Tucker and P. Wolfe (eds.), Contributions to the theory of games, vol. II, Annals of Math. Studies, 39, Princeton, 197–208.

    Google Scholar 

  6. Kemeny, J. and J. Snell (1961). Finite Markov Chains, Van Nostrand, Princeton.

    Google Scholar 

  7. Mertens, J. F. and A. Neyman (1981). Stochastic Games, Int. J. Game Theory, 10, 53–66.

    Article  Google Scholar 

  8. Parthasarathy, T. and T. E. S. Raghavan (1981). An Orderfield Property for Stochastic Games when One Player Controls Transition Probabilities, J. Opt. Theory Appl, 33, 375–392.

    Article  Google Scholar 

  9. Parthasarathy, T., S. H. Tijs, and O. J. Vrieze (1984). Stochastic Games with State Independent Transitions and Separable Rewards, In: G. Hammer and D. Pallaschke (eds.), Selected Topics in Operations Research and Mathematical Economics, Springer-Verlag, Berlin, 262–271.

    Google Scholar 

  10. Rogers, P.D. (1969). Nonzero-Sum Stochastic Games, Ph.D. Dissertation, Report ORC 69-8, Op. Res. Centre, Univ. of California, Berkeley.

    Google Scholar 

  11. Shapley, L. S. (1953). Stochastic Games, Proc. of the Nat. Acad. of Sc., U.S.A., 39, 1095–1100.

    Article  Google Scholar 

  12. Tijs, S. H. and O. J. Vrieze (1986). On the Existence of Easy Initial States for Undiscounted Stochastic Games, Math. Oper. Res., 11, 506–513.

    Article  Google Scholar 

  13. Vrieze, O. J. and F. Thuijsman (1989). On Equilibria in Repeated Games with Absorbing States, Int. J. Game Theory, 18, 293–310.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1991 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Thuijsman, F., Vrieze, O.J. (1991). Easy Initial States in Stochastic Games. In: Raghavan, T.E.S., Ferguson, T.S., Parthasarathy, T., Vrieze, O.J. (eds) Stochastic Games And Related Topics. Theory and Decision Library, vol 7. Springer, Dordrecht. https://doi.org/10.1007/978-94-011-3760-7_8

Download citation

  • DOI: https://doi.org/10.1007/978-94-011-3760-7_8

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-010-5673-1

  • Online ISBN: 978-94-011-3760-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics