Skip to main content
SpringerLink
Log in

Nonzero-sum games for continuous-time Markov chains with unbounded transition and average payoff rates

  • Articles
  • Published:
Science China Mathematics Aims and scope Submit manuscript

Abstract

This paper attempts to study two-person nonzero-sum games for denumerable continuous-time Markov chains determined by transition rates, with an expected average criterion. The transition rates are allowed to be unbounded, and the payoff functions may be unbounded from above and from below. We give suitable conditions under which the existence of a Nash equilibrium is ensured. More precisely, using the socalled “vanishing discount” approach, a Nash equilibrium for the average criterion is obtained as a limit point of a sequence of equilibrium strategies for the discounted criterion as the discount factors tend to zero. Our results are illustrated with a birth-and-death game.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Anderson W J. Continuous-Time Markov Chains. New York: Springer-Verlag, 1991

    Book  MATH  Google Scholar 

  2. Altman E, Avrachenkov K, Bonneau N, et al. Constrained cost-coupled stochastic games with independent state processes. Oper Res Lett, 2008, 36: 160–164

    Article  MathSciNet  MATH  Google Scholar 

  3. Federgruen A. On N-person stochastic games with denumerable state space. Adv Appl Probab, 1978, 10: 452–471

    Article  MathSciNet  MATH  Google Scholar 

  4. Guo X P, Hernández-Lerma O. Drift and monotonicity conditions for continuous-time controlled Markov chains with an average criterion. IEEE Trans Automat Control, 2003, 48: 236–245

    Article  MathSciNet  Google Scholar 

  5. Guo X P, Hernández-Lerma O. Zero-sum games for continuous-time Markov chains with unbounded transition and average payoff rates. J Appl Probab, 2003, 40: 327–345

    Article  MathSciNet  MATH  Google Scholar 

  6. Guo X P, Hernández-Lerma O. Zero-sum continuous-time Markov games with unbounded transition and discounted payoff rates. Bernoulli, 2005, 11: 1009–1029

    Article  MathSciNet  MATH  Google Scholar 

  7. Guo X P, Hernández-Lerma O. Nonzero-sum games for continuous-time Markov chains with unbounded discounted payoffs. J Appl Probab, 2005, 42: 303–320

    Article  MathSciNet  MATH  Google Scholar 

  8. Guo X P, Hernández-Lerma O. Zero-sum games for continuous-time jump Markov processes in Polish spaces: discounted payoffs. Adv in Appl Probab, 2007, 39: 645–668

    Article  MathSciNet  MATH  Google Scholar 

  9. Guo X P, Hernández-Lerma O. New optimality conditions for average-payoff continuous-time Markov games in Polish spaces. Sci China Math, 2011, 54: 793–816

    Article  MathSciNet  MATH  Google Scholar 

  10. Guo X P, Hernández-Lerma O. Continuous-Time Markov Decision Processes. Berlin: Springer-Verlag, 2009

    Book  MATH  Google Scholar 

  11. Hernández-Lerma O, Lasserre J B. Further Topics on Discrete-Time Markov Control Processes. New York: Springer-Verlag, 1999

    Book  MATH  Google Scholar 

  12. Jaśkiewicz A, Nowak A S. Approximation of noncooperative semi-Markov games. J Optim Theor Appl, 2006, 131: 115–134

    Article  MATH  Google Scholar 

  13. Küenle H U. On Nash equilibrium solutions in nonzero-sum stochastic games with complete information. Internat J Game Theory, 1994, 23: 303–324

    Article  MathSciNet  MATH  Google Scholar 

  14. Kumar K S. Nonzero sum stochastic differential games with discounted payoff criterion: an approximating Markov chain approach. SIAM J Control Optim, 2008, 47: 374–395

    Article  MathSciNet  MATH  Google Scholar 

  15. Mannucci P. Nonzero-sum stochastic differential games with discontinuous feedback. SIAM J Control Optim, 2005, 43: 1222–1233

    Article  MathSciNet  Google Scholar 

  16. Nowak A S. Some remarks on equilibria in semi-Markov games. Appl Math Warsaw, 2000, 27: 385–394

    MathSciNet  MATH  Google Scholar 

  17. Nowak A S, Jaśkiewicz A. Nonzero-sum semi-Markov games with the expected average payoffs. Math Methods Oper Res, 2005, 62: 23–40

    Article  MathSciNet  MATH  Google Scholar 

  18. Nowak A S. On stochastic games in economics. Math Methods Oper Res, 2007, 66: 513–530

    Article  MathSciNet  MATH  Google Scholar 

  19. Rainer C. Two different approaches to nonzero-sum stochastic differential games. Appl Math Optim, 2007, 56: 131–144

    Article  MathSciNet  MATH  Google Scholar 

  20. Sennott L I. Nonzero-sum stochastic games with unbounded costs: discounted and average cost cases. Z Oper Res, 1994, 40: 145–162

    MathSciNet  MATH  Google Scholar 

  21. Yang J, Guo X P. Zero-sum stochastic games with average payoffs: new optimality conditions. Acta Math Sin Engl Ser, 2009, 25: 1201–1216

    Article  MathSciNet  MATH  Google Scholar 

  22. Ye L E, Guo X P. New sufficient conditions for average optimality in continuous-time Markov decision processes. Math Methods Oper Res, 2010, 72: 75–94

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Mathematics and Computational Science, Sun Yat-Sen University, Guangzhou, 510275, China

    WenZhao Zhang & XianPing Guo

Authors
  1. WenZhao Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. XianPing Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to XianPing Guo.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhang, W., Guo, X. Nonzero-sum games for continuous-time Markov chains with unbounded transition and average payoff rates. Sci. China Math. 55, 2405–2416 (2012). https://doi.org/10.1007/s11425-012-4515-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11425-012-4515-7

Keywords

MSC(2010)

Search

Navigation