Abstract
We prove for a large class of stochastic games with discontinuous payoffs, a stationary Markov perfect equilibrium exists under the condition of “continuation payoff security.” This condition is easy to verify and holds in many economic games. Roughly, a game belongs to this class if for any action/state profiles and continuation payoff, a player can identify another action at the current stage with the payoff not much worse than her current one, even if other players perturb actions slightly. As an illustrative application of the equilibrium existence result, we provide a stochastic dynamic oligopoly model of firm entry, exit, and price competitions.
Similar content being viewed by others
References
Adlakha, S., Johari, R., Weintraub, G.Y.: Equilibria of dynamic games with many players: existence, approximation, and market structure. J. Econ. Theory 156, 269–316 (2015)
Aliprantis, C.D., Border, K.C.: Infinite Dimensional Analysis: A Hitchhiker’s Guide. Springer, Berlin (2006)
Amir, R.: Complementarity and diagonal dominance in discounted stochastic games. Ann. Oper. Res. 114, 39–56 (2002)
Amir, R.: Stochastic games in economics and related fields: an overview. In: Neyman, A., Sorin, S. (eds.) Stochastic Games and Applications. NATO Adv. Sci. I. C-MAT, vol. 570, pp. 455–470. Kluwer Academic, Dordrecht (2003)
Balbus, Ł, Reffett, K., Woźny, Ł: Markov stationary equilibria in stochastic supermodular games with imperfect private and public information. Dyn. Games Appl. 3, 187–206 (2013)
Balbus, Ł, Reffett, K., Woźny, Ł: A constructive study of Markov equilibria in stochastic games with strategic complementarities. J. Econ. Theory 150, 815–840 (2014)
Balder, E.J.: Lectures on Young measures. Cahiers de Mathématiques de la Décision, vol. 9517 (1995)
Bertsekas, D.P., Shreve, S.E.: Stochastic Optimal Control: The Discrete-Time Case. Athena Scientific, Nashua (1996)
Carbonell-Nicolau, O.: Perfect equilibria in games of incomplete information. Econ. Theory 71, 1591–1648 (2021). https://doi.org/10.1007/s00199-020-01311-y
Carbonell-Nicolau, O., McLean, R.P.: Refinements of Nash equilibrium in potential games. Theor. Econ. 9, 555–582 (2014)
Carbonell-Nicolau, O., McLean, R.P.: On the existence of Nash equilibrium in Bayesian games. Math. Oper. Res. 43, 100–129 (2018)
Carbonell-Nicolau, O., McLean, R.P.: Nash and Bayes–Nash equilibria in strategic-form games with intransitivities. Econ. Theory 68, 935–965 (2019). https://doi.org/10.1007/s00199-018-1151-7
Carmona, G., Podczeck, K.: Existence of Nash equilibrium in ordinal games with discontinuous preferences. Econ. Theory 61, 457–478 (2016). https://doi.org/10.1007/s00199-015-0901-z
Cingiz, K., Flesch, J., Herings, P.J.J., Predtetchinski, A.: Perfect information games where each player acts only once. Econ. Theory 69, 965–985 (2020). https://doi.org/10.1007/s00199-019-01199-3
Cole, H.L., Kocherlakota, N.: Dynamic games with hidden actions and hidden states. J. Econ. Theory 98, 114–126 (2001)
Curtat, L.O.: Markov equilibria of stochastic games with complementarities. Games Econ. Behav. 17, 177–199 (1996)
Dasgupta, P., Maskin, E.: The existence of equilibrium in discontinuous economic games, I: theory. Rev. Econ. Stud. 53, 1–26 (1986)
Duffie, D., Geanakoplos, J., Mas-Colell, A., McLennan, A.: Stationary Markov equilibria. Econometrica 62, 745–781 (1994)
Duggan, J.: Noisy stochastic games. Econometrica 80, 2017–2045 (2012)
Ericson, R., Pakes, A.: Markov-perfect industry dynamics: a framework for empirical work. Rev. Econ. Stud. 62, 53–82 (1995)
Fink, A.M.: Equilibrium in a stochastic n-person game. J. Sci. Hiroshima Univ. 28, 89–93 (1964)
Haifeng, F.: Mixed-strategy equilibria and strong purification for games with private and public information. Econ. Theory 37, 521–532 (2008). https://doi.org/10.1007/s00199-007-0315-7
He, W., Sun, Y.: Stationary Markov perfect equilibria in discounted stochastic games. J. Econ. Theory 169, 35–61 (2017)
He, W., Yannelis, N.C.: Existence of equilibria in discontinuous Bayesian games. J. Econ. Theory 162, 181–194 (2016a)
He, W., Yannelis, N.C.: Existence of Walrasian equilibria with discontinuous, non-ordered, interdependent and price-dependent preferences. Econ. Theory 61, 497–513 (2016b). https://doi.org/10.1007/s00199-015-0875-x
Hörner, J., Olszewski, W.: How robust is the folk theorem? Q. J. Econ. 124, 1773–1814 (2009)
Jaśkiewicz, A., Nowak, A.S.:, Zero-sum stochastic games. In: Handbook of Dynamic Game Theory, pp. 215–279 (2018a)
Jaśkiewicz, A., Nowak, A.S.: Non-zero-sum stochastic games. In: Handbook of Dynamic Game Theory, pp. 281–344 (2018b)
Kandori, M.: Introduction to repeated games with private monitoring. J. Econ. Theory 102, 1–15 (2002)
Khan, M.A., Rath, K.P., Sun, Y.: On a private information game without pure strategy equilibria. J. Math. Econ. 31, 341–359 (1999)
Levy, Y.: A discounted stochastic game with no stationary Nash equilibrium: two examples. Econometrica 81, 1973–2007 (2013)
Levy, Y., McLennan, A.: Corrigendum to: A discounted stochastic game with no stationary Nash equilibrium: two examples. Econometrica 83, 1237–1252 (2015)
Maskin, E., Tirole, J.: A theory of dynamic oligopoly, I: overview and quantity competition with large fixed costs. Econometrica 56, 549–569 (1988a)
Maskin, E., Tirole, J.: A theory of dynamic oligopoly, II: price competition, kinked demand curves, and Edgeworth cycles. Econometrica 56, 571–599 (1988b)
Maskin, E., Tirole, J.: Markov perfect equilibrium: I. Observable actions. J. Econ. Theory 100, 191–219 (2001)
Michael, E.: A note on paracompact spaces. Proc. Am. Math. Soc. 4, 831–838 (1953)
Milgrom, P.R., Weber, R.J.: Distributional strategies for games with incomplete information. Math. Oper. Res. 10, 619–632 (1985)
Monteiro, P.K., Page, F.H., Jr.: Uniform payoff security and Nash equilibrium in compact games. J. Econ. Theory 134, 566–575 (2007)
Nowak, A.S.: On stochastic games in economics. Math. Methods Oper. Res. 66, 513–530 (2007)
Nowak, A.S., Raghavan, T.E.S.: Existence of stationary correlated equilibria with symmetric information for discounted stochastic games. Math. Oper. Res. 17, 519–527 (1992)
Prokopovych, P.: On equilibrium existence in payoff secure games. Econ. Theory 48, 5–16 (2011). https://doi.org/10.1007/s00199-010-0526-1
Prokopovych, P., Yannelis, N.C.: On the existence of mixed strategy Nash equilibria. J. Math. Econ. 52, 87–97 (2014)
Prokopovych, P., Yannelis, N.C.: On monotone approximate and exact equilibria of an asymmetric first-price auction with affiliated private information. J. Econ. Theory 184, 104925 (2019)
Prokopovych, P., Yannelis, N.C.: On nondegenerate equilibria of double auctions with several buyers and a price floor. Econ. Theory (2021). https://doi.org/10.1007/s00199-021-01372-7
Reny, P.J.: On the existence of pure and mixed strategy Nash equilibria in discontinuous games. Econometrica 67, 1029–1056 (1999)
Reny, P.J.: Nash equilibrium in discontinuous games. Annu. Rev. Econ. (forthcoming) (2020)
Shapley, L.: Stochastic games. Proc. Natl. Acad. Sci. USA 39, 1095–1100 (1953)
Sun, Y.: Integration of correspondences on Loeb spaces. Trans. Am. Math. Soc. 349, 129–153 (1997)
Takahashi, M.: Equilibrium points of stochastic non-cooperative n-person games. J. Sci. Hiroshima Univ. 28, 95–99 (1964)
Warga, J.: Optimal Control of Differential and Functional Equations. Academic press, New York (1972)
Wiȩcek, P.: Total reward semi-Markov mean-field games with complementarity properties. Dyn. Games Appl. 7, 507–529 (2017)
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The author thanks an associate editor and two anonymous referees for their careful reading and helpful suggestions. This research is supported by Research Grants Council of Hong Kong (No. ECS-24503417).
Rights and permissions
About this article
Cite this article
He, W. Discontinuous stochastic games. Econ Theory 73, 827–858 (2022). https://doi.org/10.1007/s00199-021-01374-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00199-021-01374-5
Keywords
- Stochastic game
- Discontinuous payoff
- Continuation payoff security
- Stationary Markov perfect equilibrium
- Dynamic oligopoly