Dynamic Games in Macroeconomics

  • Łukasz BalbusEmail author
  • Kevin Reffett
  • Łukasz Woźny
Reference work entry


In this chapter, we survey how the methods of dynamic and stochastic games have been applied in macroeconomic research. In our discussion of methods for constructing dynamic equilibria in such models, we focus on strategic dynamic programming, which has found extensive application for solving macroeconomic models. We first start by presenting some prototypes of dynamic and stochastic games that have arisen in macroeconomics and their main challenges related to both their theoretical and numerical analysis. Then, we discuss the strategic dynamic programming method with states, which is useful for proving existence of sequential or subgame perfect equilibrium of a dynamic game. We then discuss how these methods have been applied to some canonical examples in macroeconomics, varying from sequential equilibria of dynamic nonoptimal economies to time-consistent policies or policy games. We conclude with a brief discussion and survey of alternative methods that are useful for some macroeconomic problems.


Strategic dynamic programming Sequential equilibria Markov equilibria Perfect public equilibria Non-optimal economies Time-consistency problems Policy games Numerical methods Approximating sets Computing correspondences 


  1. Abreu D (1988) On the theory of infinitely repeated games with discounting. Econometrica 56(2):383–396Google Scholar
  2. Abreu D, Pearce D, Stacchetti E (1986) Optimal cartel equilibria with imperfect monitoring. J Econ Theory 39(1):251–269Google Scholar
  3. Abreu D, Pearce D, Stacchetti E (1990) Toward a theory of discounted repeated games with imperfect monitoring. Econometrica 58(5):1041–1063Google Scholar
  4. Abreu D, Sannikov Y (2014) An algorithm for two-player repeated games with perfect monitoring. Theor Econ 9(2):313–338Google Scholar
  5. Aliprantis CD, Border KC (2005) Infinite dimensional analysis. A Hitchhiker’s guide. Springer, HeidelbergGoogle Scholar
  6. Alvarez F (1999) Social mobility: the Barro-Becker children meet the Laitner-Loury dynasties. Rev Econ Stud 2(1):65–103Google Scholar
  7. Alvarez F, Jermann UJ (2000) Efficiency, equilibrium, and asset pricing with risk of default. Econometrica 68(4):775–798Google Scholar
  8. Amir R (1996a) Continuous stochastic games of capital accumulation with convex transitions. Games Econ Behav 15(2):111–131Google Scholar
  9. Amir R (1996b) Strategic intergenerational bequests with stochastic convex production. Econ Theory 8(2):367–376Google Scholar
  10. Arellano C (2008) Default risk and income fluctuations in emerging economies. Am Econ Rev 98(3):690–712Google Scholar
  11. Athey S, Atkeson A, Kehoe PJ (2005) The optimal degree of discretion in monetary policy. Econometrica 73(5):1431–1475Google Scholar
  12. Atkeson A (1991) International lending with moral hazard and risk of repudiation. Econometrica 59(4):1069–1089Google Scholar
  13. Aumann R (1965) Integrals of set-valued functions. J Math Anal Appl 12(1):1–12Google Scholar
  14. Balbus L, Jaśkiewicz A, Nowak AS (2015a) Bequest games with unbounded utility functions. J Math Anal Appl 427(1):515–524Google Scholar
  15. Balbus Ł, Jaśkiewicz A, Nowak AS (2015b) Existence of stationary Markov perfect equilibria in stochastic altruistic growth economies. J Optim Theory Appl 165(1):295–315Google Scholar
  16. Balbus Ł, Jaśkiewicz A, Nowak AS (2015c) Stochastic bequest games. Games Econ Behav 90(C):247–256Google Scholar
  17. Balbus Ł, Nowak AS (2004) Construction of Nash equilibria in symmetric stochastic games of capital accumulation. Math Meth Oper Res 60:267–277Google Scholar
  18. Balbus Ł, Nowak AS (2008) Existence of perfect equilibria in a class of multigenerational stochastic games of capital accumulation. Automatica 44(6):1471–1479Google Scholar
  19. Balbus Ł, Reffett K, Woźny Ł (2012) Stationary Markovian equilibrium in altruistic stochastic OLG models with limited commitment. J Math Econ 48(2):115–132Google Scholar
  20. Balbus Ł, Reffett K, Woźny Ł (2013) A constructive geometrical approach to the uniqueness of Markov perfect equilibrium in stochastic games of intergenerational altruism. J Econ Dyn Control 37(5):1019–1039Google Scholar
  21. Balbus Ł, Reffett K, Woźny Ł (2014) A constructive study of Markov equilibria in stochastic games with strategic complementarities. J Econ Theory 150:815–840Google Scholar
  22. Balbus Ł, Reffett K, Woźny Ł (2015d) Time consistent Markov policies in dynamic economies with quasi-hyperbolic consumers. Int J Game Theory 44(1):83–112Google Scholar
  23. Balbus Ł, Reffett K, Woźny Ł (2016) On uniqueness of time-consistent Markov policies for quasi-hyperbolic consumers under uncertainty. Working paper no. WP KAE 2016_020, Collegium of Economic Analysis Working Paper Series, Warsaw School of EconomicsGoogle Scholar
  24. Balbus Ł, Woźny Ł (2016) A strategic dynamic programming method for studying short-memory equilibria of stochastic games with uncountable number of states. Dyn Games Appl 6(2): 187–208Google Scholar
  25. Baldauf M, Judd K, Mollner J, Yeltekin S (2015) Supergames with states. Discussion paper, MSGoogle Scholar
  26. Banerjee A, Mullainathan S (2010) The shape of temptation: implications for the economics lives of the poor. Working paper No. 15973, NBERGoogle Scholar
  27. Barro RJ (1999) Ramsey meets Laibson in the neoclassical growth model. Q J Econ 114(4): 1125–1152Google Scholar
  28. Barro RJ, Gordon DB (1983) Rules, discretion and reputation in a model of monetary policy. J Monet Econ 12(1):101–121Google Scholar
  29. Beer G (1980) The approximation of upper semicontinuous multifunction by step multifunction. Pac J Math 87(1):11–19Google Scholar
  30. Benjamin D, Wright MLJ (2009) Recovery before redemption: a theory of delays in sovereign debt renegotiations. Discussion paper 2009-2015, CAMA working papersGoogle Scholar
  31. Berg K, Kitti M (2014) Fractal geometry of equilibrium payoffs in discounted supergames. Fractals 22(4)Google Scholar
  32. Bernheim D, Ray D (1983) Altruistic growth economies. I. Existence of bequest equilibria. Technical report no. 419, Institute for Mathematical Studies in the Social SciencesGoogle Scholar
  33. Bernheim D, Ray D (1987) Economic growth with intergenerational altruism. Rev Econ Stud 54:227–242Google Scholar
  34. Bernheim BD, Ray D, Yeltekin S (2015) Poverty and self-control. Econometrica 85(5):1877–1911Google Scholar
  35. Brock W, Mirman L (1972) Optimal economic growth and uncertainty: the discounted case. J Econ Theory 4:479–513Google Scholar
  36. Broner F, Erce A, Martin A, Ventura J (2014) Sovereign debt markets in turbulent times: creditor discrimination and crowding-out effects. J Monet Econ 61(C):114–142Google Scholar
  37. Broner F, Martin A, Ventura J (2010) Sovereign risk and secondary markets. Am Econ Rev 100(4):1523–1555Google Scholar
  38. Caplin A, Leahy J (2006) The recursive approach to time inconsistency. J Econ Theory 131(1): 134–156Google Scholar
  39. Cass D (1965) Optimum growth in an aggregative model of capital accumulation. Rev Econ Stud 32:233–240Google Scholar
  40. Chade H, Prokopovych P, Smith L (2008) Repeated games with present-biased preferences. J Econ Theory 139(1):157–175Google Scholar
  41. Chamley C (1986) Optimal taxation of capital income in general equilibrium with infinite lives. Econometrica 54(3):607–622Google Scholar
  42. Chang R (1998) Credible monetary policy in an infinite horizon model: recursive approaches. J Econ Theory 81(2):431–461Google Scholar
  43. Chari V, Christiano L, Kehoe P (1991) Optimal fiscal and monetary policy: some recent results. J Money Credit Bank 23:519–539Google Scholar
  44. Chari V, Christiano L, Kehoe P (1994) Optimal fiscal policy in a business cycle model. J Polit Econ 102(4):617–652Google Scholar
  45. Chari V, Kehoe P (1990) Sustainable plans. J Polit Econ 98(4):783–802Google Scholar
  46. Cole HL, Kocherlakota N (2001) Dynamic games with hidden actions and hidden states. J Econ Theory 98(1):114–126Google Scholar
  47. Cole H, Kubler F (2012) Recursive contracts, lotteries and weakly concave Pareto sets. Rev Econ Dyn 15(4):479–500Google Scholar
  48. Cronshaw MB (1997) Algorithms for finding repeated game equilibria. Comput Econ 10(2): 139–168Google Scholar
  49. Cronshaw MB, Luenberger DG (1994) Strongly symmetric subgame perfect equilibria in infinitely repeated games with perfect monitoring and discounting. Games Econ Behav 6(2):220–237Google Scholar
  50. Diamond P, Koszegi B (2003) Quasi-hyperbolic discounting and retirement. J Public Econ 87:1839–1872Google Scholar
  51. Dominguez B (2005) Reputation in a model with a limited debt structure. Rev Econ Dyn 8(3): 600–622Google Scholar
  52. Dominguez B, Feng Z (2016a, forthcoming) An evaluation of constitutional constraints on capital taxation. Macroecon Dyn.
  53. Dominguez B, Feng Z (2016b) The time-inconsistency problem of labor taxes and constitutional constraints. Dyn Games Appl 6(2):225–242Google Scholar
  54. Doraszelski U, Escobar JF (2012) Restricted feedback in long term relationships. J Econ Theory 147(1):142–161Google Scholar
  55. Durdu C, Nunes R, Sapriza H (2013) News and sovereign default risk in small open economies. J Int Econ 91:1–17Google Scholar
  56. Dutta PK, Sundaram R (1992) Markovian equilibrium in a class of stochastic games: existence theorems for discounted and undiscounted models. Econ. Theory 2(2):197–214Google Scholar
  57. Ely JC, Hörner J, Olszewski W (2005) Belief-free equilibria in repeated games. Econometrica 73(2):377–415Google Scholar
  58. Farhi E, Sleet C, Werning I, Yeltekin S (2012) Nonlinear capital taxation without commitment. Rev Econ Stud 79:1469–1493Google Scholar
  59. Feng Z (2015) Time consistent optimal fiscal policy over the business cycle. Quant Econ 6(1): 189–221Google Scholar
  60. Feng Z, Miao J, Peralta-Alva A, Santos MS (2014) Numerical simulation of nonoptimal dynamic equilibrium models. Int Econ Rev 55(1):83–110Google Scholar
  61. Fesselmeyer E, Mirman LJ, Santugini M (2016) Strategic interactions in a one-sector growth model. Dyn Games Appl 6(2):209–224Google Scholar
  62. Fischer S (1980a) Dynamic inconsistency, cooperation and the benevolent dissembling government. J Econ Dyn Control 2(1):93–107Google Scholar
  63. Fischer S (1980b) On activist monetary policy and rational expectations. In: Fischer S (ed) Rational expectations and economic policy. University of Chicago Press, Chicago, pp 211–247Google Scholar
  64. Fischer RD, Mirman LJ (1992) Strategic dynamic interaction: fish wars. J Econ Dyn Control 16(2):267–287Google Scholar
  65. Fudenberg D, Levine DK (2006) A dual-self model of impulse control. Am Econ Rev 96(5): 1449–1476Google Scholar
  66. Fudenberg D, Yamamoto Y (2011) The folk theorem for irreducible stochastic games with imperfect public monitoring. J Econ Theory 146(4):1664–1683Google Scholar
  67. Harris C, Laibson D (2001) Dynamic choices of hyperbolic consumers. Econometrica 69(4): 935–957Google Scholar
  68. Harris C, Laibson D (2013) Instantaneous gratification. Q J Econ 128(1):205–248Google Scholar
  69. Hellwig C, Lorenzoni G (2009) Bubbles and self-enforcing debt. Econometrica 77(4):1137–1164Google Scholar
  70. Hörner J, Sugaya T, Takahashi S, Vieille N (2011) Recursive methods in discounted stochastic games: an algorithm for δ → 1 and a folk theorem. Econometrica 79(4):1277–1318Google Scholar
  71. Jaśkiewicz A, Nowak AS (2014) Stationary Markov perfect equilibria in risk sensitive stochastic overlapping generations models. J Econ Theory 151:411–447Google Scholar
  72. Jaśkiewicz A, Nowak AS (2015) Stochastic games of resource extraction. Automatica 54:310–316Google Scholar
  73. Judd K (1985) Redistributive taxation in a simple perfect foresight model. J Public Econ 28(1): 59–83Google Scholar
  74. Judd K, Cai Y, Yeltekin S (2015) Computing equilibria of dynamic games. Discussion paper, MSGoogle Scholar
  75. Judd K, Yeltekin S, Conklin J (2003) Computing supergame equilibria. Econometrica 71(4): 1239–1254Google Scholar
  76. Kandori M (2002) Introduction to repeated games with private monitoring. J Econ Theory 102(1):1–15Google Scholar
  77. Kehoe TJ, Levine DK (1993) Debt-constrained asset markets. Rev Econ Stud 60(4):865–888Google Scholar
  78. Kehoe TJ, Levine DK (2001) Liquidity constrained markets versus debt constrained markets. Econometrica 69(3):575–98Google Scholar
  79. Kitti M (2013) Conditional Markov equilibria in discounted dynamic games. Math Meth Oper Res 78(1):77–100Google Scholar
  80. Kitti M (2016) Subgame perfect equilibria in discounted stochastic games. J Math Anal Appl 435(1):253–266Google Scholar
  81. Klein P, Krusell P, Ríos-Rull J-V (2008) Time-consistent public policies. Rev Econ Stud 75: 789–808Google Scholar
  82. Klein P, Quadrini V, Ríos-Rull J-V (2005) Optimal time-consistent taxation with international mobility of capital. BE J Macroecon 5(1):1–36Google Scholar
  83. Klein P, Ríos-Rull J-V (2003) Time-consistent optimal fiscal policy. Int Econ Rev 44(4): 1217–1245Google Scholar
  84. Koeppl T (2007) Optimal dynamic risk sharing when enforcement is a decision variable. J Econ Theory 134:34–69Google Scholar
  85. Krebs T, Kuhn M, Wright M (2015) Human capital risk, contract enforcement, and the macroeconomy. Am Econ Rev 105:3223–3272Google Scholar
  86. Krusell P, Kurusçu B, Smith A (2002) Equilibrium welfare and government policy with quasi-geometric discounting. J Econ Theory 105(1):42–72Google Scholar
  87. Krusell P, Kurusçu B, Smith A (2010) Temptation and taxation. Econometrica 78(6):2063–2084Google Scholar
  88. Krusell P, Smith A (2003) Consumption–savings decisions with quasi–geometric discounting. Econometrica 71(1):365–375Google Scholar
  89. Krusell P, Smith A (2008) Consumption-savings decisions with quasi-geometric discounting: the case with a discrete domain. MS. Yale UniversityGoogle Scholar
  90. Kydland F, Prescott E (1977) Rules rather than discretion: the inconsistency of optimal plans. J Polit Econ 85(3):473–491Google Scholar
  91. Kydland F, Prescott E (1980) Dynamic optimal taxation, rational expectations and optimal control. J Econ Dyn Control 2(1):79–91Google Scholar
  92. Laibson D (1994) Self-control and savings. PhD thesis, MITGoogle Scholar
  93. Laibson D (1997) Golden eggs and hyperbolic discounting. Q J Econ 112(2):443–477Google Scholar
  94. Laitner J (1979a) Household bequest behaviour and the national distribution of wealth. Rev Econ Stud 46(3):467–83Google Scholar
  95. Laitner J (1979b) Household bequests, perfect expectations, and the national distribution of wealth. Econometrica 47(5):1175–1193Google Scholar
  96. Laitner J (1980) Intergenerational preference differences and optimal national saving. J Econ Theory 22(1):56–66Google Scholar
  97. Laitner J (2002) Wealth inequality and altruistic bequests. Am Econ Rev 92(2):270–273Google Scholar
  98. Leininger W (1986) The existence of perfect equilibria in model of growth with altruism between generations. Rev Econ Stud 53(3):349-368Google Scholar
  99. Le Van C, Saglam H (2004) Optimal growth models and the Lagrange multiplier. J Math Econ 40:393–410Google Scholar
  100. Levhari D, Mirman L (1980) The great fish war: an example using a dynamic Cournot-Nash solution. Bell J Econ 11(1):322–334Google Scholar
  101. Loury G (1981) Intergenerational transfers and the distributions of earnings. Econometrica 49: 843–867Google Scholar
  102. Maliar L, Maliar S (2005) Solving the neoclassical growth model with quasi-geometric discounting: a grid-based Euler-equation method. Comput Econ 26:163–172Google Scholar
  103. Maliar L, Maliar S (2006a) Indeterminacy in a log-linearized neoclassical growth model with quasi-geometric discounting. Econ Model 23/3:492–505Google Scholar
  104. Maliar L, Maliar S (2006b) The neoclassical growth model with heterogeneous quasi-geometric consumers. J Money Credit Bank 38:635–654Google Scholar
  105. Maliar L, Maliar S (2016) Ruling out multiplicity of smooth equilibria in dynamic games: a hyperbolic discounting example. Dyn Games Appl 6(2):243–261Google Scholar
  106. Marcet A, Marimon R (1998) Recursive contracts. Economics working papers, European University InstituteGoogle Scholar
  107. Marcet A, Marimon R (2011) Recursive contracts. Discussion paper. Barcelona GSE working paper series working paper no. 552Google Scholar
  108. Mertens J-F, Parthasarathy T (1987) Equilibria for discounted stochastic games. C.O.R.E. discussion paper 8750Google Scholar
  109. Mertens J-F, Parthasarathy T (2003) Equilibria for discounted stochastic games. In: Neyman A, Sorin S (eds) Stochastic games and applications. NATO advanced science institutes series D: behavioural and social sciences. Kluwer Academic, BostonGoogle Scholar
  110. Mertens J-F, Sorin S, Zamir S (2015) Repeated games. Cambridge University Press, New YorkGoogle Scholar
  111. Messner M, Pavoni N (2016) On the recursive saddle point method. Dyn Games Appl 6(2): 161–173Google Scholar
  112. Messner M, Pavoni N, Sleet C (2012) Recursive methods for incentive problems. Rev Econ Dyn 15(4):501–525Google Scholar
  113. Messner M, Pavoni N, Sleet C (2014) The dual approach to recursive optimization: theory and examples. Discussion paper 1267, Society for Economic DynamicsGoogle Scholar
  114. Mirman L (1979) Dynamic models of fishing: a heuristic approach. In: Liu PT, Sutinen JG (ed) Control theory in mathematical economics. Decker, New York, pp 39–73Google Scholar
  115. Morand O, Reffett K, Tarafdar S (2015) A nonsmooth approach to envelope theorems. J Math Econ 61(C):157–165Google Scholar
  116. Nowak AS (2006a) A multigenerational dynamic game of resource extraction. Math Soc Sci 51(3):327–336Google Scholar
  117. Nowak AS (2006b) A note on an equilibrium in the great fish war game. Econ Bull 17(2): 1–10Google Scholar
  118. Nowak AS (2006c) On perfect equilibria in stochastic models of growth with intergenerational altruism. Econ Theory 28(1):73–83Google Scholar
  119. Obara I, Park J (2013) Repeated games with general time preference. Paper available at:
  120. O’Donoghue T, Rabin M (1999) Doing it now or later. Am Econ Rev 89(1):103–124Google Scholar
  121. O’Donoghue T, Rabin M (2001) Choice and procrastination. Q J Econ 116(1):121–160Google Scholar
  122. Pearce D, Stacchetti E (1997) Time consistent taxation by a government with redistributive goals. J Econ Theory 72(2):282–305Google Scholar
  123. Peleg B, Yaari ME (1973) On the existence of a consistent course of action when tastes are changing. Rev Econ Stud 40(3):391–401Google Scholar
  124. Peralta-Alva A, Santos M (2010) Problems in the numerical simulation of models with heterogeneous agents and economic distortions. J Eur Econ Assoc 8:617–625Google Scholar
  125. Phelan C, Stacchetti E (2001) Sequential equilibria in a Ramsey tax model. Econometrica 69(6):1491–1518Google Scholar
  126. Phelps E, Pollak R (1968) On second best national savings and game equilibrium growth. Rev Econ Stud 35:195–199Google Scholar
  127. Pollak RA (1968) Consistent planning. Rev Econ Stud 35(2):201–208Google Scholar
  128. Ray D (1987) Nonpaternalistic intergenerational altruism. J Econ Theory 41:112–132Google Scholar
  129. Rincón-Zapatero JP, Santos MS (2009) Differentiability of the value function without interiority assumptions. J Econ Theory 144(5):1948–1964Google Scholar
  130. Rockafellar TR, Wets RJ-B (2009) Variational analysis. Springer, BerlinGoogle Scholar
  131. Rogoff K (1987) Reputational constraints on monetary policy. Carn-Roch Ser Public Policy 26:141–182Google Scholar
  132. Rustichini A (1998a) Dynamic programming solution of incentive constrained problems. J Econ Theory 78(2):329–354Google Scholar
  133. Rustichini A (1998b) Lagrange multipliers in incentive-constrained problems. J Math Econ 29(4):365–380Google Scholar
  134. Santos M, Miao J (2005) Numerical solution of dynamic non-optimal economies. Discussion paper, Society for Economic Dynamics, 2005 meeting papersGoogle Scholar
  135. Sleet C (1998) Recursive models for government policy. PhD thesis, Stanford UniversityGoogle Scholar
  136. Sleet C (2001) On credible monetary policy and private government information. J Econ Theory 99(1–2):338–376Google Scholar
  137. Sleet C, Yeltekin S (2006a) Credibility and endogenous social discounting. Rev Econ Dyn 9: 410–437Google Scholar
  138. Sleet C, Yeltekin S (2006b) Optimal taxation with endogenously incomplete debt markets. J Econ Theory 127:36–73Google Scholar
  139. Sleet C, Yeltekin S (2007) Recursive monetary policy games with incomplete information. J Econ Dyn Control 31(5):1557–1583Google Scholar
  140. Sleet C, Yeltekin S (2016) On the computation of value correspondences. Dyn Games Appl 6(2):174–186Google Scholar
  141. Straub L, Werning I (2014) Positive long run capital taxation: Chamley-Judd revisited. Discussion paper 20441, National Bureau of Economic ResearchGoogle Scholar
  142. Strotz RH (1955) Myopia and inconsistency in dynamic utility maximization. Rev Econ Stud 23(3):165–180Google Scholar
  143. Sundaram RK (1989a) Perfect equilibrium in non-randomized strategies in a class of symmetric dynamic games. J Econ Theory 47(1):153–177Google Scholar
  144. Sundaram RK (1989b) Perfect equilibrium in non-randomized strategies in a class of symmetric dynamic games: corrigendu. J Econ Theory 49:358–387Google Scholar
  145. Woźny Ł, Growiec J (2012) Intergenerational interactions in human capital accumulation. BE J Theor Econ 12Google Scholar
  146. Yamamoto Y (2010) The use of public randomization in discounted repeated games. Int J Game Theory 39(3):431–443MathSciNetCrossRefzbMATHGoogle Scholar
  147. Yue VZ (2010) Sovereign default and debt renegotiation. J Int Econ 80(2):176–187CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Faculty of Mathematics, Computer Sciences and EconometricsUniversity of Zielona GóraZielona GóraPoland
  2. 2.Department of EconomicsArizona State UniversityTempeUSA
  3. 3.Department of Quantitative EconomicsWarsaw School of EconomicsWarsawPoland

Personalised recommendations