Skip to main content
SpringerLink
Log in

Mean Field Games Models—A Brief Survey

  • Published:
Dynamic Games and Applications Aims and scope Submit manuscript

Abstract

The mean-field framework was developed to study systems with an infinite number of rational agents in competition, which arise naturally in many applications. The systematic study of these problems was started, in the mathematical community by Lasry and Lions, and independently around the same time in the engineering community by P. Caines, Minyi Huang, and Roland Malhamé. Since these seminal contributions, the research in mean-field games has grown exponentially, and in this paper we present a brief survey of mean-field models as well as recent results and techniques.

In the first part of this paper, we study reduced mean-field games, that is, mean-field games, which are written as a system of a Hamilton–Jacobi equation and a transport or Fokker–Planck equation. We start by the derivation of the models and by describing some of the existence results available in the literature. Then we discuss the uniqueness of a solution and propose a definition of relaxed solution for mean-field games that allows to establish uniqueness under minimal regularity hypothesis. A special class of mean-field games that we discuss in some detail is equivalent to the Euler–Lagrange equation of suitable functionals. We present in detail various additional examples, including extensions to population dynamics models. This section ends with a brief overview of the random variables point of view as well as some applications to extended mean-field games models. These extended models arise in problems where the costs incurred by the agents depend not only on the distribution of the other agents, but also on their actions.

The second part of the paper concerns mean-field games in master form. These mean-field games can be modeled as a partial differential equation in an infinite dimensional space. We discuss both deterministic models as well as problems where the agents are correlated. We end the paper with a mean-field model for price impact.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Achdou Y (2013) Finite difference methods for mean field games. In: Hamilton–Jacobi equations: approximations, numerical analysis and applications. Springer, Berlin, pp 1–47

    Chapter  Google Scholar 

  2. Achdou Y, Capuzzo-Dolcetta I (2010) Mean field games: numerical methods. SIAM J Numer Anal 48(3):1136–1162

    Article  MATH  MathSciNet  Google Scholar 

  3. Achdou Y, Perez V (2012) Iterative strategies for solving linearized discrete mean field games systems. Netw Heterog Media 7(2):197–217

    Article  MATH  MathSciNet  Google Scholar 

  4. Achdou Y, Camilli F, Capuzzo-Dolcetta I (2012) Mean field games: numerical methods for the planning problem. SIAM J Control Optim 50(1):77–109

    Article  MATH  MathSciNet  Google Scholar 

  5. Ambrosio L (2004) Transport equation and Cauchy problem for BV vector fields. Invent Math 158(2):227–260

    Article  MATH  MathSciNet  Google Scholar 

  6. Ambrosio L (2008) Transport equation and Cauchy problem for non-smooth vector fields. In: Calculus of variations and nonlinear partial differential equations. Lecture notes in math, vol 1927. Springer, Berlin, pp 1–41

    Chapter  Google Scholar 

  7. Balandat M, Tomlin C (2013) On efficiency in mean field differential games. In: 2013 American control conference (ACC)

    Google Scholar 

  8. Bardi M (2012) Explicit solutions of some linear-quadratic mean field games. Netw Heterog Media 7(2):243–261

    Article  MATH  MathSciNet  Google Scholar 

  9. Bardi M, Capuzzo-Dolcetta I (1997) Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations. Birkhäuser Boston Inc, Boston. With appendices by Maurizio Falcone and Pierpaolo Soravia

    Book  MATH  Google Scholar 

  10. Bardi M, Feleqi E (2013) The derivation of ergodic mean field game equations for several populations of players. Dyn Games Appl (to appear)

  11. Bardi M, Feleqi E (2013) Nonlinear elliptic systems and mean field games. In: 52nd IEEE conference on decision and control, Florence, December 2013

    Google Scholar 

  12. Bardi M, Priuli F (2013) LQG mean-field games with ergodic cost. Preprint

  13. Benamou J-D, Brenier Y (2000) A computational fluid mechanics solution to the Monge-Kantorovich mass transfer problem. Numer Math 84(3):375–393

    Article  MATH  MathSciNet  Google Scholar 

  14. Bensoussan A, Frehse J, Yam P (2013) Mean field games and mean field type control. Springer, Berlin

    Book  MATH  Google Scholar 

  15. Bensoussan A, Sung K, Yam S, Yung S (2013) Linear-quadratic mean field games. Preprint

  16. Biryuk A, Gomes DA (2010) An introduction to the Aubry-Mather theory. São Paulo J Math Sci 4(1):17–63

    MATH  MathSciNet  Google Scholar 

  17. Burger M, Di Francesco M, Markowich PA, Wolfram M-T (2013) On a mean field game optimal control approach modeling fast exit scenarios in human crowds. Preprint

  18. Cagnetti F, Gomes D, Mitake H, Tran H (2013) A new method for large time behavior of convex Hamilton-Jacobi equations: degenerate equations and weakly coupled systems. Preprint

  19. Camilli F, Silva F (2012) A semi-discrete approximation for a first order mean field game problem. Netw Heterog Media 7(2):263–277

    Article  MATH  MathSciNet  Google Scholar 

  20. Cardaliaguet P (2011) Notes on mean-field games

    Google Scholar 

  21. Cardaliaguet P (2013) Long time average of first order mean-field games and weak KAM theory. Preprint

  22. Cardaliaguet P (2013) Weak solutions for first order mean-field games with local coupling. Preprint

  23. Cardaliaguet P, Lasry J-M, Lions P-L, Porretta A (2012) Long time average of mean field games. Netw Heterog Media 7(2):279–301

    Article  MATH  MathSciNet  Google Scholar 

  24. Cardaliaguet P, Lasry J-M, Lions P-L, Porretta A (2013) Long time average of mean field games with a nonlocal coupling. SIAM J Control Opt (to appear)

  25. Carlini E, Silva FJ (2013) A fully-discrete semi-lagrangian scheme for a first order mean field game problem. Preprint

  26. Carmona R, Delarue F (2013) Mean field forward-backward stochastic differential equations. Preprint

  27. Carmona R, Delarue F (2013) Probabilistic analysis of mean-field games. Preprint

  28. Carmona R, Lacker D (2013) A probabilistic weak formulation of mean field games and applications. Preprint

  29. Carmona R, Delarue F, Lachapelle A (2013) Control of McKean-Vlasov dynamics versus mean field games. Math Financ Econ 7(2):131–166

    Article  MATH  MathSciNet  Google Scholar 

  30. Di Francesco M, Markowich PA, Pietschmann J-F, Wolfram M-T (2011) On the Hughes’ model for pedestrian flow: the one-dimensional case. J Differ Equ 250(3):1334–1362

    Article  MATH  Google Scholar 

  31. Evans LC (2009) Further PDE methods for weak KAM theory. Calc Var Partial Differ Equ 35(4):435–462

    Article  MATH  Google Scholar 

  32. Evans LC, Gomes D (2001) Effective Hamiltonians and averaging for Hamiltonian dynamics. I. Arch Ration Mech Anal 157(1):1–33

    Article  MATH  MathSciNet  Google Scholar 

  33. Ferreira R, Gomes D (2013) On the convergence of finite state mean-field games through Γ-convergence. Preprint

  34. Fleming WH, Soner HM (2006) Controlled Markov processes and viscosity solutions. Stochastic modelling and applied probability, vol 25. Springer, New York

    MATH  Google Scholar 

  35. Gomes D (2002) A stochastic analogue of Aubry-Mather theory. Nonlinearity 15(3):581–603

    Article  MATH  MathSciNet  Google Scholar 

  36. Gomes D (2005) Duality principles for fully nonlinear elliptic equations. In: Trends in partial differential equations of mathematical physics. Progr nonlinear differential equations appl, vol 61. Birkhäuser, Basel, pp 125–136

    Chapter  Google Scholar 

  37. Gomes D, Nurbekyan L (2012) Lagrangian dynamics and a weak KAM theorem on the d-infinite dimensional torus. Dokl Natl Akad Nauk Armen 112(2):152–159

    MathSciNet  Google Scholar 

  38. Gomes D, Nurbekyan L (2013) On the minimizers of calculus of variations problems in Hilbert spaces. Preprint

  39. Gomes D, Nurbekyan L (2013) Weak KAM theory in the d-infinite dimensional torus. Preprint

  40. Gomes D, Patrizi S (2013) Obstacle and weakly coupled systems problem in mean field games. Preprint

  41. Gomes D, Ribeiro R (2013) Mean field games with logistic population dynamics. In: 52nd IEEE conference on decision and control, Florence, December 2013

    Google Scholar 

  42. Gomes D, Sanchez-Morgado H (2011) On the stochastic Evans-Aronsson problem. Preprint

  43. Gomes D, Valdinoci E (2007) Entropy penalization methods for Hamilton-Jacobi equations. Adv Math 215(1):94–152

    Article  MATH  MathSciNet  Google Scholar 

  44. Gomes D, Voskanyan V (2013) Extended mean-field games—formulation, existence, uniqueness and examples. Preprint

  45. Gomes D, Iturriaga R, Sánchez-Morgado H, Yu Y (2010) Mather measures selected by an approximation scheme. Proc Am Math Soc 138(10):3591–3601

    Article  MATH  Google Scholar 

  46. Gomes D, Mohr J, Souza RR (2010) Discrete time, finite state space mean field games. J Math Pures Appl 93(2):308–328

    Article  MATH  MathSciNet  Google Scholar 

  47. Gomes D, Lopes A, Mohr J (2011) The Mather measure and a large deviation principle for the entropy penalized method. Commun Contemp Math 13(2):235–268

    Article  MATH  MathSciNet  Google Scholar 

  48. Gomes DA, Pires GE, Sánchez-Morgado H (2012) A-priori estimates for stationary mean-field games. Netw Heterog Media 7(2):303–314

    Article  MATH  MathSciNet  Google Scholar 

  49. Gomes DA, Mohr J, Souza RR (2013) Continuous time finite state mean field games. Appl Math Optim 68(1):99–143

    Article  MATH  MathSciNet  Google Scholar 

  50. Gomes D, Patrizi S, Voskanyan V (2013) On the existence of classical solutions for stationary extended mean field games. Preprint

  51. Gomes D, Pimentel E, Sanchez-Morgado H (2013) Time dependent mean-field games—subquadratic Hamiltonians. Preprint

  52. Gomes D, Pimentel E, Sanchez-Morgado H (2013) Time dependent mean-field games—superquadratic Hamiltonians. Preprint

  53. Gueant O (2009) Mean field games and applications to economics. Ph.D. Thesis, Université Paris Dauphine, Paris

  54. Gueant O (2009) A reference case for mean field games models. J Math Pures Appl 92(3):276–294

    Article  MATH  MathSciNet  Google Scholar 

  55. Gueant O (2011) An existence and uniqueness result for mean field games with congestion effect on graphs. Preprint

  56. Gueant O (2011) From infinity to one: the reduction of some mean field games to a global control problem. Preprint

  57. Gueant O (2011) A uniqueness result for mean field games. Classnotes

  58. Huang M (2009/10) Large-population LQG games involving a major player: the Nash certainty equivalence principle. SIAM J Control Optim 48(5):3318–3353

    Article  MathSciNet  Google Scholar 

  59. Huang M (2012) Mean field stochastic games with discrete states and mixed players. In: Proc GameNets, Vancouver

    Google Scholar 

  60. Huang M, Malhamé RP, Caines PE (2006) Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle. Commun Inf Syst 6(3):221–251

    MATH  MathSciNet  Google Scholar 

  61. Huang M, Caines PE, Malhamé RP (2007) Large-population cost-coupled LQG problems with nonuniform agents: individual-mass behavior and decentralized ϵ-Nash equilibria. IEEE Trans Autom Control 52(9):1560–1571

    Article  Google Scholar 

  62. Huang M, Caines P, Malhamé RP (2010) The NCE (mean field) principle with locality dependent cost interactions. IEEE Trans Autom Control 55(12):2799–2805

    Article  Google Scholar 

  63. Kolokoltsov VN (2010) Nonlinear Markov processes and kinetic equations. Cambridge tracts in mathematics, vol 182. Cambridge University Press, Cambridge

    MATH  Google Scholar 

  64. Kolokoltsov K, Yang W (2013) Existence of solutions to path-dependent kinetic equations and related forward-backward systems. Open J Optim 2:39–44

    Article  Google Scholar 

  65. Kolokoltsov K, Yang W (2013) Sensitivity analysis for HJB equations with an application to a coupled backward-forward system. Optimization (to appear)

  66. Kolokoltsov VN, Li J, Yang W (2011) Mean field games and nonlinear Markov processes. Preprint

  67. Lachapelle A, Lasry J-M, Lehalle C-A, Lions P-L (2013) Efficiency of the price formation process in presence of high frequency participants: a mean field game analysis. Preprint

  68. Lachapelle A, Salomon J, Turinici G Computation of mean field equilibria in economics

  69. Lasry J-M, Lions P-L (2006) Jeux à champ moyen. I. Le cas stationnaire. C R Math Acad Sci Paris 343(9):619–625

    Article  MATH  MathSciNet  Google Scholar 

  70. Lasry J-M, Lions P-L (2006) Jeux à champ moyen. II. Horizon fini et contrôle optimal. C R Math Acad Sci Paris 343(10):679–684

    Article  MATH  MathSciNet  Google Scholar 

  71. Lasry J-M, Lions P-L (2007) Mean field games. Jpn J Math 2(1):229–260

    Article  MATH  MathSciNet  Google Scholar 

  72. Lasry J-M, Lions P-L (2007) Mean field games. In: Cahiers de la chaire finance et développement durable

    Google Scholar 

  73. Lasry J-M, Lions P-L, Gueant O (2010) Application of mean field games to growth theory. Preprint

  74. Lasry J-M, Lions P-L, Gueant O (2010) Mean field games and applications. Paris-Princeton lectures on mathematical finance

    Google Scholar 

  75. Lasry J-M, Lions P-L, Gueant O (2011) Mean field games and oil production. Preprint

  76. Li T, Zhang J-F (2008) Asymptotically optimal decentralized control for large population stochastic multiagent systems. IEEE Trans Autom Control 53(7):1643–1660

    Article  Google Scholar 

  77. Lions P-L (2007–2011) College de France course on mean-field games

  78. Lions P-L (2012) IMA, University of Minessota. Course on mean-field games. Video, http://www.ima.umn.edu/2012-2013/sw11.12-13.12/

  79. Lucas RE, Moll B (2013) Knowledge growth and the allocation of time. J Polit Econ

  80. Nguyen SL, Huang M (2012) Linear-quadratic-Gaussian mixed games with continuum-parametrized minor players. SIAM J Control Optim 50(5):2907–2937

    Article  MATH  MathSciNet  Google Scholar 

  81. Nourian M, Caines P, Malhamé RP, Huang M (2013) Nash, social and centralized solutions to consensus problems via mean field control theory. IEEE Trans Autom Control 58(3):639–653

    Article  Google Scholar 

  82. Porretta A (2013) On the planning problem for the mean-field games system. Dyn Games Appl

  83. Porretta A (2013) Weak solutions to Fokker-Planck equations and mean field games. Preprint

  84. Santambrogio F (2012) A modest proposal for MFG with density constraints. Netw Heterog Media 7(2):337–347

    Article  MATH  MathSciNet  Google Scholar 

  85. Sznitman A-S (1991) Topics in propagation of chaos. In: École d’été de probabilités de Saint-Flour XIX—1989. Lecture notes in math, vol 1464. Springer, Berlin, pp 165–251

    Google Scholar 

  86. Tembine H (2013) Energy-constrained mean field games in wireless networks. J Strateg Behav Environ (accepted)

  87. Tembine H, Zhu Q, Basar T (2013) Risk-sensitive mean field games. Preprint

  88. Villani C (2003) Topics in optimal transportation. Graduate studies in mathematics, vol 58. American Mathematical Society, Providence

    MATH  Google Scholar 

Download references

Acknowledgements

D. Gomes was partially supported by CAMGSD-LARSys through FCT-Portugal and by grants PTDC/MAT/114397/2009, UTAustin/MAT/0057/2008, and UTA-CMU/MAT/0007/2009.

We would like to thank the two anonymous referees and many colleagues and students, in particular M. Bardi, I. Capuzzo Dolcetta, M. Huang, V. Kolokoltsov, A. Porretta and R. Ribeiro, who read earlier versions of this paper and provided various corrections and suggestions.

Author information

Authors and Affiliations

  1. Center for Mathematical Analysis, Geometry, and Dynamical Systems—LARSYS and Departamento de Matemática, Instituto Superior Técnico, 1049-001, Lisboa, Portugal

    Diogo A. Gomes

  2. CEMSE Division, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Saudi Arabia

    Diogo A. Gomes

  3. KAUST Strategic Research Initiative, Uncertainty Quantification Center, Thuwal, 23955-6900, Saudi Arabia

    Diogo A. Gomes

  4. LARSYS, Instituto Superior Técnico, 1049-001, Lisboa, Portugal

    João Saúde

Authors
  1. Diogo A. Gomes
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. João Saúde
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Diogo A. Gomes.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gomes, D.A., Saúde, J. Mean Field Games Models—A Brief Survey. Dyn Games Appl 4, 110–154 (2014). https://doi.org/10.1007/s13235-013-0099-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13235-013-0099-2

Keywords

Search

Navigation