Abstract
We study the asymptotic behavior of solutions to the constrained MFG system as the time horizon T goes to infinity. For this purpose, we analyze first Hamilton–Jacobi equations with state constraints from the viewpoint of weak KAM theory, constructing a Mather measure for the associated variational problem. Using these results, we show that a solution to the constrained ergodic mean field games system exists and the ergodic constant is unique. Finally, we prove that any solution of the first-order constrained MFG problem on [0, T] converges to the solution of the ergodic system as T goes to infinity.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
The theory of mean field games (MFG) was introduced independently by Lasry and Lions [1,2,3] and Huang et al. [4, 5] to study Nash equilibria for games with a very large number of players. Without entering technical details, let us recall that such an approach aims to describe the optimal value u and distribution m of players at a Nash equilibrium by a system of partial differential equations. Stochastic games are associated with a second order PDE system while deterministic games lead to the analysis of the first order system
where \(\Omega \) is an open domain in the Euclidean space or on a manifold. Following the above seminal works, this subject grew very fast producing an enormous literature. Here, for space reasons, we only refer to Cardaliaguet [6], Gomes et al. [7], Bensoussan et al. [8], Carmona and Delarue [9] and the references therein. However, most of the papers on this subject assumed the configuration space \(\Omega \) to be the torus \(\mathbb {T}^{d}\) or the whole Euclidean space \(\mathbb {R}^{d}\).
In this paper we investigate the long time behavior of the solution to (1.1) where \(\Omega \) is a bounded domain of \(\mathbb {R}^{d}\) and the state of the system is constrained in \(\overline{\Omega }\).
The constrained MFG system with finite horizon T was analyzed in [10,11,12]. In particular, Cannarsa and Capuani in [10] introduced the notion of constrained equilibria and mild solutions \((u^T,m^T)\) of the constrained MFG system (1.1) with finite horizon on \(\overline{\Omega }\) and proved an existence and uniqueness result for such a system. Cannarsa et al. [11, 12] studied the regularity of mild solutions of the constrained MFG system and used such results to give a precise interpretation of (1.1).
At this point, it is natural to raise the question of the asymptotic behavior of solutions as \(T \rightarrow +\infty \). In the absence of state constraints, results describing the asymptotic behavior of solutions of the MFG system were obtained in [13, 14], for second order systems on \(\mathbb {T}^{d}\), and in [15, 16], for first order systems on \(\mathbb {T}^{d}\) and \(\mathbb {R}^{d}\), respectively. Recently, Cardaliaguet and Porretta studied the long time behavior of solutions for the so-called Master equation associated with a second order MFG system, see [17]. As is well known, the introduction of state constraints creates serious obstructions to most techniques which can be used in the unconstrained case. New methods and ideas become necessary.
In order to understand the specific features of constrained problems, it is useful to recall the main available results for constrained Hamilton–Jacobi equations. The dynamic programming approach to constrained optimal control problems has a long history going back to Soner [18], who introduced the notion of constrained viscosity solutions as subsolutions in the interior of the domain and supersolutions up to the boundary. Several results followed the above seminal paper, for which we refer to Bardi and Capuzzo-Dolcetta [19] and Capuzzo-Dolcetta and Lions [20] and the references therein.
As for the asymptotic behavior of constrained viscosity solutions of
we recall the paper [21] by Mitake, where the solution u(t, x) is shown to converge as \(t \rightarrow +\infty \) to a viscosity solution, \(\bar{u}\), of the ergodic Hamilton–Jacobi equation
for a unique constant \(c \in \mathbb {R}\). In the absence of state constraints, it is well known that the constant c can be characterized by using Mather measures, that is, invariant measures with respect to the Lagrangian flow which minimize the Lagrangian action, see for instance [22]. On the contrary, such an analysis is missing for constrained optimal control problems and the results in [21] are obtained by pure PDE methods without constructing a Mather measure.
On the other hand, as proved in [15, 16], the role of Mather measures is crucial in the analysis of the asymptotic behavior of solutions to the MFG system on \(\mathbb {T}^{d}\) or \(\mathbb {R}^{d}\). For instance, on \(\mathbb {T}^{d}\) the limit behavior of \(u^{T}\) is described by a solution (c, u, m) of the ergodic MFG system
where m is a Mather measure and c is uniquely determined by m. Notice that the fact that u is differentiable on the support of the Mather measure gives a precise interpretation of the continuity equation in the above system.
Motivated by the above considerations, in this paper, we study the ergodic Hamilton–Jacobi equation (1.2) from the point of view of weak KAM theory, aiming at constructing a Mather measure. For this purpose, we need to recover a fractional semiconcavity result for the value function of a constrained optimal control problem, which is inspired by a similar property derived in [12]. Indeed, such a regularity is needed to prove the differentiability of a constrained viscosity solution of (1.2) along calibrated curves and, eventually, construct the Mather set.
With the above analysis at our disposal, we address the existence and uniqueness of solutions to the ergodic constrained MFG system
where V is the continuous vector field on \(\overline{\Omega }\) defined in (4.2) below.
As for existence, we construct a triple \((c, u, m) \in \mathbb {R} \times C(\overline{\Omega }) \times \mathcal {P}(\overline{\Omega })\) such that u is a constrained viscosity solution of the first equation in (1.3), with gradient Du for m-a.e. \(x \in \overline{\Omega }\), and m satisfies the second equation of system (1.3) in the sense of distributions (for the precise definition see Definition 4.1). Moreover, under an extra monotonicity assumption for F, we show that the constant c for which system (1.3) has a solution is unique—hence, independent of m—and so is \(F(\cdot , \bar{m})\): more precisely, if \((c_1,u_1,m_1)\) and \((c_2,u_2,m_2)\) are solutions of (1.3), then \(F(\cdot ,m_1)=F(\cdot ,m_2)\) and \(c_{1}=c_{2}\).
Then, we prove our main result concerning the convergence of \(u^{T} / T\): fixed any solution \((c, u, m) \in \mathbb {R} \times C(\overline{\Omega }) \times \mathcal {P}(\overline{\Omega })\) of system (1.3), there exists a constant \(C \ge 0\) such that
Moreover, for the distribution of players \(m^{T}\) we obtain an asymptotic estimate of the form
We conclude this introduction recalling that asymptotic results for second-order MFG systems on \(\mathbb {T}^{d}\) have been applied in [13, 14] to recover a Turnpike property with an exponential rate of convergence. A similar property, possibly at a lower rate, may then be expected for first-order MFG systems as well. We believe that the results of this paper could be used to the purpose.
The rest of this paper is organized as follows. In Sect. 2, we introduce the notation and some preliminaries. In Sect. 3, we provide some weak KAM type results for Hamilton–Jacobi equations with state constraints. Section 4 is devoted to the existence of solutions of (4.1). We show the convergence result of (2.2) in Sect. 5.
2 Preliminaries
2.1 Notation
We write below a list of symbols used throughout this paper.
-
Denote by \(\mathbb {N}\) the set of positive integers, by \(\mathbb {R}^d\) the d-dimensional real Euclidean space, by \(\langle \cdot ,\cdot \rangle \) the Euclidean scalar product, by \(|\cdot |\) the usual norm in \(\mathbb {R}^d\), and by \(B_{R}\) the open ball with center 0 and radius R.
-
Let \(\Omega \subset \mathbb {R}^d\) be a bounded open set with \(C^2\) boundary. \(\overline{\Omega }\) stands for its closure, \(\partial \Omega \) for its boundary and \(\Omega ^c=\mathbb {R}^d\setminus \Omega \) for the complement. For \(x\in \partial \Omega \), denote by \(\nu (x)\) the outward unit normal vector to \(\partial \Omega \) at x.
-
The distance function from \(\overline{\Omega }\) is the function \(d_{\Omega }:\mathbb {R}^d\rightarrow [0,+\infty )\) defined by \( d_{\Omega }(x):=\inf _{y\in \overline{\Omega }}|x-y|. \) Define the oriented boundary distance from \(\partial \overline{\Omega }\) by \(b_{\overline{\Omega }}(x):=d_{\Omega }(x)-d_{\Omega ^c}(x)\). Since the boundary of \(\Omega \) is of class \(C^2\), then \(b_{\Omega }(\cdot )\) is of class \(C^2\) in a neighborhood of \(\partial \Omega \).
-
Denote by \(\pi _1:\overline{\Omega }\times \mathbb {R}^d\rightarrow \overline{\Omega }\) the canonical projection.
-
Let \(\Lambda \) be a real \(n\times n\) matrix. Define the norm of \(\Lambda \) by
$$\begin{aligned} \Vert \Lambda \Vert =\sup _{|x|=1,\ x\in \mathbb {R}^d}|\Lambda x|. \end{aligned}$$ -
Let f be a real-valued function on \(\mathbb {R}^d\). The set
$$\begin{aligned} D^+ f(x)=\left\{ p\in \mathbb {R}^d: \limsup _{y\rightarrow x}\frac{f(y)-f(x) - \langle p, y-x \rangle }{|y-x|}\le 0\right\} , \end{aligned}$$is called the superdifferential of f at x.
-
Let A be a Lebesgue-measurable subset of \(\mathbb {R}^{d}\). Let \(1\le p\le \infty \). Denote by \(L^p(A)\) the space of Lebesgue-measurable functions f with \(\Vert f\Vert _{p,A}<\infty \), where
$$\begin{aligned} \Vert f\Vert _{\infty , A}&:={\mathop {{{\,\mathrm{ess\ sup}\,}}}\limits _{x \in A}} |f(x)|,\\ \Vert f\Vert _{p,A}&:=\left( \int _{A}|f|^{p}\ dx\right) ^{\frac{1}{p}}, \quad 1\le p<\infty . \end{aligned}$$Denote \(\Vert f\Vert _{\infty ,\mathbb {R}^d}\) by \(\Vert f\Vert _{\infty }\) and \(\Vert f\Vert _{p,\mathbb {R}^d}\) by \(\Vert f\Vert _{p}\), for brevity.
-
\(C_b(\mathbb {R}^d)\) stands for the function space of bounded uniformly continuous functions on \(\mathbb {R}^d\). \(C^{2}_{b}(\mathbb {R}^{d})\) stands for the space of bounded functions on \(\mathbb {R}^d\) with bounded uniformly continuous first and second derivatives. \(C^k(\mathbb {R}^{d})\) (\(k\in \mathbb {N}\)) stands for the function space of k-times continuously differentiable functions on \(\mathbb {R}^d\), and \(C^\infty (\mathbb {R}^{d}):=\cap _{k=0}^\infty C^k(\mathbb {R}^{d})\). \(C_c^\infty (\overline{\Omega })\) stands for the space of functions \(f\in C^\infty (\overline{\Omega })\) with \({{\,\mathrm{spt}\,}}(f)\subset \Omega \). Let \(a<b\in \mathbb {R}\). \(AC([a,b];\mathbb {R}^d)\) denotes the space of absolutely continuous maps \([a,b]\rightarrow \mathbb {R}^d\).
-
For \(f \in C^{1}(\mathbb {R}^{d})\), the gradient of f is denoted by \(Df=(D_{x_{1}}f, \ldots , D_{x_{n}}f)\), where \(D_{x_{i}}f=\frac{\partial f}{\partial x_{i}}\), \(i=1,2,\ldots ,d\). Let k be a nonnegative integer and let \(\alpha =(\alpha _1,\ldots ,\alpha _d)\) be a multiindex of order k, i.e., \(k=|\alpha |=\alpha _1+\cdots +\alpha _d\) , where each component \(\alpha _i\) is a nonnegative integer. For \(f \in C^{k}(\mathbb {R}^{d})\), define \(D^{\alpha }f:= D_{x_{1}}^{\alpha _{1}} \cdot \cdot \cdot D^{\alpha _{d}}_{x_{d}}f\).
-
Given a metric space (X, d) we denote by \(\mathcal {B}(X)\) the Borel \(\sigma \)-algebra on X and by \(\mathcal {P}(X)\) the set of Borel probability measures on \((X, \mathcal {B}(X))\). The support of a measure \(\mu \in \mathcal {P}(X)\), denoted by \({{\,\mathrm{spt}\,}}(\mu )\), is the closed set defined by
$$\begin{aligned} {{\,\mathrm{spt}\,}}(\mu ) := \Big \{x \in X: \mu (V_x)>0\ \text {for each open neighborhood} V_x\, \text {of}\, x\Big \}. \end{aligned}$$
2.2 Measure Theory and MFG with State Constraints
We first recall the definition of weak-\(*\) convergence of probability measures and then the definition of Wasserstein distance on the whole space \(\mathbb {R}^{d}\), which can be easily adapted to any domain \(\Omega \subset \mathbb {R}^{d}\).
We say that a sequence \(\{\mu _k\}_{k\in \mathbb {N}}\subset \mathcal {P}(\mathbb {R}^d)\) is weakly-\(*\) convergent to \(\mu \in \mathcal {P}(\mathbb {R}^d)\), denoted by \(\mu _k {\mathop {\longrightarrow }\limits ^{w^*}}\mu \), if
For \(p\in [1,+\infty )\), the Wasserstein space of order p is defined as
where \(x_0 \in \mathbb {R}^d\) is arbitrary. Given any two measures m and \(m^{\prime }\) in \(\mathcal {P}_p(\mathbb {R}^n)\), define
The Wasserstein distance of order p between m and \(m'\) is defined by
The distance \(d_1\) is also commonly called the Kantorovich–Rubinstein distance and can be characterized by a useful duality formula (see, for instance, [23]) as follows
for all m, \(m'\in \mathcal {P}_1(\mathbb {R}^d)\).
We shall always treat \(\mathcal {P}_1(\mathbb {R}^d)\) as a metric space with the Kantorovich–Rubinstein distance. In the case of a bounded open domain \(\Omega \subset \mathbb {R}^d\), we have that \(\mathcal {P}_1(\overline{\Omega })=\mathcal {P}(\overline{\Omega })\).
We recall some definitions and results for the constrained MFG system
where
and \(\lambda _{+}(t,x)\) is defined in Proposition 3.12 (see also [12, Proposition 2.5]).
Let us consider the metric space
equipped with the uniform distance. For any \(x\in \overline{\Omega }\), define
For any \(t \in [0,T]\), denote by \(e_{t}: \Gamma \rightarrow \overline{\Omega }\) the evaluation map, defined by
For any \(t \in [0,T]\) and any \(\eta \in \mathcal {P}(\Gamma )\)Footnote 1, we set
where \(e_{t} \sharp \eta \) stands for the image measure (or push-forward) of \(\eta \) by \(e_{t}\), i.e., for any \(\varphi \in C(\overline{\Omega })\)
For any fixed \(m_{0} \in \mathcal {P}(\overline{\Omega })\), denote by \(\mathcal {P}_{m_{0}}(\Gamma )\) the set of all Borel probability measures \(\eta \in \mathcal {P}(\Gamma )\) such that \(m^{\eta }_{0}=m_{0}\). For any \(\eta \in \mathcal {P}_{m_{0}}(\Gamma )\) define the following functional
Definition 2.1
(Constrained MFG equilibrium) Let \(m_{0} \in \mathcal {P}(\overline{\Omega })\). We say that \(\eta \in \mathcal {P}_{m_{0}}(\Gamma )\) is a constrained MFG equilibrium for \(m_{0}\) if
where
Assume that \(L\in C^1(\overline{\Omega }\times \mathbb {R}^d)\) is convex with respect to the second argument and assume that there are \(C_i>0\), \(i=1,2,3,4\), such that for all \((x,v)\in \overline{\Omega }\times \mathbb {R}^d\), there hold
Under these assumptions, assuming that \(F:\overline{\Omega }\times \mathcal {P}(\overline{\Omega })\rightarrow \mathbb {R}\) and \(u^{f}:\overline{\Omega }\rightarrow \mathbb {R}\) are continuous functions it has been proved in [10, Theorem 3.1] that there exists at least one constrained MFG equilibrium.
Definition 2.2
(Mild solutions of constrained MFG system) We say that \((u^T,m^T)\in C([0,T]\times \overline{\Omega })\times C([0,T];\mathcal {P}(\overline{\Omega }))\) is a mild solution of the constrained MFG problem in \(\overline{\Omega }\), if there is a constrained MFG equilibrium \(\eta \in \mathcal {P}_{m_0}(\Gamma )\) such that
-
(i)
\(m^T(t)=e_t\sharp \eta \) for all \(t\in [0,T]\);
-
(ii)
\(u^T\) is given by
$$\begin{aligned} u^T(t,x)=\inf _{\gamma \in \Gamma , \gamma (t)=x} \Big \{\int _t^T\big (L(\gamma (s),\dot{\gamma }(s))+F(\gamma (s),m^T(s))\big )ds+u^f(\gamma (T))\Big \},\nonumber \\ \end{aligned}$$(2.4)for all \((t,x)\in [0,T]\times \overline{\Omega }\).
The existence of a mild solution \((u^{T}, m^{T})\) of constraint MFG system on [0, T] is a direct consequence of the existence of constrained MFG equilibrium.
In addition, assuming that F is strictly monotone, i.e.,
for all \(m_1\), \(m_2\in \mathcal {P}(\overline{\Omega })\) and
if and only if \(F(x,m_1)=F(x,m_2)\) for all \(x\in \overline{\Omega }\), Cannarsa and Capuani [10] proved that if \((u^T_1,m^T_1)\), \((u^T_2,m^T_2)\) are mild solutions, then \(u^T_1=u^T_2\). Note that, when F is a coupling function of local type, then the above condition is nothing but the monotonicity of F with respect to the second variable. For MFG systems, the connection between uniqueness and monotonicity is well-known in the literature and was first pointed out in Lasry–Lions [3].
2.3 Weak KAM Theory on Euclidean Space
In this part we recall some definitions and results in the weak KAM theory on the Euclidean space. Most of the results are due to Fathi and Maderna [24] and Contreras [25].
\(\bullet \) Tonelli Lagrangians and Hamiltonians. Let \(L: \mathbb {R}^{d} \times \mathbb {R}^{d} \rightarrow \mathbb {R}\) be a \(C^{2}\) Lagrangian.
Definition 2.3
(Strict Tonelli Lagrangians) L is called a strict Tonelli Lagrangian if there exist positive constants \(C_{i}\) (\(i=1,2,3\)) such that, for all \((x,v) \in \mathbb {R}^{d} \times \mathbb {R}^{d}\) there hold
-
(a)
\(\frac{I}{C_{1}} \le D_{vv}^{2}L(x,v) \le C_{1} I\), where I is the identity matrix;
-
(b)
\(\Vert D^{2}L(x,v)\Vert \le C_{2}(1+|v|)\);
-
(c)
\(|L(x,0)|+|D_{x}L(x,0)|+ |D_{v}L(x,0)| \le C_{3}\).
Remark 2.4
Let L be a strict Tonelli Lagrangian. It is easy to check that there are two positive constants \(\alpha \), \(\beta \) depending only on \(C_{i}\) (\(i=1,2,3\)) in Definition 2.3, such that
-
(e)
\(|D_{v}L(x,v)| \le \alpha (1+|v|)\), \(\forall (x,v)\in \mathbb {R}^d\times \mathbb {R}^d\);
-
(f)
\(|D_{x}L(x,v)| \le \alpha (1+|v|^{2})\), \(\forall (x,v)\in \mathbb {R}^d\times \mathbb {R}^d\);
-
(g)
\(\frac{1}{4\beta }|v|^{2}- \alpha \le L(x,v) \le 4\beta |v|^{2} +\alpha \), \(\forall (x,v)\in \mathbb {R}^d\times \mathbb {R}^d\);
-
(h)
\(\sup \big \{L(x,v): x\in \mathbb {R}^d, |v| \le R \big \} < +\infty \), \(\forall R\ge 0\).
Define the Hamiltonian \(H: \mathbb {R}^{d} \times \mathbb {R}^{d} \rightarrow \mathbb {R}\) associated with L by
It is straightforward to check that if L is a strict Tonelli Lagrangian, then H satisfies (a), (b), and (c) in Definition 2.3. Such a function H is called a strict Tonelli Hamiltonian.
If L is a reversible Lagrangian, i.e., \(L(x,v)=L(x,-v)\) for all \((x,v) \in \mathbb {R}^{n} \times \mathbb {R}^{n}\), then \(H(x,p)=H(x,-p)\) for all \((x,p) \in \mathbb {R}^{d} \times \mathbb {R}^{d}\).
We always work with Tonelli Lagrangians and Hamiltonians, if not stated otherwise.
\(\bullet \) Invariant measures and holonomic measures. The Euler-Lagrange equation associated with L
generates a flow of diffeomorphisms \(\phi _{t}^{L}: \mathbb {R}^{d} \times \mathbb {R}^{d} \rightarrow \mathbb {R}^{d} \times \mathbb {R}^{d}\), with \(t \in \mathbb {R}\), defined by
where \(x: \mathbb {R} \rightarrow \mathbb {R}^{d}\) is the maximal solution of (2.5) with initial conditions \(x(0)=x_{0}, \ \dot{x}(0)=v_{0}\). It should be noted that, for any strict Tonelli Lagrangian L, the flow \(\phi _{t}^{L}\) is complete [24, Corollary 2.2].
We recall that a Borel probability measure \(\mu \) on \(\mathbb {R}^{d} \times \mathbb {R}^{d}\) is called \(\phi _{t}^{L}\)-invariant, if
or, equivalently,
We denote by \(\mathfrak {M}_{L}\) the set of all \(\phi _{t}^{L}\)-invariant Borel probability measures on \(\mathbb {R}^{d} \times \mathbb {R}^{d}\).
Let \(C^0_{l}\) be the set of all continuous functions \(f:\mathbb {R}^d\times \mathbb {R}^d\rightarrow \mathbb {R}\) satisfying
endowed with the topology induced by the uniform convergence on compact subsets. Denote by \((C^0_{l})'\) the dual of \(C^0_{l}\). Let \(\gamma :[0,T]\rightarrow \mathbb {R}^d\) be a closed absolutely continuous curve for some \(T>0\). Define a probability measure \(\mu _{\gamma }\) on the Borel \(\sigma \)-algebra of \(\mathbb {R}^d\times \mathbb {R}^d\) by
for all \(f\in C^0_{l}\). Let \(\mathcal {K}(\mathbb {R}^d)\) denote the set of such \(\mu _{\gamma }\)’s. We call \(\overline{\mathcal {K}(\mathbb {R}^d)}\) the set of holonomic measures, where \(\overline{\mathcal {K}(\mathbb {R}^d)}\) denotes the closure of \(\mathcal {K}(\mathbb {R}^d)\) with respect to the topology induced by the weak convergence on \((C^0_{l})'\). By [26, Proposition 2.3.2], we have that
\(\bullet \) Mañé’s critical value. If [a, b] is a finite interval with \(a<b\) and \(\gamma :[a,b]\rightarrow \mathbb {R}^d\) is an absolutely continuous curve, we define its L action as
The critical value of the Lagrangian L, which was introduced by Mañé in [27], is defined as follows:
By [26, 2–5.2 Theorem], \(c_L\) can be also characterized in the following way:
where the action \(B_{L}\) is defined as
for any \(\nu \in \overline{\mathcal {K}(\mathbb {R}^{d})}\).
If L is a reversible Tonelli Lagrangian, and
then for \(x\in {\mathop {{{\,\mathrm{argmin}\,}}}\limits _{x\in \mathbb {R}^d}}L(x,0)\), the atomic measure \(\delta _{(x,0)}\) is a \(\phi _{t}^{L}\)-invariant probability measure, i.e., \(\delta _{(x,0)}\in \mathfrak {M}_{L}\). Note that
which, together with (2.6) and (2.8), implies that
In view of (2.9), it is straightforward to see that
\(\bullet \) Weak KAM theorem. Let us recall definitions of weak KAM solutions and viscosity solutions of the Hamilton–Jacobi equation
where c is a real number.
Definition 2.5
(Weak KAM solutions) A function \(u \in C(\mathbb {R}^{d})\) is called a backward weak KAM solution of equation (HJ) with \(c=c_L\), if it satisfies the following two conditions:
-
(i)
for each continuous and piecewise \(C^{1}\) curve \(\gamma :[t_{1}, t_{2}] \rightarrow \mathbb {R}^{d}\), we have that
$$\begin{aligned} u(\gamma (t_{2}))-u(\gamma (t_{1})) \le \int _{t_{1}}^{t_{2}}{L(\gamma (s), \dot{\gamma }(s))ds}+c_L(t_{2}-t_{1}); \end{aligned}$$ -
(ii)
for each \(x \in \mathbb {R}^{d}\), there exists a \(C^{1}\) curve \(\gamma :(-\infty ,0] \rightarrow \mathbb {R}^{d}\) with \(\gamma (0)=x\) such that
$$\begin{aligned} u(x)-u(\gamma (t))=\int _{t}^{0}{L(\gamma (s), \dot{\gamma }(s))ds}-c_Lt, \quad \forall t<0. \end{aligned}$$
Remark 2.6
Let u be a function on \(\mathbb {R}^d\). A \(C^1\) curve \(\gamma :[a,b]\rightarrow \mathbb {R}^d\) with \(a<b\) is said to be \((u,L,c_L)\)-calibrated, if it satisfies
It is not difficult to check that if u satisfies condition (i) in Definition 2.5, then the curves appeared in condition (ii) in Definition 2.5 are necessarily \((u,L,c_L)\)-calibrated curves.
Definition 2.7
(Viscosity solutions)
-
(i)
A function \(u\in C(\mathbb {R}^{d})\) is called a viscosity subsolution of equation (HJ) if for every \(\varphi \in C^1(\mathbb {R}^{d})\) at any local maximum point \(x_0\) of \(u-\varphi \) on \(\mathbb {R}^{d}\) the following holds:
$$\begin{aligned} H(x_0,D\varphi (x_0))\le c; \end{aligned}$$ -
(ii)
A function \(u\in C(\mathbb {R}^{d})\) is called a viscosity supersolution of equation (HJ) if for every \(\varphi \in C^1(\mathbb {R}^{d})\) at any local minimum point \(x_0\) of \(u-\varphi \) on \(\mathbb {R}^{d}\) the following holds:
$$\begin{aligned} H(y_0,D\psi (y_0))\ge c; \end{aligned}$$ -
(iii)
u is a viscosity solution of equation (HJ) on \(\mathbb {R}^{d}\) if it is both a viscosity subsolution and a viscosity supersolution on \(\mathbb {R}^{d}\).
Fathi and Maderna [24] got the existence of backward weak KAM solutions (or, equivalently, viscosity solutions) for \(c \ge c_{L}\).
3 Hamilton–Jacobi Equations with State Constraints
3.1 Constrained Viscosity Solutions
Let us recall the notion of constrained viscosity solutions of equation (HJ) on \(\overline{\Omega }\), see for instance [18].
Definition 3.1
(Constrained viscosity solutions) \(u\in C(\overline{\Omega })\) is said to be a constrained viscosity solution of (HJ) on \(\overline{\Omega }\) if it is a subsolution on \(\Omega \) and a supersolution on \(\overline{\Omega }\).
Consider the state constraint problem for equation (HJ) on \(\overline{\Omega }\):
Mitake [21] showed that there exists a unique constant, denoted by \(c_H\), such that problem (3.1)–(3.2) admits solutions. Moreover, \(c_H\) can be characterized by
See [21, Theorem 3.3, Theorem 3.4, Remark 2] for details.
Furthermore, by standard comparison principle for viscosity solutions one can prove that following representation formula for constrained viscosity solutions holds true.
Proposition 3.2
(Representation formula for constrained viscosity solutions) \(u \in C(\overline{\Omega })\) is a constrained viscosity solution of (HJ) on \(\overline{\Omega }\) for \(c=c_H\) if and only if
where \(\mathcal {C}(x;t)\) denotes the set of all curves \(\gamma \in AC([0,t],\overline{\Omega })\) with \(\gamma (t)=x\).
Remark 3.3
If u is a constrained viscosity solution of (HJ) on \(\overline{\Omega }\) for \(c=c_H\), then by Proposition 3.2 and [21, Theorem 5.2] one can deduce that \(u\in W^{1,\infty }(\Omega )\). Thus, u is Lipschitz in \(\partial \Omega \), since \(\Omega \) is open and bounded with \(\partial \Omega \) of class \(C^2\) (see, for instance, [28, Chapter 5]).
Proposition 3.4
(Equi-Lipschitz continuity of constrained viscosity solutions) Let u be a constrained viscosity solution of (HJ) on \(\overline{\Omega }\) for \(c=c_H\). Then, u is Lipschitz continuous on \(\overline{\Omega }\) with a Lipschitz constant \(K_1>0\) depending only on H.
Proof
Recall that \(\Omega \) is a bounded domain with \(C^{2}\) boundary. By Remark 3.5–(iii) below \(\Omega \) is C-quasiconvex for some \(C>0\). Thus, for any x, \(y\in \overline{\Omega }\), there is an absolutely continuous curve \(\gamma :[0,\tau (x,y)]\rightarrow \overline{\Omega }\) connecting x and y, with \(0<\tau (x,y)\le C|x-y|\) and \(|\dot{\gamma }(t)|\le 1\) a.e. in \([0,\tau (x,y)]\). In view of (3.4), we deduce that
Hence, we get that
By exchanging the roles of x and y, we get that
where \(K_1:=C\cdot \Big (\sup _{x\in \overline{\Omega },|v|\le 1}L(x,v)+c_H\Big )\) depending only on H and \(\Omega \). \(\square \)
Remark 3.5
Let \(U\subseteq \mathbb {R}^d\) be a connected open set.
-
(i)
For any \(x \in \bar{U}\) and \(C >0\), we say that \(y \in \bar{U}\) is a (x, C)-reachable in U, if there exists a curve \(\gamma \in \text {AC}([0,\tau (x,y)]; \bar{U})\) for some \(\tau (x,y) > 0\) such that \(|\dot{\gamma }(t)| \le 1\) a.e. in \([0, \tau (x,y)]\), \(\gamma (0)=x\), \(\gamma (\tau (x,y))=y\) and \(\tau (x,y) \le C|x-y|\). We denote by \(\mathcal {R}_{C}(x,y)\) the set of all (x, C)-reachable points from \(x \in U\). We say that U is C-quasiconvex if for any \(x \in \bar{U}\) we have that \(\mathcal {R}_{C}(x,U)= U\).
-
(ii)
U is called a Lipschitz domain, if \(\partial U\) is locally Lipschitz, i.e., \(\partial U\) can be locally represented as the graph of a Lipschitz function defined on some open ball of \(\mathbb {R}^{d-1}\).
-
(iii)
U is C-quasiconvex for some \(C>0\) if U is a bounded Lipschitz domain (see, for instance, Sects. 2.5.1 and 2.5.2 in [29]). Since \(\Omega \) is a bounded domain with \(C^2\) boundary, then it is C-quasiconvex for some \(C>0\).
Consider the assumption (A1) \(\displaystyle {{\mathop {{{\,\mathrm{argmin}\,}}}\limits _{x \in \mathbb {R}^{d}}}}\ L(x,0) \cap \overline{\Omega }\not = \emptyset \).
Proposition 3.6
Let H be a reversible Tonelli Hamiltonian. Assume (A1). Then, \(c_H=c_L\).
Proof
By [24, Theorem 1.1], there exists a global viscosity solution \(u_{d}\) of \(H(x,Du(x))=c\), \((x\in \mathbb {R}^d)\) with \(c=c_L\). Since \(\Omega \) is an open subset of \(\mathbb {R}^{d}\), by definition \(u_{d}\big |_{\Omega }\) is solution of (3.1) for \(c=c_L\). Thus, \(c_H \le c_L\).
Recalling the characterization (3.3), since \(\varphi \) is differentiable almost everywhere and H is a reversible Tonelli Hamiltonian we have that
Therefore, by (A1) and the fact that
we deduce that
where the last equality holds by (2.10). \(\square \)
From now on, we assume that L is a reversible strict Tonelli Lagrangian and denote by c the common value of \(c_L\) and \(c_H\).
Remark 3.7
Comparing to the classical weak KAM solutions, see Definition 2.5, one can call \(u: \overline{\Omega } \rightarrow \mathbb {R}\) a constrained weak KAM solution if for any \(t_{1} < t_{2}\) and any absolutely continuous curve \(\gamma : [t_{1}, t_{2}] \rightarrow \overline{\Omega }\) we have
and, for any \(x \in \overline{\Omega }\) there exists a \(C^{1}\) curve \(\gamma _{x}: (-\infty , 0] \rightarrow \overline{\Omega }\) with \(\gamma _{x}(0)=x\) such that
One can easily see that a constrained weak KAM solution must be a constrained viscosity solution by definition and Proposition 3.2. In order to prove the opposite relation we need to go back to the \(C^{1,1}\) regularity of solutions of the Hamiltonian system associated with a state constraint control problem. This will be the subject of a forthcoming paper.
3.2 Semiconcavity Estimates of Constrained Viscosity Solutions
Here, we give a semiconcavity estimate for constrained viscosity solutions of (1.2). Note that a similar result has been obtained in [12, Corollary 3.2] for a general calculus of variation problem under state constraints with a Tonelli Lagrangian and a regular terminal cost. Such regularity of the data allowed the authors to prove the semiconcavity result using the sensitivity relation and the maximum principle which is not possible in our context. Indeed, by the representation formula (3.4), i.e.
one can immediately observe that the terminal cost is not regular enough to apply the maximum principle in [11, Theorem 3.1]. For these reasons, we decided to prove semiconcavity using a dynamical approach based on the properties of calibrated curves.
Let \(\Gamma ^t_{x,y}(\overline{\Omega })\) be the set of all absolutely continuous curve \(\gamma :[0,t]\rightarrow \overline{\Omega }\) such that \(\gamma (0)=x\) and \(\gamma (t)=y\). For each \(x,y\in \overline{\Omega }\), \(t>0\), let
We recall that, since the boundary of \(\Omega \) is of class \(C^2\), there exists \(\rho _0>0\) such that
Now, recall a result from [10].
Lemma 3.8
Let \(\gamma \in AC([0,T],\mathbb {R}^d)\) and suppose \(d_{\Omega }(\gamma (t))<\rho _0\) for all \(t\in [0,T]\). Then \(d_{\Omega }\circ \gamma \in AC([0,T],\mathbb {R})\) and
Proposition 3.9
For any \(x^*\in \overline{\Omega }\), the functions \(A^{\overline{\Omega },L}_t(\cdot ,x^*)\) and \(A^{\overline{\Omega },L}_t(x^*,\cdot )\) both are locally semiconcave with fractional modulus. More precisely, there exists \(C>0\) such that, if \(h\in \mathbb {R}^d\) with \(x\pm h\in \overline{\Omega }\), then we have
In particular, for such an h, we also have
where u is the constrained viscosity solution defined by (1.2).
Proof
Here we only study the semi-concavity of the function \(A^{\overline{\Omega },L}_t(\cdot ,x^*)\) for any \(x^*\in \overline{\Omega }\), since \(A^{\overline{\Omega },L}_t(x^*,\cdot )=A^{\overline{\Omega },\breve{L}}_t(\cdot ,x^*)\), where \(\breve{L}(x,v)=L(x,-v)\). We divide the proof into several steps.
I. Projection method Fix \(x,x^*\in \overline{\Omega }\), \(h\in \mathbb {R}^d\) such that \(x\pm h\in \overline{\Omega }\). Let \(\gamma \in \Gamma ^t_{x,x^*}(\overline{\Omega })\) be a minimizer for \(A_t(x,x^*)\), and \(\varepsilon >0\). For \(r\in (0,\varepsilon /2]\), define
Recalling (3.5), if \(|h|\ll 1\), then \(d_{\Omega }(\gamma _{\pm }(s))\le \rho _0\) for \(s\in [0,r]\), since
This implies \(d_{\Omega }(\gamma _{\pm }(s))\le \rho _0\) for all \(s\in [0,t]\). Denote by \(\widehat{\gamma }_{\pm }\) the projection of \(\gamma _{\pm }\) onto \(\overline{\Omega }\), that is
From our construction of \(\widehat{\gamma }_{\pm }\), it is easy to see that \(\widehat{\gamma }_{\pm }(0)=x{\pm }h\) and for all \(s\in [0,t]\),
Moreover, in view of Lemma 3.8, we conclude that for almost all \(s\in [0,r]\)
To proceed with the proof we need estimates for \(\int ^r_0|\widehat{\gamma }_{+}(s)-\widehat{\gamma }_{-}(s)|^2\ ds\) and \(\int ^r_0|\dot{\widehat{\gamma }}_{+}(s)-\dot{\widehat{\gamma }}_{-}(s)|^2\ ds\). The first one is easily obtained by (3.6). That is
To obtain the second estimate, notice that
and
It is enough to give the estimate of
II. Estimate of \(\int ^r_0|\dot{\widehat{\gamma }}_{\pm }(s)-\dot{\gamma }_{\pm }(s)|^2\ ds\). We will only give the estimate for \(\int ^r_0|\dot{\widehat{\gamma }}_{+}(s)-\dot{\gamma }_{+}(s)|^2\ ds\) since the other is similar. Recalling Lemma 3.8 we conclude that for \(s\in [0,r]\),
In view of the fact that \(\langle D^2b_{\Omega }(x),Db_{\Omega }(x)\rangle =0\) for all \(x\in \Sigma _{\rho _0}\), we have that
Recall \(\gamma \in C^{1,1}([0,T,\overline{\Omega }])\), then \(|\dot{\gamma }(s)|\) is uniformly bounded by a constant independent of h and r. It follows there exists \(C_1>0\) such that
In view of Lemma 3.8, we obtain that
We observe that the set \(\{s\in [0,r]: \gamma _+(s)\in \overline{\Omega }^c\}\) is open and it is composed of countable union of disjoint open intervals \((a_i,b_i)\). Thus
Integrating by parts we conclude that
Notice \(\gamma _+(a_i),\gamma _+(b_i)\in \partial \Omega \) for all \(i\in \mathbb {N}\), so \(d_{\Omega }(\gamma _+(a_i))=d_{\Omega }(\gamma _+(b_i))=0\). Moreover, there exists \(C_2>0\) such that
also since \(\gamma \in C^{1,1}([0,T,\overline{\Omega }])\). Therefore
Combing the two estimates on \(I_1\) and \(I_2\), we have that
III. Fractional semiconcavity estimate of \(A_t(x,x^*)\). From the previous estimates we have that
Now, let \(\gamma \in \Gamma ^t_{x,x^*}(\overline{\Omega })\) be a minimizer for \(A_t(x,x^*)\). Thus,
Owing to (3.6), we have
On the other hand
Therefore, taking \(r=|h|^{\frac{1}{2}}\),
IV. Fractional semiconcavity estimate for u defined in (3.4). By using the fundamental solution and fix \(t=1\), we have
Thus the required semiconcavity estimate follow by the relation
where the infimum above achieves at \(y=y^*\). \(\square \)
3.3 Differentiability of Constrained Viscosity Solutions
Let u be a constrained viscosity solution of (HJ) on \(\overline{\Omega }\). Recall that, \(\gamma :[t_1,t_2]\rightarrow \overline{\Omega }\) is (u, L, c)-calibrated, if it satisfies
for any \([t'_{1}, t'_{2}] \subset [t_1,t_2]\).
Proposition 3.10
(Differentiability property I) Let u be a constrained viscosity solution of (HJ) on \(\overline{\Omega }\). Let \(x \in \Omega \) be such that there exists a (u, L, c)-calibrated curve \(\gamma :[-\tau ,\tau ] \rightarrow \Omega \) such that \(\gamma (0)=x\), for some \(\tau > 0\). Then, u is differentiable at x.
Proposition 3.11
(Differentiability property II) Let u be a constrained viscosity solution of (HJ) on \(\overline{\Omega }\). Let \(x \in \partial \Omega \) be such that there exists a (u, L, c)-calibrated curve \(\gamma :[-\tau ,\tau ] \rightarrow \Omega \) such that \(\gamma (0)=x\), for some \(\tau > 0\). For any direction y tangential to \(\Omega \) at x, the directional derivative of u at x in the direction y exists.
We omit the proof of Proposition 3.10 here since it follows by standard arguments, as for the case without the constraint \(\Omega \), and for this we refer to [22, Theorem 4.11.5]. We prove Proposition 3.11 in Appendix A, for the reader convenience, since it is given by a combination of the arguments in [22, Theorem 4.11.5] and the so-called projection method.
Let \(x \in \partial \Omega \) be such that there exists a (u, L, c)-calibrated curve \(\gamma :[-\tau ,\tau ]\rightarrow \overline{\Omega }\) with \(\gamma (0)=x\) for some \(\tau >0\). From Proposition 3.11, for any y tangential to \(\Omega \) at x, we have
Thus, one can define the tangential gradient of u at x by
Given \(x \in \partial \Omega \), each \(p \in D^{+}u(x)\) can be written as
where \(p^{\nu }=\langle p, \nu (x) \rangle \nu (x)\), and \(p^{\tau }\) is the tangential component of p, i.e., \(\langle p^{\tau }, \nu (x) \rangle =0\).
By similar arguments to the one in [12, Proposition 2.5, Proposition 4.3 and Theorem 4.3] and by Proposition 3.11 the following results can be obtained: Proposition 3.12, Corollary 3.13 and Proposition 3.14.
Proposition 3.12
Let \(x \in \partial \Omega \) and \(u:\overline{\Omega }\rightarrow \mathbb {R}\) be a Lipschitz continuous and semiconcave function. Then,
where
and
denotes the one-sided derivative of u at x in direction \(-\nu \).
Corollary 3.13
Let u be a constrained viscosity solution of (HJ) on \(\overline{\Omega }\). Let \(x \in \partial \Omega \) be a point such that there is a (u, L, c)-calibrated curve \(\gamma :[-\tau ,\tau ] \rightarrow \Omega \) such that \(\gamma (0)=x\), for some \(\tau > 0\). Then, all \(p\in D^+u(x)\) have the same tangential component, i.e.,
and
Proposition 3.14
Let u be a constrained viscosity solution of (HJ) on \(\overline{\Omega }\). Let \(x \in \partial \Omega \) be a point such that there is a (u, L, c)-calibrated curve \(\gamma :[-\tau ,\tau ] \rightarrow \Omega \) such that \(\gamma (0)=x\), for some \(\tau > 0\). Then,
Theorem 3.15
Let u be a constrained viscosity solution of (HJ) on \(\overline{\Omega }\). Let \(x \in \overline{\Omega }\) and \(\gamma :[-\tau ,\tau ]\rightarrow \overline{\Omega }\) be a (u, L, c)-calibrated curve with \(\gamma (0)=x\) for some \(\tau >0\). Then,
-
(i)
if \(x \in \Omega \), then
$$\begin{aligned} \dot{\gamma }(0)=D_{p}H(x, Du(x)); \end{aligned}$$ -
(ii)
if \(x \in \partial \Omega \), then
$$\begin{aligned} \dot{\gamma }(0)=D_{p}H(x, D^{\tau }u(x)+\lambda _{+}(x)\nu (x)). \end{aligned}$$
Proof
We first prove (i). Since \(\gamma \) is a calibrated curve, we have that for any \(\varepsilon \in (0,\tau ]\)
Thus, we deduce that
and passing to the limit as \(\varepsilon \rightarrow 0\), by Proposition 3.10 we get
Since u is a viscosity solution of equation (HJ) in \(\Omega \), then \(c=H(x,Du(x))\). Thus, we deduce that
By the properties of the Legendre transform, the above equality yields
In order to prove (ii), proceeding as above by Propositions 3.11 and 3.14 we get
Hence, we obtain that
This completes the proof. \(\square \)
3.4 Mather Set for Reversible Tonelli Lagrangians in \(\overline{\Omega }\)
Assume (A1). Set
Clearly the set \(\tilde{\mathcal {M}}_{\overline{\Omega }}\) is nonempty under assumption (A1) and we call \(\tilde{\mathcal {M}}_{\overline{\Omega }}\) the Mather set associated with the reversible strict Tonelli Lagrangian L. Note that
since L is reversible. Hence, it is straightforward to check that the constant curve at x is a minimizing curve for the action \(A_L(\cdot )\), where \(x\in \mathcal {M}_{\overline{\Omega }}:=\pi _1\tilde{\mathcal {M}}_{\overline{\Omega }}\). We call \(\mathcal {M}_{\overline{\Omega }}\) the projected Mather set.
Definition 3.16
(Mather measures) Let \(\mu \in \mathcal {P}(\overline{\Omega }\times \mathbb {R}^d)\). We say that \(\mu \) is a Mather measure for a reversible strict Tonelli Lagrangian L if \({{\,\mathrm{spt}\,}}(\mu )\subset \tilde{\mathcal {M}}_{\overline{\Omega }}\).
Remark 3.17
Let \(x\in \mathcal {M}_{\overline{\Omega }}\). Let u be a constrained viscosity solution of (HJ) on \(\overline{\Omega }\).
-
(i)
Obviously, the atomic measure \(\delta _{(x,0)}\), supported on (x, 0), is a Mather measure.
-
(ii)
Let \(\gamma (t)\equiv x\), \(t\in \mathbb {R}\). Note that \(u(\gamma (t'))-u(\gamma (t))=0\) for all \(t\le t'\) and that
$$\begin{aligned} \int _t^{t'}L(\gamma (s),\dot{\gamma }(s))ds+c(t'-t)=\int _t^{t'}L(x,0)ds+c(t'-t)=0, \end{aligned}$$where the last equality comes from (2.10). Hence, the curve \(\gamma \) is a (u, L, c)-calibrated curve.
-
(iii)
By Theorem 3.15, we have that
$$\begin{aligned} 0=\dot{\gamma }(0)=D_{p}H(x, Du(x)),\quad&\text {if}\ x\in \Omega \cap \mathcal {M}_{\overline{\Omega }},\nonumber \\ 0=\dot{\gamma }(0)=D_{p}H(x, D^{\tau }u(x)+\lambda _{+}(x)\nu (x)),\quad&\text {if}\ x \in \partial \Omega \cap \mathcal {M}_{\overline{\Omega }}. \end{aligned}$$(3.12)
Let \(\mu \in \mathcal {P}(\overline{\Omega }\times \mathbb {R}^d)\) be a Mather measure and set \(\mu _1:={\pi _1}\sharp \mu \). That is, \(\mu _1\) is a probability measure on \(\overline{\Omega }\) and \({{\,\mathrm{spt}\,}}(\mu _1)\subset \mathcal {M}_{\overline{\Omega }}\). Then, from Propositions 3.10 and 3.11 we get the following result.
Proposition 3.18
The map \(\pi _1: {{\,\mathrm{spt}\,}}(\mu )\rightarrow {{\,\mathrm{spt}\,}}(\mu _1)\) is one-to-one and the inverse is given by
The proof is a simple adaptation of Fathi [22, Corollary 4.12.14] and thus we omit it here.
4 Ergodic MFG with State Constraints
By the results proved so far we expect that the limit behavior of the MFG system (2.2) is described by the solutions of the following system:
where
and \(\lambda _{+}(x)\) is defined in Proposition 3.12.
4.1 Assumptions
From now on, we suppose that L is a reversible strict Tonelli Lagrangian on \(\mathbb {R}^d\). Let \(F: \mathbb {R}^d \times \mathcal {P}(\overline{\Omega }) \rightarrow \mathbb {R}\) be a function, satisfying the following assumptions:
- (F1):
-
for every measure \(m \in \mathcal {P}(\overline{\Omega })\) the function \(x \mapsto F(x,m)\) is of class \(C^{2}_{b}(\mathbb {R}^d)\) and
$$\begin{aligned} \mathcal {F}:=\sup _{m \in \mathcal {P}(\overline{\Omega })} \sum _{|\alpha |\le 2} \Vert D^{\alpha }F(\cdot , m)\Vert _{\infty } < +\infty , \end{aligned}$$where \(\alpha =(\alpha _1,\ldots ,\alpha _n)\) and \(D^{\alpha }=D^{\alpha _1}_{x_1}\cdots D^{\alpha _n}_{x_n}\);
- (F2):
-
for every \(x \in \mathbb {R}^d\) the function \(m \mapsto F(x,m)\) is Lipschitz continuous and
$$\begin{aligned} \mathrm{{Lip}}_{2}(F):=\displaystyle {\sup _{\begin{array}{c} x\in \mathbb {R}^d\\ m_1,\ m_2 \in \mathcal {P}(\overline{\Omega }) \\ m_1\ne m_2 \end{array} }}\frac{|F(x,m_1)-F(x,m_2)|}{d_{1}(m_1, m_2)} < +\infty ; \end{aligned}$$ - (F3):
-
there is a constant \(C_F>0\) such that for every \(m_{1}\), \(m_{2} \in \mathcal {P}(\overline{\Omega })\),
$$\begin{aligned} \int _{\overline{\Omega }}{(F(x,m_{1})-F(x, m_{2}))\ d(m_{1}-m_{2})} \ge C_F \int _{\overline{\Omega }}{\left( F(x,m_{1})-F(x,m_{2})\right) ^{2}\ dx}; \end{aligned}$$ - (A2):
-
\(\displaystyle {{\mathop {{{\,\mathrm{argmin}\,}}}\limits _{x \in \mathbb {R}^{d}}}}\big (L(x,0)+F(x,m)\big )\cap \overline{\Omega }\ne \emptyset \), \(\quad \forall m\in \mathcal {P}(\overline{\Omega })\).
Note that assumption (A2) is MFG counterpart of assumption (A1) which guarantees, as we will see, that for any measure m the Mather set associated with the Lagrangian \(L(x,v)+F(x,m)\) is non-empty.
Definition 4.1
(Solutions of constrained ergodic MFG system) A triple
is called a solution of constrained ergodic MFG system (4.1) if
-
(i)
\(\bar{u}\) is a constrained viscosity solution of the first equation of system (4.1);
-
(ii)
\(D\bar{u}\) exists for \(\bar{m}-\mathrm{a.e.} \ \ x \in \overline{\Omega }\);
-
(iii)
\(\bar{m}\) is a projected minimizing measure, i.e., there is a minimizing measure \(\eta _{\bar{m}}\) for \(L(x,v) + F(x,\bar{m})\) such that \(\bar{m}={\pi _{1}}\sharp \eta _{\bar{m}}\).
We denote by \(\mathcal {S}\) the set of solutions of system (4.1).
The next result shows the connection between the triple \((\bar{c}, \bar{u}, \bar{m}) \in \mathbb {R} \times C(\overline{\Omega }) \times \mathcal {P}(\overline{\Omega })\) given in the above definition and the constrained ergodic MFG system.
Proposition 4.2
Let \((\bar{c}, \bar{u}, \bar{m}) \in \mathcal {S}\). Then, \(\bar{m}\) satisfies the second equation in the sense of distributions, that is,
where the vector field V is related to \(\bar{u}\) in the following way:
-
(i)
if \(x\in \Omega \cap {{\,\mathrm{spt}\,}}(\bar{m})\), then \(D\bar{u}(x)\) exists and
$$\begin{aligned} V(x)=D_pH(x,D\bar{u}(x)); \end{aligned}$$ -
(ii)
if \(x\in \partial \Omega \cap {{\,\mathrm{spt}\,}}(\bar{m})\), then
$$\begin{aligned} V(x)=D_pH(x,D^{\tau }\bar{u}(x)+\lambda _{+}(x)\nu (x)), \end{aligned}$$where \(D^{\tau }\bar{u}(x)\) is defined in Corollary 3.13Footnote 2 and \(\lambda _{+}(x)\) is defined in (3.11).
The proof of Proposition 4.2 is an adaptation of [15, Theorem 3].
Definition 4.3
(Mean field Lagrangians and Hamiltonians) Let H be the reversible strict Tonelli Hamiltonian associated with L (reversible as well). For any \(m\in \mathcal {P}(\overline{\Omega })\), we define the mean field Lagrangian and Hamiltonian associated with m by
By assumption (F1), it is clear that for any given \(m\in \mathcal {P}(\overline{\Omega })\), \(L_m\) (resp. \(H_{m}\)) is a reversible strict Tonelli Lagrangian (resp. Hamiltonian). So, in view of (A2), all the results recalled and proved in Sect. 3 still hold for \(L_m\) and \(H_m\).
In view of Proposition 3.6, for any given \(m\in \mathcal {P}(\overline{\Omega })\), we have \(c_{H_{m}}=c_{L_m}\). Denoting by c(m) such common value we obtain the next result by an adaptation of [15, Lemma 1].
Lemma 4.4
(Lipschitz continuity of the critical value) The function \(m\mapsto c(m)\) is Lipschitz continuous on \(\mathcal {P}(\overline{\Omega })\) with respect to the metric \(d_{1}\), where the Lipschitz constant depends on F only.
4.2 Existence of Solutions of Constrained Ergodic MFG Systems
We are now in a position to prove that \(\mathcal {S}\ne \emptyset \).
Theorem 4.5
(Existence of solutions of (4.1)) Assume (F1), (F2), and (A2).
-
(i)
There exists at least one solution \((c_{H_{\bar{m}}},\bar{u},\bar{m})\) of system (4.1), i.e., \(\mathcal {S}\ne \emptyset \).
-
(ii)
Assume, in addition, (F3). Let \((c_{H_{\bar{m}_{1}}}, \bar{u}_{1}, \bar{m}_{1})\), \((c_{H_{\bar{m}_{2}}}, \bar{u}_{2}, \bar{m}_{2})\in \mathcal {S}\). Then,
$$\begin{aligned} F(x,\bar{m}_{1})= F(x,\bar{m}_{2}),\quad \forall x\in \overline{\Omega }\quad \text {and}\quad c_{H_{\bar{m}_{1}}}=c_{H_{\bar{m}_{2}}}. \end{aligned}$$
Remark 4.6
By (ii) in Theorem 4.5, it is clear that each element of \(\mathcal {S}\) has the form \((\bar{\lambda },\bar{u},\bar{m})\), where \(\bar{m}\) is a projected minimizing measure and \(\bar{\lambda }\) denotes the common Mañé critical value of \(H_{\bar{m}}\).
Proof of Theorem 4.5
The existence result (i) follows by the application of the Kakutani fixed point theorem. Indeed, by the arguments in Sect. 3, for any \(m\in \mathcal {P}(\overline{\Omega })\), there is a minimizing measure \(\eta _{m}\) associated with \(L_m\). Thus we can define a set-valued map as follows
where
Then, a fixed point \(\bar{m}\) of \(\Psi \) is a solution in the sense of distributions of the stationary continuity equation and there exists a constrained viscosity solution associated with \(H_{\bar{m}}\) by Mitake [21]. For more details see for instance [15, Theorem 3].
Let \((c_{H_{\bar{m}_{1}}}, \bar{u}_{1}, \bar{m}_{1})\), \((c_{H_{\bar{m}_{2}}}, \bar{u}_{2}, \bar{m}_{2})\in \mathcal {S}\). Given any \(T>0\), define the following sets of curves:
and
One can define Borel probability measures on \(\Gamma \) by
where
By definition, it is direct to see that \({{\,\mathrm{spt}\,}}(\mu _i)\subset \tilde{\mathcal {M}}_{\bar{m}_i}\) and
Given any \(x_0\in {{\,\mathrm{spt}\,}}(\bar{m}_1)\), let \(\gamma _1\) denote the constant curve \(t\mapsto x_0\), then for any \(t>0\) we have that
which imply that
By integrating the above inequality on \(\Gamma \) with respect to \(\mu _1\), we get that
In view of Fubini Theorem and (4.5), we deduce that
implying that
Exchanging the roles of \(\bar{m}_1\) and \(\bar{m}_2\), we obtain that
Hence, we get that
Recalling assumption (F3), we deduce that \(F(x,\bar{m}_2)=F(x,\bar{m}_1)\) for all \(x\in \overline{\Omega }\) and thus \(c_{H_{\bar{m}_{1}}}=c_{H_{\bar{m}_{2}}}\). \(\square \)
Remark 4.7
Note that even though the uniqueness result is a consequence of the classical Lasry–Lions monotonicity condition for MFG system, our proof here differs from the one in [15] and in [16]: indeed, in our setting the stationary continuity equation has different vector fields depending on the mass of the measure in \(\Omega \) and the mass on \(\partial \Omega \). This is why we addressed the problem representing the Mather measures associated with the system through measures supported on the set of calibrated curves.
5 Convergence of Mild Solutions of the Constrained MFG Problem
This section is devoted to the long-time behavior of first-order constrained MFG system (2.2). We will assume (F1)–(F3), (A2), and the following additional conditions:
- (U):
-
\(u^f\in C^1_b(U)\), where U is an open subset of \(\mathbb {R}^d\) such that \(\overline{\Omega }\subset U\).
- (A3):
-
the set-value map
$$\begin{aligned} (\mathcal {P}(\overline{\Omega }), d_{1}) \rightrightarrows (\mathbb {R}^{d}, |\cdot |), \quad m \mapsto {\mathop {{{\,\mathrm{argmin}\,}}}\limits _{x \in \overline{\Omega }}} \{L(x,0)+F(x,m)\} \end{aligned}$$has a Lipschitz selection, i.e., there exists a measurable map \(\xi ^{*}(m)\) such that \(\xi _{*}(m) \in {\mathop {{{\,\mathrm{argmin}\,}}}\limits _{x \in \overline{\Omega }}}\{L(x,0) + F(x,m)\}\) and, moreover, for any \(m \in \mathcal {P}(\overline{\Omega })\)
$$\min _{x \in \overline{\Omega }} \left\{ L(x,0)+F(x,m) \right\} =0.$$
Remark 5.1
Assumptions (A2) and (A3) imply that \(L(x,v)+F(x,m)\ge 0\) for all \((x,v)\in \mathbb {R}^d\times \mathbb {R}^d\) and all \(m\in \mathcal {P}(\overline{\Omega })\). Moreover, if \((u^{T}, m^{\eta })\) is a mild solution of the MFG system (2.2) then by (A3) we have that there exists a Lipschitz continuous curve \(\xi _{*}: [0,T] \rightarrow \overline{\Omega }\) such that
and \(L(\xi _{*}(t), \dot{\xi }_{*}(t))+F(\xi _{*}(t), m^{\eta }_{t})=0\) for any \(t \in [0,T]\).
We provide now two examples of mean field Lagrangian that satisfies assumption (A3).
Example 5.2
-
(1)
Let \(L_{m}(x,v)=\frac{1}{2}|v|^{2}+f(x)g(m)\) for some continuous functions \(f: \overline{\Omega }\rightarrow \mathbb {R}\) and \(g: \mathcal {P}(\overline{\Omega }) \rightarrow \mathbb {R}_{+}\). Then, we have that
$${\mathop {{{\,\mathrm{argmin}\,}}}\limits _{x \in \overline{\Omega }}}\{L(x,0)+f(x)g(m)\}={\mathop {{{\,\mathrm{argmin}\,}}}\limits _{x \in \overline{\Omega }}} f(x)g(m) = {\mathop {{{\,\mathrm{argmin}\,}}}\limits _{x \in \overline{\Omega }}}\, f(x) $$is independent of \(m \in \mathcal {P}(\overline{\Omega })\). Thus, for any given \(\bar{x} \in {\mathop {{{\,\mathrm{argmin}\,}}}\limits _{x \in \overline{\Omega }}}\ f(x)\) the Lipschitz selection of minimizers \(\xi _{*}(m) \equiv \bar{x}\) satisfies assumption (A3).
-
(2)
Let \(L_{m}(x,v)= \frac{1}{2}|v|^{2} + \big (f(x) + g(m) \big )^{2}\), where \(g: \mathcal {P}(\overline{\Omega }) \rightarrow \mathbb {R}\) is Lipschitz continuous with respect to the \(d_{1}\) distance and \(f: \overline{\Omega }\rightarrow \mathbb {R}\) is such that \(f^{-1}\) is Lipschitz continuous. Thus the minimum is reached at \(f(x)=-g(m)\) and by the assumptions on f and g such minimum has a Lipschitz dependence with respect to \(m \in \mathcal {P}(\overline{\Omega })\).
5.1 Convergence of Mild Solutions
In order to get the convergence result of mild solutions of system (2.2), we prove two preliminary results first.
Lemma 5.3
(Energy estimate) There exists a constant \(\bar{\kappa }\ge 0\) such that for any mild solution \((u^{T}, m^{\eta }_t)\) of constrained MFG system (2.2) associated with a constrained MFG equilibrium \(\eta \in \mathcal {P}_{m_{0}}(\Gamma )\), and any solution \((c(\bar{m}), \bar{u}, \bar{m})\) of constrained ergodic MFG system (4.1), there holds
where \(\bar{\kappa }\) depends only on L, F and \(\Omega \).
Proof
As we did in the proof of Theorem 4.5 (ii), one can define a Borel probability measure on \(\Gamma \) by
where
and
By definition, it is direct to check that \({{\,\mathrm{spt}\,}}(\bar{\eta })\subset \tilde{\mathcal {M}}_{\bar{m}}\) and
Note that
where \(\Gamma ^{*}_{\eta }\) is as in Definition 2.1. First, we consider term A:
Since \(\eta \) is a constrained MFG equilibrium associated with \(m_0\), then any curve \(\gamma \in {{\,\mathrm{spt}\,}}(\eta )\) satisfies the following equality
In view of (3.4) with \(L=L_{\bar{m}}\), one can deduce that
Hence, we have that
By Proposition 3.4 we estimate the second term of the right-hand side of the above inequality as follows:
where \(K_{2}:=C\cdot \Big ( \sup _{x\in \overline{\Omega }, |v|\le 1}L(x,v)+\mathcal {F}+c(\bar{m})\Big )\) comes from Proposition 3.4. In view of Lemma 4.4 and the compactness of \(\mathcal {P}(\overline{\Omega })\), \(K_2\) is well-defined and depends only on L, F and \(\Omega \). For the first term, since \(u^{f}\) is bounded on \(\overline{\Omega }\), we only need to estimate \(u^{T}(0, \gamma (0))\) where \(\gamma \in {{\,\mathrm{spt}\,}}(\eta )\).
Take \(\xi _{*}\) as in assumption (A3) and Remark 5.1. Since \(\Omega \) is C-quasiconvex, there is \(\beta \in \Gamma \) such that \(\beta (0)=\gamma (0)\), \(\beta (\tau (\gamma (0), \xi _{*}(0)))=\xi _{*}(0)\) and \(|\dot{\beta }(t)| \le 1\) a.e. in \(t \in [0, \tau (\gamma (0), \xi _{*}(0))]\), where \(\tau (\gamma (0), \xi _{*}(0))\le C|\gamma (0)-\xi _{*}(0)|\). Define a curve \(\xi \in \Gamma \) as follows:
If \(T\ge \tau (\gamma (0),\xi _{*}(0))\), since \((u^T,m^{\eta }_t)\) is mild solution of (2.2), we deduce that
Thus, by (A3) we have that the second integral of the right-hand side of the above inequality is zero. Hence,
We can conclude that
If \(T<\tau (\gamma (0),\xi _{*}(0))\), in view if Remark 5.1, we get that
Thus, we can get (5.2) again.
Now we estimate term B. Note that
By Remark 5.1, we obtain that
and since \(\bar{\gamma }\in {{\,\mathrm{spt}\,}}(\bar{\eta })\) is a constant curve we deduce that
Hence, we have that
Therefore, combining (5.2) and (5.3) we conclude that
\(\square \)
Lemma 5.4
Let \(f: \overline{\Omega }\rightarrow \mathbb {R}\) be a Lipschitz continuous function with Lipschitz constant \(\mathrm{Lip}[f] \le M\) for some constant \(M \ge 0\). Then, there exists a constant \(C(d,M)\ge 0\) such that
Proof
Fix \(x_{0} \in \partial \Omega \) and fix a radius \(r \ge 0\). We divide the proof into two parts: first, we assume that \(\overline{\Omega }\) coincides with the half-ball centered in \(x_{0}\) with radius r contained in \(\{x \in \mathbb {R}^{d}: x_{d} \ge 0\}\) such that \(x_{0} \in \{x \in \mathbb {R}^{d}: x_{d}=0\}\); then, we remove this constraint proving the result for a general domain \(\Omega \).
Part I: we denote by \(B^{+}\) the set \(\overline{B}_{r}(x_{0}) \cap \{x \in \mathbb {R}^{d}: x_{d} \ge 0\}\) and by \(B^{-}\) the complement of \(B^{+}\). Let \(\tilde{f}\) denote the following extension of f in \(\overline{B}_{r}(x_{0})\):
Let \(\chi _{r}\) denote a cut-off function such that \(\chi _{r}(x)=1\) for \(x \in B_{r}(x_{0})\), \(\chi _{r}(x)=0\) for \(x \in \mathbb {R}^{d} \backslash B_{2r}(x_{0})\) and \(0 \le \chi _{r}(x) \le 1\) for \(x \in B_{2r}(x_{0}) \backslash B_{r}(x_{0})\) and let \(\tilde{f}_{r}\) be the extension of \(\tilde{f}\) on \(\mathbb {R}^{d}\), i.e. \(\tilde{f}_{r}(x):= \tilde{f}\cdot \chi _{r}(x)\). Moreover, for any \(\delta > 0\) we consider a cover of \(\overline{B}_{r}(x_{0})\) through cubes of length \(\delta \) denoted by \(Q_{\delta }\). Then, by construction we have that for any cube \(Q_{\delta }\)
for some constant \(C(\delta ) \ge 0\). Therefore, applying Lemma 4 in [15] we get
Thus, recalling that by construction \(B^{+} \equiv \overline{\Omega }\) we obtain that by (5.4)
Part II: let \(x_{0} \in \partial \Omega \) be such that \(\Omega \) is not flat in a neighborhood of \(x_{0}\), that is we are in case I. Then, we can find a \(C^{1}\) mapping \(\Phi \), with inverse given by \(\Psi \) such that changing the coordinate system according to the map \(\Phi \) we obtain that \(\Omega ^{\prime }:=\Phi (\Omega )\) is flat in a neighborhood of \(x_{0}\). Proceeding similarly as in Part I, we define
and
Thus, if we set \(y=\Phi (x)\), we have that \(x=\Psi (y)\), and if we define \(f^{\prime }(y)=f(\Psi (y))\) then by Parti I we get
which implies, returning to the original coordinates, that
for a general domain \(\Omega \) not necessarily flat in a neighborhood of \(x_{0} \in \partial \Omega \).
Since \(\Omega \) is compact, there exists a finitely many points \(x^{0}_{i} \in \partial \Omega \), neighborhood \(W_{i}\) is \(x^{0}_{i}\) and functions \(f^{\prime }_{i}\) defined as before for \(i =1, \dots , N\), such that, fixed \(W_{0} \subset \Omega \), we have \(\Omega \subset \bigcup _{i=1}^{N} W_{i}\). Furthermore, let \(\{\zeta _{i}\}_{i=1, \dots , N}\) be a partition of unit associated with \(\{ W_{i}\}_{i =1, \dots , N}\) and define \(\bar{f}(x)=\sum _{i=1}^{N}{\zeta _{i}f^{\prime }_{i}(x)}\). Then, by (5.5) applied to \(\bar{f}\) we get the conclusion. \(\square \)
Theorem 5.5
(Convergence of mild solutions of (2.2)) For each \(T>1\), let \((u^{T}, m^{\eta }_t)\) be a mild solution of (2.2). Let \((c(\bar{m}), \bar{u}, \bar{m})\in \mathcal {S}\). Then, there exists a positive constant \(C'\) such that
where \(C'\) depends only on L, F, \(u^{f}\) and \(\Omega \).
Proof
Let \(\bar{v}(x)= \bar{u}(x)-\bar{u}(0)\) and define
Since \((\bar{\lambda }, \bar{u}, \bar{m})\) is a solution of (4.1), one can deduce that w is a constrained viscosity solution of the Cauchy problem
So, w(t, x) can be represented as the value function of the following minimization problem
Since \((u^{T}, m^{\eta }_t)\) is a mild solution of (2.2), in view of (2.4) we get that
We prove inequality (5.7) first. By Lemma 5.4 below and Hölder’s inequality, we get
Now, by assumption (F3) and Lemma 5.3 the term
is bounded by a constant depending only on L, F and \(\Omega \), while
Inequality (5.7) follows.
Next, we prove (5.6). For any given \((x,t)\in \overline{\Omega }\times [0,T]\), let \(\gamma ^*:[0,T]\rightarrow \overline{\Omega }\) be a minimizer of problem (5.8). By (5.8) and (5.9), we have that
By (5.10), we get
Let us first consider term B. Note that
where \(C'>0\) is a constant depending only on L, F and \(\Omega \).
Since \(\bar{u}\) and \(u^f\) are continuous functions on \(\overline{\Omega }\), we can conclude that \(A \le O(\frac{1}{T})\), which together with (5.11) implies that
Moreover, for any given \((x,t)\in \overline{\Omega }\times [0,T]\), let \(\xi ^{*}(\cdot )\) be a minimizer of problem (5.9). In view of (5.8) and (5.9), we deduce that
So, by almost the same arguments used above, one obtains
which completes the proof of the theorem. \(\square \)
Notes
The symbol \(\mathcal {P}(\Gamma )\) here stands for the space of probability measures on \(\Gamma \) with the Borel \(\sigma \)-algebra.
Note that since \(x \in supp(\bar{m})\) then there is a (u, L, c)-calibrated curve \(\gamma :[-\tau ,\tau ] \rightarrow \Omega \) such that \(\gamma (0)=x\), for some \(\tau > 0\).
References
Lasry, J.-M., Lions, P.-L.: Jeux á champ moyen. I. Le cas stationnaire (French) [mean field games. I. The stationary case]. C. R. Math. Acad. Sci. Paris 343 619–625 (2006)
Lasry, J.-M., Lions, P.-L.: Jeux à champ moyen. II. Horizon fini et controle optimal (French) [mean field games. II. Finite horizon and optimal control]. C. R. Math. Acad. Sci. Paris 343 679–684 (2006)
Lasry, J.-M., Lions, P.-L.: Mean field games. Jpn. J. Math. 2 229–260 (2007)
Huang, M., Malhamé, R..P., Caines, P..E.: Large-population cost-coupled LQG problems with nonuniform agents: individual-mass behavior and decentralized \(\epsilon \)-Nash equilibria. IEEE Trans. Autom. Control 52, 1560–1571 (2007)
Huang, M., Malhamé, R.P., Caines, P.E.: Large population stochastic dynamic games: closed-loop Mckean–Vlasov systems and the Nash certainty equivalence principle. Commun. Inf. Syst. 6, 221–251 (2006)
Cardaliaguet, P.: Notes on mean field games from P.-L. lions lectures at Collége de France (2012) (unpublished)
Gomes, D.A., Pimentel, E.A., Voskanyan, V.: Regularity Theory for Mean-Field Game Systems. Springer (2016)
Bensoussan, A., Frehse, J., Yam, P.: Mean Field Games and Mean Field Type Control Theory. Springer (2013)
Carmona, R., Delarue, F.: Probabilistic Theory of Mean Field Games with Applications. Springer (2017)
Cannarsa, P., Capuani, R.: Existence and uniqueness for mean field games with state constraints. In: PDE Models for Multi-Agent Phenomena, Springer INdAM Ser., vol. 28. Springer, Cham (2018)
Cannarsa, P., Capuani, R., Cardaliaguet, P.: C\(^{1,1}\)-Smoothness of constrained solutions in the calculus of variations with application to mean field games. Math. Eng. (Springfield) 1(1), 174–203 (2019)
Cannarsa, P., Capuani, R., Cardaliaguet, P.: Mean field games with state constraints: from mild to pointwise solutions of the PDE system. Calc. Var. Part. Differ. Equ. 60(3), 33 (2021)
Cardaliaguet, P., Lasry, J.-M., Lions, P.-L., Porretta, A.: Long time average of mean field games. Netw. Heterog. Media 7(2), 270–301 (2012)
Cardaliaguet, P., Lasry, J.-M., Lions, P.-L., Porretta, A.: Long time average of mean field games with a nonlocal coupling. SIAM J. Control Optim. 51(5), 3558–3591 (2013)
Cannarsa, P., Cheng, W., Mendico, C., Wang, K.: Long-time behavior of first-order mean field games on Euclidean space. Dyn. Games Appl. 10(2), 361–390 (2020)
Cardaliaguet, P.: Long time average of first order mean field games and weak kam theory. Dyn. Games Appl. 3, 473–488 (2013)
Cardaliaguet, P., Porretta, A.: Long time behavior of the master equation in mean field game theory. Anal. PDE 12(6), 1397–1453 (2019)
Soner, M.: Optimal control with state-constraint. I. SIAM. J. Control Optim. 24, 552–561 (1986)
Bardi, M., Capuzzo-Dolcetta, I.: Optimal Control and Viscosity Solutions of Hamilton–Jacobi–Bellman Equations. Birkhäuser, Boston (1997)
Capuzzo-Dolcetta, I., Lions, P.-L.: Hamilton–Jacobi equations with state constraints. Trans. Am. Math. Soc. 318, 643–683 (1990)
Mitake, H.: Asymptotic solutions of Hamilton–Jacobi equations with state constraints. Appl. Math. Optim. 58, 393–410 (2008)
Fathi, A.: Weak KAM Theorem and Lagrangian Dynamics (unpublished)
Villani, C.: Topics in optimal transportation. In: Graduate Studies in Mathematics, vol. 58. American Mathematical Society, Providence (2003)
Fathi, A., Maderna, E.: Weak kam theorem on non compact manifolds. NoDEA Nonlinear Differ. Equ. Appl. 14, 1–27 (2007)
Contreras, G.: Action potential and weak KAM solutions. Calc. Var. Part. Differ. Equ. 13, 427–458 (2001)
Contreras, G., Iturriaga, R.: Global minimizers of autonomous Lagrangians. In: 22nd Colóuio Brasileiro de Matemática. Instituto de Matemática Pura e Aplicada (IMPA), Rio de Janeiro (1999)
Mañé, R.: Lagrangian flows: the dynamics of globally minimizing orbits. Bol. Soc. Brasil. Mat. (N.S.) 28, 141–153 (1997)
Evans, L.: Partial differential equations. Graduate Studies in Mathematics, 19. American Mathematical Society, Providence, RI (1998)
Brudnyi, A., Brudnyi, Y.: Methods of geometric analysis in extension and trace problems. Volume 1. In: Monographs in Mathematics, vol. 102. Birkhäuser/Springer (2012)
Acknowledgements
Piermarco Cannarsa was partly supported by Istituto Nazionate di Alta Matematica (GNAMPA 2019 Research Projects) and by the MIUR Excellence Department Project awarded to the Department of Mathematics, University of Rome Tor Vergata, CUP E83C18000100006. Wei Cheng was partly supported by Natural Scientific Foundation of China (Grant Nos. 11871267, 11631006 and 11790272). Cristian Mendico was partly supported by Istituto Nazionale di Alta Matematica (GNAMPA 2019 Research Projects). Part of this paper was completed while the third author was visiting the Department of Mathematics of the University of Rome Tor Vergata. Kaizhi Wang was partly supported by National Natural Science Foundation of China (Grant Nos. 11771283, 11931016) and Innovation Program of Shanghai Municipal Education Commission (Grant Nos. 2021-01-07-00-02-E00087). The four authors are grateful to the anonymous referees for the instructive comments.
Funding
Open access funding provided by Università degli Studi di Roma Tor Vergata within the CRUI-CARE Agreement.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix A: Proof of Proposition 3.11
Appendix A: Proof of Proposition 3.11
Without any loss of generality, assume there is a curve \(\gamma :[-\tau ,\tau ] \rightarrow \Omega \) satisfying \(\gamma (0)=x\) and
for any \([t_{1}, t_{2}] \subset [-\tau ,\tau ]\), where \(\tau >0\) is a constant. Let \(y \in \mathbb {R}^{d}\) be such that \(\langle y, \nu (x) \rangle = 0\), where \(\nu (x)\) is the outward unit normal to \(\partial \Omega \) at x. Let \(y_{i}\in \mathbb {R}^{d}\) and \(\lambda _{i}>0\), \(i \in \mathbb {N}\) be such that
-
\(y_{i} \rightarrow y\) and \(\lambda _i \rightarrow 0\), as \(i \rightarrow \infty \);
-
\(x+\lambda _{i} y_{i} \in \overline{\Omega }\), \(\forall i\in \mathbb {N}\).
By similar arguments in Proposition 3.10, we only need to prove that
Now we prove the first inequality in (A.1) and we omit the proof of the second since it follows by a similar argument. For each \(i\in \mathbb {N}\), we define a curve \(\gamma _{i}: [-\varepsilon , 0] \rightarrow \mathbb {R}^{d}\) by
where \(0<\varepsilon <\tau \) will be suitably chosen later. Define the curve \(\hat{\gamma }_{i}: [-\varepsilon ,0] \rightarrow \overline{\Omega }\) as the projection of \(\gamma _{i}\) onto \(\overline{\Omega }\), that is,
Thus, by (3.4) and the property of (u, L, c)-calibrated curves we have that
Taking the difference of the two expressions, we get
Moreover, by regularity of the data and the Lagrangian L we get
Let \(\varepsilon =\lambda _{i}\). Then,
(i) since \(d_{\Omega }(\gamma _{i}(s)) \le \lambda _{i}|y_i|\) and \(|D_{x}L(\gamma (s), \dot{\gamma }(s))| \le C(1+ \Vert \dot{\gamma }\Vert ^2_{\infty })\), we deduce that
is bounded. Thus,
as \(i \rightarrow \infty \). Moreover, by similar argument we deduce that
as \(i \rightarrow \infty \).
(ii) Since b and \(\gamma \) are smooth functions, we have that
Moreover, \(|D_{v}L(\gamma (s), \dot{\gamma }(s))| \le C(1+\Vert \dot{\gamma }\Vert _{\infty }).\) Thus,
So, since \(\mathbf{1}_{\Omega ^{c}}(\gamma _{i}(s)) \big \langle Db(\gamma _{i}(s)), D_{v}L(\gamma (s), \dot{\gamma }(s)) \big \rangle \) is bounded we have that the last integrand is bounded independently of \(\lambda _{i}\). Furthermore, since \(y_{i} \rightarrow y\) and \(\langle \nu (x), y \rangle =0\) we get
as \(i\rightarrow \infty \).
Therefore, we obtain that
\(\square \)
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Cannarsa, P., Cheng, W., Mendico, C. et al. Weak KAM Approach to First-Order Mean Field Games with State Constraints. J Dyn Diff Equat 35, 1885–1916 (2023). https://doi.org/10.1007/s10884-021-10071-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10884-021-10071-9
Keywords
- Weak KAM theory
- Mean field games
- State constraints
- Semiconcave functions
- Long-time behavior of solutions