Abstract
We consider a Hamilton–Jacobi equation associated to the Mayer optimal control problem in the Wasserstein space \(\mathscr {P}_2(\mathbb {R}^{d})\) and define its solutions in terms of the Hadamard generalized differentials. Continuous solutions are unique whenever we focus our attention on solutions defined on explicitly described time dependent compact valued tubes of probability measures. We also prove some viability and invariance theorems in the Wasserstein space and discuss a new notion of proximal normal.
Similar content being viewed by others
References
Ambrosio, L., Crippa, G.: Continuity equations and ODE flows with non-smooth velocity. Proc. R. Soc. Edinburgh Sect. A Math. 144, 1191–1244 (2014)
Ambrosio, L., Feng, J.: On a class of first order Hamilton–Jacobi equations in metric spaces. J. Differ. Equ. 256, 2194–2245 (2014)
Ambrosio, L., Gigli, N.: A user’s guide to optimal transport. In: Modelling and Optimisation on Flows on Networks, Lecture Notes in Mathematics. Springer (2012)
Ambrosio, L., Gigli, N., Savaré, G.: Gradient Flows in Metric Spaces and in the Space of Probability Measures. Birkhäuser, Basel (2000)
Aubin, J.-P., Frankowska, H.: Set-Valued Analysis. Birkhäusser, Basel (1990)
Bongini, M., Fornasier, M., Rossi, F., Solombrino, F.: Mean field Pontryagin maximum principle. J. Optim. Theory Appl. 175, 1–38 (2017)
Bonnet, B., Frankowska, H.: Differential inclusions in Wasserstein spaces: the Cauchy–Lipschitz framework. J. Differ. Equ. 271, 594–637 (2021)
Bonnet, B., Frankowska, H.: Necessary optimality conditions for optimal control problems in Wasserstein spaces. Applied Mathematics and Optimisation. Published online https://link.springer.com/article/10.1007/s00245-021-09772-w (2021)
Bonnet, B., Frankowska, H.: Sensitivity analysis of the value function of mean-field optimal control problems and applications. to appear in J. Math. Pures Appl.
Bonnet, B., Rossi, F.: The Pontryagin maximum principle in the Wasserstein space. Calculus Var. Partial Differ. Equ. 58, 11 (2019)
Cannarsa, P., Sinestrari, C.: Semiconcave Functions, Hamilton–Jacobi Equations, and Optimal Control. Birkhäuser, Boston (2004)
Cavagnari, G., Marigonda, A., Piccoli, B.: Generalized dynamic programming principle and sparse mean-field control problems. JMAA 481, 1 (2020)
Crandall, M.G., Lions, P.-L.: Viscosity solutions of Hamilton–Jacobi equations. Trans. Am. Math. Soc. 277, 1–42 (1983)
Crandall, M.G., Evans, L.C., Lions, P.-L.: Some properties of viscosity solutions of Hamilton–Jacobi equation. Trans. Am. Math. Soc. 282, 487–502 (1984)
Diestel, J.: Remarks on weak compactness in \(L^1 (\mu, X)\). Glasgow Math. J. 18, 87–91 (1977)
Feng, J., Kurtz, T.G.: Large Deviations for Stochastic Processes, Mathematical Surveys and Monographs, vol. 131. AMS, Providence (2006)
Feng, J., Katsoulakis, M.: A comparison principle for Hamilton–Jacobi equations related to controlled gradient flows in infinite dimensions. Arch. Ration. Mech. Anal. 192, 275–310 (2009)
Feng, J., Nguyen, T.: Hamilton–Jacobi equations in space of measures associated with a system of conservation laws. J. Math. Pures Appl. 97, 318–390 (2012)
Fornasier, M., Solombrino, F.: Mean field optimal control. ESAIM COCV 20, 1123–1152 (2014)
Frankowska, H.: Optimal trajectories associated to a solution of contingent Hamilton–Jacobi equations. Appl. Math. Optim. 19, 291–311 (1989)
Frankowska, H.: Lower semicontinuous solutions of Hamilton–Jacobi–Bellman equations. SIAM J. Control Optim. 31, 257–272 (1993)
Frankowska, H., Plaskacz, S., Rzeżuchowski, T.: Measurable viability theorems and Hamilton–Jacobi–Bellman equation. J. Differ. Equ. 116, 265–305 (1995)
Gangbo, W., Tudorascu, A.: On differentiability in the Wasserstein space and well-posedness for Hamilton–Jacobi equations. J. Math. Pures Appl. 125, 119–174 (2019)
Gozlan, N., Roberto, C., Samson, P.-M.: Hamilton–Jacobi equations on metric spaces and transport entropy inequalities. Rev. Mat. Iberoam. 30, 133–163 (2014)
Green, J.-W., Valentine, F.A.: On the Arzela–Ascoli theorem. Math. Mag. 34, 199–202 (1960)
Ishii, H.: Perron’s method for Hamilton–Jacobi equations. Duke Math. J. 55, 369–384 (1987)
Jimenez, C., Marigonda, A., Quincampoix, M.: Optimal control of multiagent systems in the Wasserstein space. Calculus Var. Partial Differ. Equ. (2020)
Lions, P.-L., Perthame, B.: Remarks on Hamilton–Jacobi equations with measurable time-dependent Hamiltonians. Nonlinear Anal. TMA 11, 613–621 (1987)
Marigonda, A., Quincampoix, M.: Mayer control problem with probabilistic uncertainty on initial positions. J. Differ. Equ. 264, 3212–3252 (2018)
Pogodaev, N.: Optimal control of continuity equations. Nonlinear Differ. Equ. Appl. 23, 21 (2016)
Soulaimani, S.A.: Viability with probabilistic knowledge of initial condition, application to optimal control. Set Valued Anal. 16, 1037–1060 (2008)
Villani, C.: Optimal Transport: Old and New. Springer, Berlin (2009)
Villani, C.: Topics in Optimal Transportation, Graduate Studies in Mathematics, vol. 58. American Mathematical Society, Providence (2003)
Acknowledgements
The authors are grateful to Benoît Bonnet for the idea of the proof of the claim in Step 1.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by A. Mondino.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This material is based upon work supported by the Air Force Office of Scientific Research under Award Number FA9550-18-1-0254.
Appendix
Appendix
We equip the space \([0,1] \times \mathscr {P}_{2}(\mathbb {R}^{d})\) with the following metric: for \((s_i,\mu _i) \in [0,1] \times \mathscr {P}_{2}(\mathbb {R}^{d}), \, i=1,2\)
and denote by \(B((s,\mu ), R)\) the closed ball in this space with center at \((s,\mu ) \in [0,1] \times \mathscr {P}_{2}(\mathbb {R}^{d})\) and radius \(R \ge 0\).
Proof of Lemma 6.1
Set \(K = \mathscr {E}p(w)\) and let \((s,\nu ), \, ({\bar{t}},{\bar{\mu }}) \in \Delta _r\) and \(z \in \mathbb {R}\) be as in the statement of the lemma. Then for any \((t,\mu , z') \in K\),
We first consider the case \(z \ne w({\bar{t}}, {\bar{\mu }})\). Pick any \((\kappa , F, m) \in \overset{\circ }{T}_{K}({\bar{t}}, {\bar{\mu }}, w({\bar{t}}, {\bar{\mu }}))\). Then there exists a sequence \(h_i \rightarrow 0+\) such that
Let \(\alpha \in \Pi _{0}({\bar{\mu }}, \nu )\) and \({\bar{\alpha }}\) be its barycentric projection with respect to \({\bar{\mu }}\). Dividing by \(2h_i>0\) and taking the limit in the above inequality as \(i \rightarrow \infty \) we obtain, using the same arguments as in the proof of Proposition 2.14,
Consider \(p \in L^2({\bar{\mu }};\mathbb {R}^{d})\) such that \(p(x)={\bar{\alpha }} (x)- x\) \({\bar{\mu }}\)-a.e. Then the above inequality implies
As in Proposition 2.20 we get
Therefore, by the assumptions of lemma,
Since the Hamiltonian is positively homogeneous with respect to the second variable, multiplying by \(|z - w({\bar{t}}, {\bar{\mu }}) |\) we obtain the desired inequality.
It remains to consider the much more delicate case \(z = w({\bar{t}}, {\bar{\mu }})\). Let \(\gamma \in \Pi _{0}({\bar{\mu }}, \nu )\) and define
By [4, Theorem 7.2.2], \(W_2(\nu _n,\nu )= \frac{1}{n}W_2({\bar{\mu }},\nu )\). That is \(\lim _{n \rightarrow \infty }\nu _n=\nu \) in \(W_2\) metric. We also define
and observe that \(\lim _{n \rightarrow \infty }s_n = s\), \(z = \frac{1}{n} w({\bar{t}}, {\bar{\mu }}) + \left( 1-\frac{1}{n} \right) z = w({\bar{t}}, {\bar{\mu }}). \)
Fix n.
Step 1. We prove here that
Let \((t,\mu ,m) \in K\) be such that \(\mathrm{dist} ((s_n,\nu _n, z),K)= d ((s_n,\nu _n, z),(t,\mu ,m) )\). It exists because \(\Delta _r\) is compact and K is closed. Then
By [11, Proposition 1.1.3],
and
By [4, (7.3.12)] we also have
Summing up the above inequalities we obtain
From (7.1) we deduce that \(\rho _n \le \left( 1-\frac{1}{n} \right) d ((s,\nu , z),(t, \mu ,m)) \) and therefore
The above inequality implies that \(( t, \mu , m ) =({\bar{t}}, {\bar{\mu }},w({\bar{t}}, {\bar{\mu }}) )\) and (7.2) follows.
Step 2. Let \((t,\mu ) \notin B_n\). We claim that \(d_2((t,\mu ),(s_n,\nu _n))=\mathrm{dist} ((t,\mu ), B_n) + \rho _n. \)
Indeed, denoting by \(\partial B_n\) the boundary of \(B_n\) we have
which yields
Consider any \(\gamma \in \Pi _0(\mu ,\nu _n)\) and let \(\mu _\lambda = ((1-\lambda ) \pi _1 +\lambda \pi _2)_\#\gamma . \) Then the mapping
is continuous with respect to \(\lambda \in [0,1]\) and \(\varphi (0) > \rho _n^2\), \(\varphi (1) =0\). This implies that there exists \(\lambda \in (0,1)\) such that \(\varphi (\lambda )=\rho _n^2.\) Hence \(((1-\lambda )t +\lambda s_n, \mu _\lambda )\) is an element of \(\partial B_n\) and we deduce that \((1-\lambda )\left( (t-s_n)^2 + W_2^2 (\mu , \nu _n)\right) ^{1/2} = \rho _n\). This and the triangle inequality yield
Consequently,
Step 3. For every integer \(k \ge 1\) consider the minimization problem
Denote by \((t_k,\mu _k)\) a minimizer that exists because \(\Delta _r\) is compact and w is lower semicontinuous.
Case 1. We assume here that for some k, \((t_k,\mu _k) \in B_n \) and claim that \((t_k,\mu _k)=({\bar{t}}, {\bar{\mu }})\). Indeed, in this case \(w(t_k,\mu _k) \le w({\bar{t}}, {\bar{\mu }}) \). Therefore, \((t_k,\mu _k, w({\bar{t}}, {\bar{\mu }})) \in K\). On the other hand,
and our claim follows from (7.2). Hence
Let \(\alpha _n \in \Pi _{0}({\bar{\mu }}, \nu _n)\), \({\bar{\alpha }}_n \) be its barycenter with respect to \({\bar{\mu }} \) and let \(p \in L^2({\bar{\mu }} ;\mathbb {R}^{d})\) satisfy \(p(x)={\bar{\alpha }}_n (x)- x\) \({\bar{\mu }}\)-a.e. Consider any \((\kappa , F) \in \overset{\circ }{T}_{\Delta _r}({\bar{t}}, {\bar{\mu }})\) and \(h_i \rightarrow 0+, \, (\tau _i,\xi _i) \in \Delta _r\) such that
with \(|\tau _i-{\bar{t}} - h_i \kappa | + W_2(\xi _i, (Id+h_i F)_{\#}{\bar{\mu }}) = o(h_i )\).
We discuss three possible occurrences:
-
(a)
There exists a subsequence \(\{i_j\}_j\) such that \(d_2((\tau _{i_j},\xi _{i_j}), (s_n,\nu _n)) >\rho _n\) for every j. Then \((\tau _{i_j},\xi _{i_j}) \notin B_n\) and by Step 2
$$\begin{aligned} w({\bar{t}}, {\bar{\mu }}) + k \rho _n \le w( \tau _{i_j}, \xi _{i_j}) + k d_2(( \tau _{i_j},\xi _{i_j}), (s_n,\nu _n)) \quad \forall \, j. \end{aligned}$$(7.3)On the other hand, \( W_2^2(\xi _{i_j},\nu _n )= W_2^2((Id+h_{i_j} F)_{\#}{\bar{\mu }},\nu _n) +o(h_{i_j}) \) and therefore from (7.3) we obtain
$$\begin{aligned} w({\bar{t}}, {\bar{\mu }}) + k \rho _n \le w( \tau _{i_j}, \xi _{i_j}) + k \sqrt{ d_2^2(({\bar{t}} + h_{i_j}\kappa ,(Id+h_{i_j}F)_{\#}{\bar{\mu }}),(s_n,\nu _n) ) + o(h_{i_j})}.\nonumber \\ \end{aligned}$$(7.4)Since \(\alpha _n\in \Pi _{0}({\bar{\mu }} ,\nu _n )\) we know that \((\pi _1 +h_{i_j}F\circ \pi _1 , \pi _2 )_{\#}\alpha _n\) is a transport plan between \( (Id+h_{i_j}F)_{\#}{\bar{\mu }}\) and \(\nu _n\). Thus
$$\begin{aligned} \begin{array}{ll} W_{2}^{2}( (Id+h_{i_j}F)_{\#}{\bar{\mu }}, \nu _n) &{} \le \displaystyle { \int _{\mathbb {R}^{d}\times \mathbb {R}^{d}}|x+h_{i_j}F(x)-y|^{2} \mathrm {d}\alpha _n(x,y)}\\ &{} \displaystyle { = W_2^2({\bar{\mu }},\nu _n) + 2h_{i_j} \int _{\mathbb {R}^{d}\times \mathbb {R}^{d}} \langle x-y, F(x) \rangle \mathrm {d}\alpha _n(x,y) +o(h_{i_j})} \end{array} \end{aligned}$$and
$$\begin{aligned} ({\bar{t}} + h_{i_j}\kappa&-s_n)^2 + \; W_2^2((Id+h_{i_j} F)_{\#}{\bar{\mu }},\nu _n)\\&\quad \displaystyle \le ({\bar{t}} -s_n)^2 \\&\quad + 2h_{i_j}({\bar{t}} -s_n)\kappa + W_2^2({\bar{\mu }},\nu _n) + 2h_{i_j} \int _{\mathbb {R}^{d}\times \mathbb {R}^{d}} \langle x-y, F(x) \rangle \mathrm {d}\alpha _n(x,y) +o(h_{i_j})\\&\quad \displaystyle { = \rho _n^2\left( 1+ \frac{2h_{i_j}}{ \rho _n^2} \left( ({\bar{t}} -s_n)\kappa + \int _{\mathbb {R}^{d}\times \mathbb {R}^{d}} \langle x-y, F(x) \rangle \mathrm {d}\alpha _n(x,y) \right) + \frac{1}{ \rho _n^2}o(h_{i_j}) \right) . } \end{aligned}$$This and (7.4) imply
$$\begin{aligned} -\frac{k}{\rho _n} \left( ({\bar{t}}-s_n)\kappa + \int _{\mathbb {R}^{d} \times \mathbb {R}^{d} }\langle x-y, F(x) \rangle \mathrm{d }\alpha _n(x,y) \right) \le D_{\uparrow }w({\bar{t}}, {\bar{\mu }})(\kappa ,F). \end{aligned}$$(7.5) -
(b)
There exists a subsequence \(\{i_j\}\) such that for every j, \((\tau _{i_j},\xi _{i_j}) \in B_n\) and \(d_2((\tau _{i_j},\xi _{i_j}), (s_n,\nu _n)) =\rho _n + o(h_{i_j}).\) Then the inequality \(w({\bar{t}}, {\bar{\mu }}) \le w( \tau _{i_j},\xi _{i_j})\) implies that
$$\begin{aligned} w({\bar{t}}, {\bar{\mu }}) + k \rho _n \le w( \tau _{i_j}, \xi _{i_j}) + k d_2(( \tau _{i_j},\xi _{i_j}), (s_n,\nu _n)) + k\,|o(h_{i_j})| \quad \forall \, j. \end{aligned}$$We deduce (7.5) in the same way as in (a).
-
(c)
It remains to consider the case when for some \(\beta >0\) and all large i, \(d_2((\tau _{i},\xi _{i}), (s_n,\nu _n)) ) \le \rho _n - \beta h_i.\) We claim that \(D_{\uparrow }w({\bar{t}}, {\bar{\mu }})(\kappa ,F)= +\infty \). Indeed take \(m= w({\bar{t}}, {\bar{\mu }}) + \sqrt{\beta \rho _n h_i}\) and observe that
$$\begin{aligned} d((\tau _{i},\xi _{i},m),(s_n,\nu _n,z)) \le \sqrt{\rho _n^2 - 2\beta \rho _nh_i + \beta ^2 h_i^2 + \beta \rho _n h_i}= \sqrt{\rho _n^2 - \beta \rho _nh_i + \beta ^2 h_i^2 }. \end{aligned}$$Then \(d((\tau _{i},\xi _{i},m),(s_n,\nu _n,z)) \le \rho _n\) whenever \(h_i\) is sufficiently small. This and (7.2) imply that
$$\begin{aligned} w({\bar{t}}, {\bar{\mu }}) + \sqrt{\beta \rho _n h_i} < w(\tau _{i},\xi _{i}). \end{aligned}$$Since the above holds true for any large i our claim follows.
Consequently, (a), (b) and (c) together imply (7.5) for any \((\kappa , F) \in \overset{\circ }{T}_{\Delta _r}({\bar{t}}, {\bar{\mu }})\). Therefore
and by our assumption,
Hence for some \(u \in U\)
which implies
In this case we set \(\mu _{n} = {\bar{\mu }}, t_{n} ={\bar{t}}, u_n=u\).
Case 2. For all k we have \((t_k,\mu _k) \notin B_n \). Then consider a subsequence \((t_{k_i}, \mu _{k_i})\) converging to some \((t,\mu ) \in \Delta _r\). Since
by the lower semicontinuity of w, we have \(w(t,\mu ) \le w({\bar{t}}, {\bar{\mu }})\) and \((t,\mu ) \in B_n \). In the same way as in Case 1 we deduce that \((t,\mu )=({\bar{t}}, {\bar{\mu }}).\) Because \((t_{k_i}, \mu _{k_i})\) is an arbitrary converging subsequence it follows that \((t_k,\mu _k)\) converge to \(({\bar{t}}, {\bar{\mu }})\) when \(k \rightarrow \infty \).
By Step 2 for all \((t,\mu )\) sufficiently close to \((t_k,\mu _k)\) we have
Consider \(k_n\) such that \((t_{k_n}-{\bar{t}})^2 + W_2^2 (\mu _{k_n}, {\bar{\mu }}) \le 1/n.\) To simplify the notation, we rename the variables by writing \(t_n\) instead of \(t_{k_n}\) and \(\mu _n\) instead of \(\mu _{k_n}\). Thus \(\mu _n\) converge to \({\bar{\mu }}\) in \(W_2\) metric and \(t_n \rightarrow {\bar{t}}\).
Let \((\kappa , F) \in \overset{\circ }{T}_{\Delta _r}(t_n,\mu _n)\) and \(\alpha _n \in \Pi _0(\mu _n, \nu _n)\). Set \(\delta _n:=d_2((t_n,\mu _n),(s_n,\nu _n)) \ge \rho _n .\) From (7.8), we know that for all \((t,\mu )\) sufficiently close to \((t_n,\mu _n)\) we have
From this last inequality it follows by the arguments similar to those of Case 1 (a) applied with \((t_n,\mu _n)\) instead of \(({\bar{t}},{\bar{\mu }})\) that
Let \({\bar{\alpha }}_n \) denote the barycentric projection of \(\alpha _n\) with respect to \(\mu _n\) and consider \(p_n \in L^2(\mu _n;\mathbb {R}^{d})\) satisfying \(p_n(x) = {\bar{\alpha }}_n (x)- x \) \(\mu _n\) a.e. Then
and by our assumptions for some \(u_n \in U\)
Therefore,
and
This and (7.6) imply that the above inequality holds in both cases 1 and 2.
Step 4. Observe next that for some \(R>0\) and all n, \(\mathrm{supp} (\alpha _n) \subset B(0,R)\times B(0,R)\). By [4, Proposition 7.1.3] a subsequence \(\alpha _{n_i}\) converges narrowly to some \(\alpha \in \Pi _0({\bar{\mu }}, \nu )\). Since U is compact, \(n_i\) may be chosen in such way that \(u_{n_i}\) converge to some \({\bar{u}} \in U.\)
Taking the limit in the last inequality we obtain
Let \({\bar{\alpha }} \) denote the barycentric projection of \(\alpha \) with respect to \({\bar{\mu }}\). Consider \(p \in L^2({\bar{\mu }};\mathbb {R}^{d})\) satisfying \(p(x) = {\bar{\alpha }}(x)-x\) \({\bar{\mu }}\)-a.e. Then the last inequality yields \( {\bar{t}} - s + \mathscr {H}({\bar{\mu }},-p) \ge 0\) completing the proof. \(\square \)
Rights and permissions
About this article
Cite this article
Badreddine, Z., Frankowska, H. Solutions to Hamilton–Jacobi equation on a Wasserstein space. Calc. Var. 61, 9 (2022). https://doi.org/10.1007/s00526-021-02113-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00526-021-02113-3