Skip to main content
Log in

Discontinuous solutions of Hamilton–Jacobi–Bellman equation under state constraints

  • Published:
Calculus of Variations and Partial Differential Equations Aims and scope Submit manuscript

Abstract

This article is devoted to the Hamilton–Jacobi partial differential equation

$$\left\{\begin{array}{lll}\frac{\partial V}{\partial t} = H\left(t, x, - \frac{\partial V}{\partial x}\right) & \hbox{on} & [0, 1]\times {\overline{\Omega}}\\V(1, x) = g(x) & \hbox{on}& {\overline{\Omega}},\end{array}\right.$$

where the Hamiltonian \({{H:[0, 1] \times \mathbb{R}^n \times \mathbb{R}^n \to \mathbb{R}}}\) is convex and positively homogeneous with respect to the last variable, \({{\Omega \subset \mathbb{R}^n}}\) is open and \({{g : \mathbb{R}^n \to \mathbb{R} \cup \{+ \infty\}}}\) is lower semicontinuous. Such Hamiltonians do arise in the optimal control theory. We apply the method of generalized characteristics to show uniqueness of lower semicontinuous solution of this first order PDE. The novelty of our setting lies in the fact that we do not ask regularity of the boundary of Ω and extend the Soner inward pointing condition in a nontraditional way to get uniqueness in the class of lower semicontinuous functions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Aubin J.-P.: Viability Theory. Birkhäuser, Boston (1991)

    MATH  Google Scholar 

  2. Aubin J.-P.: Optima and Equilibria. Springer, Berlin (1993)

    MATH  Google Scholar 

  3. Aubin J.-P., Frankowska H.: Set-Valued Analysis. Birkhäuser, Boston (1990)

    MATH  Google Scholar 

  4. Bardi M., Capuzzo-Dolcetta I.: Optimal Control and Viscosity Solutions of Hamilton–Jacobi–Bellman Equations. Birkhäuser, Boston (1997)

    Book  MATH  Google Scholar 

  5. Barles G.: Discontinuous viscosity solutions of first order of Hamilton–Jacobi equations: a guided visit. Nonlinear Anal. TMA. 20, 1123–1134 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  6. Barron E.N., Jensen R.: Semicontinuous viscosity solutions for Hamilton–Jacobi equations with convex Hamiltonian. Comm. Partial Diff. Equ. 15, 1713–1742 (1990)

    Article  MathSciNet  MATH  Google Scholar 

  7. Barron E.N., Jensen R.: Optimal control and semicontinuous viscosity solutions. Proc. Am. Math. Soc. 113, 397–402 (1991)

    Article  MathSciNet  MATH  Google Scholar 

  8. Bettiol P., Bressan A., Vinter R.B.: On trajectories satisfying a state onstraint: W 1,1 estimates and counter-examples. SIAM J. Control Optim. 48, 4664–4679 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  9. Bettiol P., Frankowska H., Vinter R.B.: L estimates on trajectories confined to a closed subset. J. Diff. Equ. 252, 1912–1933 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  10. Cannarsa P., Frankowska H.: Some characterizations of optimal trajectories in control theory. SIAM J. Control Optim. 29, 1322–1347 (1991)

    Article  MathSciNet  MATH  Google Scholar 

  11. Cardaliaguet P., Quincampoix M., Saint-Pierre P.: Optimal times for constrained non-linear control problems without local controllability. Appl. Math. Optim. 36, 21–42 (1997)

    MathSciNet  MATH  Google Scholar 

  12. Capuzzo-Dolcetta I., Lions P.-L.: Hamilton Jacobi equations with state constraints. Trans. Am. Math. Soc. 318, 643–685 (1990)

    Article  MathSciNet  MATH  Google Scholar 

  13. Castaing, C., Valadier, M. (ed.): Convex Analysis and Measurable Multifunctions. Springer, Berlin (1977)

  14. Clarke F.H.: Optimization and Nonsmooth Analysis. Wiley-Interscience, New York (1983)

    MATH  Google Scholar 

  15. Crandall M.G., Evans L.C., Lions P.L.: Some properties of viscosity solutions of Hamilton–Jacobi equation. Trans. Amer. Math. Soc. 282, 487–502 (1984)

    Article  MathSciNet  MATH  Google Scholar 

  16. Crandall M.G., Lions P.L.: Viscosity solutions of Hamilton–Jacobi equations. Trans. Amer. Math. Soc. 277, 1–42 (1983)

    Article  MathSciNet  MATH  Google Scholar 

  17. Evans L.C., Souganidis P.E.: Differential games and representation formulas for solutions of Hamilton–Jacobi equations. Indiana Univ. Math. J. 33, 773–797 (1984)

    Article  MathSciNet  MATH  Google Scholar 

  18. Filippov A.F.: Classical solutions of differential equations with multivalued right-hand side. SIAM J. Control Optim. 5, 609–621 (1967)

    Article  MATH  Google Scholar 

  19. Frankowska H.: Optimal trajectories associated to a solution of contingent Hamilton–Jacobi equations. Appl. Math. Optim. 19, 291–311 (1989)

    Article  MathSciNet  MATH  Google Scholar 

  20. Frankowska H.: Lower semicontinuous solutions of Hamilton–Jacobi–Bellman equation. In: Proceedings of IEEE CDC Conference. Brighton, England (1991)

  21. Frankowska H.: Lower semicontinuous solutions of Hamilton–Jacobi–Bellman equations. SIAM J. Control Optim. 31, 257–272 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  22. Frankowska H., Plaskacz S., Rzeżuchowski T.: Measurable viability theorems and Hamilton–Jacobi–Bellman equation. J. Diff. Equ. 116, 265–305 (1995)

    Article  MATH  Google Scholar 

  23. Frankowska, H., Plaskacz, S.: Hamilton–Jacobi equations for infinite horizon control problems with state constraints. In: Proceedings of International Conference “Calculus of Variations and Related Topics”, Haifa, March 25–April 1, 1998 (1999)

  24. Frankowska H., Plaskacz S.: Semicontinuous solutions of Hamilton–Jacobi–Bellman equations with degenerate state constraints. JMAA 251, 818–838 (2000)

    MathSciNet  MATH  Google Scholar 

  25. Frankowska H., Rampazzo F.: Filippov’s and Filippov-Wazewski’s theorems on closed domains. J. Diff. Equ. 161, 449–478 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  26. Frankowska H., Vinter R.B.: Existence of neighbouring feasible trajectories: applications to dynamic programming for state constrained optimal control problems. J. Optim. Theory Appl. 104, 21–40 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  27. Ishii H.: Hamilton–Jacobi equations with discontinuous Hamiltonians on arbitrary open subsets. Bull. Fat. Sci. Eng. Chuo Univ. 28, 33–77 (1985)

    Google Scholar 

  28. Ishii H.: Perron’s method for Hamilton–Jacobi equations. Duke Math. J. 55, 369–384 (1987)

    Article  MathSciNet  MATH  Google Scholar 

  29. Ishii H.: Representation of solutions of Hamilton–Jacobi equations. Nonlinear Anal. TMA. 12, 121–146 (1988)

    Article  MATH  Google Scholar 

  30. Ishii H., Koike S.: A new formulation of state constraint problems for first order PDE’s. SIAM J. Control Optim. 34, 554–571 (1996)

    Article  MathSciNet  MATH  Google Scholar 

  31. Lions P.-L.: Generalized Solutions of Hamilton–Jacobi Equations. Pitman, Boston (1982)

    MATH  Google Scholar 

  32. Lions P.-L., Perthame B.: Remarks on Hamilton–Jacobi equations with measurable time-dependent Hamiltonians. Nonlinear Anal. TMA. 11, 613–621 (1987)

    Article  MathSciNet  MATH  Google Scholar 

  33. Lions P.-L., Souganidis P.E.: Differential games, optimal control and directional derivatives of viscosity solutions of Bellman’s and Isaac’s equations. SIAM J. Control Optim. 23, 566–583 (1985)

    Article  MathSciNet  MATH  Google Scholar 

  34. Loreti P., Tessitore M.E.: Approximation and regularity results on constrained viscosity solutions of Hamilton–Jacobi–Bellman equations. J. Math. Syst., Estim. Control 4, 467–483 (1994)

    MathSciNet  MATH  Google Scholar 

  35. Rampazzo F.: Faithful representations for convex Hamilton–Jacobi equations. SIAM J. Control Optim. 44, 867–884 (2006)

    Article  MathSciNet  Google Scholar 

  36. Rockafellar, T., Wets, R.: Variational Analysis. Grundlehren Math. Wiss. 317, Springer, Berlin (1998)

  37. Siconolfi A.: Almost continuous solutions of geometric Hamilton–Jacobi equations. Ann. I. H. Poincaré AN. 20, 237–269 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  38. Soner H.M.: Optimal control with state-space constraints. SIAM J. Control Optim. 24, 552–561 (1986)

    Article  MathSciNet  MATH  Google Scholar 

  39. Subbotin A.I.: A generalization of the basic equation of the theory of the differential games. Soviet. Math. Dokl. 22, 358–362 (1980)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hélène Frankowska.

Additional information

Communicated by L. Ambrosio.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Frankowska, H., Mazzola, M. Discontinuous solutions of Hamilton–Jacobi–Bellman equation under state constraints. Calc. Var. 46, 725–747 (2013). https://doi.org/10.1007/s00526-012-0501-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00526-012-0501-8

Mathematics Subject Classification (2000)

Navigation