Set-Valued and Variational Analysis

, Volume 26, Issue 3, pp 643–662 | Cite as

The Mayer and Minimum Time Problems with Stratified State Constraints

  • C. Hermosilla
  • P. R. Wolenski
  • H. ZidaniEmail author


This paper studies optimal control problems with state constraints by imposing structural assumptions on the constraint domain coupled with a tangential restriction with the dynamics. These assumptions replace pointing or controllability assumptions that are common in the literature, and provide a framework under which feasible boundary trajectories can be analyzed directly. The value functions associated with the state constrained Mayer and minimal time problems are characterized as solutions to a pair of Hamilton-Jacobi inequalities with appropriate boundary conditions. The novel feature of these inequalities lies in the choice of the Hamiltonian.


State constraints Stratified structure Mayer problem Minimal time function Hamilton-Jacobi equations 

Mathematics Subject Classification (2010)

35B37 49J15 49Lxx 49J53 90C39 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.



The authors would like to thank the editor and the anonymous referees for their useful comments and suggestions. This work was partially supported by iCODE institue, the European Union under the 7th Framework Programme FP7-PEOPLE-2010-ITN Grant agreement number 264735-SADCO and by the ANR project HJNet ANR-12-BS01-0008-01.


  1. 1.
    Altarovici, A., Bokanowski, O., Zidani, H.: A general Hamilton-Jacobi framework for nonlinear state-constrained control problems. ESAIM Control, Optim. Calc. Var. 19(2), 337–357 (2013)MathSciNetCrossRefzbMATHGoogle Scholar
  2. 2.
    Arutyunov, A.V., Tynyanskiy, N.T.: The maximum principle in a problem with phase constraints. Sov. J. Comput. Syst. Sci. 23, 28–35 (1985). Translated into English Original Russian text was published in 1984MathSciNetGoogle Scholar
  3. 3.
    Arutyunov, A.V.: On necessary conditions for optimality in a problem with state constraints. Dokl. Akad. Nauk SSSR 280(5), 1033–1037 (1985)MathSciNetGoogle Scholar
  4. 4.
    Arutyunov, A.V.: On the theory of the maximum principle in optimal control problems with phase constraints. Sov. Math. Dokl. 39(1), 1–4 (1989)MathSciNetzbMATHGoogle Scholar
  5. 5.
    Aubin, J.P., Cellina, A.: Differential inclusions: set-valued maps and viability theory. Volume 264 of Grundlehren der mathematischen Wissenschaften. Springer-Verlag, New York (1984)CrossRefGoogle Scholar
  6. 6.
    Bardi, M., Capuzzo-Dolcetta, I.: Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations. Systems & Control: Foundations & Applications. Birkhäuser Boston Inc., Boston, MA (1997). With appendices by M. Falcone and P. SoraviaCrossRefzbMATHGoogle Scholar
  7. 7.
    Barnard, R.C., Wolenski, P.R.: Flow invariance on stratified domains. Set-Valued Var. Anal. 21, 377–403 (2013)MathSciNetCrossRefzbMATHGoogle Scholar
  8. 8.
    Barron, E.N., Jensen, R.: Semicontinuous viscosity solutions for Hamilton-Jacobi equations with convex Hamiltonians. Comm. Partial Differ. Equat. 15(12), 1713–1742 (1990)MathSciNetzbMATHGoogle Scholar
  9. 9.
    Bettiol, P., Frankowska, H., Vinter, R.B.: \(l^{\infty }\) estimates on trajectories confined to a closed subset. J. Differ. Equat. 252(2), 1912–1933 (2012)MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Blanc, A.: Deterministic exit time problems with discontinuous exit cost. SIAM J. Control Optim. 35, 399–434 (1997)MathSciNetCrossRefzbMATHGoogle Scholar
  11. 11.
    Bokanowski, O., Forcadel, N., Zidani, H.: Deterministic state-constrained optimal control problems without controllability assumptions. ESAIM Control, Optim. Calc. Var. 17(4), 995–1015 (2011)MathSciNetCrossRefzbMATHGoogle Scholar
  12. 12.
    Clarke, F.: Functional analysis, calculus of variations and optimal control. Volume 264 of Graduate Text in Mathematics. Springer (2013)Google Scholar
  13. 13.
    Clarke, F., Ledyaev, Y., Stern, R., Wolenski, P.: Nonsmooth Analysis and Control Theory. Volume 178 of Graduate Text in Mathematics. Springer (1998)Google Scholar
  14. 14.
    Crandall, M., Evans, L., Lions, P.-L.: Some properties of viscosity solutions of Hamilton-Jacobi equations. Trans. Amer. Math. Soc. 282, 487–502 (1984)MathSciNetCrossRefzbMATHGoogle Scholar
  15. 15.
    Dubovitskii, A.Y., Dubovitskii, V.A.: Necessary conditions for strong minimum in optimal control problems with degeneration of endpoint and phase constraints. Usp. Mat. Nauk. 40(2), 175–176 (1985)MathSciNetGoogle Scholar
  16. 16.
    Forcadel, N., Rao, Z., Zidani, H.: State-constrained optimal control problems of impulsive differential equations. Appl. Math. Optim. 68, 1–19 (2013)MathSciNetCrossRefzbMATHGoogle Scholar
  17. 17.
    Frankowska, H.: Lower semicontinuous solutions of Hamilton-Jacobi-Bellman equations. SIAM J. Control Optim. 31(1), 257–272 (1993)MathSciNetCrossRefzbMATHGoogle Scholar
  18. 18.
    Frankowska, H., Plaskacz, S.: Semicontinuous solutions of Hamilton-Jacobi-Bellman equations with degenerate state constraints. J. Math. Anal Appl. 251(2), 818–838 (2000)MathSciNetCrossRefzbMATHGoogle Scholar
  19. 19.
    Frankowska, H., Vinter, R.B.: Existence of neighboring feasible trajectories Applications to dynamics programming for state-constrained optimal control problems. J. Optim. Theory Appl. 104(1), 20–40 (2000)MathSciNetCrossRefzbMATHGoogle Scholar
  20. 20.
    Hermosilla, C., Zidani, H.: Infinite horizon problems on stratifiable state constraints sets. J. Differ. Equat. 258(4), 1430–1460 (2015)MathSciNetCrossRefzbMATHGoogle Scholar
  21. 21.
    Ishii, H., Koike, S.: A new formulation of state constraint problems for first-order pdes. SIAM J. Control Optim. 34(2), 554–571 (1996)MathSciNetCrossRefzbMATHGoogle Scholar
  22. 22.
    Komarov, V.A.: The equation of dynamic programming for a time-optimal problem with phase constraints. Math. USSR Sbornik 63(1), 47–58 (1989). Translated into English. Original Russian text was published in 1988MathSciNetCrossRefzbMATHGoogle Scholar
  23. 23.
    Lee, J.: Introduction to smooth manifolds. Volume 218 of Graduate Text in Mathematics. Springer (2013)Google Scholar
  24. 24.
    Motta, M.: On nonlinear optimal control problems with state constraints. SIAM J. Control Optim. 33, 1411–1424 (1995)MathSciNetCrossRefzbMATHGoogle Scholar
  25. 25.
    Motta, M., Rampazzo, F.: Multivalued dynamics on a closed domain with absorbing boundary. applications to optimal control problems with integral constraints. Nonlinear Anal. 41, 631–647 (2000)MathSciNetCrossRefzbMATHGoogle Scholar
  26. 26.
    Soner, H.: Optimal control with state-space constraint I. SIAM J. Control Optim. 24(3), 552–561 (1986)MathSciNetCrossRefzbMATHGoogle Scholar
  27. 27.
    Soner, H.: Optimal control with state-space constraint II. SIAM J. Control Optim. 24(6), 1110–1122 (1986)MathSciNetCrossRefzbMATHGoogle Scholar
  28. 28.
    Smirnov, G.: Introduction to the theory of differential inclusions. Volume 41 of Graduate Studies in Mathematics. AMS (2002)Google Scholar
  29. 29.
    Wolenski, P., Zhuang, Y.: Proximal analysis and the minimal time function. SIAM J. Control Optim. 36(3), 1048–1072 (1998). electronicMathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2017

Authors and Affiliations

  1. 1.Departamento de MatemáticasUniversidad Técnica Federico Santa MaríaValparaísoChile
  2. 2.Department of MathematicsLouisiana State UniversityBaton RougeUSA
  3. 3.Unité des Mathématiques Appliquées (UMA), ENSTA ParisTechPalaiseauFrance

Personalised recommendations