Monotone Numerical Schemes and Feedback Construction for Hybrid Control Systems

  • Roberto Ferretti
  • Hasnaa Zidani


Hybrid systems are a general framework which can model a large class of control systems arising whenever a set of continuous and discrete dynamics are mixed in a single system. In this paper, we study the convergence of monotone numerical approximations of value functions associated to control problems governed by hybrid systems. We discuss also the feedback reconstruction and derive a convergence result for the approximate feedback control law. Some numerical examples are given to show the robustness of the monotone approximation schemes.


Hybrid systems Approximation of the value function   Optimal feedback law 

Mathematics Subject Classification

34K34 34K35 49L20 65N12 



This work has been partially supported by the EU under the 7th Framework Program Marie Curie Initial Training Network “FP7-PEOPLE-2010-ITN”, GA number 264735-SADCO.


  1. 1.
    Goebel, R., Sanfelice, R.G., Teel, A.R.: Hybrid dynamical systems. IEEE Control Systems 29, 28–93 (2009)CrossRefMathSciNetGoogle Scholar
  2. 2.
    Liberzon, D.: Switching in Systems and Control. Springer, New York (2003)CrossRefzbMATHGoogle Scholar
  3. 3.
    Sussmann, H.: A maximum principle for hybrid optimal control problems. In: Proceedings of the 38th IEEE Conference on Decision and Control 1, 425–430 (1999)Google Scholar
  4. 4.
    Dharmatti, S., Ramaswamy, M.: Hybrid control system and viscosity solutions. SIAM J. Control Optim. 34, 1259–1288 (2005)CrossRefMathSciNetGoogle Scholar
  5. 5.
    Zhang, H., James, R.: Optimal control of hybrid systems and a system of quasi-variational inequalities. SIAM J. Control Optim. 45, 722–761 (2006)CrossRefMathSciNetGoogle Scholar
  6. 6.
    Barles, G., Dharmatti, S.: Unbounded viscosity solutions of hybrid control systems. ESAIM: COCV 16, 176–193 (2010)CrossRefzbMATHMathSciNetGoogle Scholar
  7. 7.
    Ferretti, R., Zidani, H.: Monotone numerical schemes and feedback construction for hybrid control systems. HAL preprint. (2014). Accessed 4 Aug 2014
  8. 8.
    Branicky, M.S., Borkar, V., Mitter, S.: A unified framework for hybrid control problem. IEEE Trans. Autom. Control 43, 31–45 (1998)CrossRefzbMATHMathSciNetGoogle Scholar
  9. 9.
    Bensoussan, A., Menaldi, J.L.: Hybrid control and dynamic programming. Dyn. Contin. Discret. Impulse Syst. 3, 395–442 (1997)zbMATHMathSciNetGoogle Scholar
  10. 10.
    Granato, G., Zidani, H.: Level-set approach for reachability analysis of hybrid systems under lag constraints. SIAM J. Control Optim. 52, 606–628 (2014)CrossRefzbMATHMathSciNetGoogle Scholar
  11. 11.
    Ishii, K.: Viscosity solutions of nonlinear second order elliptic PDEs associated with impulse control problems II. Funkcialaj Ekvacioj 38, 297–328 (1995)zbMATHMathSciNetGoogle Scholar
  12. 12.
    Barles, G., Souganidis, P.E.: Convergence of approximation schemes for fully nonlinear second order equations. Asymptot. Anal. 4, 271–283 (1991)zbMATHMathSciNetGoogle Scholar
  13. 13.
    Crandall, M.G., Lions, P.-L.: Two approximations of solutions of Hamilton–Jacobi equations. Math. Comp. 43, 1–19 (1984)CrossRefzbMATHMathSciNetGoogle Scholar
  14. 14.
    Kushner, H.J., Dupuis, P.G.: Numerical Methods for Stochastic Control Problems in Continuous Time. Springer, New York (2001)CrossRefzbMATHGoogle Scholar
  15. 15.
    Camilli, F., Falcone, M.: An approximation scheme for the optimal control of diffusion processes. RAIRO Modélisation Mathématique et Analyse Numérique 29, 97–122 (1995)zbMATHMathSciNetGoogle Scholar
  16. 16.
    Falcone, M., Ferretti, R.: Semi-Lagrangian schemes for Hamilton–Jacobi equations, discrete representation formulae and Godunov methods. J. Comput. Phys. 175, 559–575 (2002)CrossRefzbMATHMathSciNetGoogle Scholar
  17. 17.
    Falcone, M., Ferretti, R.: Semi-Lagrangian Approximation Schemes for Linear and Hamilton-Jacobi Equations. SIAM, Philadelphia (2013)CrossRefGoogle Scholar
  18. 18.
    Crandall, M.G., Tartar, L.: Some relations between nonexpansive and order preserving mappings. Proc. Am. Math. Soc. 78, 385–390 (1980)CrossRefzbMATHMathSciNetGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  1. 1.Dipartmento di Matematica e FisicaUniversità Roma TreRomeItaly
  2. 2.Unité de Mathématiques Appliquées (UMA)ENSTA ParisTechPalaiseauFrance

Personalised recommendations