Advertisement

Discrete Event Dynamic Systems

, Volume 25, Issue 3, pp 345–364 | Cite as

Optimal control of hybrid switched systems: A brief survey

  • Feng ZhuEmail author
  • Panos J. Antsaklis
Article

Abstract

This paper surveys recent results in the field of optimal control of hybrid and switched systems. We first summarize results that use different problem formulations and then explore the underlying relations among them. Specifically, based on the type of switching, we focus on two important classes of problems: internally forced switching (IFS) problems and externally forced switching (EFS) problems. For IFS problems, we focus on optimal control techniques for piecewise affine systems. For EFS problems, methodologies of two-stage optimization, embedding transformation and switching LQR design are investigated. Detailed optimization methods found in the literature are discussed.

Keywords

Hybrid systems Switched systems Optimal control Survey 

Notes

Acknowledgments

The support of the National Science Foundation under the CPS Large Grant No. CNS-1035655 is gratefully acknowledged. We also would like to thank the anonymous reviewers for their helpful comments that have improved the manuscript.

References

  1. Antsaklis PJ (2000) Special issue on hybrid systems: theory and applications. A brief introduction to the theory and applications of hybrid systems. Proc IEEE 88(7):879–887CrossRefGoogle Scholar
  2. Antsaklis PJ, Koutsoukos X D (2002) Hybrid systems control. Encyclopedia of physical science and technology, 3rd edn 7:445–458Google Scholar
  3. Antsaklis PJ, Koutsoukos X D (2005) Hybrid systems: review and recent progress. Wiley, pp 273–298Google Scholar
  4. Antsaklis PJ, Nerode A (1998) Hybrid control systems: an introductory discussion to the special issue. IEEE Trans Autom Control 43(4):457–460CrossRefMathSciNetGoogle Scholar
  5. Antsaklis PJ, Koutsoukos X, Zaytoon J (1998) On hybrid control of complex systems: a survey. Eur J Autom 32:1023–1045Google Scholar
  6. Axelsson H, Wardi Y, Egerstedt M (2005a) Transition-time optimization for switched systems. In: IFAC Proceedings volumes, vol 16. pp 453–458Google Scholar
  7. Axelsson H, Wardi Y, Egerstedt M, Verriest E (2005b) A provably convergent algorithm for transition-time optimization in switched systems. In: Proceedings 44th IEEE conference on decision and control and European control conference. pp 1397–1402Google Scholar
  8. Axelsson H, Wardi Y, Egerstedt M, Verriest E (2008) Gradient descent approach to optimal mode scheduling in hybrid dynamical systems. J Optim Theory Appl 136:167–186CrossRefzbMATHMathSciNetGoogle Scholar
  9. Azuma S, Egerstedt M, Wardi Y (2006) Output-based optimal timing control of switched systems. In: Hybrid systems: computation and control, lecture notes in computer science, vol 3927. Springer, pp 64–78Google Scholar
  10. Baotic M, Christophersen F, Morari M (2003a) A new algorithm for constrained finite time optimal control of hybrid systems with a linear performance index. In: European control conference. pp 3335–3340Google Scholar
  11. Baotic M, Christophersen F J, Morari M (2003b) Infinite time optimal control of hybrid systems with a linear performance index. In: Proceedings. 42nd IEEE conference on decision and control, vol 3. pp 3191– 3196Google Scholar
  12. Baotic M, Christophersen F, Morari M (2006) Constrained optimal control of hybrid systems with a linear performance index. IEEE Trans Autom Control 51(12):1903–1919CrossRefMathSciNetGoogle Scholar
  13. Baric M, Grieder P, Baotic M, Morari M (2005) Optimal control of pwa systems by exploiting problem structure. In: IFAC World Congress, vol 16. pp 307–312Google Scholar
  14. Baric M, Grieder P, Baotic M, Morari M (2008) An efficient algorithm for optimal control of pwa systems with polyhedral performance indices. Automatica 44(1):296–301CrossRefzbMATHMathSciNetGoogle Scholar
  15. Bemporad A, Morari M (1999a) Control of systems integrating logic, dynamics, and constraints. Automatica 35:407–427CrossRefzbMATHMathSciNetGoogle Scholar
  16. Bemporad A, Morari M (1999b) Control of systems integrating logic, dynamics, and constraints. Automatica 35(3):407–427CrossRefzbMATHMathSciNetGoogle Scholar
  17. Bemporad A, Borrelli F, Morari M (2000a) Optimal controllers for hybrid systems: stability and piecewise linear explicit form. In: Proceedings of the 39th IEEE conference on decision and control, vol 2. pp 1810–1815Google Scholar
  18. Bemporad A, Borrelli F, Morari M (2000b) Piecewise linear optimal controllers for hybrid systems. In: Proceedings of the IEEE American control conference, vol 2. pp 1190–1194Google Scholar
  19. Bemporad A, Ferrari-Trecate G, Morari M (2000c) Observability and controllability of piecewise affine and hybrid systems. IEEE Trans Autom Control 45(10):1864–1876CrossRefzbMATHMathSciNetGoogle Scholar
  20. Bemporad A, Borrelli F, Morari M (2002a) On the optimal control law for linear discrete time hybrid systems. In: International workshop on hybrid systems: computation and control. pp 105–119Google Scholar
  21. Bemporad A, Giua A, Seatzu C (2002b) An iterative algorithm for the optimal control of continuous-time switched linear systems. In: Proceedings. 6th international workshop on discrete event systems. pp 335–340Google Scholar
  22. Bemporad A, Giua A, Seatzu C (2002c) A master-slave algorithm for the optimal control of continuous-time switched affine systems. In: Proceedings of the 41st IEEE conference on decision and control, vol 2. pp 1976–1981Google Scholar
  23. Bemporad A, Giua A, Seatzu C (2002d) Synthesis of state-feedback optimal controllers for continuous-time switched linear systems. In: Proceedings of the 41st IEEE conference on decision and control, vol 3. pp 3182–3187Google Scholar
  24. Bemporad A, Corona D, Giua A, Seatzu C (2003) Optimal state-feedback quadratic regulation of linear hybrid automata. In: Proceedings 2003 IFAC conference on analysis and design of hybrid systems. pp 407–412Google Scholar
  25. Bengea SC, DeCarlo RA (2005) Optimal control of switching systems. Automatica 41(1):11–27zbMATHMathSciNetGoogle Scholar
  26. Berkovitz L D (1974) Optimal control theory. Springer, New YorkCrossRefzbMATHGoogle Scholar
  27. Borrelli F, Baotic M, Bemporad A, Morari M (2003) An efficient algorithm for computing the state feedback optimal control law for discrete time hybrid systems. In: Proceedings of the IEEE American control conference, vol 6. pp 4717–4722Google Scholar
  28. Borrelli F, Baotic M, Bemporad A, Morari M (2005) Dynamic programming for constrained optimal control of discrete-time linear hybrid systems. Automatica 41(10):1709–1721CrossRefzbMATHMathSciNetGoogle Scholar
  29. Branicky MS, Mitter SK (1995) Algorithms for optimal hybrid control. In: Proceedings of the 34th IEEE conference on decision and control, vol 3. pp 2661–2666Google Scholar
  30. Branicky MS, Borkar V S, Mitter SK (1998) A unified framework for hybrid control: model and optimal control theory. IEEE Trans Autom Control 43(1):31–45CrossRefzbMATHMathSciNetGoogle Scholar
  31. Caines P, Shaikh M (2006) Optimality zone algorithms for hybrid systems: efficient algorithms for optimal location and control computation, vol 3927. Springer Berlin / Heidelberg. pp 123–137Google Scholar
  32. Caines PE, Shaikh MS (2005) Optimality zone algorithms for hybrid systems computation and control: From exponential to linear complexity. In: Proceedings of the IEEE international symposium on intelligent control, Mediterrean conference on control and automation. pp 1292–1297Google Scholar
  33. Caldwell T, Murphey T (2012a) Projection-based switched system optimization: Absolute continuity of the line search. In: IEEE 51st conference on decision and control. pp 699–706Google Scholar
  34. Caldwell T, Murphey T (2012b) Single integration optimization of linear time-varying switched systems. IEEE Trans Autom Control 57(6)Google Scholar
  35. Caldwell TM, Murphey T (2010) An adjoint method for second-order switching time optimization. In: 49th IEEE conference on decision and control. pp 2155–2162Google Scholar
  36. Caldwell TM, Murphey T (2011) Single integration optimization of linear timevarying switched systems. In: American control conference. pp 2024–2030Google Scholar
  37. Caldwell TM, Murphey T (2012c) Projection-based switched system optimization. In: American control conference. pp 4552–4557Google Scholar
  38. Cassandras CG, Pepyne DL, Wardi Y (1998) Optimal control of systems with time-driven and event-driven dynamics. In: Proceedings of the 37th IEEE conference on decision and control, vol 1. pp 7–12Google Scholar
  39. Cassandras CG, Pepyne DL, Wardi Y (2001) Optimal control of a class of hybrid systems. IEEE Trans Autom Control 46(3):398–415CrossRefzbMATHMathSciNetGoogle Scholar
  40. Cho YC, Cassandras CG, Pepyne DL (2000) Forward algorithms for optimal control of a class of hybrid systems. In: Proceedings of the 39th IEEE conference on decision and control, vol 1. pp 975–980Google Scholar
  41. Christophersen F J, Baotić M, Morari M (2005) Optimal control of piecewise affine systems: a dynamic programming approach. In: Control and observer design for nonlinear finite and infinite dimensional systems Meurer T, Graichen K, Gilles ED (eds), vol 322, Springer-VerlagGoogle Scholar
  42. Corona D, Giua A, Seatzu C (2004a) Optimal feedback switching laws for autonomous hybrid automata. In: Proceedings of the 2004 IEEE international symposium on intelligent control. pp 31–36Google Scholar
  43. Corona D, Seatzu C, Giua A, Gromov D, Mayer E, Raisch J (2004b) Optimal hybrid control for switched affine systems under safety and liveness constraints. In: IEEE international symposium on computer aided control systems design. pp 35–40Google Scholar
  44. Das T, Mukherjee R (2008) Optimally switched linear systems. Automatica 44(5):1437–1441CrossRefzbMATHMathSciNetGoogle Scholar
  45. Ding X, Wardi Y, Egerstedt M (2009a) On-line adaptive optimal timing control of switched systems. In: Proceedings of the 48th IEEE conference on decision and control Chinese control conference. pp 5305–5310Google Scholar
  46. Ding X, Wardi Y, Egerstedt M (2009b) On-line optimization of switched-mode dynamical systems. IEEE Trans Autom Control 54(9):2266–2271CrossRefMathSciNetGoogle Scholar
  47. Egerstedt M, Wardi Y, Delmotte F (2003) Optimal control of switching times in switched dynamical systems. In: Proceedings 42nd IEEE conference on decision and control, vol 3. pp 2138–2143Google Scholar
  48. Egerstedt M, Azuma S, Wardi Y (2006a) Optimal timing control of switched linear systems based on partial information. Nonlinear Anal Theory Methods Appl 65(9):1736–1750CrossRefzbMATHMathSciNetGoogle Scholar
  49. Egerstedt M, Wardi Y, Axelsson H (2006b) Transition-time optimization for switched-mode dynamical systems. IEEE Trans Autom Control 51(1):110–115CrossRefMathSciNetGoogle Scholar
  50. Feng Z G, Teo K L, Rehbock V (2009) A discrete filled function method for the optimal control of switched systems in discrete time. Optim Control Appl Methods 30(6):585–593CrossRefMathSciNetGoogle Scholar
  51. Ferrari-Trecate G, Mignone D, Morari M (2002) Moving horizon estimation for hybrid systems. IEEE Trans Autom Control 47(10):1663–1676CrossRefMathSciNetGoogle Scholar
  52. Fotiou I, Beccuti A, Papafotiou G, Morari M (2006a) Optimal control of piece-wise polynomial hybrid systems using cylindrical algebraic decomposition. In: Hybrid systems: computation and control. pp 227–241Google Scholar
  53. Fotiou I, Rostalski P, Parrilo P, Morari M (2006b) Parametric optimization and optimal control using algebraic geometry methods. Int J Control 79(11):1340–1358CrossRefzbMATHMathSciNetGoogle Scholar
  54. Giua A, Seatzu C, der Mee CV (2001a) Optimal control of switched autonomous linear systems. In: Proceedings of the 40th IEEE conference on decision and control, vol 3. pp 2472–2477Google Scholar
  55. Giua A, Seatzu C, Mee CVD (2001b) Optimal control of autonomous linear systems switched with a pre-assigned finite sequence. In: Proceedings of the 2001 IEEE international symposium on intelligent control. pp 144–149Google Scholar
  56. Goebel R, Sanfelice R, Teel A (2009) Hybrid dynamical systems. IEEE Control Syst 29(2):28–93CrossRefMathSciNetGoogle Scholar
  57. Gokbayrak K, Cassandras CG (2000a) A hierarchical decomposition method for optimal control of hybrid systems. In: Proceedings of the 39th IEEE conference on decision and control, vol 2. pp 1816–1821Google Scholar
  58. Gokbayrak K, Cassandras CG (2000b) Hybrid controllers for hierarchically decomposed systems Proceedings of the 3rd international workshop on hybrid systems: computation and control. Springer-Verlag, London, pp 117–129Google Scholar
  59. Gonzalez H, Vasudevan R, Kamgarpour M, Sastry SS, Bajcsy R, Tomlin C (2010a) A numerical method for the optimal control of switched systems. In: 49th IEEE conference on decision and control. pp 7519–7526Google Scholar
  60. Gonzalez H, Vasudevan R, Kamgarpour M, Sastry SS, Bajcsy R, Tomlin CJ (2010b) A descent algorithm for the optimal control of constrained nonlinear switched dynamical systems. In: Proceedings of the 13th ACM international conference on hybrid systems: computation and control, HSCC ’10. pp 51–60Google Scholar
  61. Görges D, Izák M, Liu S (2011) Optimal control and scheduling of switched systems. IEEE Trans Autom Control 56(1):135–140CrossRefGoogle Scholar
  62. Hedlund S, Rantzer A (1999a) CDP Tool, a Matlab tool for optimal control of hybrid systemsGoogle Scholar
  63. Hedlund S, Rantzer A (1999b) Optimal control of hybrid systems. In: Proceedings of the 38th IEEE conference on decision and control, vol 4. pp 3972–3977Google Scholar
  64. Hedlund S, Rantzer A (2002) Convex dynamic programming for hybrid systems. IEEE Trans Autom Control 47(9):1536–1540CrossRefMathSciNetGoogle Scholar
  65. Imura J, van der Schaft A (2000) Characterization of well-posedness of piecewise-linear systems. IEEE Trans Autom Control 45(9):1600–1619CrossRefzbMATHMathSciNetGoogle Scholar
  66. Johnson E, Murphey T (2009) Second order switching time optimization for time-varying nonlinear systems. In: IEEE 48th conference on decision and control. pp 5281–5286Google Scholar
  67. Johnson E, Murphey T (2011) Second-order switching time optimization for nonlinear time-varying dynamic systems. IEEE Trans Autom Control 56(8):1953–1957CrossRefMathSciNetGoogle Scholar
  68. Kerrigan E, Mayne D (2002) Optimal control of constrained, piecewise affine systems with bounded disturbances. In: Proceedings of the 41st IEEE conference on decision and control, 2002, vol 2. pp 1552–1557Google Scholar
  69. Kvasnica M, Grieder P, Baotić MMulti-Parametric Toolbox (MPT). http://control.ee.ethz.ch/mpt/
  70. Lin H, Antsaklis P (2009) Stability and stabilizability of switched linear systems: a survey of recent results. IEEE Trans Autom Control 54(2):308–322CrossRefMathSciNetGoogle Scholar
  71. Lincoln B, Rantzer A (2006) Relaxing dynamic programming. IEEE Trans Autom Control 51(8):1249–1260. doi: 10.1109/TAC.2006.878720 CrossRefMathSciNetGoogle Scholar
  72. Lofberg J (2004) Yalmip: a toolbox for modeling and optimization in MATLAB. In: Proceedings of the CACSD conferenceGoogle Scholar
  73. Loxton R, Teo K, Rehbock V (2009) Computational method for a class of switched system optimal control problems. IEEE Trans Autom Control 54(10):2455–2460CrossRefMathSciNetGoogle Scholar
  74. Lunze J, Lamnabhi-Lagarrigue F (2009) Handbook of hybrid systems control. Cambridge University PressGoogle Scholar
  75. Matveev AS, Savkin AV (2000) Qualitative theory of hybrid dynamical systems. Birkhauser, BostonCrossRefzbMATHGoogle Scholar
  76. Mignone D, Ferrari-Trecate G, Morari M (2000) Stability and stabilization of piecewise affine and hybrid systems: an lmi approach. In: Proceedings of the 39th IEEE conference on decision and control, 2000, vol 1. pp 504–509Google Scholar
  77. Mojica Nava, E, Meziat R, Quijano N, Gauthier A, Rakoto-Ravalontsalama N (2008) Optimal control of switched systems: a polynomial approach. In: IFAC Proceedings Volumes, vol 17. pp 7808–7813Google Scholar
  78. Mojica-Nava E, Quijano N, Rakoto-Ravalontsalama N (2013) A polynomial approach for optimal control of switched nonlinear systems. Int J Robust Nonlinear Control Early AccessGoogle Scholar
  79. Piccoli B (1999) Necessary conditions for hybrid optimization. In: Proceedings of the 38th IEEE conference on decision and control, vol 1. pp 410–415Google Scholar
  80. Rantzer A (2006) Relaxed dynamic programming in switching systems. IEE Proc Control Theory Appl 153(5):567–574CrossRefMathSciNetGoogle Scholar
  81. Rantzer A, Johansson M (2000) Piecewise linear quadratic optimal control. IEEE Trans Autom Control 45(4):629–637CrossRefzbMATHMathSciNetGoogle Scholar
  82. Riedinger P, Kratz F, Iung C, Zanne C (1999) Linear quadratic optimization for hybrid systems. In: Proceedings of the 38th IEEE conference on decision and control, vol 3. pp 3059–3064Google Scholar
  83. Roll J, Bemporad A, Ljung L (2004) Identification of piecewise affine systems via mixed-integer programming. Automatica 40(1):37–50CrossRefzbMATHMathSciNetGoogle Scholar
  84. Savkin AV, Evans R J (2002) Hybrid dynamical systems. Birkhauser, BostonCrossRefzbMATHGoogle Scholar
  85. van der Schaft S (2000) An introduction to hybrid dynamical systems. Springer-VerlagGoogle Scholar
  86. Seatzu C, Corona D, Giua A, Bemporad A (2006a) Optimal control of continuous-time switched affine systems. IEEE Trans Autom Control 51(5):726–741CrossRefMathSciNetGoogle Scholar
  87. Seatzu C, Gromov D, Raisch J, Corona D, Giua A (2006b) Optimal control of discrete-time hybrid automata under safety and liveness constraints. Nonlinear Anal Theory Methods Appl 65(6):1188–1210CrossRefzbMATHMathSciNetGoogle Scholar
  88. Sebastain Engell GF, Schnieder E (2002) Modeling, analysis, and design of hybrid systems. Springer-VerlagGoogle Scholar
  89. Shaikh M, Caines P (2003) On the optimal control of hybrid systems: optimization of trajectories, switching times, and location schedules. In: Hybrid systems: computation and control, lecture notes in computer science, vol 2623. pp 466–481Google Scholar
  90. Shaikh MS, Caines PE (2002) On trajectory optimization for hybrid systems: theory and algorithms for fixed schedules. In: Proceedings of the 41st IEEE conference on decision and control, vol 2. pp 1997–1998Google Scholar
  91. Sontag E (1981) Nonlinear regulation: the piecewise linear approach. IEEE Trans Autom Control 26(2):346–358CrossRefzbMATHMathSciNetGoogle Scholar
  92. Sontag ED (1996) Interconnected automata and linear systems: a theoretical framework in discrete-time. In: Proceedings of the DIMACS/SYCON workshop on Hybrid systems III: verification and control: verification and control. Springer-Verlag New York, Inc., Secaucus, pp 436–448Google Scholar
  93. Sussmann H J (2000) Set-valued differentials and the hybrid maximum principle. In: Proceedings of the 39th IEEE conference on decision and control, vol 1. pp 558–563Google Scholar
  94. Tabuada P (2009) Verification and control of hybrid systems. Springer-VerlagGoogle Scholar
  95. Wardi Y, Egerstedt M (2012) Algorithm for optimal mode scheduling in switched systems. In: American control conference. pp 4546–4551Google Scholar
  96. Wardi Y, Ding X, Egerstedt M, Azuma S (2007) On-line optimization of switched-mode systems: algorithms and convergence properties. In: 46th IEEE conference on decision and control. pp 5005–5010Google Scholar
  97. Wardi Y, Twu P, Egerstedt M (2010) On-line optimal timing control of switched systems. In: 49th IEEE conference on decision and control. pp 2137–2142Google Scholar
  98. Wassim M Haddad VC, Nersesov SG (2006) Impulsive and hybrid dynamical systems. Princeton University PressGoogle Scholar
  99. Wei S, Uthaichana K, Zefran M, DeCarlo RA, Bengea S (2007) Applications of numerical optimal control to nonlinear hybrid systems. Nonlinear Anal Hybrid Syst 1(2):264–279CrossRefzbMATHMathSciNetGoogle Scholar
  100. Xu X, Antsaklis P (2000a) A dynamic programming approach for optimal control of switched systems. In: Proceedings of the 39th IEEE conference on decision and control, vol 2. pp 1822–1827Google Scholar
  101. Xu X, Antsaklis P (2000b) Optimal control of switched systems: new results and open problems. In: Proceedings of the IEEE American control conference, vol 4. pp 2683–2687Google Scholar
  102. Xu X, Antsaklis P (2002a) An approach to general switched linear quadratic optimal control problems with state jumps. In: Proceedings 15th international symposium on mathematical theory of networks and systems (MTNS). pp 1–12Google Scholar
  103. Xu X, Antsaklis P (2002b) Optimal control of switched autonomous systems. In: Proceedings of the 41st IEEE conference on decision and control, vol 4. pp 4401–4406Google Scholar
  104. Xu X, Antsaklis P (2002c) Optimal control of switched systems via non-linear optimization based on direct differentiations of value functions, vol 75Google Scholar
  105. Xu X, Antsaklis P (2003) Results and perspectives on computational methods for optimal control of switched systems. In: 6th international workshop hybrid systems: computation and control, vol 2623. Springer, pp 540–550Google Scholar
  106. Xu X, Antsaklis P (2004a) Optimal control of switched systems based on parameterization of the switching instants. IEEE Trans Autom Control 49(1):2–16CrossRefMathSciNetGoogle Scholar
  107. Xu X, Antsaklis P (2004b) Optimal control of switched systems based on parameterization of the switching instants. IEEE Trans Autom Control 49(1):2–16CrossRefMathSciNetGoogle Scholar
  108. Zhang P, Cassandras CG (2001) An improved forward algorithm for optimal control of a class of hybrid systems. In: Proceedings of the 40th IEEE conference on decision and control, vol 2. pp 1235–1236Google Scholar
  109. Zhang W, Hu J (2008a) On optimal quadratic regulation for discrete-time switched linear systems. In: Hybrid systems: computation and control, lecture notes in computer science Egerstedt M, Mishra B (eds), vol 4981, Springer, Berlin / HeidelbergGoogle Scholar
  110. Zhang W, Hu J (2008b) Optimal quadratic regulation for discrete-time switched linear systems: a numerical approach.In: IEEE Proceedings of American control conference. pp 4615–4620Google Scholar
  111. Zhang W, Abate A, Hu J (2009a) Efficient suboptimal solutions of switched lqr problems. In: IEEE Proceedings of American control conference. pp 1084–1091Google Scholar
  112. Zhang W, Hu J, Abate A (2009b) On the value functions of the discrete-time switched lqr problem. IEEE Trans Autom Control 54(11):2669–2674CrossRefMathSciNetGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  1. 1.Department of Electrical EngineeringUniversity of Notre DameNotre DameUSA

Personalised recommendations