Skip to main content
SpringerLink
Log in

Optimal control of hybrid switched systems: A brief survey

  • Published:
Discrete Event Dynamic Systems Aims and scope Submit manuscript

Abstract

This paper surveys recent results in the field of optimal control of hybrid and switched systems. We first summarize results that use different problem formulations and then explore the underlying relations among them. Specifically, based on the type of switching, we focus on two important classes of problems: internally forced switching (IFS) problems and externally forced switching (EFS) problems. For IFS problems, we focus on optimal control techniques for piecewise affine systems. For EFS problems, methodologies of two-stage optimization, embedding transformation and switching LQR design are investigated. Detailed optimization methods found in the literature are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Antsaklis PJ (2000) Special issue on hybrid systems: theory and applications. A brief introduction to the theory and applications of hybrid systems. Proc IEEE 88(7):879–887

    Article  Google Scholar 

  • Antsaklis PJ, Koutsoukos X D (2002) Hybrid systems control. Encyclopedia of physical science and technology, 3rd edn 7:445–458

    Google Scholar 

  • Antsaklis PJ, Koutsoukos X D (2005) Hybrid systems: review and recent progress. Wiley, pp 273–298

  • Antsaklis PJ, Nerode A (1998) Hybrid control systems: an introductory discussion to the special issue. IEEE Trans Autom Control 43(4):457–460

    Article  MathSciNet  Google Scholar 

  • Antsaklis PJ, Koutsoukos X, Zaytoon J (1998) On hybrid control of complex systems: a survey. Eur J Autom 32:1023–1045

    Google Scholar 

  • Axelsson H, Wardi Y, Egerstedt M (2005a) Transition-time optimization for switched systems. In: IFAC Proceedings volumes, vol 16. pp 453–458

  • Axelsson H, Wardi Y, Egerstedt M, Verriest E (2005b) A provably convergent algorithm for transition-time optimization in switched systems. In: Proceedings 44th IEEE conference on decision and control and European control conference. pp 1397–1402

  • Axelsson H, Wardi Y, Egerstedt M, Verriest E (2008) Gradient descent approach to optimal mode scheduling in hybrid dynamical systems. J Optim Theory Appl 136:167–186

    Article  MATH  MathSciNet  Google Scholar 

  • Azuma S, Egerstedt M, Wardi Y (2006) Output-based optimal timing control of switched systems. In: Hybrid systems: computation and control, lecture notes in computer science, vol 3927. Springer, pp 64–78

  • Baotic M, Christophersen F, Morari M (2003a) A new algorithm for constrained finite time optimal control of hybrid systems with a linear performance index. In: European control conference. pp 3335–3340

  • Baotic M, Christophersen F J, Morari M (2003b) Infinite time optimal control of hybrid systems with a linear performance index. In: Proceedings. 42nd IEEE conference on decision and control, vol 3. pp 3191– 3196

  • Baotic M, Christophersen F, Morari M (2006) Constrained optimal control of hybrid systems with a linear performance index. IEEE Trans Autom Control 51(12):1903–1919

    Article  MathSciNet  Google Scholar 

  • Baric M, Grieder P, Baotic M, Morari M (2005) Optimal control of pwa systems by exploiting problem structure. In: IFAC World Congress, vol 16. pp 307–312

  • Baric M, Grieder P, Baotic M, Morari M (2008) An efficient algorithm for optimal control of pwa systems with polyhedral performance indices. Automatica 44(1):296–301

    Article  MATH  MathSciNet  Google Scholar 

  • Bemporad A, Morari M (1999a) Control of systems integrating logic, dynamics, and constraints. Automatica 35:407–427

    Article  MATH  MathSciNet  Google Scholar 

  • Bemporad A, Morari M (1999b) Control of systems integrating logic, dynamics, and constraints. Automatica 35(3):407–427

    Article  MATH  MathSciNet  Google Scholar 

  • Bemporad A, Borrelli F, Morari M (2000a) Optimal controllers for hybrid systems: stability and piecewise linear explicit form. In: Proceedings of the 39th IEEE conference on decision and control, vol 2. pp 1810–1815

  • Bemporad A, Borrelli F, Morari M (2000b) Piecewise linear optimal controllers for hybrid systems. In: Proceedings of the IEEE American control conference, vol 2. pp 1190–1194

  • Bemporad A, Ferrari-Trecate G, Morari M (2000c) Observability and controllability of piecewise affine and hybrid systems. IEEE Trans Autom Control 45(10):1864–1876

    Article  MATH  MathSciNet  Google Scholar 

  • Bemporad A, Borrelli F, Morari M (2002a) On the optimal control law for linear discrete time hybrid systems. In: International workshop on hybrid systems: computation and control. pp 105–119

  • Bemporad A, Giua A, Seatzu C (2002b) An iterative algorithm for the optimal control of continuous-time switched linear systems. In: Proceedings. 6th international workshop on discrete event systems. pp 335–340

  • Bemporad A, Giua A, Seatzu C (2002c) A master-slave algorithm for the optimal control of continuous-time switched affine systems. In: Proceedings of the 41st IEEE conference on decision and control, vol 2. pp 1976–1981

  • Bemporad A, Giua A, Seatzu C (2002d) Synthesis of state-feedback optimal controllers for continuous-time switched linear systems. In: Proceedings of the 41st IEEE conference on decision and control, vol 3. pp 3182–3187

  • Bemporad A, Corona D, Giua A, Seatzu C (2003) Optimal state-feedback quadratic regulation of linear hybrid automata. In: Proceedings 2003 IFAC conference on analysis and design of hybrid systems. pp 407–412

  • Bengea SC, DeCarlo RA (2005) Optimal control of switching systems. Automatica 41(1):11–27

    MATH  MathSciNet  Google Scholar 

  • Berkovitz L D (1974) Optimal control theory. Springer, New York

    Book  MATH  Google Scholar 

  • Borrelli F, Baotic M, Bemporad A, Morari M (2003) An efficient algorithm for computing the state feedback optimal control law for discrete time hybrid systems. In: Proceedings of the IEEE American control conference, vol 6. pp 4717–4722

  • Borrelli F, Baotic M, Bemporad A, Morari M (2005) Dynamic programming for constrained optimal control of discrete-time linear hybrid systems. Automatica 41(10):1709–1721

    Article  MATH  MathSciNet  Google Scholar 

  • Branicky MS, Mitter SK (1995) Algorithms for optimal hybrid control. In: Proceedings of the 34th IEEE conference on decision and control, vol 3. pp 2661–2666

  • Branicky MS, Borkar V S, Mitter SK (1998) A unified framework for hybrid control: model and optimal control theory. IEEE Trans Autom Control 43(1):31–45

    Article  MATH  MathSciNet  Google Scholar 

  • Caines P, Shaikh M (2006) Optimality zone algorithms for hybrid systems: efficient algorithms for optimal location and control computation, vol 3927. Springer Berlin / Heidelberg. pp 123–137

  • Caines PE, Shaikh MS (2005) Optimality zone algorithms for hybrid systems computation and control: From exponential to linear complexity. In: Proceedings of the IEEE international symposium on intelligent control, Mediterrean conference on control and automation. pp 1292–1297

  • Caldwell T, Murphey T (2012a) Projection-based switched system optimization: Absolute continuity of the line search. In: IEEE 51st conference on decision and control. pp 699–706

  • Caldwell T, Murphey T (2012b) Single integration optimization of linear time-varying switched systems. IEEE Trans Autom Control 57(6)

  • Caldwell TM, Murphey T (2010) An adjoint method for second-order switching time optimization. In: 49th IEEE conference on decision and control. pp 2155–2162

  • Caldwell TM, Murphey T (2011) Single integration optimization of linear timevarying switched systems. In: American control conference. pp 2024–2030

  • Caldwell TM, Murphey T (2012c) Projection-based switched system optimization. In: American control conference. pp 4552–4557

  • Cassandras CG, Pepyne DL, Wardi Y (1998) Optimal control of systems with time-driven and event-driven dynamics. In: Proceedings of the 37th IEEE conference on decision and control, vol 1. pp 7–12

  • Cassandras CG, Pepyne DL, Wardi Y (2001) Optimal control of a class of hybrid systems. IEEE Trans Autom Control 46(3):398–415

    Article  MATH  MathSciNet  Google Scholar 

  • Cho YC, Cassandras CG, Pepyne DL (2000) Forward algorithms for optimal control of a class of hybrid systems. In: Proceedings of the 39th IEEE conference on decision and control, vol 1. pp 975–980

  • Christophersen F J, Baotić M, Morari M (2005) Optimal control of piecewise affine systems: a dynamic programming approach. In: Control and observer design for nonlinear finite and infinite dimensional systems Meurer T, Graichen K, Gilles ED (eds), vol 322, Springer-Verlag

  • Corona D, Giua A, Seatzu C (2004a) Optimal feedback switching laws for autonomous hybrid automata. In: Proceedings of the 2004 IEEE international symposium on intelligent control. pp 31–36

  • Corona D, Seatzu C, Giua A, Gromov D, Mayer E, Raisch J (2004b) Optimal hybrid control for switched affine systems under safety and liveness constraints. In: IEEE international symposium on computer aided control systems design. pp 35–40

  • Das T, Mukherjee R (2008) Optimally switched linear systems. Automatica 44(5):1437–1441

    Article  MATH  MathSciNet  Google Scholar 

  • Ding X, Wardi Y, Egerstedt M (2009a) On-line adaptive optimal timing control of switched systems. In: Proceedings of the 48th IEEE conference on decision and control Chinese control conference. pp 5305–5310

  • Ding X, Wardi Y, Egerstedt M (2009b) On-line optimization of switched-mode dynamical systems. IEEE Trans Autom Control 54(9):2266–2271

    Article  MathSciNet  Google Scholar 

  • Egerstedt M, Wardi Y, Delmotte F (2003) Optimal control of switching times in switched dynamical systems. In: Proceedings 42nd IEEE conference on decision and control, vol 3. pp 2138–2143

  • Egerstedt M, Azuma S, Wardi Y (2006a) Optimal timing control of switched linear systems based on partial information. Nonlinear Anal Theory Methods Appl 65(9):1736–1750

    Article  MATH  MathSciNet  Google Scholar 

  • Egerstedt M, Wardi Y, Axelsson H (2006b) Transition-time optimization for switched-mode dynamical systems. IEEE Trans Autom Control 51(1):110–115

    Article  MathSciNet  Google Scholar 

  • Feng Z G, Teo K L, Rehbock V (2009) A discrete filled function method for the optimal control of switched systems in discrete time. Optim Control Appl Methods 30(6):585–593

    Article  MathSciNet  Google Scholar 

  • Ferrari-Trecate G, Mignone D, Morari M (2002) Moving horizon estimation for hybrid systems. IEEE Trans Autom Control 47(10):1663–1676

    Article  MathSciNet  Google Scholar 

  • Fotiou I, Beccuti A, Papafotiou G, Morari M (2006a) Optimal control of piece-wise polynomial hybrid systems using cylindrical algebraic decomposition. In: Hybrid systems: computation and control. pp 227–241

  • Fotiou I, Rostalski P, Parrilo P, Morari M (2006b) Parametric optimization and optimal control using algebraic geometry methods. Int J Control 79(11):1340–1358

    Article  MATH  MathSciNet  Google Scholar 

  • Giua A, Seatzu C, der Mee CV (2001a) Optimal control of switched autonomous linear systems. In: Proceedings of the 40th IEEE conference on decision and control, vol 3. pp 2472–2477

  • Giua A, Seatzu C, Mee CVD (2001b) Optimal control of autonomous linear systems switched with a pre-assigned finite sequence. In: Proceedings of the 2001 IEEE international symposium on intelligent control. pp 144–149

  • Goebel R, Sanfelice R, Teel A (2009) Hybrid dynamical systems. IEEE Control Syst 29(2):28–93

    Article  MathSciNet  Google Scholar 

  • Gokbayrak K, Cassandras CG (2000a) A hierarchical decomposition method for optimal control of hybrid systems. In: Proceedings of the 39th IEEE conference on decision and control, vol 2. pp 1816–1821

  • Gokbayrak K, Cassandras CG (2000b) Hybrid controllers for hierarchically decomposed systems Proceedings of the 3rd international workshop on hybrid systems: computation and control. Springer-Verlag, London, pp 117–129

  • Gonzalez H, Vasudevan R, Kamgarpour M, Sastry SS, Bajcsy R, Tomlin C (2010a) A numerical method for the optimal control of switched systems. In: 49th IEEE conference on decision and control. pp 7519–7526

  • Gonzalez H, Vasudevan R, Kamgarpour M, Sastry SS, Bajcsy R, Tomlin CJ (2010b) A descent algorithm for the optimal control of constrained nonlinear switched dynamical systems. In: Proceedings of the 13th ACM international conference on hybrid systems: computation and control, HSCC ’10. pp 51–60

  • Görges D, Izák M, Liu S (2011) Optimal control and scheduling of switched systems. IEEE Trans Autom Control 56(1):135–140

    Article  Google Scholar 

  • Hedlund S, Rantzer A (1999a) CDP Tool, a Matlab tool for optimal control of hybrid systems

  • Hedlund S, Rantzer A (1999b) Optimal control of hybrid systems. In: Proceedings of the 38th IEEE conference on decision and control, vol 4. pp 3972–3977

  • Hedlund S, Rantzer A (2002) Convex dynamic programming for hybrid systems. IEEE Trans Autom Control 47(9):1536–1540

    Article  MathSciNet  Google Scholar 

  • Imura J, van der Schaft A (2000) Characterization of well-posedness of piecewise-linear systems. IEEE Trans Autom Control 45(9):1600–1619

    Article  MATH  MathSciNet  Google Scholar 

  • Johnson E, Murphey T (2009) Second order switching time optimization for time-varying nonlinear systems. In: IEEE 48th conference on decision and control. pp 5281–5286

  • Johnson E, Murphey T (2011) Second-order switching time optimization for nonlinear time-varying dynamic systems. IEEE Trans Autom Control 56(8):1953–1957

    Article  MathSciNet  Google Scholar 

  • Kerrigan E, Mayne D (2002) Optimal control of constrained, piecewise affine systems with bounded disturbances. In: Proceedings of the 41st IEEE conference on decision and control, 2002, vol 2. pp 1552–1557

  • Kvasnica M, Grieder P, Baotić MMulti-Parametric Toolbox (MPT). http://control.ee.ethz.ch/mpt/

  • Lin H, Antsaklis P (2009) Stability and stabilizability of switched linear systems: a survey of recent results. IEEE Trans Autom Control 54(2):308–322

    Article  MathSciNet  Google Scholar 

  • Lincoln B, Rantzer A (2006) Relaxing dynamic programming. IEEE Trans Autom Control 51(8):1249–1260. doi:10.1109/TAC.2006.878720

    Article  MathSciNet  Google Scholar 

  • Lofberg J (2004) Yalmip: a toolbox for modeling and optimization in MATLAB. In: Proceedings of the CACSD conference

  • Loxton R, Teo K, Rehbock V (2009) Computational method for a class of switched system optimal control problems. IEEE Trans Autom Control 54(10):2455–2460

    Article  MathSciNet  Google Scholar 

  • Lunze J, Lamnabhi-Lagarrigue F (2009) Handbook of hybrid systems control. Cambridge University Press

  • Matveev AS, Savkin AV (2000) Qualitative theory of hybrid dynamical systems. Birkhauser, Boston

    Book  MATH  Google Scholar 

  • Mignone D, Ferrari-Trecate G, Morari M (2000) Stability and stabilization of piecewise affine and hybrid systems: an lmi approach. In: Proceedings of the 39th IEEE conference on decision and control, 2000, vol 1. pp 504–509

  • Mojica Nava, E, Meziat R, Quijano N, Gauthier A, Rakoto-Ravalontsalama N (2008) Optimal control of switched systems: a polynomial approach. In: IFAC Proceedings Volumes, vol 17. pp 7808–7813

  • Mojica-Nava E, Quijano N, Rakoto-Ravalontsalama N (2013) A polynomial approach for optimal control of switched nonlinear systems. Int J Robust Nonlinear Control Early Access

  • Piccoli B (1999) Necessary conditions for hybrid optimization. In: Proceedings of the 38th IEEE conference on decision and control, vol 1. pp 410–415

  • Rantzer A (2006) Relaxed dynamic programming in switching systems. IEE Proc Control Theory Appl 153(5):567–574

    Article  MathSciNet  Google Scholar 

  • Rantzer A, Johansson M (2000) Piecewise linear quadratic optimal control. IEEE Trans Autom Control 45(4):629–637

    Article  MATH  MathSciNet  Google Scholar 

  • Riedinger P, Kratz F, Iung C, Zanne C (1999) Linear quadratic optimization for hybrid systems. In: Proceedings of the 38th IEEE conference on decision and control, vol 3. pp 3059–3064

  • Roll J, Bemporad A, Ljung L (2004) Identification of piecewise affine systems via mixed-integer programming. Automatica 40(1):37–50

    Article  MATH  MathSciNet  Google Scholar 

  • Savkin AV, Evans R J (2002) Hybrid dynamical systems. Birkhauser, Boston

    Book  MATH  Google Scholar 

  • van der Schaft S (2000) An introduction to hybrid dynamical systems. Springer-Verlag

  • Seatzu C, Corona D, Giua A, Bemporad A (2006a) Optimal control of continuous-time switched affine systems. IEEE Trans Autom Control 51(5):726–741

    Article  MathSciNet  Google Scholar 

  • Seatzu C, Gromov D, Raisch J, Corona D, Giua A (2006b) Optimal control of discrete-time hybrid automata under safety and liveness constraints. Nonlinear Anal Theory Methods Appl 65(6):1188–1210

    Article  MATH  MathSciNet  Google Scholar 

  • Sebastain Engell GF, Schnieder E (2002) Modeling, analysis, and design of hybrid systems. Springer-Verlag

  • Shaikh M, Caines P (2003) On the optimal control of hybrid systems: optimization of trajectories, switching times, and location schedules. In: Hybrid systems: computation and control, lecture notes in computer science, vol 2623. pp 466–481

  • Shaikh MS, Caines PE (2002) On trajectory optimization for hybrid systems: theory and algorithms for fixed schedules. In: Proceedings of the 41st IEEE conference on decision and control, vol 2. pp 1997–1998

  • Sontag E (1981) Nonlinear regulation: the piecewise linear approach. IEEE Trans Autom Control 26(2):346–358

    Article  MATH  MathSciNet  Google Scholar 

  • Sontag ED (1996) Interconnected automata and linear systems: a theoretical framework in discrete-time. In: Proceedings of the DIMACS/SYCON workshop on Hybrid systems III: verification and control: verification and control. Springer-Verlag New York, Inc., Secaucus, pp 436–448

    Google Scholar 

  • Sussmann H J (2000) Set-valued differentials and the hybrid maximum principle. In: Proceedings of the 39th IEEE conference on decision and control, vol 1. pp 558–563

  • Tabuada P (2009) Verification and control of hybrid systems. Springer-Verlag

  • Wardi Y, Egerstedt M (2012) Algorithm for optimal mode scheduling in switched systems. In: American control conference. pp 4546–4551

  • Wardi Y, Ding X, Egerstedt M, Azuma S (2007) On-line optimization of switched-mode systems: algorithms and convergence properties. In: 46th IEEE conference on decision and control. pp 5005–5010

  • Wardi Y, Twu P, Egerstedt M (2010) On-line optimal timing control of switched systems. In: 49th IEEE conference on decision and control. pp 2137–2142

  • Wassim M Haddad VC, Nersesov SG (2006) Impulsive and hybrid dynamical systems. Princeton University Press

  • Wei S, Uthaichana K, Zefran M, DeCarlo RA, Bengea S (2007) Applications of numerical optimal control to nonlinear hybrid systems. Nonlinear Anal Hybrid Syst 1(2):264–279

    Article  MATH  MathSciNet  Google Scholar 

  • Xu X, Antsaklis P (2000a) A dynamic programming approach for optimal control of switched systems. In: Proceedings of the 39th IEEE conference on decision and control, vol 2. pp 1822–1827

  • Xu X, Antsaklis P (2000b) Optimal control of switched systems: new results and open problems. In: Proceedings of the IEEE American control conference, vol 4. pp 2683–2687

  • Xu X, Antsaklis P (2002a) An approach to general switched linear quadratic optimal control problems with state jumps. In: Proceedings 15th international symposium on mathematical theory of networks and systems (MTNS). pp 1–12

  • Xu X, Antsaklis P (2002b) Optimal control of switched autonomous systems. In: Proceedings of the 41st IEEE conference on decision and control, vol 4. pp 4401–4406

  • Xu X, Antsaklis P (2002c) Optimal control of switched systems via non-linear optimization based on direct differentiations of value functions, vol 75

  • Xu X, Antsaklis P (2003) Results and perspectives on computational methods for optimal control of switched systems. In: 6th international workshop hybrid systems: computation and control, vol 2623. Springer, pp 540–550

  • Xu X, Antsaklis P (2004a) Optimal control of switched systems based on parameterization of the switching instants. IEEE Trans Autom Control 49(1):2–16

    Article  MathSciNet  Google Scholar 

  • Xu X, Antsaklis P (2004b) Optimal control of switched systems based on parameterization of the switching instants. IEEE Trans Autom Control 49(1):2–16

    Article  MathSciNet  Google Scholar 

  • Zhang P, Cassandras CG (2001) An improved forward algorithm for optimal control of a class of hybrid systems. In: Proceedings of the 40th IEEE conference on decision and control, vol 2. pp 1235–1236

  • Zhang W, Hu J (2008a) On optimal quadratic regulation for discrete-time switched linear systems. In: Hybrid systems: computation and control, lecture notes in computer science Egerstedt M, Mishra B (eds), vol 4981, Springer, Berlin / Heidelberg

  • Zhang W, Hu J (2008b) Optimal quadratic regulation for discrete-time switched linear systems: a numerical approach.In: IEEE Proceedings of American control conference. pp 4615–4620

  • Zhang W, Abate A, Hu J (2009a) Efficient suboptimal solutions of switched lqr problems. In: IEEE Proceedings of American control conference. pp 1084–1091

  • Zhang W, Hu J, Abate A (2009b) On the value functions of the discrete-time switched lqr problem. IEEE Trans Autom Control 54(11):2669–2674

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgments

The support of the National Science Foundation under the CPS Large Grant No. CNS-1035655 is gratefully acknowledged. We also would like to thank the anonymous reviewers for their helpful comments that have improved the manuscript.

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, University of Notre Dame, Notre Dame, IN, 46556, USA

    Feng Zhu & Panos J. Antsaklis

Authors
  1. Feng Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Panos J. Antsaklis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Feng Zhu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhu, F., Antsaklis, P.J. Optimal control of hybrid switched systems: A brief survey. Discrete Event Dyn Syst 25, 345–364 (2015). https://doi.org/10.1007/s10626-014-0187-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10626-014-0187-5

Keywords

Search

Navigation