Dynamic Programming Approach for Discrete-Valued Time Discrete Optimal Control Problems with Dwell Time Constraints

  • Michael Burger
  • Matthias GerdtsEmail author
  • Simone Göttlich
  • Michael Herty
Conference paper
Part of the IFIP Advances in Information and Communication Technology book series (IFIPAICT, volume 494)


The article discusses a numerical approach to solve optimal control problems in discrete time that involve continuous and discrete controls. Special attention is drawn to the modeling and treatment of dwell time constraints. For the solution of the optimal control problem in discrete time, a dynamic programming approach is employed. A numerical example is included that illustrates the impact of dwell time constraints in mixed integer optimal control.


Dynamic programming Mixed-integer optimization Dwell time constraints 


  1. 1.
    Gerdts, M.: Solving mixed-integer optimal control problems by branch & bound: a case study from automobile test-driving with gear shift. Optim. Control Appl. Methods 26(1), 1–18 (2005)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Gerdts, M.: A variable time transformation method for mixed-integer optimal control problems. Optim. Control Appl. Methods 27(3), 169–182 (2006)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Gerdts, M.: Optimal Control of ODEs and DAEs. DeGruyter, Berlin (2011)zbMATHGoogle Scholar
  4. 4.
    Göttlich, S., Herty, M., Ziegler, U.: Modeling and optimizing traffic light settings on road networks. Comput. Oper. Res. 55, 36–51 (2015)MathSciNetCrossRefzbMATHGoogle Scholar
  5. 5.
    Howlett, P.: Optimal strategies for the control of a train. Automatica 32(4), 519–532 (1996)MathSciNetCrossRefzbMATHGoogle Scholar
  6. 6.
    Khmelnitsky, E.: A combinatorial, graph-based solution method for a class of continuous-time optimal control problems. Math. Oper. Res. 27(2), 312–325 (2002)MathSciNetCrossRefzbMATHGoogle Scholar
  7. 7.
    Kirches, C.: Fast numerical methods for mixed-integer nonlinear model-predictive control. Ph.D. thesis, Naturwissenschaftlich-Mathematische Gesamtfakultät, Universität Heidelberg, Heidelberg, Germany (2010)Google Scholar
  8. 8.
    Kirches, C., Sager, S., Bock, H.G., Schlöder, J.P.: Time-optimal control of automobile test drives with gear shifts. Optim. Control Appl. Methods 31, 137–153 (2010). doi: 10.1002/oca.892 MathSciNetCrossRefzbMATHGoogle Scholar
  9. 9.
    Lee, H.W.J., Teo, K.L., Cai, X.Q.: An optimal control approach to nonlinear mixed integer programming problems. Comput. Math. Appl. 36(3), 87–105 (1998)MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Lee, H.W.J., Teo, K.L., Rehbock, V., Jennings, L.S.: Control parameterization enhancing technique for time optimal control problems. Dyn. Syst. Appl. 6(2), 243–262 (1997)zbMATHGoogle Scholar
  11. 11.
    Lee, H.W.J., Teo, K.L., Rehbock, V., Jennings, L.S.: Control parametrization enhancing technique for optimal discrete-valued control problems. Automatica 35(8), 1401–1407 (1999)MathSciNetCrossRefzbMATHGoogle Scholar
  12. 12.
    Palagachev, K., Gerdts, M.: Mathematical programs with blocks of vanishing constraints arising in discretized mixed-integer optimal control problems. Set-Valued Var. Anal. 23(1), 149–167 (2015)MathSciNetCrossRefzbMATHGoogle Scholar
  13. 13.
    Sager, S.: Reformulations and algorithms for the optimization of switching decisions in nonlinear optimal control. J. Process Control 19(8), 1238–1247 (2009)CrossRefGoogle Scholar
  14. 14.
    Sager, S., Bock, H.G., Diehl, M., Reinelt, G., Schlöder, J.P.: Numerical methods for optimal control with binary control functions applied to a Lotka-Volterra type fishing problem. In: Seeger, A. (ed.) Recent Advances in Optimization (Proceedings of the 12th French-German-Spanish Conference on Optimization). Lectures Notes in Economics and Mathematical Systems, vol. 563, pp. 269–289. Springer, Heidelberg (2006)Google Scholar
  15. 15.
    Sager, S., Kirches, C., Bock, H.G.: Fast solution of periodic optimal control problems in automobile test-driving with gear shifts. In: Proceedings of the 47th IEEE Conference on Decision and Control (CDC 2008), Cancun, Mexico, pp. 1563–1568 (2008). ISBN: 978-1-4244-3124-3Google Scholar
  16. 16.
    Sager, S.: Numerical methods for mixed-integer optimal control problems. Ph.D. thesis, Heidelberg: Univ. Heidelberg, Naturwissenschaftlich-Mathematische Gesamtfakultät (Diss.). viii, 219 p. (2006)Google Scholar
  17. 17.
    Sager, S., Bock, H.G., Reinelt, G.: Direct methods with maximal lower bound for mixed-integer optimal control problems. Math. Program. (A) 118(1), 109–149 (2009)MathSciNetCrossRefzbMATHGoogle Scholar
  18. 18.
    Siburian, A.: Numerical Methods for Robust, Singular and Discrete Valued Optimal Control Problems. Ph.D. thesis, Curtin University of Technology, Perth, Australia (2004)Google Scholar
  19. 19.
    Teo, K.L., Jennings, L.S., Lee, V., Rehbock, H.W.J.: The control parameterization enhancing transform for constrained optimal control problems. J. Aust. Math. Soc. 40(3), 314–335 (1999)MathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2016

Authors and Affiliations

  • Michael Burger
    • 1
  • Matthias Gerdts
    • 2
    Email author
  • Simone Göttlich
    • 3
  • Michael Herty
    • 4
  1. 1.Abteilung Mathematische Methoden in Dynamik und Festigkeit MDFFraunhofer-Institut für Techno- und Wirtschaftsmathematik ITWMKaiserslauternGermany
  2. 2.Institut für Mathematik und Rechneranwendung (LRT)Universität der Bundeswehr MünchenNeubibergGermany
  3. 3.Department of MathematicsUniversity of MannheimMannheimGermany
  4. 4.Department of MathematicsRWTH AachenAachenGermany

Personalised recommendations