Skip to main content

Discrete Optimal Control

  • Reference work entry
  • First Online:
Encyclopedia of Systems and Control
  • 53 Accesses

Abstract

Discrete optimal control is a branch of mathematics which studies optimization procedures for controlled discrete-time models – that is, the optimization of a performance index associated with a discrete-time control system. This entry gives an introduction to the topic. The formulation of a general discrete optimal control problem is described, and applications to mechanical systems are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 1,699.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 1,999.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Bibliography

  • Bock HG, Plitt KJ (1984) A multiple shooting algorithm for direct solution of optimal control problems. In: 9th IFAC world congress, Budapest. Pergamon Press, pp 242–247

    Google Scholar 

  • Bloch AM, Hussein I, Leok M, Sanyal AK (2009) Geometric structure-preserving optimal control of a rigid body. J Dyn Control Syst 15(3):307–330

    Article  MathSciNet  MATH  Google Scholar 

  • Bloch AM, Crouch PE, Nordkvist N (2013) Continuous and discrete embedded optimal control problems and their application to the analysis of Clebsch optimal control problems and mechanical systems. J Geom Mech 5(1):1–38

    Article  MathSciNet  MATH  Google Scholar 

  • Bonnans JF, Laurent-Varin J (2006) Computation of order conditions for symplectic partitioned Runge-Kutta schemes with application to optimal control. Numer Math 103:1–10

    Article  MathSciNet  MATH  Google Scholar 

  • Bou-Rabee N, Marsden JE (2009) Hamilton-Pontryagin integrators on Lie groups: introduction and structure-preserving properties. Found Comput Math 9(2):197–219

    Article  MathSciNet  MATH  Google Scholar 

  • Cadzow JA (1970) Discrete calculus of variations. Int J Control 11:393–407

    Article  MATH  Google Scholar 

  • de León M, Martí’n de Diego D, Santamaría-Merino A (2007) Discrete variational integrators and optimal control theory. Adv Comput Math 26(1–3):251–268

    Article  MathSciNet  MATH  Google Scholar 

  • Hager WW (2001) Numerical analysis in optimal control. In: International series of numerical mathematics, vol 139. Birkhäuser Verlag, Basel, pp 83–93

    Google Scholar 

  • Hairer E, Lubich C, Wanner G (2002) Geometric numerical integration, structure-preserving algorithms for ordinary differential equations’. Springer series in computational mathematics, vol 31. Springer, Berlin

    MATH  Google Scholar 

  • Hussein I, Leok M, Sanyal A, Bloch A (2006) A discrete variational integrator for optimal control problems on SO(3)’. In: Proceedings of the 45th IEEE conference on decision and control, San Diego, pp 6636–6641

    Google Scholar 

  • Hwang CL, Fan LT (1967) A discrete version of Pontryagin’s maximum principle. Oper Res 15:139–146

    Article  MathSciNet  MATH  Google Scholar 

  • Jordan BW, Polak E (1964) Theory of a class of discrete optimal control systems. J Electron Control 17:697–711

    Article  MathSciNet  Google Scholar 

  • Jiménez F, Martín de Diego D (2010) A geometric approach to Discrete mechanics for optimal control theory. In: Proceedings of the IEEE conference on decision and control, Atlanta, pp 5426–5431

    Google Scholar 

  • Jiménez F, Kobilarov M, Martín de Diego D (2013) Discrete variational optimal control. J Nonlinear Sci 23(3):393–426

    Article  MathSciNet  MATH  Google Scholar 

  • Junge O, Ober-Blöbaum S (2005) Optimal reconfiguration of formation flying satellites. In: IEEE conference on decision and control and European control conference ECC, Seville

    Book  Google Scholar 

  • Junge O, Marsden JE, Ober-Blöbaum S (2006) Optimal reconfiguration of formation flying spacecraft- a decentralized approach. In: IEEE conference on decision and control and European control conference ECC, San Diego, pp 5210–5215

    Google Scholar 

  • Kobilarov M (2008) Discrete geometric motion control of autonomous vehicles. Thesis, Computer Science, University of Southern California

    Google Scholar 

  • Kobilarov M, Marsden JE (2011) Discrete geometric optimal control on Lie groups. IEEE Trans Robot 27(4):641–655

    Article  Google Scholar 

  • Leok M (2004) Foundations of computational geometric mechanics, control and dynamical systems. Thesis, California Institute of Technology. Available in http://www.math.lsa.umich.edu/~mleok

    Google Scholar 

  • Leyendecker S, Ober-Blobaum S, Marsden JE, Ortiz M (2007) Discrete mechanics and optimal control for constrained multibody dynamics. In: 6th international conference on multibody systems, nonlinear dynamics, and control, ASME international design engineering technical conferences, Las Vegas

    Google Scholar 

  • Marrero JC, Martín de Diego D, Martínez E (2006) Discrete Lagrangian and Hamiltonian mechanics on Lie groupoids. Nonlinearity 19:1313–1348. Corrigendum: Nonlinearity 19

    Google Scholar 

  • Marrero JC, Martín de Diego D, Stern A (2010) Lagrangian submanifolds and discrete constrained mechanics on Lie groupoids. Preprint, To appear in DCDS-A 35-1, January 2015.

    Google Scholar 

  • Marsden JE, West M (2001) Discrete mechanics and variational integrators. Acta Numer 10: 357–514

    Article  MathSciNet  MATH  Google Scholar 

  • Marsden JE, Pekarsky S, Shkoller S (1999a) Discrete Euler-Poincaré and Lie-Poisson equations. Nonlinearity 12:1647–1662

    Article  MathSciNet  MATH  Google Scholar 

  • Marsden JE, Pekarsky S, Shkoller S (1999b) Symmetry reduction of discrete Lagrangian mechanics on Lie groups. J Geom Phys 36(1–2):140–151

    MathSciNet  MATH  Google Scholar 

  • Ober-Blöbaum S (2008) Discrete mechanics and optimal control. Ph.D. Thesis, University of Paderborn

    Google Scholar 

  • Ober-Blöbaum S, Junge O, Marsden JE (2011) Discrete mechanics and optimal control: an analysis. ESAIM Control Optim Calc Var 17(2):322–352

    Article  MathSciNet  MATH  Google Scholar 

  • Pytlak R (1999) Numerical methods for optimal control problems with state constraints. Lecture Notes in Mathematics, 1707. Springer-Verlag, Berlin, xvi+215 pp.

    Google Scholar 

  • Wendlandt JM, Marsden JE (1997a) Mechanical integrators derived from a discrete variational principle. Phys D 106:2232–2246

    Article  MathSciNet  MATH  Google Scholar 

  • Wendlandt JM, Marsden JE (1997b) Mechanical systems with symmetry, variational principles and integration algorithms. In: Alber M, Hu B, Rosenthal J (eds) Current and future directions in applied mathematics, (Notre Dame, IN, 1996), Birkhäuser Boston, Boston, MA, pp 219–261

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to David Martin De Diego .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Martin De Diego, D. (2021). Discrete Optimal Control. In: Baillieul, J., Samad, T. (eds) Encyclopedia of Systems and Control. Springer, Cham. https://doi.org/10.1007/978-3-030-44184-5_47

Download citation

Publish with us

Policies and ethics