Skip to main content
Log in

Dualization and discretization of linear-quadratic control problems with bang–bang solutions

  • Original Paper
  • Published:
EURO Journal on Computational Optimization

Abstract

We consider linear-quadratic (LQ) control problems, where the control variable appears linearly and is box-constrained. It is well-known that these problems exhibit bang–bang and singular solutions. We assume that the solution is of bang–bang type, which is computationally challenging to obtain. We employ a quadratic regularization of the LQ control problem by embedding the \(L^2\)-norm of the control variable into the cost functional. First, we find a dual problem guided by the methodology of Fenchel duality. Then we prove strong duality and the saddle point property, which together ensure that the primal solution can be recovered from the dual solution. We propose a discretization scheme for the dual problem, under which a diagram depicting the relations between the primal and dual problems and their discretization commutes. The commuting diagram ensures that, given convergence results for the discrete primal variables, discrete dual variables also converge to a solution of the dual problem with a similar error bound. We demonstrate via a simple but illustrative example that significant computational savings can be achieved by solving the dual, rather than the primal, problem.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Alt W, Schneider C (2015) Linear-quadratic control problems with \({L^1}\)-control cost. Optim Control Appl Methods 36:512–534

    Article  Google Scholar 

  • Alt W, Seydenschwanz M (2011) Regularization and discretization of linear-quadratic control problems. Control Cybern 40(4):903–920

    Google Scholar 

  • Alt W, Seydenschwanz M (2014) An implicit discretization scheme for linear-quadratic control problems with bang–bang solutions. Optim Methods Softw 29(3):535–560

    Article  Google Scholar 

  • Alt W, Baier R, Gerdts M, Lempio F (2012) Error bounds for Euler approximation of linear-quadratic control problems with bang–bang solutions. Numer Algebra Control Optim 2(3):547–570

    Article  Google Scholar 

  • Alt W, Baier R, Gerdts M, Lempio F (2013) Approximation of linear control problems with bang–bang solutions. Optimization 62(1):9–32

    Article  Google Scholar 

  • Alt W, Schneider C, Seydenschwanz M (2015) Perturbation and regularization of linear-quadratic optimal control problems with bang–bang solutions. Technical report, Friedrich-Schiller-Universität Jena

  • Amman HM, Kendrick DA (1998) Computing the steady state of linear quadratic optimization models with rational expectations. Econ Lett 58:185–191

    Article  Google Scholar 

  • Borwein JM, Zhu QJ (2005) Techniques of variational analysis. Springer, Berlin

    Google Scholar 

  • Burachik RS, Kaya CY, Majeed SN (2014) A duality approach for solving control-constrained linear-quadratic optimal control problems. SIAM J Control Optim 52(3):1423–1456

    Article  Google Scholar 

  • Büskens C, Maurer H (2000) SQP-methods for solving optimal control problems with control and state constraints: adjoint variables, sensitivity analysis and real-time control. J Comput Appl Math 120:85–108

    Article  Google Scholar 

  • Christiansen B, Maurer H, Zirn O (2010) Optimal control of machine tool manipulators. In: Diehl M, Glineur F, Jarlebring E, Michiels W (eds) Recent advances in optimization and its applications in engineering. Springer, Berlin, pp 451–460

    Chapter  Google Scholar 

  • Felgenhauer U (2003) On stability of bang–bang type controls. SIAM J Control Optim 41(6):1843–1867

    Article  Google Scholar 

  • Fenchel W (1949) On conjugate convex functions. Can J Math 1:73–77

    Article  Google Scholar 

  • Fourer R, Gay DM, Kernighan BW (2003) AMPL: a modelling language for mathematical programming, 2nd edn. Duxbury Press, Belmont

    Google Scholar 

  • Haunschmied JL, Piétrus A, Veliov VM (2013) The Euler method for linear control systems revisited. In: Large-scale scientific computing—9th international conference, LSSC 2013, Sozopol, Bulgaria, June 3–7, 2013. Revised Selected Papers, pp 90–97

  • Hestenes MR (1966) Calculus of variations and optimal control theory. Wiley, New York

    Google Scholar 

  • Huber PJ (1964) Robust estimation of a location parameter. Ann Math Stat 35(1):73–101

    Article  Google Scholar 

  • Ioffe AD, Tihomirov VM (1979) Theory of extremal problems. North Holland, Amsterdam

    Google Scholar 

  • Kaya CY (2010) Inexact restoration for Runge–Kutta discretization of optimal control problems. SIAM J Numer Anal 48(4):1492–1517

    Article  Google Scholar 

  • Kaya CY, Noakes JL (2003) Computational algorithm for time-optimal switching control. J Optim Theory Appl 117:69–92

    Article  Google Scholar 

  • Kaya CY, Lucas SK, Simakov ST (2004) Computations for bang-bang constrained optimal control using a mathematical programming formulation. Optim Control Appl Methods 25:295–308

    Article  Google Scholar 

  • Kugelmann B, Pesch HJ (1990) New general guidance method in constrained optimal control, part 1: numerical method. J Optim Theory Appl 67:421–435

    Article  Google Scholar 

  • Luenberger DG (1969) Optimization by vector space methods. Wiley, New York

    Google Scholar 

  • Maurer H, Oberle HJ (2002) Second order sufficient conditions for optimal control problems with free final time: the Riccati approach. SIAM J Control Optim 41:380–403

    Article  Google Scholar 

  • Maurer H, Büskens C, Kim JHR, Kaya CY (2005) Optimization methods for the verification of second order sufficient conditions for bang–bang controls. Optim Control Appl Methods 26:129–156

    Article  Google Scholar 

  • Mouktonglang T (2011) Innate immune response via perturbed LQ-control problem. Adv Stud Biol 3:327–332

    Google Scholar 

  • Osmolovskii NP, Maurer H (2012) Applications to regular and bang–bang control: second-order necessary and sufficient optimality conditions in calculus of variations and optimal control. SIAM, Philadelphia

    Book  Google Scholar 

  • Schneider C, Alt W (2014) Regularization of linear-quadratic control problems with \({L}^1\)-control cost. In: Pötzsche C, Heuberger C, Kaltenbacher B, Rendl F (eds) System modeling and optimization. IFIP advances in information and communication technology. 26th IFIP TC 7 Conference, CSMO 2013, vol 443, pp 296–305. Springer, Berlin

  • Seydenschwanz M (2015) Convergence results for the discrete regularization of linear-quadratic control problems with bang–bang solutions. Comput Optim Appl 61:731–760

    Article  Google Scholar 

  • Tikhomirov V (2009) Lagrange principle and necessary conditions. Control Cybern 38:1589–1605

    Google Scholar 

  • Veliov VM (2005) Error analysis of discrete approximations to bang–bang optimal control problems: the linear case. Control Cybern 34(3):967–982

    Google Scholar 

  • Wächter A, Biegler LT (2006) On the implementation of a primal-dual interior point filter line search algorithm for large-scale nonlinear programming. Math Program 106(1):25–57

    Article  Google Scholar 

  • Werner J (1984) Optimization theory and applications. In: Vieweg advanced lectures in mathematics. Vieweg, Braunschweig

Download references

Acknowledgments

We would like to thank Radu Ioan Boţ und Regina S. Burachik for helpful discussions and also express our gratitude to the anonymous referees for valuable suggestions and comments.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Christopher Schneider.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alt, W., Kaya, C.Y. & Schneider, C. Dualization and discretization of linear-quadratic control problems with bang–bang solutions. EURO J Comput Optim 4, 47–77 (2016). https://doi.org/10.1007/s13675-015-0049-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13675-015-0049-4

Keywords

Mathematics Subject Classification

Navigation