On Block Triangular Preconditioners for the Interior Point Solution of PDE-Constrained Optimization Problems

  • John W. Pearson
  • Jacek Gondzio
Conference paper
Part of the Lecture Notes in Computational Science and Engineering book series (LNCSE, volume 125)


We consider the numerical solution of saddle point systems of equations resulting from the discretization of PDE-constrained optimization problems, with additional bound constraints on the state and control variables, using an interior point method. In particular, we derive a Bramble–Pasciak Conjugate Gradient method and a tailored block triangular preconditioner which may be applied within it. Crucial to the usage of the preconditioner are carefully chosen approximations of the (1, 1)-block and Schur complement of the saddle point system. To apply the inverse of the Schur complement approximation, which is computationally the most expensive part of the preconditioner, one may then utilize methods such as multigrid or domain decomposition to handle individual sub-blocks of the matrix system.



JWP gratefully acknowledges financial support from the Engineering and Physical Sciences Research Council (EPSRC) Fellowship EP/M018857/2. JG gratefully acknowledges support from the EPSRC Grant EP/N019652/1. The authors thank an anonymous referee for their helpful comments.


  1. 1.
    A. Battermann, M. Heinkenschloss, Preconditioners for Karush–Kuhn–Tucker matrices arising in the optimal control of distributed systems, in Control and Estimation of Distributed Parameter Systems, ed. by W. Desch, F. Kappel, K. Kunisch (Birkhäuser, Basel, 1998), pp. 15–32CrossRefGoogle Scholar
  2. 2.
    M. Benzi, G.H. Golub, J. Liesen, Numerical solution of saddle point problems. Acta Numer. 14, 1–137 (2005)MathSciNetCrossRefGoogle Scholar
  3. 3.
    M. Benzi, E. Haber, L. Taralli, Multilevel algorithms for large-scale interior point methods. SIAM J. Sci. Comput. 31, 4152–4175 (2009)MathSciNetCrossRefGoogle Scholar
  4. 4.
    J.H. Bramble, J.E. Pasciak, A preconditioning technique for indefinite systems resulting from mixed approximations of elliptic problems. Math. Comput. 50(181), 1–17 (1988)MathSciNetCrossRefGoogle Scholar
  5. 5.
    A. Drǎgǎnescu, C. Petra, Multigrid preconditioning of linear systems for interior point methods applied to a class of box-constrained optimal control problems. SIAM J. Numer. Anal. 50(1), 328–353 (2012)Google Scholar
  6. 6.
    G.H. Golub, R.S. Varga, Chebyshev semi-iterative methods, successive over-relaxation iterative methods, and second order Richardson iterative methods I. Numer. Math. 3, 147–156 (1961)MathSciNetCrossRefGoogle Scholar
  7. 7.
    G.H. Golub, R.S. Varga, Chebyshev semi-iterative methods, successive over-relaxation iterative methods, and second order Richardson iterative methods II. Numer. Math. 3, 157–168 (1961)MathSciNetCrossRefGoogle Scholar
  8. 8.
    M.J. Grotte, J. Huber, D. Kourounis, O. Schenk, Inexact interior-point method for PDE-constrained nonlinear optimization. SIAM J. Sci. Comput. 36, A1251–A1276 (2014)MathSciNetCrossRefGoogle Scholar
  9. 9.
    A. Napov, Y. Notay, An algebraic multigrid method with guaranteed convergence rate. SIAM J. Sci. Comput. 34(2), A1079–A1109 (2012)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Y. Notay, An aggregation-based algebraic multigrid method. Electron. Trans. Numer. Anal. 37, 123–146 (2010)MathSciNetzbMATHGoogle Scholar
  11. 11.
    Y. Notay, Aggregation-based algebraic multigrid for convection–diffusion equations. SIAM J. Sci. Comput. 34(4), A2288–A2316 (2012)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Y. Notay, AGMG Software and Documentation, see
  13. 13.
    J.W. Pearson, J. Gondzio, Fast interior point solution of quadratic programming problems arising from PDE-constrained optimization. Numer. Math. 137(4), 959–999 (2017)MathSciNetCrossRefGoogle Scholar
  14. 14.
    J.W. Pearson, A.J. Wathen, A new approximation of the Schur complement in preconditioners for PDE-constrained optimization. Numer. Linear Algebra Appl. 19, 816–829 (2012)MathSciNetCrossRefGoogle Scholar
  15. 15.
    J.W. Pearson, A.J. Wathen, Fast iterative solvers for convection–diffusion control problems. Electron. Trans. Numer. Anal. 40, 294–310 (2013)MathSciNetzbMATHGoogle Scholar
  16. 16.
    J.W. Pearson, M. Stoll, A.J. Wathen, Regularization-robust preconditioners for time-dependent PDE-constrained optimization problems. SIAM J. Matrix Anal. Appl. 33(4), 1126–1152 (2012)MathSciNetCrossRefGoogle Scholar
  17. 17.
    T. Rees, M. Stoll, Block triangular preconditioners for PDE-constrained optimization. Numer. Linear Algebra Appl. 17(6), 977–996 (2010)MathSciNetCrossRefGoogle Scholar
  18. 18.
    M. Stoll, Solving linear systems using the adjoint, DPhil thesis, University of Oxford, 2008Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.School of MathematicsThe University of EdinburghEdinburghUK

Personalised recommendations