Efficient Solvers for Saddle Point Problems with Applications to PDE–Constrained Optimization

  • Walter Zulehner
Part of the Lecture Notes in Applied and Computational Mechanics book series (LNACM, volume 66)


We review some of the recent work on preconditioners for saddle point problems. In particular, we discuss preconditioners that are constructed based on exact or inexact Schur complements and on interpolation theory. These preconditioners are used within Krylov subspace methods, for which it is shown that the total number of iterations is bounded by global constants. The described techniques are applied to two model problems from optimal control.


Condition Number Saddle Point Problem Interpolation Theory Krylov Subspace Method Element Space Versus 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Babuška, I.: Error-bounds for finite element method. Numer. Math. 16, 322–333 (1971)MathSciNetzbMATHCrossRefGoogle Scholar
  2. 2.
    Babuška, I.: The finite element method with Lagrangian multipliers. Numer. Math. 20, 179–192 (1973)zbMATHCrossRefGoogle Scholar
  3. 3.
    Benzi, M., Golub, G.H., Liesen, J.: Numerical solution of saddle point problems. Acta Numerica 14, 1–137 (2005)MathSciNetzbMATHCrossRefGoogle Scholar
  4. 4.
    Bergh, J., Löfström, J.: Interpolation Spaces. An Introduction. Die Grundlehren der mathematischen Wissenschaften. Band 223. Springer, Heidelberg (1976)Google Scholar
  5. 5.
    Bramble, J.H., Pasciak, J.E.: A preconditioning technique for indefinite systems resulting from mixed approximations of elliptic problems. Math. Comp. 50, 1–17 (1988)MathSciNetzbMATHCrossRefGoogle Scholar
  6. 6.
    Bramble, J.H., Pasciak, J.E.: Iterative techniques for time dependent Stokes problems. Comput. Math. Appl. 33(1-2), 13–30 (1997)MathSciNetzbMATHCrossRefGoogle Scholar
  7. 7.
    Brezzi, F.: On the existence, uniqueness and approximation of saddle-point problems arising from Lagrangian multipliers. RAIRO 8, 129–151 (1974)MathSciNetzbMATHGoogle Scholar
  8. 8.
    Cahouet, J., Chabard, J.P.: Some fast 3D finite element solvers for the generalized Stokes problem. Int. J. Numer. Methods Fluids 8(8), 865–895 (1988)MathSciNetzbMATHCrossRefGoogle Scholar
  9. 9.
    Copeland, D., Kolmbauer, M., Langer, U.: Domain decomposition solvers for frequency-domain finite element equations. In: Huang, Y., Kornhuber, R., Widlund, O., Xu, J. (eds.) Domain Decomposition in Science and Engineering XIX. Lecture Notes in Computational Science and Engineering, vol. 78, pp. 301–308. Springer, New York (2011)CrossRefGoogle Scholar
  10. 10.
    Gould, N.I.M., Simoncini, V.: Spectral analysis of saddle point matrices with indefinite leading blocks. SIAM J. Matrix. Anal. Appl. 31(3), 1152–1171 (2010)MathSciNetzbMATHCrossRefGoogle Scholar
  11. 11.
    Greenbaum, A.: Iterative methods for solving linear systems. Frontiers in Applied Mathematics, vol. 17. SIAM, Philadelphia (1997)zbMATHCrossRefGoogle Scholar
  12. 12.
    Gunzburger, M.D., Manservisi, S.: Analysis and approximation of the velocity tracking problem for Navier-Stokes flows with distributed control. SIAM J. Numer. Anal. 37(5), 1481–1512 (2000)MathSciNetzbMATHCrossRefGoogle Scholar
  13. 13.
    Hackbusch, W.: Fast solution of elliptic control problems. J. Optimization Theory Appl. 31, 565–581 (1980)MathSciNetzbMATHCrossRefGoogle Scholar
  14. 14.
    Higham, N.J.: Functions of Matrices. Theory and Computation. SIAM, Philadelphia (2008)zbMATHCrossRefGoogle Scholar
  15. 15.
    Hinze, M., Pinnau, R., Ulbrich, M., Ulbrich, S.: Optimization with PDE constraints. Mathematical Modelling: Theory and Applications, vol. 23. Springer, Dordrecht (2009)zbMATHCrossRefGoogle Scholar
  16. 16.
    Kollmann, M., Kolmbauer, M., Langer, U., Wolfmayr, M., Zulehner, W.: A finite element solver for a multiharmonic parabolic optimal control problem. NuMa-Report 2011-10, Institute of Computational Mathematics, Johannes Kepler University Linz (2011)Google Scholar
  17. 17.
    Kolmbauer, M., Kollmann, M.: A preconditioned MINRES solver for time-periodic parabolic optimal control problems. NuMa-Report 2011-06, Institute of Computational Mathematics, Johannes Kepler University Linz (2011)Google Scholar
  18. 18.
    Krendl, W., Simoncini, V., Zulehner, W.: Stability estimates and structural spectral properties of saddle point problems. DK-Report 2012-03, Doctoral Program Computational Mathematics, Johannes Kepler University Linz (2012)Google Scholar
  19. 19.
    Kuznetsov, Y.A.: Efficient iterative solvers for elliptic finite element problems on nonmatching grids. Russ. J. Numer. Anal. Math. Model. 10(3), 187–211 (1995)zbMATHCrossRefGoogle Scholar
  20. 20.
    Langer, U., Queck, W.: On the convergence factor of Uzawa’s algorithm. J. Comput. Appl. Math. 15, 191–202 (1986)MathSciNetzbMATHCrossRefGoogle Scholar
  21. 21.
    Lions, J.L.: Optimal Control of Systems Governed by Partial Differential Equations. Springer, Heidelberg (1971)zbMATHCrossRefGoogle Scholar
  22. 22.
    Lions, J.L., Magenes, E.: Non-homogeneous Boundary Value Problems and Applications, vol. I. Die Grundlehren der mathematischen Wissenschaften, Band 181. Springer, Heidelberg (1972)Google Scholar
  23. 23.
    Mardal, K.A., Winther, R.: Uniform preconditioners for the time dependent Stokes problem. Numer. Math. 98(2), 305–327 (2004)MathSciNetzbMATHCrossRefGoogle Scholar
  24. 24.
    Mardal, K.A., Winther, R.: Uniform preconditioners for the time dependent Stokes problem. Numer. Math. 103(1), 171–172 (2006)MathSciNetzbMATHCrossRefGoogle Scholar
  25. 25.
    Mardal, K.A., Winther, R.: Preconditioning discretizations of systems of partial differential equations. Numer. Linear Algebra Appl. 18, 1–40 (2011)MathSciNetzbMATHCrossRefGoogle Scholar
  26. 26.
    Murphy, M.F., Golub, G.H., Wathen, A.J.: A note on preconditioning for indefinite linear systems. SIAM J. Sci. Comput. 21(6), 1969–1972 (2000)MathSciNetzbMATHCrossRefGoogle Scholar
  27. 27.
    Olshanskii, M.A., Reusken, A.: On the convergence of a multigrid method for linear reaction-diffusion problems. Computing 65(3), 193–202 (2000)MathSciNetzbMATHCrossRefGoogle Scholar
  28. 28.
    Olshanskii, M.A., Peters, J., Reusken, A.: Uniform preconditioners for a parameter dependent saddle point problem with application to generalized Stokes interface equations. Numer. Math. 105(1), 159–191 (2006)MathSciNetzbMATHCrossRefGoogle Scholar
  29. 29.
    Paige, C.C., Saunders, M.A.: Solution of sparse indefinite systems of linear equations. SIAM J. Numer. Anal. 12, 617–629 (1975)MathSciNetzbMATHCrossRefGoogle Scholar
  30. 30.
    Rees, T., Wathen, A.J.: Preconditioning iterative methods for the optimal control of the Stokes equations. SIAM J. Sci. Comput. 33, 2903–2926 (2011)MathSciNetzbMATHCrossRefGoogle Scholar
  31. 31.
    Rees, T., Dollar, H.S., Wathen, A.J.: Optimal solvers for PDE-constrained optimization. SIAM J. Sci. Comput. 32, 271–298 (2010)MathSciNetzbMATHCrossRefGoogle Scholar
  32. 32.
    Rusten, T., Winther, R.: A preconditioned iterative method for saddle-point problems. SIAM J. Matrix Anal. Appl. 13, 887–904 (1992)MathSciNetzbMATHCrossRefGoogle Scholar
  33. 33.
    Schöberl, J., Zulehner, W.: Symmetric indefinite preconditioners for saddle point problems with applications to PDE-constrained optimization problems. SIAM J. Matrix Anal. Appl. 29, 752–773 (2007)MathSciNetzbMATHCrossRefGoogle Scholar
  34. 34.
    Silvester, D., Wathen, A.J.: Fast iterative solution of stabilised Stokes systems. Part II: Using general block preconditioners. SIAM J. Numer. Anal. 31(5), 1352–1367 (1994)MathSciNetzbMATHCrossRefGoogle Scholar
  35. 35.
    Stoll, M., Wathen, A.J.: Combination preconditioning and the Bramble-Pasciak +  preconditioner. SIAM J. Matrix Anal. Appl. 30(2), 582–608 (2008)MathSciNetzbMATHCrossRefGoogle Scholar
  36. 36.
    Tröltzsch, F.: Optimal Control of Partial Differential Equations. Theory, Methods and Applications. Graduate Studies in Mathematics, vol. 112. American Mathematical Society, Providence (2010)zbMATHGoogle Scholar
  37. 37.
    Wathen, A.J., Silvester, D.: Fast iterative solution of stabilised Stokes systems. Part I: Using simple diagonal preconditioners. SIAM J. Numer. Anal. 30, 630–649 (1993)MathSciNetzbMATHCrossRefGoogle Scholar
  38. 38.
    Xu, J., Zikatanov, L.: Some observations on Babuška and Brezzi theories. Numer. Math. 94(1), 195–202 (2003)MathSciNetzbMATHCrossRefGoogle Scholar
  39. 39.
    Zulehner, W.: Analysis of iterative methods for saddle point problems: a unified approach. Math. Comp. 71, 479–505 (2002)MathSciNetzbMATHCrossRefGoogle Scholar
  40. 40.
    Zulehner, W.: Nonstandard norms and robust estimates for saddle point problems. SIAM J. Matrix Anal. Appl. 32, 536–560 (2011)MathSciNetzbMATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  1. 1.Institut für Numerische MathematikJohannes Kepler Universität LinzLinzAustria

Personalised recommendations