Numerische Mathematik

, Volume 48, Issue 5, pp 543–560

The rate of convergence of Conjugate Gradients

  • A. van der Sluis
  • H. A. van der Vorst


It has been observed that the rate of convergence of Conjugate Gradients increases when one or more of the extreme Ritz values have sufficiently converged to the corresponding eigenvalues (the “superlinear convergence” of CG). In this paper this will be proved and made quantitative. It will be shown that a very modest degree of convergence of an extreme Ritz value already suffices for an increased rate of convergence to occur.

Subject Classifications

AMS (MOS): 65F10 CR: G.1.3 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Concus, P., Golub, G.H., O'Leary, D.P.: A generalized Conjugate Gradient method for the numerical solution of elliptic partial differential equations. In: Sparse Matrix Computations (J.R. Bunch and D.J. Rose, eds.), pp. 309–332. New York: Academic Press 1976Google Scholar
  2. 2.
    Golub, G.H., Van Loan, C.F.: Matrix Computations. Oxford: North Oxford Academic 1983Google Scholar
  3. 3.
    Hayes, R.M.: Iterative methods of solving linear problems on Hilbert space. National Bureau of Standards, Appl. Math. Ser.,39, 71–103 (1954)Google Scholar
  4. 4.
    Hestenes, M.R., Stiefel, E.: Methods of conjugate gradients for solving linear systems. J. Res. Natl. Bur. Stand.49, 409–436 (1952)Google Scholar
  5. 5.
    Kaniel, S.: Estimates for some computational techniques in linear algebra. Math. Comput.20, 369–378 (1966)Google Scholar
  6. 6.
    Karush, W.: An iterative method for finding characteristic vectors of a symmetric matrix. Pacific J. Math.1, 233–248 (1950)Google Scholar
  7. 7.
    Karush, W.: Convergence of a method of solving linear problems. Proc. Amer. Math. Soc.3, 839–851 (1952)Google Scholar
  8. 8.
    Meinardus, G.: Über eine Verallgemeinerung einer Ungleichung von L.V. Kantorovitch. Numer. Math.5, 14–23 (1963)Google Scholar
  9. 9.
    Meyerink, J.A., van der Vorst, H.A.: An iterative solution method for linear systems of which the coefficient matrix is a symmetricM-matrix. Math. Comput.31, 148–162 (1977)Google Scholar
  10. 10.
    Parlett, B.N.: The Symmetric Eigenvalue Problem. Englewood Cliffs: Prentice Hall 1980Google Scholar
  11. 11.
    Parlett, B.N., Simon, H., Stringer, L.M.: On estimating the largest eigenvalue with the Lanczos Algorithm. Math. Comput.38, 153–165 (1982)Google Scholar
  12. 12.
    Saad, Y.: On the rates of convergence of the Lanczos and Block Lanczos methods. SIAM J. Numer. Anal.17, 687–706 (1980)Google Scholar
  13. 13.
    van der Sluis, A., van der Vorst, H.A.: The convergence behaviour of Ritz values in the presence of close eigenvalues. (To be published)Google Scholar
  14. 14.
    Winther, R.: Some superlinear convergence results for the conjugate gradient methods. SIAM J. Numer. Anal.17, 14–17 (1980)Google Scholar

Copyright information

© Springer-Verlag 1986

Authors and Affiliations

  • A. van der Sluis
    • 1
  • H. A. van der Vorst
    • 2
  1. 1.Mathematical InstituteUniversity of UtrechtUtrechtThe Netherlands
  2. 2.Department of MathematicsUniversity of TechnologyDelftThe Netherlands

Personalised recommendations