Skip to main content
Log in

Spectral behaviour of GMRES applied to singular systems

  • Published:
Advances in Computational Mathematics Aims and scope Submit manuscript

Abstract

The purpose of this paper is to develop a spectral analysis of the Hessenberg matrix obtained by the GMRES algorithm used for solving a linear system with a singular matrix. We prove that the singularity of the Hessenberg matrix depends on the nature of A and some other criteria such as the zero eigenvalue multiplicity and the projection of the initial residual on particular subspaces. We also show some new results about the distinct kinds of breakdown which may occur in the algorithm when the system is singular.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Axelsson, O.: A generalized conjugate gradient, least-square method. Numer. Math. 51, 209–227 (1987)

    Article  MATH  MathSciNet  Google Scholar 

  2. Brown, P.N.: A theoretical comparison of the Arnoldi and GMRES algorithms. SIAM J. Sci. Statist. Comput. 12, 58–78 (1991)

    Article  MATH  MathSciNet  Google Scholar 

  3. Brown, P.N., Walker, H.F.: GMRES on (nearly) singular systems. SIAM J. Matrix Anal. Appl. 18, 37–51 (1997)

    Article  MATH  MathSciNet  Google Scholar 

  4. Calvetti, D., Lewis, B., Reichel, L.: GMRES-type methods for inconsistent systems. Linear Algebra Appl. 316, 157–169 (2000)

    Article  MATH  MathSciNet  Google Scholar 

  5. Freund, R.W., Hochbruck, M.: On the use of two QMR algorithms for solving singular systems and applications in Markov chain modeling. Numer. Linear Algebra Appl. 1, 403–420 (1994)

    Article  MATH  MathSciNet  Google Scholar 

  6. Ipsen, I.C.F., Meyer, C.D.: The idea behind Krylov methods. Amer. Math. Monthly 105, 889–899 (1998)

    Article  MATH  MathSciNet  Google Scholar 

  7. Lang, S.: Algèbre linéaire, vol. 2, pp. 294–295. InterEditions, Paris (1976)

    Google Scholar 

  8. Reichel, L., Ye, Q.: Breakdown-free GMRES for singular systems. SIAM J. Matrix Anal. Appl. 26, 1001–1021 (2005)

    Article  MATH  MathSciNet  Google Scholar 

  9. Saad, Y.: Krylov subspace methods for solving large unsymmetric linear systems. Math. Comp. 37, 105–26 (1981)

    Article  MATH  MathSciNet  Google Scholar 

  10. Saad, Y., Schultz, M.H.: GMRES: a generalized residual method for solving nonsymmetric linear systems. SIAM J. Sci. Statist. Comput. 7, 856–869 (1986)

    Article  MATH  MathSciNet  Google Scholar 

  11. Sidi, A., Kluzner, V.: A Bi-CG type iterative method for Drazin-inverse solution of singular inconsistent nonsymmetric linear systems of arbitrary index. Electron. J. Linear Algebra 6, 72–94 (2000)

    MATH  MathSciNet  Google Scholar 

  12. Van Der Vorst, H.A., Vuik, C.: The superlinear convergence behaviour of GMRES. J. Comput. Appl. Math. 48, 327–341 (1993)

    Article  MATH  MathSciNet  Google Scholar 

  13. Wang, G., Wei, Y., Qiao, S.: Generalized Inverses: Theory and Computations. Science, Beijing (2004)

    Google Scholar 

  14. Wei, Y., Wu, H.: Convergence properties of Krylov subspace methods for singular linear systems with aribitrary index. J. Comput. Appl. Math. 114, 305–318 (2000)

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Laurent Smoch.

Additional information

Communicated by L. Reichel.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Smoch, L. Spectral behaviour of GMRES applied to singular systems. Adv Comput Math 27, 151–166 (2007). https://doi.org/10.1007/s10444-007-9029-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10444-007-9029-4

Keywords

Mathematics Subject Classifications (2000)

Navigation