Skip to main content
Log in

Hybrid methods based on LCG and GMRES

  • Published:
Computational and Applied Mathematics Aims and scope Submit manuscript

Abstract

Recently, the left conjugate gradient (LCG) method has been developed and applied in many fields, such as computing physics and thermal pollution. As a typical \(Galerkin\) method, LCG is easy to get implemented and performs efficiently. LCG iteratively generates approximate solutions with residuals orthogonal to the Krylov subspaces. On the other hand, LCG lacks residual norm-minimization which is different from the famous generalized minimal residual method (GMRES). Although LCG and GMRES are based on different numerical principles, both algorithms exhibit similar behaviors in extensive computational experiments. To probe into the relationship between LCG and GMRES, we first demonstrate the mathematical equivalence of LCG and the full orthogonalization method (FOM). Then, the residual norm connection of LCG and GMRES is established as an easy consequence of relation between FOM and GMRES. Moreover, this paper presents two hybrid algorithms based on the LCG and GMRES. To unify the directness of LCG and optimality of GMRES, LCG residual norm-minimization (LCGR) algorithm is proposed. If orthogonalization is considered in the hybridization, LCG orthogonalization (LCGO) is designed. Numerical experiments show that two hybrid schemes do improve the performance of the standard LCG and GMRES, as well as the comparable methods such as nested GMRES (GMRESR) and generalized conjugate residual orthogonalization (GCRO).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Arnoldi WE (1951) The principle of minimized iterations in the solution of the matrix eigenvalue problem. Q Appl Math 9:17–29

    MathSciNet  MATH  Google Scholar 

  • Bayliss A, Goldsten CI, Turkel E (1983) An iterative method for the Helmholtz equation. J Comput Phys 49:443–457

    Article  MathSciNet  MATH  Google Scholar 

  • Brown PN (1991) A theoretical comparison of the Arnoldi and GMRES algorithms. SIAM J Sci Stat Comput 12:58–78

    Article  MathSciNet  MATH  Google Scholar 

  • Calvetti D, Golub GH, Reichel L (1994) Adaptive Chebyshev iterative methods for nonsymmetric linear systems based on modified moments. Numer Math 67:21–40

    Article  MathSciNet  MATH  Google Scholar 

  • Cao ZH (1997) A note on the convergence behavior of GMRES. Appl Numer Math 25:13–20

    Article  MathSciNet  MATH  Google Scholar 

  • Catabriga L, Coutinho ALGA, Franca LP (2004) Evaluating the LCD algorithm for solving linear systems of equations arising from implicit SUPG formulation of compressible flows. Int J Numer Methods Eng 60:1513–1534

    Article  MathSciNet  MATH  Google Scholar 

  • Catabriga L, Melotti B, Pessoa L, Valli AMP, Coutinho ALGA (2004) Comparison between GMRES and LCD iterative methods in the finite element and finite difference solution of convection–diffusion equation. In: Proceedings of the XXV Iberian Latin-American congress on computational methods in engineering, Recife, Brazil, 10–12, 2004

  • Cullum J, Greenbaum A (1996) Relation between Galerkin and norm-minimizing iterative methods for solving linear systems. SIAM J Matrix Anal Appl 17:223–247

    Article  MathSciNet  MATH  Google Scholar 

  • Dai YH, Yuan JY (2004) Study on semi-conjugate direction methods for non-symmetric systems. Int J Numer Methods Eng 60:1383–1399

    Article  MATH  Google Scholar 

  • de Sturler E (1996) Nested Krylov methods based on GCR. J Comput Appl Math 67:15–41

    Article  MathSciNet  MATH  Google Scholar 

  • Elman HC (1982) Iterative methods for large sparse nonsymmetric systems of linear equations. Computer Science Department, Yale University, New haven, CT

  • Gutknecht Martin H (1992) A completed theory of the unsymmetric Lanczos process and related algorithm, part I. SIAM J Matrix Anal Appl 13:594–639

    Article  MathSciNet  MATH  Google Scholar 

  • Gutknecht Martin H (1994) A completed theory of the unsymmetric Lanczos process and related algorithm, part II. SIAM J Matrix Anal Appl 15:327–341

    Article  MathSciNet  Google Scholar 

  • Liessen J, Rozloz̆ník M, Strakos̆ Z (2002) Least squares residuals and minimal residuals methods. SIAM J Sci Comput 23:1503–1525

    Article  MathSciNet  Google Scholar 

  • Saad Y (1981) Krylov subspace methods for solving unsymmetric linear systems. Math Comput 37:105–126

    Article  MathSciNet  MATH  Google Scholar 

  • Saad Y (1984) Practical use of some Krylov subspace methods for solving indefinite and nonsymmetric linear systems. SIAM J Sci Stat Comput 5:203–228

    Article  MathSciNet  MATH  Google Scholar 

  • Saad Y, Schultz MH (1986) GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems. SIAM J Sci Comput 7:856–869

    Article  MathSciNet  MATH  Google Scholar 

  • Saad Y, Wu KS (1996) DQGMRES: a Quasi-minimal residual algorithm based on incomplete orthogonalization. Numer Linear Algebra Appl 3:329–343

    Article  MathSciNet  MATH  Google Scholar 

  • Silva RS, Raupp FM, Almeida RC. A numerical methodology to solve thermal pollution problems. In: The 9th Brazilian congress of thermal engineering and sciences, Caxambu, Minas Gerais, Brazil, 1–12, 2002

  • Sleijpen GLG, van der Vorst HA, Modersitzki J (2000) Differences in the effects of rounding errors in Krylov solvers for symmetric indefinite linear systems. SIAM J Matrix Anal Appl 22:726–751

    Article  MathSciNet  MATH  Google Scholar 

  • Van der Vorst HA, Vuik C (1993) The superlinear convergence behaviour of GMRES. J Comput Appl Math 48:327–341

    Article  MathSciNet  MATH  Google Scholar 

  • Van der Vorst HA, Vuik C (1994) GMRESR: a family of nested GMRES methods. Numer Linear Algebra Appl 1:369–386

    Article  MathSciNet  MATH  Google Scholar 

  • Wang LP, Dai YH (2008) Left conjugate gradient method for non-Hermitian linear systems. Numer Linear Algebra Appl 15:891–909

    Article  MathSciNet  MATH  Google Scholar 

  • Wang LP, Yuan JY (2013) Conjugate decomposition and its applications. J Oper Res Soc China 1:199–215

    Article  MATH  Google Scholar 

  • Yuan JY, Gloub GH, Plemmons JR, Cecílio WAG (2004) Semi-conjugate direction methods for real positive definite systems. BIT Numer Math 44:189–207

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgments

L. Wang thanks Professor Yuan Jinyun and Professor Dai Yuhong for their useful suggestions on this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Liping Wang.

Additional information

Communicated by Jinyun Yuan.

The work is supported by the Fundamental Research Funds for the Central Universities (No. NZ2013211), China.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, L., Zhu, Y. Hybrid methods based on LCG and GMRES. Comp. Appl. Math. 35, 301–319 (2016). https://doi.org/10.1007/s40314-015-0225-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40314-015-0225-4

Keywords

Mathematics Subject Classification

Navigation