Hybrid methods based on LCG and GMRES
- 136 Downloads
Abstract
Recently, the left conjugate gradient (LCG) method has been developed and applied in many fields, such as computing physics and thermal pollution. As a typical \(Galerkin\) method, LCG is easy to get implemented and performs efficiently. LCG iteratively generates approximate solutions with residuals orthogonal to the Krylov subspaces. On the other hand, LCG lacks residual norm-minimization which is different from the famous generalized minimal residual method (GMRES). Although LCG and GMRES are based on different numerical principles, both algorithms exhibit similar behaviors in extensive computational experiments. To probe into the relationship between LCG and GMRES, we first demonstrate the mathematical equivalence of LCG and the full orthogonalization method (FOM). Then, the residual norm connection of LCG and GMRES is established as an easy consequence of relation between FOM and GMRES. Moreover, this paper presents two hybrid algorithms based on the LCG and GMRES. To unify the directness of LCG and optimality of GMRES, LCG residual norm-minimization (LCGR) algorithm is proposed. If orthogonalization is considered in the hybridization, LCG orthogonalization (LCGO) is designed. Numerical experiments show that two hybrid schemes do improve the performance of the standard LCG and GMRES, as well as the comparable methods such as nested GMRES (GMRESR) and generalized conjugate residual orthogonalization (GCRO).
Keywords
Left conjugate gradient method Galerkin method Residual norm-minimization GMRESR GCROMathematics Subject Classification
65F10Notes
Acknowledgments
L. Wang thanks Professor Yuan Jinyun and Professor Dai Yuhong for their useful suggestions on this paper.
References
- Arnoldi WE (1951) The principle of minimized iterations in the solution of the matrix eigenvalue problem. Q Appl Math 9:17–29MathSciNetMATHGoogle Scholar
- Bayliss A, Goldsten CI, Turkel E (1983) An iterative method for the Helmholtz equation. J Comput Phys 49:443–457MathSciNetCrossRefMATHGoogle Scholar
- Brown PN (1991) A theoretical comparison of the Arnoldi and GMRES algorithms. SIAM J Sci Stat Comput 12:58–78MathSciNetCrossRefMATHGoogle Scholar
- Calvetti D, Golub GH, Reichel L (1994) Adaptive Chebyshev iterative methods for nonsymmetric linear systems based on modified moments. Numer Math 67:21–40MathSciNetCrossRefMATHGoogle Scholar
- Cao ZH (1997) A note on the convergence behavior of GMRES. Appl Numer Math 25:13–20MathSciNetCrossRefMATHGoogle Scholar
- Catabriga L, Coutinho ALGA, Franca LP (2004) Evaluating the LCD algorithm for solving linear systems of equations arising from implicit SUPG formulation of compressible flows. Int J Numer Methods Eng 60:1513–1534MathSciNetCrossRefMATHGoogle Scholar
- Catabriga L, Melotti B, Pessoa L, Valli AMP, Coutinho ALGA (2004) Comparison between GMRES and LCD iterative methods in the finite element and finite difference solution of convection–diffusion equation. In: Proceedings of the XXV Iberian Latin-American congress on computational methods in engineering, Recife, Brazil, 10–12, 2004Google Scholar
- Cullum J, Greenbaum A (1996) Relation between Galerkin and norm-minimizing iterative methods for solving linear systems. SIAM J Matrix Anal Appl 17:223–247MathSciNetCrossRefMATHGoogle Scholar
- Dai YH, Yuan JY (2004) Study on semi-conjugate direction methods for non-symmetric systems. Int J Numer Methods Eng 60:1383–1399CrossRefMATHGoogle Scholar
- de Sturler E (1996) Nested Krylov methods based on GCR. J Comput Appl Math 67:15–41MathSciNetCrossRefMATHGoogle Scholar
- Elman HC (1982) Iterative methods for large sparse nonsymmetric systems of linear equations. Computer Science Department, Yale University, New haven, CTGoogle Scholar
- Gutknecht Martin H (1992) A completed theory of the unsymmetric Lanczos process and related algorithm, part I. SIAM J Matrix Anal Appl 13:594–639MathSciNetCrossRefMATHGoogle Scholar
- Gutknecht Martin H (1994) A completed theory of the unsymmetric Lanczos process and related algorithm, part II. SIAM J Matrix Anal Appl 15:327–341MathSciNetCrossRefGoogle Scholar
- Liessen J, Rozloz̆ník M, Strakos̆ Z (2002) Least squares residuals and minimal residuals methods. SIAM J Sci Comput 23:1503–1525MathSciNetCrossRefGoogle Scholar
- Saad Y (1981) Krylov subspace methods for solving unsymmetric linear systems. Math Comput 37:105–126MathSciNetCrossRefMATHGoogle Scholar
- Saad Y (1984) Practical use of some Krylov subspace methods for solving indefinite and nonsymmetric linear systems. SIAM J Sci Stat Comput 5:203–228MathSciNetCrossRefMATHGoogle Scholar
- Saad Y, Schultz MH (1986) GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems. SIAM J Sci Comput 7:856–869MathSciNetCrossRefMATHGoogle Scholar
- Saad Y, Wu KS (1996) DQGMRES: a Quasi-minimal residual algorithm based on incomplete orthogonalization. Numer Linear Algebra Appl 3:329–343MathSciNetCrossRefMATHGoogle Scholar
- Silva RS, Raupp FM, Almeida RC. A numerical methodology to solve thermal pollution problems. In: The 9th Brazilian congress of thermal engineering and sciences, Caxambu, Minas Gerais, Brazil, 1–12, 2002Google Scholar
- Sleijpen GLG, van der Vorst HA, Modersitzki J (2000) Differences in the effects of rounding errors in Krylov solvers for symmetric indefinite linear systems. SIAM J Matrix Anal Appl 22:726–751MathSciNetCrossRefMATHGoogle Scholar
- Van der Vorst HA, Vuik C (1993) The superlinear convergence behaviour of GMRES. J Comput Appl Math 48:327–341MathSciNetCrossRefMATHGoogle Scholar
- Van der Vorst HA, Vuik C (1994) GMRESR: a family of nested GMRES methods. Numer Linear Algebra Appl 1:369–386MathSciNetCrossRefMATHGoogle Scholar
- Wang LP, Dai YH (2008) Left conjugate gradient method for non-Hermitian linear systems. Numer Linear Algebra Appl 15:891–909MathSciNetCrossRefMATHGoogle Scholar
- Wang LP, Yuan JY (2013) Conjugate decomposition and its applications. J Oper Res Soc China 1:199–215CrossRefMATHGoogle Scholar
- Yuan JY, Gloub GH, Plemmons JR, Cecílio WAG (2004) Semi-conjugate direction methods for real positive definite systems. BIT Numer Math 44:189–207MathSciNetCrossRefMATHGoogle Scholar