Skip to main content
Log in

Minimum residual Hermitian and skew-Hermitian splitting iteration method for non-Hermitian positive definite linear systems

  • Published:
BIT Numerical Mathematics Aims and scope Submit manuscript

Abstract

By applying the minimum residual technique to the Hermitian and skew-Hermitian splitting (HSS) iteration scheme, we introduce a non-stationary iteration method named minimum residual HSS (MRHSS) iteration method to solve non-Hermitian positive definite linear systems. The convergence property of the MRHSS iteration method together with the property of the iteration parameters are carefully studied. Numerical results verify the effectiveness and robustness of the MRHSS iteration method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Axelsson, O., Kucherov, A.: Real valued iterative methods for solving complex symmetric linear systems. Numer. Linear Algebra Appl. 7(4), 197–218 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  2. Bai, Z.-Z.: Several splittings for non-Hermitian linear systems. Sci. China A: Math. 51(8), 1339–1348 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  3. Bai, Z.-Z.: Optimal parameters in the HSS-like methods for saddle-point problems. Numer. Linear Algebra Appl. 16(6), 447–479 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  4. Bai, Z.-Z.: On semi-convergence of Hermitian and skew-Hermitian splitting methods for singular linear systems. Computing 89, 171–197 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  5. Bai, Z.-Z.: Motivations and realizations of Krylov subspace methods for large sparse linear systems. J. Comput. Appl. Math. 283, 71–78 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  6. Bai, Z.-Z.: Quasi-HSS iteration methods for non-Hermitian positive definite linear systems of strong skew-Hermitian parts. Numer. Linear Algebra Appl. 25, e2116 (2018). https://doi.org/10.1002/nla.2116

    Article  MathSciNet  MATH  Google Scholar 

  7. Bai, Z.-Z., Benzi, M.: Regularized HSS iteration methods for saddle-point linear systems. BIT Numer. Math. 57(2), 287–311 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  8. Bai, Z.-Z., Benzi, M., Chen, F.: Modified HSS iteration methods for a class of complex symmetric linear systems. Computing 87, 93–111 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  9. Bai, Z.-Z., Benzi, M., Chen, F.: On preconditioned MHSS iteration methods for complex symmetric linear systems. Numer. Algorithms 56, 297–317 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  10. Bai, Z.-Z., Benzi, M., Chen, F., Wang, Z.-Q.: Preconditioned MHSS iteration methods for a class of block two-by-two linear systems with applications to distributed control problems. IMA J. Numer. Anal. 33, 343–369 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  11. Bai, Z.-Z., Golub, G.H.: Accelerated Hermitian and skew-Hermitian splitting iteration methods for saddle-point problems. IMA J. Numer. Anal. 27(1), 1–23 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  12. Bai, Z.-Z., Golub, G.H., Li, C.-K.: Optimal parameter in Hermitian and skew-Hermitian splitting method for certain two-by-two block matrices. SIAM J. Sci. Comput. 2(28), 583–603 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  13. Bai, Z.-Z., Golub, G.H., Li, C.-K.: Convergence properties of preconditioned Hermitian and skew-Hermitian splitting methods for non-Hermitian positive semidefinite matrices. Math. Comput. 76(257), 287–298 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  14. Bai, Z.-Z., Golub, G.H., Lu, L.-Z., Yin, J.-F.: Block triangular and skew-Hermitian splitting methods for positive-definite linear systems. SIAM J. Sci. Comput. 26, 844–863 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  15. Bai, Z.-Z., Golub, G.H., Ng, M.K.: Hermitian and skew-Hermitian splitting methods for non-Hermitian positive definite linear systems. SIAM J. Matrix Anal. Appl. 24, 603–626 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  16. Bai, Z.-Z., Golub, G.H., Ng, M.K.: On successive-overrelaxation acceleration of the Hermitian and skew-Hermitian splitting iterations. Numer. Linear Algebra Appl. 14(4), 319–335 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  17. Bai, Z.-Z., Golub, G.H., Pan, J.-Y.: Preconditioned Hermitian and skew-Hermitian splitting methods for non-Hermitian positive semidefinite linear systems. Numer. Math. 98, 1–32 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  18. Bai, Z.-Z., Rozložník, M.: On the numerical behavior of matrix splitting iteration methods for solving linear systems. SIAM J. Numer. Anal. 53(4), 1716–1737 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  19. Benzi, M.: A generalization of the Hermitian and skew-Hermitian splitting iteration. SIAM J. Matrix Anal. Appl. 31(2), 360–374 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  20. Benzi, M., Gander, M., Golub, G.H.: Optimization of the Hermitian and skew-Hermitian splitting iteration for saddle-point problems. BIT Numer. Math. 43, 881–900 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  21. Benzi, M., Golub, G.H.: A preconditioner for generalized saddle point problems. SIAM J. Matrix Anal. Appl. 26, 20–41 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  22. Benzi, M., Golub, G.H., Liesen, J.: Numerical solution of saddle point problems. Acta Numer. 14, 1–137 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  23. Cao, Y., Ren, Z.-R., Shi, Q.: A simplified HSS preconditioner for generalized saddle point problems. BIT Numer. Math. 56(2), 423–439 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  24. Cao, Y., Yao, L.-Q., Jiang, M.-Q., Niu, Q.: A relaxed HSS preconditioner for saddle point problems from meshfree discretization. J. Comput. Math. 21, 398–421 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  25. Chen, F.: On choices of iteration parameter in HSS method. Appl. Math. Comput. 271, 832–837 (2015)

    MathSciNet  MATH  Google Scholar 

  26. Chen, F., Liu, Q.-Q.: On semi-convergence of modified HSS iteration methods. Numer. Algorithms 64(3), 507–518 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  27. Greenbaum, A.: Iterative Methods for Solving Linear Systems. SIAM, Philadelphia (1997)

    Book  MATH  Google Scholar 

  28. Gu, G.-D.: HSS method with a complex parameter for the solution of complex linear system. J. Comput. Math. 29(4), 441–457 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  29. Guo, X.-X., Wang, S.: Modified HSS iteration methods for a class of non-Hermitian positive-definite linear systems. Appl. Math. Comput. 218(20), 10122–10128 (2012)

    MathSciNet  MATH  Google Scholar 

  30. Gutknecht, M.H., Rozložník, M.: By how much can residual minimization accelerate the convergence of orthogonal residual methods? Numer. Algorithms 27(2), 189–213 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  31. Gutknecht, M.H., Rozložník, M.: Residual smoothing techniques: do they improve the limiting accuracy of iterative solvers? BIT Numer. Math. 41(1), 86–114 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  32. Hu, Q.-Y., Zou, J.: An iterative method with variable relaxation parameters for saddle-point problems. SIAM J. Matrix Anal. Appl. 23(2), 317–338 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  33. Huang, Y.-M.: A practical formula for computing optimal parameters in the HSS iteration methods. J. Comput. Appl. Math. 255, 142–149 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  34. Li, W., Liu, Y.-P., Peng, X.-F.: The generalized HSS method for solving singular linear systems. J. Comput. Appl. Math. 236(9), 2338–2353 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  35. Li, X., Yang, A.-L., Wu, Y.-J.: Parameterized preconditioned Hermitian and skew-Hermitian splitting iteration method for saddle-point problems. Int. J. Comput. Math. 91(6), 1224–1238 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  36. Meng, G.-Y., Wen, R.-P., Zhao, Q.-S.: The generalized HSS method with a flexible shift-parameter for non-Hermitian positive definite linear systems. BIT Numer. Math. 56(2), 543–556 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  37. Ren, Z.-R., Cao, Y.: An alternating positive-semidefinite splitting preconditioner for saddle point problems from time-harmonic eddy current models. IMA J. Numer. Anal. 36, 922–946 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  38. Saad, Y.: Iterative Methods for Sparse Linear Systems, 2nd edn. SIAM, Philadelphia (2003)

    Book  MATH  Google Scholar 

  39. Simoncini, V., Benzi, M.: Spectral properties of the Hermitian and skew-Hermitian splitting preconditioner for saddle point problems. SIAM J. Matrix Anal. Appl. 26(2), 377–389 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  40. Vecharynski, E., Knyazev, A.: Preconditioned steepest descent-like methods for symmetric indefinite systems. Linear Algebra Appl. 511, 274–295 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  41. Walker, H.F.: Residual smoothing and peak/plateau behavior in Krylov subspace methods. Appl. Numer. Math. 19(3), 279–286 (1995)

    Article  MathSciNet  MATH  Google Scholar 

  42. Yang, A.-L.: Scaled norm minimization method for computing the parameters of the HSS and the two-parameter HSS preconditioners. Numer. Linear Algebra Appl. 25, e2169 (2018). https://doi.org/10.1002/nla.2169

    Article  MathSciNet  MATH  Google Scholar 

  43. Yang, A.-L., An, J., Wu, Y.-J.: A generalized preconditioned HSS method for non-Hermitian positive definite linear systems. Appl. Math. Comput. 216(6), 1715–1722 (2010)

    MathSciNet  MATH  Google Scholar 

  44. Yang, A.-L., Wu, Y.-J.: The Uzawa-HSS method for saddle-point problems. Appl. Math. Lett. 38, 38–42 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  45. Zhou, L., Walker, H.F.: Residual smoothing techniques for iterative methods. SIAM J. Sci. Comput. 15(2), 297–312 (1994)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

The authors are very much indebted to the referees for their constructive and valuable comments and suggestions which greatly improved the quality of this paper. This work is partially supported by the National Key Research and Development Program of China (Grant No. 2018YFC0406600) and the National Natural Science Foundation of China (Grant Nos. 11471150, 11771225, 11401281).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ai-Li Yang.

Additional information

Communicated by Lars Eldén.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, AL., Cao, Y. & Wu, YJ. Minimum residual Hermitian and skew-Hermitian splitting iteration method for non-Hermitian positive definite linear systems. Bit Numer Math 59, 299–319 (2019). https://doi.org/10.1007/s10543-018-0729-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10543-018-0729-6

Keywords

Mathematics Subject Classification

Navigation