Abstract
We consider the application of semi-iterative methods (SIM) to the standard (SOR) method with complex relaxation parameter ω, under the following two assumptions: (1) the associated Jacobi matrix J is consistently ordered and weakly cyclic of index 2, and (2) the spectrum σ(J) of J belongs to a compact subset Σ of the complex plane \(\mathbb{C}\), which is symmetric with respect to the origin. By using results from potential theory, we determine the region of optimal choice of \(\omega \in \mathbb{C}\) for the combination SIM–SOR and settle, for a large class of compact sets Σ, the classical problem of characterising completely all the cases for which the use of the SIM-SOR is advantageous over the sole use of SOR, under the hypothesis that \(\sigma (J)\subset\Sigma\). In particular, our results show that, unless the outer boundary of Σ is an ellipse, SIM–SOR is always better and, furthermore, one of the best possible choices is an asymptotically optimal SIM applied to the Gauss–Seidel method. In addition, we derive the optimal complex SOR parameters for all ellipses which are symmetric with respect to the origin. Our work was motivated by recent results of M.Eiermann and R.S. Varga.
Similar content being viewed by others
References
Dancis, J.: The optimal ω is not best for the SOR iteration method. Linear Algebra Appl 154/156, 819–845 (1991)
Driscoll T.A., Toh K.-C., Trefethen L.N. (1998). From potential theory to matrix iterations in six steps. SIAM Rev. 40(3):547–578
D’Sylva, E., Miles, G.A.: The S.S.O.R. iteration scheme for equations with σ1 ordering. Comput J 6, 366–367 (1963/1964)
Eiermann M., Niethammer W. (1983). On the construction of semi-iterative methods. SIAM J Numer Anal 20(6):1153–1160
Eiermann M., Varga R.S. (1993). Is the optimal ω best for the SOR iteration method?. Linear Algebra Appl 182:257–277
Eiermann, M., Varga, R.S.: Optimal semi-iterative methods applied to SOR in the mixed case. In: Numerical linear algebra (Kent, OH, 1992), pp 47–73. Berlin: de Gruyter 1993
Eiermann M., Niethammer W., Varga R.S. (1984). A study of semi-iterative methods for nonsymmetric systems of linear equations. Numer Math 47(4):505–533
Eiermann M., Li X., Varga R.S. (1989). On hybrid semi-iterative methods. SIAM J Numer Anal 26(1):152–168
Gaier D. (1987). Lectures on complex approximation. Birkhäuser Boston, Boston, MA. (Translated from the German by Renate McLaughlin)
Halmos P.R. (1974). Finite-dimensional vector spaces, 2nd edn. Springer, Berlin Heidelberg New York (Undergraduate Texts in Mathematics)
Henrici P. (1988). Applied and computational complex analysis, vol 1. Wiley, New York
Hu M., Jackson K., Janssen J., Vandewalle S. (1997). Remarks on the optimal convolution kernel for CSOR waveform relaxation. Adv Comput Math 7(1–2):135–156
Janssen J., Vandewalle S. (1997). On SOR waveform relaxation methods. SIAM J Numer Anal 34(6):2456–2481
Kahan W. (1958). Gauss–Seidel methods of solving large systems of linear equations. PhD Thesis, University of Toronto, Toronto, Canada
Kjellberg, G.: On the convergence of the successive over-relaxation applied to a class of linear systems of equations with complex eigenvalues. Technical report, Ericsson Technics Stockholm 1958
Kredell B. (1962). On complex successive overrelaxation. BIT 2:143–152
Lumsdaine A., Wu D. (2003). Krylov subspace acceleration of waveform relaxation. SIAM J Numer Anal 41(1):90–111
Lynn M.S. (1964). On the equivalence of SOR, SSOR and USSOR as applied to σ1-ordered systems of linear equations. Comput J 7:72–75
Novati P. (2003). A polynomial method based on Fejér points for the computation of functions of unsymmetric matrices. Appl Numer Math 44(1–2):201–224
Ransford T. (1995). Potential theory in the complex plane, volume 28 of London Mathematical Society Student Texts. Cambridge University Press, Cambridge
Reichelt M.W., White J.K., Allen J. (1995). Optimal convolution SOR acceleration of waveform relaxation with application to parallel simulation of semiconductor devices. SIAM J Sci Comput 16(5):1137–1158
Saff, E.B., Totik, V.: Logarithmic potentials with external fields, volume 316 of Grundlehren der Mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences]. Berlin Heidelberg New York: Springer, 1997 (Appendix B by Thomas Bloom)
Varga R.S. (1957). A comparison of the successive overrelaxation method and semi-iterative methods using Chebyshev polynomials. J Soc Indust Appl Math 5:39–46
Varga R.S. (2000). Matrix iterative analysis, volume 27 of Springer Series in Computational Mathematics. Springer, Berlin Heidelberg New York (revised and expanded edition)
Walsh, J.L.: Interpolation and approximation by rational functions in the complex domain, 4th edn. American mathematical society colloquium publications, vol. XX. Providence, RI: American Mathematical Society, 1965
Wrigley, H.E.: Accelerating the Jacobi method for solving simultaneous equations by Chebyshev extrapolation when the eigenvalues of the iteration matrix are complex. Comput J 6, 169–176 (1963/1964)
Young D.M. (1950). Iterative methods for solving partial differential equations of elliptic type. PhD Thesis, Harvard University, Cambridge, MA
Young D.M. (1954). Iterative methods for solving partial difference equations of elliptic type. Trans Amer Math Soc 76:92–111
Young D.M. (1971). Iterative solution of large linear systems. Academic, New York
Author information
Authors and Affiliations
Corresponding author
Additional information
Dedicated to Professor Richard S. Varga in recognition of his substantial contributions to the subject of the paper.
Rights and permissions
About this article
Cite this article
Hadjidimos, A., Stylianopoulos, N.S. Optimal Semi-Iterative Methods for Complex SOR with Results from Potential Theory. Numer. Math. 103, 591–610 (2006). https://doi.org/10.1007/s00211-006-0002-9
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00211-006-0002-9
Keywords
- SOR
- Complex relaxation parameter
- Asymptotically optimal semi-iterative methods
- Green functions
- Potential theory