Abstract
The finite difference or the finite element discretizations of many differential or integral equations often result in a class of systems of weakly nonlinear equations. In this paper, by reasonably applying both the multisplitting and the two-stage iteration techniques, and in accordance with the special properties of this system of weakly nonlinear equations, we first propose a general multisplitting two-stage iteration method through the two-stage multiple splittings of the system matrix. Then, by applying the accelerated overrelaxation (AOR) technique of the linear iterative methods, we present a multisplitting two-stage AOR method, which particularly uses the AOR-like iteration as inner iteration and is substantially a relaxed variant of the afore-presented method. These two methods have a forceful parallel computing function and are much more suitable to the high-speed multiprocessor systems. For these two classes of methods, we establish their local convergence theories, and precisely estimate their asymptotic convergence factors under some suitable assumptions when the involved nonlinear mapping is only directionally differentiable. When the system matrix is either an H-matrix or a monotone matrix, and the nonlinear mapping is a P-bounded mapping, we thoroughly set up the global convergence theories of these new methods. Moreover, under the assumptions that the system matrix is monotone and the nonlinear mapping is isotone, we discuss the monotone convergence properties of the new multisplitting two-stage iteration methods, and investigate the influence of the multiple splittings as well as the relaxation parameters upon the convergence behaviours of these methods. Numerical computations show that our new methods are feasible and efficient for parallel solving of the system of weakly nonlinear equations.
Similar content being viewed by others
References
Z.Z. Bai, A class of two-stage iterative methods for systems of weakly nonlinear equations, Numer. Algorithms 14 (1997) 295–319.
Z.Z. Bai and D.R. Wang, The monotone convergence of the two-stage iterative method for solving large sparse systems of linear equations, Appl. Math. Lett. 10 (1997) 113–117.
Z.Z. Bai and D.R. Wang, Schubert's method for sparse systems of B-differentiable equations, J. Fudan Univ. Natur. Sci. 34 (1995) 683–690.
L. Elsner, Comparisons of weak regular splittings and multisplitting methods, Numer. Math. 56 (1989) 283–289.
A. Frommer and D.B. Szyld, H-splittings and two-stage iterative methods, Numer. Math. 63 (1992) 345–356.
R. Fuster, V. Migallón and J. Penadés, Non-stationary parallel multisplitting AOR methods, Electron. Trans. Numer. Anal. 4 (1996) 1–13.
G.H. Golub and M.L. Overton, The convergence of the inexact Chebyshev and Richardson iterative methods for solving linear systems, Numer. Math. 53 (1988) 571–593.
A. Hadjidimos, Accelerated overrelaxation method, Comp. Math. 32 (1978) 149–157.
R.J. Lanzkron, D.J. Rose and D.B. Szyld, Convergence of nested classical iterative methods for linear systems, Numer. Math. 58 (1991) 685–702.
I. Marek and D.B. Szyld, Comparison theorems for weak splittings of bounded operators, Numer. Math. 58 (1990) 387–397.
J.M. Martínez, SOR-secant methods, SIAM J. Numer. Anal. 31 (1994) 217–226.
M. Neumann and R.J. Plemmons, Convergence of parallel multisplitting iterative methods for M-matrices, Linear Algebra Appl. 88/89 (1987) 559–573.
D.P. O'Leary and R.E. White, Multi-splittings of matrices and parallel solution of linear systems, SIAM J. Alg. Discr. Meth. 6 (1985) 630–640.
J.M. Ortega and W.C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables (Academic Press, New York, 1970).
J.S. Pang, A B-differentiable equation-based, globally and locally quadratically convergent algorithm for nonlinear programs, complementarity and variational inequality problems, Math. Programming 51 (1991) 101–131.
S.M. Robinson, Local structure of feasible sets in nonlinear programming, Part III, stability and sensitivity, Math. Programming Study 30 (1987) 45–66.
A. Shapiro, On concepts of directional differentiability, J. Optim. Theory Appl. 66 (1990) 477–487.
D.B. Szyld and M.T. Jones, Two-stage and multisplitting methods for the parallel solution of linear systems, SIAM J. Matrix Anal. Appl. 13 (1992) 671–679.
R.S. Varga, Matrix Iterative Analysis (Prentice-Hall, Englewood Cliffs, NJ, 1962).
D.R. Wang, On the convergence of the parallel multisplitting AOR algorithms, Linear Algebra Appl. 154/156 (1991) 473–486.
D.R. Wang and Z.Z. Bai, On the monotone convergence of matrix multisplitting iteration methods, in: Proc.'92 Shanghai Int.Conf.Numer.Algebra Appl., ed. E.X. Jiang (China Science and Technology Press, Beijing, 1994) pp. 125–128.
D.R. Wang, Z.Z. Bai and D.J. Evans, On the monotone convergence of multisplitting method for a class of system of weakly nonlinear equations, Internat. J. Comput. Math. 60 (1996) 229–242.
R.E. White, Parallel algorithms for nonlinear problems, SIAM J. Alg. Discr. Meth. 7 (1986) 137–149.
R.E. White, A nonlinear parallel algorithm with application to the Stefan problem, SIAM J. Numer. Anal. 23 (1986) 639–652.
Z.I. Wóznicki, Nonnegative splitting theory, Japan J. Industr. Appl. Math. 10 (1994) 289–342.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Bai, ZZ. Parallel multisplitting two-stage iterative methods for large sparse systems of weakly nonlinear equations. Numerical Algorithms 15, 347–372 (1997). https://doi.org/10.1023/A:1019110324062
Issue Date:
DOI: https://doi.org/10.1023/A:1019110324062