Abstract
Many iterative processes can be interpreted as discrete dynamical systems and, in certain cases, they correspond to a time discretization of differential systems. In this paper, we propose to derive iterative schemes for solving linear systems of equations by modeling the problem to solve as a stable state of a proper differential system; the solution of the original linear problem is then computed numerically by applying a time marching scheme. We discuss some aspects of this approach, which allows to recover some known methods but also to introduce new ones. We give convergence results and numerical illustrations.
Similar content being viewed by others
References
F. Alvarez, H. Attouch, J. Bolte and P. Redont, A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics, J. Math. Pures Appl. 81 (2002) 747–779.
J. Barzilai and J.M. Borwein, Two points step size gradient methods, IMA J. Numer. Anal. 8 (1988) 141–148.
M. Benzi, Preconditioning techniques for large linear systems: A survey, J. Comput. Phys. 182 (2002) 418–477.
A. Bhaya and E. Kaszkurewicz, Iterative methods as dynamical systems with feedback control, Preprint, UFRJ, Department of Electrical Engineering (2003).
C. Brezinski, Variations on Richardson's method and acceleration, in: Numerical Analysis.A Numerical Analysis Conference in Honour of Jean Meinguet, Bull. Soc. Math. Belg. (1996)pp. 33–44.
C. Brezinski, Projection Methods for Systems of Equations (North-Holland, Amsterdam, 1997).
C. Brezinski, Difference and differential equations, and convergence acceleration algorithms, in: SIDE III – Symmetries and Integrability of Difference Equations, eds. D. Levi and O. Ragnisco, CRM Proceedings and Lecture Notes, Vol. 25 (AMS, Providence, RI, 2000).
C. Brezinski, Dynamical systems and sequence transformations, J. Phys. A: Math. Gen. 34 (2001) 10659–10669.
C. Brezinski and J.-P. Chehab, Nonlinear Hybrid Procedures and fixed point iterations, Numer. Funct. Anal. Optim. 19 (1998) 465–487.
J.-P. Chehab, Differential equations and inverse preconditioners, Prépublications d'Orsay 2002-20, submitted.
A. Cuyt and L. Wuytack, Nonlinear Methods in Numerical Analysis (North-Holland, Amsterdam, 1987).
R.W. Freund and N.M. Nachtigal, QMR a quasi-minimal residual method for non-Hermitian linear systems, Numer. Math. 60 (1991) 315–339.
U. Helmke and J.B. Moore, Optimization and Dynamical Systems (Springer, Berlin, 1994).
M.W. Hirsch and S. Smale, Differential Equations, Dynamical Systems and Linear Algebra (Academic Press, London, 1974).
J.H. Hubbard and B.H. West, Differential Equations. A Dynamical Systems Approach. Part I: Ordinary Differential Equations (Springer, New York, 1991).
F. Luengo, M. Raydan, W. Glunt and T.L. Hayden, Preconditioned spectral gradient method, Numer. Algorithms 30 (2002) 241–258.
J.M. Ortega and W.C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables (Academic Press, San Diego, 1970).
Y. Saad, Iterative Methods for Sparse Linear Systems (SIAM, Philadelphia, PA, 1996).
A.M. Stuart, Numerical analysis of dynamical systems, in: Acta Numerica (Cambridge Univ. Press, Cambridge, 1994) pp. 467–572.
H.A. Van der Vorst, Bi-Cgstab: A fast and smoothly converging variant of Bi-CG for the solution of nonsymmetric linear systems, SIAM J. Sci. Statist. Comput. 13 (1992) 631–644.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by H. Sadok
AMS subject classification
65F10, 65F35, 65L05, 65L12, 65L20, 65N06
Rights and permissions
About this article
Cite this article
Chehab, JP., Laminie, J. Differential equations and solution of linear systems. Numer Algor 40, 103–124 (2005). https://doi.org/10.1007/s11075-005-1523-5
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/s11075-005-1523-5