Abstract
We recall Newton’s iteration for computing the inverse or Moore–Penrose generalized inverse of a matrix. Then we specialize this approach to the case of structured matrices where all input, output and intermediate auxiliary matrices are represented in a compressed form, via their short displacement generators. We design a new Newton-like iteration based on a cubic polynomial and show its effectiveness by some numerical experiments for matrices from the Toeplitz-like class and the Cauchy-like class.
Similar content being viewed by others
References
G.S. Ammar and P. Gader, New decompositions of the inverse of a Toeplitz matrix, in: Signal Processing, Scattering and Operator Theory, and Numerical Methods, eds. M.A. Kaashoek, J.H. van Schuppen and A.C.N. Ran (Birkhäuser, Basel, 1990) pp. 421–428.
A. Ben-Israel, A note on iterative method for generalized inversion of matrices, Math. Comp. 20 (1966) 439–440.
A. Ben-Israel and D. Cohen, On iterative computation of generalized inverses and associated projections, SIAM J. Numer. Anal. 3 (1966) 410–419.
D.A. Bini, G. Codevico and M. Van Barel, Solving Toeplitz least square problems by means of Newton’s iterations, Numer. Algorithms 33 (2003) 93–103.
D.A. Bini and B. Meini, Solving block banded block Toeplitz systems with banded Toeplitz blocks, F.T. Luk, Proc. SPIE 3807 (1999) 300–311.
D.A. Bini and V.Y. Pan, Polynomial and Matrix Computations, Vol. 1: Fundamental Algorithms (Birkhäuser, Boston, 1994).
G. Codevico, V. Pan, M. Van Barel and X. Wang, Iterative inversion of structured matrices, Report TW351, Department of Computer Science, Katholieke Universiteit Leuven (2002); also in Special Issue on Algebraic and Numerical Algorithms of Theoret. Comput. Sci. (2004) (in press).
I. Gohberg and V. Olshevsky, Circulants, displacements and decompositions of matrices, Integral Equations Operator Theory 15 (1992) 730–743.
I. Gohberg and A. Semencul, On the inversion of finite Toeplitz matrices and their continuous analogs, Mat. Issledovaniia 2 (1972) 187–224.
G.H. Golub and C.F. Van Loan, Matrix Computations, 3rd ed. (Johns Hopkins Univ. Press, Baltimore, MD, 1996).
G. Heinig and K. Rost, Algebraic Methods for Toeplitz-like Matrices and Operators (Akademie-Verlag, Berlin, and Birkhäuser, Basel/Stuttgart, 1984).
T. Kailath, S.-Y. Kung and M. Morf, Displacement ranks of matrices and linear equations, J. Math. Anal. Appl. 68 (1979) 395–407.
T. Kailath, S. Kung and M. Morf, Displacement ranks of a matrix, Bull. Amer. Math. Soc. 1 (1979) 769–773.
T. Kailath and A. Sayed, Displacement structure: Theory and applications, SIAM Rev. 37(3) (1995) 297–386.
T. Kailath and A.H. Sayed, eds., Fast Reliable Algorithms for Matrices with Structure (SIAM, Philadelphia, PA, 1999).
T. Kailath, A. Vieira and M. Morf, Inverses of Toeplitz operators, innovations and orthogonal polynomials, SIAM Rev. 20 (1978) 106–119.
M. Morf, Fast algorithms for multivariable systems, Ph.D. thesis, Department of Electrical Engineering, Stanford University, Stanford, CA (1974).
V.Y. Pan, Nearly optimal computations with structured matrices, in: Proc. of the 11th Annual ACM–SIAM Symposium on Discrete Algorithms (SODA’2000) (ACM/SIAM, New York, Philadephia, PA, 2000) pp. 953–962.
V.Y. Pan, Structured Matrices and Polynomials: Unified Superfast Algorithms (Birkhäuser/Springer, Boston/New York, 2001).
V.Y. Pan, M. Kunin, R.E. Rosholt and H. Cebecioğlu, Residual correction algorithms for general and structured matrices, Preprint (2002).
V.Y. Pan and R. Schreiber, An improved Newton iteration for the generalized inverse of a matrix, with applications, SIAM J. Sci. Statist. Comput. 12(5) (1991) 1109–1131.
V.Y. Pan and X. Wang, Inversion of displacement operators, SIAM J. Matrix Anal. Appl. 24(3) (2003) 660–677.
G. Schultz, Iterative Berechnung der Reciproken Matrix, Z. Angew. Math. Mech. 13 (1933) 57–59.
T. Söderström and G.W. Stewart, On the numerical properties of an iterative method for computing the Moore–Penrose generalized inverse, SIAM J. Numer. Anal. 11 (1974) 61–74.
M. Van Barel and G. Codevico, An adaptation of the Newton iteration method to solve symmetric positive definite Toeplitz systems, Report TW349, Department of Computer Science, Katholieke Universiteit Leuven (2002).
Y. Wei, J. Cai and M. Ng, Computing Moore–Penrose inverses of Toeplitz matrices by Newton’s iteration, Math. Comput. Model., to appear.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Codevico, G., Pan, V.Y. & Van Barel, M. Newton-Like Iteration Based on a Cubic Polynomial for Structured Matrices. Numer Algor 36, 365–380 (2004). https://doi.org/10.1007/s11075-004-3996-z
Issue Date:
DOI: https://doi.org/10.1007/s11075-004-3996-z