BIT Numerical Mathematics

, Volume 38, Issue 2, pp 275–282 | Cite as

A stationary iterative pseudoinverse algorithm

  • Tommy Elfving


Iterative methods applied to the normal equationsA T Ax=A T b are sometimes used for solving large sparse linear least squares problems. However, when the matrix is rank-deficient many methods, although convergent, fail to produce the unique solution of minimal Euclidean norm. Examples of such methods are the Jacobi and SOR methods as well as the preconditioned conjugate gradient algorithm. We analyze here an iterative scheme that overcomes this difficulty for the case of stationary iterative methods. The scheme combines two stationary iterative methods. The first method produces any least squares solution whereas the second produces the minimum norm solution to a consistent system.

AMS subject classification

65F10 65F20 65F50 

Key words

Stationary iterative methods least squares pseudoinverse solution 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    A. Ben-Israel and T. N. E. Greville,Generalized Inverses, Theory and Applications, Wiley, New York, 1974.MATHGoogle Scholar
  2. 2.
    Å. Björck,Numerical Methods for Least Squares Problems, SIAM, Philadelphia, 1996.MATHGoogle Scholar
  3. 3.
    Å. Björck and T. Elfving,Accelerated projection methods for computing pseudoinverse solutions of linear equations, BIT, 19 (1979), pp. 145–163.MATHMathSciNetCrossRefGoogle Scholar
  4. 4.
    Y. Censor, P. P. B. Eggermont and D. Gordon,Strong underrelaxation in Kaczmarz's method for inconsistent systems, Numer. Math., 41 (1983), pp. 83–92.MATHMathSciNetCrossRefGoogle Scholar
  5. 5.
    A. Dax,The convergence of linear stationary iterative processes for solving singular unstructured systems of linear equations, SIAM Review, 32 (1990), pp. 611–635.MATHMathSciNetCrossRefGoogle Scholar
  6. 6.
    P. P. B. Eggermont, G. T. Herman and A. Lent,Iterative algorithms for large partitioned linear systems, with applications to image reconstruction, Linear Algebra Appl., 40 (1981), pp. 37–67.MATHMathSciNetCrossRefGoogle Scholar
  7. 7.
    T. Elfving,On the conjugate gradient method for solving linear least squares problems, Report LiTH-MAT-R-78-3, Department of Mathematics Linköping University, Linköping, Sweden, 1978.Google Scholar
  8. 8.
    T. Elfving,Block-iterative methods for consistent and inconsistent linear equations, Numer. Math., 35 (1980), pp. 1–12.MATHMathSciNetCrossRefGoogle Scholar
  9. 9.
    M. Hanke and W. Niethammer,On the acceleration of Kaczmarz's method for inconsistent linear systems, Linear Algebra Appl., 130 (1990), pp. 83–98.MATHMathSciNetCrossRefGoogle Scholar
  10. 10.
    M. T. Heath,Numerical methods for large sparse linear least squares problems, SIAM J. Sci. Statist. Comput., 5 (1984), pp. 497–513.MATHMathSciNetCrossRefGoogle Scholar
  11. 11.
    G. T. Herman,Image Reconstruction from Projections. The Fundamentals of Computerized Tomography, Academic Press, New York, 1980.MATHGoogle Scholar
  12. 12.
    M. R. Hestenes and E. Stiefel,Methods of conjugate gradients for solving linear systems, J. Res. Nat. Bur. Standards, B49 (1952), pp. 409–436.MATHMathSciNetGoogle Scholar
  13. 13.
    F. Natterer,The Mathematics of Computerized Tomography, Wiley, New York, 1986.MATHGoogle Scholar
  14. 14.
    R. A. Horn and C. R. Johnson,Matrix Analysis, Cambridge University Press, New York (1990).Google Scholar
  15. 15.
    R. J. Plemmons,Stationary iterative methods for linear systems with non-Hermitian singular matrices, Technical Report, Department of Computer Science, The University of Tennessee, Knoxville, TN, 1970.Google Scholar
  16. 16.
    C. Popa,Least-squares solution of overdetermined inconsistent linear systems using Kaczmarz's relaxation, Internat. J. Comput. Math., 55 (1995), pp.79–89.MATHGoogle Scholar
  17. 17.
    L. P. Pyle,A generalized inverse ∈-algorithm for constructing intersection projection matrices, with applications, Numer. Math., 10 (1967), pp. 86–102.MATHMathSciNetCrossRefGoogle Scholar
  18. 18.
    K. Tanabe,Projection method for solving a singular system of linear equations and its applications, Numer. Math., 17 (1971), pp. 203–214.MATHMathSciNetCrossRefGoogle Scholar

Copyright information

© Swets & Zeitlinger 1998

Authors and Affiliations

  • Tommy Elfving
    • 1
  1. 1.Department of MathematicsLinköping UniversityLinköpingSweden

Personalised recommendations