BIT Numerical Mathematics

, Volume 29, Issue 3, pp 491–504 | Cite as

Regularization,GSVD and truncatedGSVD

  • Per Christian Hansen
Part II Numerical Mathematics


The purpose of this paper is to analyze Tikhonov regularization in general form by means of generalized SVD (GSVD) in the same spirit as SVD is used to analyze standard-form regularization. We also define a truncated GSVD solution which is of interest in its own right and which sheds light on regularization as well. In addition, our analysis gives insight into a particular numerical method for solving the general-form problem via a transformation to standard form.

AMS subject classification

65F20 65F30 


Ill-posed problems regularization generalized SVD perturbation theory generalized cross-validation transformation to standard form 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Å. Björck,Least Squares Methods; in P. G. Ciarlet & J. L. Lions (Eds),Handbook of Numerical Analysis, Vol. III: Finite Difference Methods — Solution of Equations inn, Elsevier (1989), to appear.Google Scholar
  2. [2]
    M. G. Cox,Data approximation by splines in one and two independent variables; in A. Iserles & M. J. D. Powell,The State of the Art in Numerical Analysis, Clarendon Press (1987), pp. 111–138.Google Scholar
  3. [3]
    L. Eldén,Algorithms for regularization of ill-conditioned least-squares problems, BIT 17 (1977), 134–145.CrossRefGoogle Scholar
  4. [4]
    G. H. Golub, M. T. Heath & G. Wahba,Generalized cross-validation as a method for choosing a good ridge parameter, Technometrics 21 (1979), 215–223.Google Scholar
  5. [5]
    P. C. Hansen,The truncated SVD as a method for regularization, BIT 27 (1987), 534–553.CrossRefGoogle Scholar
  6. [6]
    P. C. Hansen,Computation of the singular value expansion, Computing 40 (1988), 185–199.Google Scholar
  7. [7]
    P. C. Hansen,Truncated SVD solutions to discrete ill-posed problems with ill-determined numerical rank, SIAM J. Sci. Stat. Comput., to appear.Google Scholar
  8. [8]
    P. C. Hansen,Solution of ill-posed problems by means of truncated SVD, in: R. P. Agarwal, Y. M. Chow & S. J. Wilson (Eds.),Numerical Mathematics, Singapore 1986, ISNM 88, Birkhäuser (1988), pp. 179–192.Google Scholar
  9. [9]
    P. C. Hansen,Relations between SVD and GSVD of discrete regularization problems in standard and general form, to appear in Lin. Alg. & Its Appl.Google Scholar
  10. [10]
    P. C. Hansen,The discrete Picard condition for discrete ill-posed problems, submitted to BIT.Google Scholar
  11. [11]
    J. W. Hilgers,On the equivalence of regularization and certain reproducing kernel Hilbert space approaches for solving first kind problems, SIAM J. Numer, Anal. 13 (1976), 172–184.Google Scholar
  12. [12]
    A. S. Householder,The Theory of Matrices in Numerical Analysis, Dover Publications, New York (1974).Google Scholar
  13. [13]
    G. W. Stewart,A note on the perturbation of singular values, Lin. Alg. & Its Appl. 28 (1979), 213–216.Google Scholar
  14. [14]
    A. N. Tikhonov,Solution of incorrectly formulated problems and the regularization method, Doklady Akad. Nauk SSSR 151 (1963), 501–504 = Soviet Math. 4 (1963), 1035-1038.Google Scholar
  15. [15]
    C. F. Van Loan,Generalizing the singular value decomposition, SIAM J. Numer. Anal. 13 (1976), 76–83.CrossRefGoogle Scholar
  16. [16]
    J. M. Varah,A practical examination of some numerical methods for linear discrete ill-posed problems, SIAM Review 21 (1979), 100–111.CrossRefGoogle Scholar
  17. [17]
    C. R. Vogel,Optimal choice of a truncation level for the truncated SVD solution of linear first kind integral equations when data are noisy, SIAM J. Numer. Anal. 23 (1986), 109–117.CrossRefGoogle Scholar
  18. [18]
    G. Wahba,Practical approximate solutions to linear operator equations when the data are noisy, SIAM J. Numer. Anal. 14 (1977), 651–667.CrossRefGoogle Scholar
  19. [19]
    G. M. Wing,Condition numbers of matrices arising from the numerical treatment of linear integral equations of the first kind, J. Integral Equations 9 (Suppl.) (1985), 191–204.Google Scholar

Copyright information

© BIT Foundations 1989

Authors and Affiliations

  • Per Christian Hansen
    • 1
  1. 1.UNI·C, Building 305Technical University of DenmarkLyngbyDenmark

Personalised recommendations