Chinese Annals of Mathematics, Series B

, Volume 35, Issue 3, pp 383–398 | Cite as

Multi-parameter Tikhonov regularization — An augmented approach

  • Kazufumi ItoEmail author
  • Bangti Jin
  • Tomoya Takeuchi


We study multi-parameter regularization (multiple penalties) for solving linear inverse problems to promote simultaneously distinct features of the sought-for objects. We revisit a balancing principle for choosing regularization parameters from the viewpoint of augmented Tikhonov regularization, and derive a new parameter choice strategy called the balanced discrepancy principle. A priori and a posteriori error estimates are provided to theoretically justify the principles, and numerical algorithms for efficiently implementing the principles are also provided. Numerical results on deblurring are presented to illustrate the feasibility of the balanced discrepancy principle.


Multi-parameter regularization Augmented Tikhonov regularization, Balanced discrepancy principle 

2000 MR Subject Classification

65J20 65J22 49N45 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Belge, M., Kilmer, M. E. and Miller, E. L., Efficient determination of multiple regularization parameters in a generalized L-curve framework, Inverse Problems, 18(4), 2002, 1161–1183.CrossRefzbMATHMathSciNetGoogle Scholar
  2. [2]
    Broyden, C. G., A class of methods for solving nonlinear simultaneous equations, Math. Comp., 19(92), 1965, 577–593.CrossRefzbMATHMathSciNetGoogle Scholar
  3. [3]
    Burger, M. and Osher, S., Convergence rates of convex variational regularization, Inverse Problems, 20(5), 2004, 1411–1420.CrossRefzbMATHMathSciNetGoogle Scholar
  4. [4]
    Chen, Z., Lu, Y., Xu, Y. and Yang, H., Multi-parameter Tikhonov regularization for linear ill-posed operator equations, J. Comput. Math., 26(1), 2008, 37–55.zbMATHMathSciNetGoogle Scholar
  5. [5]
    Engl, H. W., Hanke, M. and Neubauer, A., Regularization of Inverse Problems, Kluwer, Dordrecht, 1996.CrossRefzbMATHGoogle Scholar
  6. [6]
    Hofmann, B., Kaltenbacher, B., Poeschl, C. and Scherzer, O., A convergence rates result for Tikhonov regularization in Banach spaces with non-smooth operators, Inverse Problems, 23(3), 2007, 987–1010.CrossRefzbMATHMathSciNetGoogle Scholar
  7. [7]
    Ito, K., Jin, B. and Takeuchi, T., Multi-parameter Tikhonov regularization, Methods Appl. Anal., 18(1), 2011, 31–46.CrossRefzbMATHMathSciNetGoogle Scholar
  8. [8]
    Ito, K., Jin, B. and Takeuchi, T., A regularization parameter for nonsmooth Tikhonov regularization, SIAM J. Sci. Comput., 33(3), 2011, 1415–1438.CrossRefzbMATHMathSciNetGoogle Scholar
  9. [9]
    Ito, K. and Kunisch, K., BV-type regularization methods for convoluted objects with edge, flat and grey scales, Inverse Problems, 16(4), 2000, 909–928.CrossRefzbMATHMathSciNetGoogle Scholar
  10. [10]
    Ivanov, V. K., Vasin, V. V. and Tanana, V. P., Theory of Linear Ill-Posed Problems and Its Applications, VSP, Utrecht, 2nd edition, 2002.CrossRefzbMATHGoogle Scholar
  11. [11]
    Jin, B. and Lorenz, D. A., Heuristic parameter-choice rules for convex variational regularization based on error estimates, SIAM J. Numer. Anal., 48(3), 2010, 1208–1229.CrossRefzbMATHMathSciNetGoogle Scholar
  12. [12]
    Jin, B. and Zou, J., Augmented Tikhonov regularization, Inverse Problems, 25(2), 2009, 025001, 25 pages.CrossRefMathSciNetGoogle Scholar
  13. [13]
    Lu, S. and Pereverzev, S. V., Multi-parameter regularization and its numerical regularization, Numer. Math., 118(1), 2011, 1–31.CrossRefzbMATHMathSciNetGoogle Scholar
  14. [14]
    Lu, S., Pereverzev, S. V., Shao, Y. and Tautenhahn, U., Discrepancy curves for multi-parameter regularization, J. Inv. Ill-Posed Probl., 18(6), 2010, 655–676.zbMATHMathSciNetGoogle Scholar
  15. [15]
    Lu, Y., Shen, L. and Xu, Y., Multi-parameter regularization methods for high-resolution image reconstruction with displacement errors, IEEE Trans. Circuits Syst. I. Regul. Pap., 54(8), 2007, 1788–1799.CrossRefMathSciNetGoogle Scholar
  16. [16]
    Mathé, P., The Lepskii principle revisited, Inverse Problems, 22(3), 2006, L11–L15.CrossRefzbMATHGoogle Scholar
  17. [17]
    Stephanakis, I. M., Regularized image restoration in multiresolution spaces, Opt. Eng., 36(6), 1997, 1738–1744.CrossRefGoogle Scholar
  18. [18]
    Xu, P., Fukuda, Y. and Liu, Y., Multiple parameter regularization: numerical solutions and applications to the determination of geopotential from precise satellite orbits, J. Geod., 80(1), 2006, 17–27.CrossRefGoogle Scholar
  19. [19]
    Zou, H. and Hastie, T., Regularization and variable selection via the elastic net, J. R. Stat. Soc. Ser. B, 67(2), 2005, 301–320.CrossRefzbMATHMathSciNetGoogle Scholar

Copyright information

© Fudan University and Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  1. 1.Center for Research in Scientific Computation & Department of MathematicsNorth Carolina State UniversityRaleighUSA
  2. 2.Department of MathematicsUniversity of California, RiversideRiversideUSA
  3. 3.Collaborative Research Center for Innovative Mathematical Modelling, Institute of Industrial ScienceThe University of TokyoTokyoJapan

Personalised recommendations