, 55:17 | Cite as

Irregularization accelerates iterative regularization

  • Paola Brianzi
  • Fabio Di Benedetto
  • Claudio Estatico
  • Luca Surace


When iterative methods are employed as regularizers of inverse problems, a main issue is the trade-off between smoothing effects and computation time, related to the convergence rate of iterations. Very often, faster methods obtain less accuracy. A new acceleration strategy is presented here, inspired by a choice of penalty terms formerly proposed in 2012 by Huckle and Sedlacek in the context of Tikhonov regularization by direct solvers. More precisely, we consider a special penalty term endowed with high regularization capabilities, and we apply it by using the opposite sign, that is negative, to its regularization parameter. This unprecedented choice leads to an “irregularization” phenomenon, which speeds up the underlying basic iterative method. The speeding up effects of the negative valued penalty term can be controlled through a sequence of decreasing coefficients as the iterations proceed in order to prevent noise amplification, tuning the weight of the correction term which generates the anti-regularization behavior. Filter factor expansion and convergence are analyzed in the simplified context of linear inverse problems in Hilbert spaces, by considering modified Landweber iterations as a first case study.


Inverse problems Regularization Modified Landweber Convergence analysis Filter factor 

Mathematics Subject Classification

65F22 65F10 45Q05 


  1. 1.
    Bertero, M., Boccacci, P.: Introduction to Inverse Problems in Imaging. Institute of Physics Publ, Bristol (1998)CrossRefMATHGoogle Scholar
  2. 2.
    Beckner, W.: Inequalities in Fourier analysis. Ann. Math. 102, 159–182 (1975)MathSciNetCrossRefMATHGoogle Scholar
  3. 3.
    Brianzi, P., Di Benedetto, F., Estatico, C.: Improvement of space-invariant image deblurring by preconditioned Landweber iterations. SIAM J. Sci. Comp. 30, 1430–1458 (2008)MathSciNetCrossRefMATHGoogle Scholar
  4. 4.
    Brianzi, P., Di Benedetto, F., Estatico, C.: Preconditioned iterative regularization in Banach spaces. Comput. Optim. Appl. 54, 263–282 (2013)MathSciNetCrossRefMATHGoogle Scholar
  5. 5.
    Caponigro, M., Fornasier, M., Piccoli, B., Trélat, E.: Sparse stabilization and control of the Cucker-Smale model. Math. Contr. Rel. Fields AIMS 3, 447–466 (2013)MathSciNetCrossRefMATHGoogle Scholar
  6. 6.
    Chidume, C.: Geometric Properties of Banach Spaces and Nonlinear Iterations. Lecture Notes in Mathematics. Springer, Berlin (2009)MATHGoogle Scholar
  7. 7.
    Donatelli, M., Hanke, M.: Fast nonstationary preconditioned iterative methods for ill-posed problems, with application to image deblurring. Inverse Probl. 29, 095008 (2013). (16 pp.)MathSciNetCrossRefMATHGoogle Scholar
  8. 8.
    Eidelman, Y., Milman, V., Tsolomitis, A.: Functional Analysis: An Introduction. American Mathematical Society, Providence (2004)CrossRefMATHGoogle Scholar
  9. 9.
    Estatico, C.: A class of filtering superoptimal preconditioners for highly ill-conditioned linear systems. BIT Numer. Math. 42, 753–778 (2002)MathSciNetCrossRefMATHGoogle Scholar
  10. 10.
    Estatico, C., Gratton, S., Lenti, F., Titley-Peloquin, D.: A conjugate gradient like method for p-norm minimization in functional spaces. Numer. Math. 137, 895–922 (2017)MathSciNetCrossRefMATHGoogle Scholar
  11. 11.
    Groetsch, C.W.: Generalized Inverses of Linear Operators. Marcel Dekker Inc., New York (1977)MATHGoogle Scholar
  12. 12.
    Hanke, M., Nagy, J.G., Plemmons, R.J.: Preconditioned iterative regularization for ill-posed problems. In: Reichel, L., Ruttan, A., Varga, R.S. (eds.) Numerical Linear Algebra and Scientific Computing, pp. 141–163. Walter de Gruyter Press (1993)Google Scholar
  13. 13.
    Hansen, P.C., Nagy, J.G., O’Leary, D.P.: Deblurring Images: Matrices, Spectra, and Filtering. SIAM, Philadelphia (2006)CrossRefMATHGoogle Scholar
  14. 14.
    Huckle, T., Sedlacek, M.: Tykhonov-Phillips regularization with operator dependent seminorms. Numer. Alg. 60, 339–353 (2012)CrossRefMATHGoogle Scholar
  15. 15.
    Landweber, L.: An iteration formula for Fredholm integral equations of the first kind. Am. J. Math. 73, 615–624 (1951)MathSciNetCrossRefMATHGoogle Scholar
  16. 16.
    Lenti, F., Nunziata, F., Estatico, C., Migliaccio, M.: Spatial resolution enhancement of earth observation products using an acceleration technique for iterative methods. IEEE Geosci. Remote Sens. Lett. 12, 269–273 (2015)CrossRefGoogle Scholar
  17. 17.
    Liggins II, M., Hall, D., Llinas, J.: Handbook of Multisensor Data Fusion: Theory and Practice. CRC Press, Boca Raton (2008)CrossRefGoogle Scholar
  18. 18.
    Long, D.G.: Reconstruction and resolution enhancement techniques for microwave sensors. In: Chen, C.H. (ed.) Frontiers of Remote Sensing Information Processing. World Scientific, Sinapore (2003). ch. 11Google Scholar
  19. 19.
    Morikuni, K., Reichel, L., Hayami, K.: FGMRES for linear discrete ill-posed problems. Appl. Numer. Math. 75, 175–187 (2013)MathSciNetCrossRefMATHGoogle Scholar
  20. 20.
    Pastorino, M.: Microwave Imaging. John Wiley, Hoboken (2010)CrossRefGoogle Scholar
  21. 21.
    Roggemann, M.C., Welsh, B.: Imaging Through Turbulence. CRC Press, Boca Raton (1996)Google Scholar
  22. 22.
    Saad, Y.: A flexible inner-outer preconditioned GMRES algorithm. SIAM J. Sci. Comput. 14, 461–469 (1993)MathSciNetCrossRefMATHGoogle Scholar
  23. 23.
    Scherzer, O.: A modified Landweber iteration for solving parameter estimation problems. Appl. Math. Optim. 38, 45–68 (1998)MathSciNetCrossRefMATHGoogle Scholar
  24. 24.
    Scherzer, O., Grasmair, M., Grossauer, H., Haltmeier, M., Lenzen, F.: Variational Methods in Imaging. Springer, Berlin (2009)MATHGoogle Scholar
  25. 25.
    Schuster, T., Kaltenbacher, B., Hofmann, B., Kazimierski, K.S.: Regularization Methods in Banach Spaces. Radon Series on Computational and Applied Mathematics, vol. 10. De Gruyter, Berlin (2012)CrossRefMATHGoogle Scholar
  26. 26.
    Taylor, A.E., Lay, D.C.: Introduction to Functional Analysis. Krieger Publishing Company, Malabar (1980)MATHGoogle Scholar
  27. 27.
    Vesely, L., Zajíček, L.: Delta-convex mappings between Banach spaces and applications, Dissertationes, Math., 289 (1989), Warszawa, Poland (52 pp.)Google Scholar
  28. 28.
    Zhao, D.: Multiscale Seismic Tomography. Geophysics. Springer, Berlin (2015)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Italia S.r.l., part of Springer Nature 2018

Authors and Affiliations

  1. 1.Dipartimento di MatematicaGenovaItaly
  2. 2.IPSEOA Marco PoloGenovaItaly

Personalised recommendations