Skip to main content
SpringerLink
Log in

Regularization of geophysical ill-posed problems by iteratively re-weighted and refined least squares

  • ORIGINAL PAPER
  • Published:
Computational Geosciences Aims and scope Submit manuscript

Abstract

The iteratively re-weighted least squares (IRLS) is a commonly used algorithm which has received significant attention in geophysics and other fields of scientific computing for regularization of discrete ill-posed problems. The IRLS replaces a difficult optimization problem by a sequence of weighted linear systems. The optimum solution of the original problem is usually determined by computing the solution for various regularization parameters λ, each needing several re-weighted iterations (usually 10–15). In this paper, in order to decrease the required computation time (iterations) while maintaining good properties of the algorithm such as edge-preserving, the IRLS is augmented with a refinement strategy and the value of λ is progressively updated in a geometrical form during the iterations. The new algorithm, called iteratively re-weighted and refined least squares (IRRLS), can be interpreted as a Landweber iteration with a non-stationary shaping matrix which is updated based on the solution obtained from previous iteration. Two main properties of IRRLS are (1) the regularization parameter is the stopping iteration and (2) it is equipped with a tuning parameter which makes it flexible for recovering models with different smoothness. We show numerically that both the residual and regularization norms are monotone functions of iteration and hence well behaved for automatic determination of stopping parameter. The Stain’s unbiased risk estimate (SURE), generalized cross validation (GCV), L-curve analysis, and discrepancy principle (DCP) techniques are employed for automatic determination of optimum iteration. Experimental results from seismic deconvolution and seismic tomography are included showing that the proposed methodology outperforms the conventional IRLS with significantly lower computational burden.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Charbonnier, P., Blanc-Feraud, L., Aubert, G., Barlaud, M.: Deterministic edge-preserving regularization in computed imaging. IEEE Trans. Image Process. 6, 298–311 (1997)

    Article  Google Scholar 

  2. Chen, S., Donoho, D.L., Saunders, M.: Atomic decomposition by basis pursuit. SIAM J. Sci. Comput. 20, 33–61 (1998)

    Article  Google Scholar 

  3. Daubechies, I., DeVore, R., Fornasier, M., Gunturk, S.: Iteratively re-weighted least squares minimization for sparse recovery. Commun. Pure Appl. Math. 63, 1–38 (2010)

    Article  Google Scholar 

  4. Donoho, D.L.: Nonlinear solution of linear inverse problems by wavelet-vaguelette decomposition. Appl. Comput. Harmon. Anal. 2, 101–126 (1995)

    Article  Google Scholar 

  5. Elfving, T., Nikazad, T.: Stopping rules for landweber-type iteration. Inverse Prob. 23, 1417–1432 (2007)

    Article  Google Scholar 

  6. Farquharson, C.G., Oldenburg, D.W.: Non-linear inversion using general measures of data misfit and model structure. Geophys. J. Int. 134, 13–27 (1998)

    Article  Google Scholar 

  7. Gheymasi, H.M., Gholami, A.: A local-order regularization for geophysical inverse problems. Geophys. J. Int. 195, 1288–1299 (2013)

    Article  Google Scholar 

  8. Gholami, A., Hosseini, S.M.: A general framework for sparsity-based denoising and inversion. IEEE Trans. Signal Process. 59(11), 5202–5211 (2011)

    Article  Google Scholar 

  9. Gholami, A., Hosseini, S.M.: A balanced combination of tikhonov and total variation regularizations for reconstruction of piecewise-smooth signals. Signal Process. 93, 1945–1960 (2013)

    Article  Google Scholar 

  10. Gholami, A., Sacchi, M.D.: A fast and automatic sparse deconvolution in the presence of outliers. IEEE Trans. Geosci. Remote Sens. 50(10), 4105–4116 (2012)

    Article  Google Scholar 

  11. Gholami, A., Siahkoohi, H.R.: Regularization of linear and non-linear geophysical ill-posed problems with joint sparsity constraints. Geophys. J. Int. 180, 871–882 (2010)

    Article  Google Scholar 

  12. Girard, D.A.: A fast monte-carlo cross-validation procedure for large least squares problems with noisy data. Numer. Math. 56 (1989)

  13. Hanke, M., Groetsh, C.W.: Nonstationaty iterated tikhonov regularization. J. Optim. Theory Appl. 98, 37–53 (1998)

    Article  Google Scholar 

  14. Hansen, P.C.: Analysis of discrete ill-posed problems by means of the l-curve. SIAM Rev. 34(4), 561–580 (1992)

    Article  Google Scholar 

  15. Hansen, P.C.: Rank-deficient and discrete Ill-posed problems: Numerical aspects of linear inversion. SIAM, Philadelphia (1999)

    Google Scholar 

  16. Hutchinson, M.F.: A stochastic estimator for the trace of the influence matrix for Laplacian smoothing splines. Comput. Stat.—Simul. Comput. 19(2), 433–450 (1990)

    Article  Google Scholar 

  17. Landweber, L.: An iteration formula for Fredholm integral equations of the first kind. Amer. J. Math. 73, 615–624 (1951)

    Article  Google Scholar 

  18. Lawson, C.L.: Contributions to the theory of linear least maximum approximation. Ph.D. thesis, University of California, Los Angeles (1961)

  19. Levy, S., Fullager, P.K.: Reconstruction of a sparse spike train from a portion of its spectrum and application to high-resolution deconvolution. Geophysics 49, 1235–1243 (1981)

    Article  Google Scholar 

  20. Mayer, C.D.: Matrix analysis and applied linear algebra. SIAM, Philadelphia (2001)

    Google Scholar 

  21. Morozov, V.: The solution of functional equations by the method of regularization. Soviet Math. Dokl 7(4), 414–417 (1966)

    Google Scholar 

  22. Ramani, S., Liu, Z., Rosen, J., Nielsen, J.F., Fessler, J.A.: Regularization parameter selection for nonlinear iterative image restoration and MRI reconstruction using GCV and SURE-based methods. IEEE Trans. Image Process. 21(8), 3659–3672 (2012)

    Article  Google Scholar 

  23. Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D 60, 259–268 (1992)

    Article  Google Scholar 

  24. Scales, J.A.: Tomographic inversion via the conjugate gradient method. Geophysics 52, 179–185 (1987)

    Article  Google Scholar 

  25. Strand, O.N.: Theory and methods related to the singular-function expansion and landweber’s iteration for integral equations of the first kind. SIAM J. Numer. Anal 11, 798–825 (1974)

    Article  Google Scholar 

  26. Succhi, M.D.: Reweighting strategies in seismic deconvolution. Geophys. J. Int. 129, 651–656 (1997)

    Article  Google Scholar 

  27. Taylor, H.L., Banks, S.C., McCoy, J.F.: Deconvolution with the l p -norm. Geophysics 66, 39–52 (1979)

    Article  Google Scholar 

  28. Tikhonov, A.N., Arsenin, V.Y.: Solutions of Ill-posed problems. Winston and Sons, Washington (1977)

    Google Scholar 

  29. Vogel, C.R.: Computational methods for inverse problems. SIAM, Philadelphia (2002)

    Book  Google Scholar 

  30. Wahba, G.: Practical approximate solution of linear operator equations when the data are noisy. SIAM J. Numer. Anal. 14(4), 651–667 (1997)

    Article  Google Scholar 

  31. van Wijk, K., Scales, J.A., Navidi, W., Tenorio, L.: Data and model uncertainty estimation for linear inversion. Geophys. J. Int. 149, 625–632 (2002)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Geophysics, University of Tehran, Tehran, Iran

    Ali Gholami & Hamzeh Mohammadi Gheymasi

Authors
  1. Ali Gholami
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hamzeh Mohammadi Gheymasi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hamzeh Mohammadi Gheymasi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gholami, A., Mohammadi Gheymasi, H. Regularization of geophysical ill-posed problems by iteratively re-weighted and refined least squares. Comput Geosci 20, 19–33 (2016). https://doi.org/10.1007/s10596-015-9544-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10596-015-9544-1

Keywords

Search

Navigation