Skip to main content
Log in

Multi-component separation, inpainting and denoising with recovery guarantees

  • Research
  • Published:
Research in the Mathematical Sciences Aims and scope Submit manuscript

Abstract

In image processing, problems of separation and reconstruction of missing pixels from incomplete digital images have been far more advanced in past decades. Many empirical results have produced very good results; however, providing a theoretical analysis for the success of algorithms is not an easy task, especially, for inpainting and separating multi-component signals. In this paper, we propose two main algorithms based on \(l_1\) constrained and unconstrained minimization for separating N distinct geometric components and simultaneously filling in the missing part of the observed image. We then present a theoretical guarantee for these algorithms using compressed sensing technique, which is based on a principle that each component can be sparsely represented by a suitably chosen dictionary. Those sparsifying systems are extended to the case of general frames instead of Parseval frames which have been typically used in the past. We finally prove that the method does indeed succeed in separating point singularities from curvilinear singularities and texture as well as inpainting the missing band contained in curvilinear singularities and texture.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Data availability

The authors declare that [the/all other] data supporting the findings of this study are available within the article [and its supplementary information files].

References

  1. Cai, J.-F., Cha, R.H., Shen, Z.: Simultaneous cartoon and texture inpainting. Inverse Probl. Imaging 4(3), 379–395 (2010)

    Article  MathSciNet  Google Scholar 

  2. Chan, T.F., Kang, S.H., Shen, J.: Euler’s elastica and curvature-based inpainting. SIAM J. Appl. Math. 63, 564–592 (2002)

    MathSciNet  Google Scholar 

  3. Christensen, O.: An Introduction to Frames and Riesz Bases. Applied and Numerical Harmonic Analysis, Birkhäuser Boston Inc., Boston (2003)

    Book  Google Scholar 

  4. Daubechies, I., Grossman, A., Meyer, Y.: Painless nonorthogonal expansions. J. Math. Phys. 27, 1271–1283 (1986)

    Article  ADS  MathSciNet  Google Scholar 

  5. Do, V.T., Goessmann, A.: An asymptotic analysis of separating pointlike and \(C^{1/\alpha }-\)curvelike singularities (2011). arXiv:2107.01949 [math.FA]

  6. Do, V.T., Levie, R., Kutyniok, G.: Analysis of simultaneous inpainting and geometric separation based on sparse decomposition. Anal. Appl. (2021). https://doi.org/10.1142/S021953052150007X

    Article  Google Scholar 

  7. Donoho, D.L.: Compressed sensing. IEEE Trans. Inf. Theory 52, 1289–1306 (2006)

    Article  MathSciNet  Google Scholar 

  8. Donoho, D.L., Kutyniok, G.: Geometric Separation using a Wavelet-Shearlet Dictionary. In: Fesquet, L., Torrésani, B. (eds.) Proceedings of 8th International Conference on Sampling Theory and Applications (SampTA), Marseille (2009)

  9. Donoho, D.L., Kutyniok, G.: Microlocal analysis of the geometric separation problem. Commun. Pure Appl. Math. 66(1), 1–47 (2013)

    Article  MathSciNet  Google Scholar 

  10. Duffin, R.J., Schaeffer, A.C.: A class of nonharmonic Fourier series. Trans. Am. Math. Soc. 72, 341–366 (1952)

    Article  MathSciNet  Google Scholar 

  11. Elad, M., Starck, J.-L., Querre, P., Donoho, D.L.: Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA). Appl. Comput. Harmon. Anal. 19(3), 340–358 (2005)

    Article  MathSciNet  Google Scholar 

  12. Genzel, M., Kutyniok, G.: Asymptotic analysis of inpainting via universal shearlet systems. SIAM J. Imaging Sci. 7(4), 2301–2339 (2014)

    Article  MathSciNet  Google Scholar 

  13. Grafakos, L.: Classical Fourier Analysis. Graduate Texts in Mathematics, vol. 249. Springer, New York (2008)

    Google Scholar 

  14. Gribonval, R., Bacry, E.: Harmonic decomposition of audio signals with matching pursuit. IEEE Trans. Signal Process. 51(1), 101–111 (2003)

    Article  ADS  MathSciNet  Google Scholar 

  15. Guo, K., Labate, D.: The construction of smooth Parseval frames of shearlets. Math. Model. Nat. Phenom. 8, 82–105 (2013)

    Article  MathSciNet  Google Scholar 

  16. Guo, K., Labate, D., Ayllon, J.: Image inpainting using sparse multiscale representations: image recovery performance guarantees. Appl. Comput. Harmon. Anal. 49, 343–380 (2020)

    Article  MathSciNet  Google Scholar 

  17. King, E.J., Kutyniok, G., Zhuang, X.: Analysis of data separation and recovery problems using clustered sparsity. In: Proceedings of SPIE, Wavelets and Sparsity XIV, vol. 8138, pp. 813818–813818-11 (2011)

  18. King, E.J., Kutyniok, G., Zhuang, X.: Ananasis of inpainting via clustered sparsity and microlocal analysis. J. Math. Imaging Vis. 48, 205–234 (2014)

    Article  Google Scholar 

  19. Kutyniok, G.: Clustered sparsity and separation of cartoon and texture. SIAM J. Imaging Sci. 6, 848–874 (2013)

    Article  MathSciNet  Google Scholar 

  20. Kutyniok, G., Lim, W.-Q.: Image separation using wavlets and shearlets. In: Curves and Surfaces (Avignon, France, 2010), Lecture Notes in Computer Science 6920. Springer, Berlin (2012)

  21. Starck, J.-L., Candes, E., Donoho, D.L.: Astronomical Image Representation by the Curvelet Transform. Astron. Astrophys. 398, 785–800 (2003)

    Article  ADS  Google Scholar 

  22. Teschke, G.: Multi-frame representations in linear inverse problems with mixed multi-constraints. Appl. Comput. Harmon. Anal. 22(1), 43–60 (2007)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

VT.D. acknowledges support by the VIED-MOET Fellowship through Project 911.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Van Tiep Do.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Do, V.T. Multi-component separation, inpainting and denoising with recovery guarantees. Res Math Sci 11, 5 (2024). https://doi.org/10.1007/s40687-023-00416-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s40687-023-00416-9

Keywords

Mathematics Subject Classification

Navigation