Skip to main content
Log in

Inpainting via High-dimensional Universal Shearlet Systems

  • Published:
Acta Applicandae Mathematicae Aims and scope Submit manuscript

Abstract

Thresholding and compressed sensing in combination with both wavelet and shearlet transforms have been very successful in inpainting tasks. Recent results have demonstrated that shearlets outperform wavelets in the problem of image inpainting. In this paper, we provide a general framework for universal shearlet systems in high dimensions. This theoretical framework is used to analyze the recovery of missing data via \(\ell^{1} \) minimization in an abstract model situation. In addition, we set up a particular model inspired by seismic data and a box mask to model missing data. Finally, the results of numerical experiments comparing various inpainting methods are presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Algorithm 1
Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Bertalmio, M., Bertozzi, A., Sapiro, G.: Navier-Stokes, fluid dynamics, and image and video inpainting. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, pp. I355–I362 (2001)

    Google Scholar 

  2. Cai, J.-F., Chan, R.H., Shen, Z.: Simultaneous cartoon and texture inpainting. Inverse Probl. Imaging 4, 379–395 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  3. Davenport, M., Duarte, M., Eldar, Y., Kutyniok, G.: Introduction to compressed sensing. In: Compressed Sensing: Theory and Applications, pp. 1–68. Cambridge University Press, Cambridge (2012)

    Google Scholar 

  4. Donoho, D., Kutyniok, G.: Microlocal analysis of the geometric separation problem. Commun. Pure Appl. Math. 66, 1–47 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  5. Easley, G., Labate, D., Lim, W.: Sparse directional image representations using the discrete shearlet transform. Appl. Comput. Harmon. Anal. 25, 25–46 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  6. Easley, G.R., Labate, D., Colonna, F.: Shearlet based total variation for denoising. IEEE Trans. Image Process. 18(2), 260–268 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  7. Elad, M., Starck, J.-L., Querre, P., Donoho, D.L.: Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA). Appl. Comput. Harmon. Anal. 19, 340–358 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  8. Foucart, S., Rauhut, H.: A Mathematical Introduction to Compressive Sensing. Birkhäuser, Basel (2013)

    Book  MATH  Google Scholar 

  9. Genzel, M., Kutyniok, G.: Symptotic analysis of inpainting via universal shearlet systems. SIAM J. Imaging Sci. 7, 2301–2339 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  10. Guo, K., Labate, D.: Optimally sparse multidimensional representation using shearlets. SIAM J. Math. Anal. 39, 298–318 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  11. Guo, K., Labate, D.: The construction of smooth Parseval frames of shearlets. Math. Model. Nat. Phenom. 8, 82–105 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  12. Guo, K., Labate, D.: Geometric separation of singularities using combined multiscale dictionaries. J. Fourier Anal. Appl. 21(4), 667–693 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  13. Hennenfent, G., Fenelon, L., Herrmann, F.J.: Nonequispaced curvelet transform for seismic data reconstruction: a sparsity-promoting approach. Geophysics 75(6), WB203–WB210 (2010)

    Article  Google Scholar 

  14. Herrmann, F.J., Hennenfent, G.: Non-parametric seismic data recovery with curvelet frames. Geophys. J. Int. 173(1), 233–248 (2008)

    Article  Google Scholar 

  15. King, E.J., Kutyniok, G., Zhuang, X.: Analysis of data separation and recovery problems using clustered sparsity. In: Wavelets and Sparsity XIV. Proceedings of the SPIE, vol. 8138, p. 813818 (2011)

    Chapter  Google Scholar 

  16. King, E.J., Kutyniok, G., Zhuang, X.: Analysis of inpainting via clustered sparsity and microlocal analysis. J. Math. Imaging Vis. 48, 205–234 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  17. Kutyniok, G.: Geometric separation by single-pass alternating thresholding. Appl. Comput. Harmon. Anal. 36, 23–50 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  18. Kutyniok, G., Lim, W.-Q., Reisenhofer, R.: Shearlab 3D: faithful digital shearlet transforms based on compactly supported shearlets. ACM Trans. Math. Softw. 42(1), 5 (2015)

    MathSciNet  MATH  Google Scholar 

  19. Labate, D., Lim, W.-Q., Kutyniok, G., Weiss, G.: Sparse multidimensional representation using shearlets. In: Papadakis, M., Laine, A.F., Unser, M.A. (eds.) Wavelets XI. SPIE Proc., vol. 5914, pp. 254–262. SPIE, Bellingham (2005)

    Chapter  Google Scholar 

  20. Ma, J., März, M.: A multilevel based reweighting algorithm with joint regularizers for sparse recovery. Preprint

  21. Nam, S., Davies, M.E., Elad, M., Gribonval, R.: Cosparse analysis modeling-uniqueness and algorithms. In: 2011 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP, pp. 5804–5807. IEEE Press, New York (2011)

    Chapter  Google Scholar 

  22. Nam, S., Davies, M.E., Elad, M., Gribonval, R.: The cosparse analysis model and algorithms. Appl. Comput. Harmon. Anal. 34, 30–56 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  23. Negi, P.S., Labate, D.: 3D discrete shearlet transform and video processing. IEEE Trans. Image Process. 21(6), 2944–2954 (2012)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

The first author would like to thank Professor Gitta Kutyniok for stimulating discussions and pointing out various references. She is grateful to the department of Mathematics, Technische Universität Berlin for hospitality and Martin Genzel for proofreading the paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to R. A. Kamyabi-Gol.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Amiri, Z., Kamyabi-Gol, R.A. Inpainting via High-dimensional Universal Shearlet Systems. Acta Appl Math 156, 177–209 (2018). https://doi.org/10.1007/s10440-018-0159-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10440-018-0159-0

Keywords

Mathematics Subject Classification (2000)

Navigation