Skip to main content
SpringerLink
Log in

Block-based image inpainting in the wavelet domain

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

This paper introduces a new model for block-based image inpainting in the wavelet domain. The proposed technique separates the inpainting process into two different and important steps, both using the energy of wavelet coefficients. First, the model explores wavelet detail coefficients to estimate the image gradient vector, weighting each vector with the energy of wavelet coefficients. Such information is then used to determine which block belonging to the inpainting region should be filled first. After that, an adapted method for texture synthesis in the wavelet domain is applied in order to successfully fill this block. These two steps are applied successively, until the inpainting region is completely filled. Experimental results indicate that the proposed algorithm can fill large inpainting regions with good visual quality, presenting results comparable to or better than other competitive approaches for image inpainting.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: Proceedings of SIGGRAPH 2000, pp. 417–424. ACM Press, New York (2000)

  2. Bertalmio, M., Vese, L., Sapiro, G., Osher, S.: Simultaneous structure and texture image inpainting. IEEE Trans. Image Processing 12, 882–889 (2003)

    Article  Google Scholar 

  3. Chan, T.F., Shen, J., Zhou, H.M.: Total variation wavelet inpainting. Tech. rep., UCLA Comp. Appl. Math. (CAM) Tech. Report, Los Angeles (2001)

  4. Chen, Y., Luan, Q., Li, H., Au, O.: Sketch-guided texture-based image inpainting. In: Proceedings of IEEE International Conference on Image Processing (ICIP), pp. 1997–2000 (2006)

  5. Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. Image Processing 13(9), 1200–1212 (2004)

    Article  Google Scholar 

  6. Drori, I., Cohen-Or, D., Yeshurun, H.: Fragment-based image completion. In: Proceedings of SIGGRAPH 2003, pp. 303–312. ACM Press, New York (2003)

  7. Efros, A.A., Leung, T.K.: Texture synthesis by non-parametric sampling. In: IEEE International Conference on Computer Vision, pp. 1033–1038. Corfu, Greece (1999)

  8. Kanizsa, G.: Organization in Vision. Praeger, New York (1979)

    Google Scholar 

  9. Kokaram, A., Morris, R., Fitzgerald, W., Rayner, P.: Interpolation of missing data in image sequences. IEEE Trans. Image Processing 11, 1509–1519 (1995)

    Article  Google Scholar 

  10. Mallat, S.: A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans. Pattern Anal. Mach. Intell. 11, 674–693 (1989)

    Article  MATH  Google Scholar 

  11. Masnou, S., Morel, J.: Level lines based disocclusion. In: Proceedings of IEEE International Conference on Image Processing, vol. 3, pp. 259–263 (1998)

  12. Meyer, Y.: Oscillating Patterns in Image Processing and Nonlinear Evolution Equations. American Mathematical Society, Boston (2001)

  13. Nitzberg, M., Mumford, D., Shiota, T.: Filtering, Segmentation, and Depth. Springer, New York (1993)

    MATH  Google Scholar 

  14. Patwardhan, K., Sapiro, G.: Projection based image and video inpainting using wavelets. In: Proceedings of IEEE International Conference on Image Processing, vol. I, pp. 857–860 (2003)

  15. Pessoa, L., Thompson, E., Noe, A.: Finding out about filling-in: A guide to perceptual completion for visual science and the philosophy of perception. Behavioral and Brain Sciences 21(6), 723–748 (1998)

    Article  Google Scholar 

  16. Rane, S.D., Remus, J., Sapiro, G.: Wavelet-domain reconstruction of lost blocks in wireless image transmission and packet-switched networks. In: Proceedings of IEEE International Conference on Image Processing, pp. 309–312 (2002)

  17. Sarkar, S., Boyer, K.L.: Integration, inference, and management of spatial information using bayesian networks: Perceptual organization. IEEE Trans. Pattern Anal. Mach. Intell. 15(3), 256–274 (1993)

    Article  Google Scholar 

  18. Sun, J., Yuan, L., Jia, J., Shum, H.Y.: Image completion with structure propagation. ACM Trans. Comput. Graph. 24(3), 861–868 (2005)

    Article  Google Scholar 

  19. Tonietto, L., Walter, M., Jung, C.R.: Patch-based texture synthesis using wavelets. In: Proceedings of SIBGRAPI, pp. 383–389. IEEE Computer Society, Natal, Brazil (2005)

  20. Tonietto, L., Walter, M., Jung, C.R.: A randomized approach for patch-based texture synthesis using wavelets. Comput. Graph. Forum 25(4), 675–684 (2006)

    Article  Google Scholar 

  21. Tschumperle, D., Deriche, R.: Vector-valued image regularization with PDEs: A common framework for different applications. IEEE Trans. Pattern Anal. Mach. Intell. 27(4), 506–517 (2005)

    Article  Google Scholar 

  22. Vese, L.A., Osher, S.J.: Modeling textures with total variation minimization and oscillating patterns in image processing. J. Sci. Comput. 19(1-3), 553–572 (2003)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Graduate School of Applied Computing, Unisinos – Universidade do Vale do Rio dos Sinos, Av. Unisinos, 950, São Leopoldo, RS, Brazil, 93022-000

    Ubiratã A. Ignácio & Cláudio R. Jung

Authors
  1. Ubiratã A. Ignácio
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cláudio R. Jung
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ubiratã A. Ignácio.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ignácio, U., Jung, C. Block-based image inpainting in the wavelet domain. Visual Comput 23, 733–741 (2007). https://doi.org/10.1007/s00371-007-0139-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-007-0139-2

Keywords

Search

Navigation