Skip to main content
SpringerLink
Log in

Domain-based structure-aware image inpainting

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Although image inpainting has been extensively studied in recent years, some problems in this area are still open. In particular, the structure restoration is one of the difficulties due to the incompleteness of the reconstructed structural information. The less reasonable filling order and the ignorance of local consistency of the image would also easily lead to undesired repairing results. To remedy the above problems, this paper proposed a new domain-based structural-aware image inpainting method. We specially designed a new iterative structure searching algorithm which can restore more complete and reliable structural information. The adjacent patches were connected to form a repairing domain which serves as the minimal repair unit. The introduction of the domain ensures the coherency and searching accuracy of the repairing results. Moreover, we introduced a novel repair order calculation method which can greatly reduce the influence of the error propagation in conventional methods. Various experiment results demonstrated the effectiveness of our method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Bertalmio, M., Vese, L., Sapiro, G., Osher, S.: Simultaneous structure and texture image inpainting. IEEE Trans. Image Process. 12(8), 882–889 (2003)

  2. Criminisi, A., Pérez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. Image Process. 13(9), 1200–1212 (2004)

    Article  Google Scholar 

  3. Sun, J., Yuan, L., Jia, J., Shum, H.: Image completion with structure propagation. In: ACM SIGGRAPH, pp. 861–868 (2005)

  4. Komodakis, N.: Image completion using global optimization. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 442–452 (2006)

  5. Wong, A., Orchard, J.: A nonlocal-means approach to exemplar-based inpainting. In: The International Conference on Image Processing (ICIP), pp. 2600–2603 (2008)

  6. Xu, Z.B., Sun, J.: Image inpainting by patch propagation using patch sparsity. IEEE Trans. Image Process. 19(5), 1153–1165 (2010)

    Article  MathSciNet  Google Scholar 

  7. Martınez-Noriega, R., Roumy, A.: Exemplar-based image inpainting: fast priority and coherent nearest neighbor search. In: IEEE International Workshop on Machine Learning for Signal Processing (MLSP), pp. 1–6 (2012)

  8. Ndjiki-Nya, P., Köppel, M., Doshkov, D., Wiegand, T.: Automatic structure-aware inpainting for complex image content. In: ISVC, pp. 1144–1156 (2008)

  9. Li, S., Zhao, M.: Image inpainting with salient structure completion and texture propagation. Pattern Recogn. Lett. 32(9), 1256–1266 (2011)

    Article  Google Scholar 

  10. Cao, F., Gousseau, Y., Masnou, S., Pérez, P.: Geometrically guided exemplar-based inpainting. SIAM J. Imaging Sci. 4(4), 1143–1179 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  11. Wu, J.L., Chou, Y.Y.: An effective content-aware image inpainting method. J. Inf. Sci. Eng. 28(4), 755–770 (2012)

    MathSciNet  Google Scholar 

  12. Lee, J., Lee, O.K., Park, R.H.: Robust exemplar-based inpainting algorithm using region segmentation. IEEE Trans. Consum. Electron. 58(2), 553–561 (2012)

    Article  Google Scholar 

  13. Martinez-Noriega, R., Roumy, A.: Prior and macro-filling order for image completion. In: The 20th IEEE International Conference on Image Processing (ICIP), pp. 719–723 (2013)

  14. Bugeau, A., Bertalmío, M., Caselles, V., Sapiro, G.: A comprehensive framework for image inpainting. IEEE Trans. Image Process. 19(10), 2634–2645 (2010)

    Article  MathSciNet  Google Scholar 

  15. He, K., Sun, J.: Statistics of patch offsets for image completion. In: European Conference on Computer Vision (ECCV), pp. 16–29 (2012)

  16. Le Meur, O., Ebdelli, M., Guillemot, C.: Hierarchical super-resolution based inpainting. IEEE Trans. Image Process. 22(10), 3779–3790 (2013)

    Article  MathSciNet  Google Scholar 

  17. Guillemot, C., Turkan, M., Le Meur, M., Ebdelli, M.: Object removal and loss concealment using neighbor embedding methods. Signal Process. Image Commun. 28(10), 1405–1419 (2013)

    Article  Google Scholar 

Download references

Acknowledgments

The authors would like to thank the anonymous reviewers for their helpful and insightful comments. This work was partly supported by the Natural Science Foundation of China (No. 61170118), and the Application Foundation Research Plan Project of Tianjin (No. 14JCQNJC00100).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Tianjin University, Tianjin, 300350, People’s Republic of China

    Shiguang Liu

  2. Department of Computer Engineering, Zhonghuan Information College, Tianjin University of Technology, Tianjin, 300380, People’s Republic of China

    Yinwei Wei

  3. Tianjin Key Laboratory of Cognitive Computing and Application, Tianjin, 300350, People’s Republic of China

    Shiguang Liu

Authors
  1. Yinwei Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shiguang Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shiguang Liu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wei, Y., Liu, S. Domain-based structure-aware image inpainting. SIViP 10, 911–919 (2016). https://doi.org/10.1007/s11760-015-0840-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-015-0840-y

Keywords

Search

Navigation