Skip to main content
Log in

An improved image quality algorithm for exemplar-based image inpainting

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Image inpainting is a common technique for repairing image regions that are scratched or damaged. This process involves reconstructing damaged parts and filling-in regions in which data/colour information is missing. There are many potential applications for image inpainting, such as repairing old images, repairing scratched images, removing unwanted objects, and filling-in missing areas. This paper develops an exemplar-based algorithm, one of the most important and popular image inpainting techniques, to fill-in missing regions caused by removing unwanted objects, image compression, scratches, or image transformation via the Internet. The proposed algorithm includes two phases of searching to select the best-matching information. In the first phase, the searching mechanism uses the entire image to find and select the most similar patches using the Euclidean distance. The second phase measures the distance between the location of the selected patches and the location of the patch to be filled. The performance of the proposed approach is evaluated through comprehensive experiments on several well-known images used in this area of research. The experimental results demonstrate the superior performance of the proposed approach over some state-of-the-art approaches in terms of quality in terms of both objective (using the peak signal-to-noise ratio (PSNR) as well as the structural similarity index method (SSIM)) and subjective (i.e., visual) measures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Aarti D, Mukherji P (2012) Image inpainting using multiresolution wavelet transform analysis. In: 2012 International Conference on Communication, Information & Computing Technology (ICCICT), pp. 1–6, IEEE, Mumbai

  2. Abdulla AA (2015) Exploiting similarities between secret and cover images for improved embedding efficiency and security in digital steganography. PhD thesis, University of Buckingham

  3. Ahmed MW, Abdulla AA (2020) Quality improvement for exemplar-based image inpainting using a modified searching mechanism. UHD J Sci Technol 4:1–8

  4. Ali M, Nizar B, Abdessamad H (2013) Automatic inpainting scheme for video text detection and removal. IEEE Trans Image Process 22(11):4460–4472

    Article  MathSciNet  Google Scholar 

  5. Antonio C, Patrik P, Kentaro T (2003) Object removal by exemplar-based inpainting. 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. II-II

  6. Antonio C, Patrik P, Kentaro T (2004) Region filling and object removal by exemplar-based image inpainting. IEEE Trans Image Process 13(9):1200–1212

    Article  Google Scholar 

  7. Chinmayee R, Anupama A, Bagashree P (2018) Image Inpainting using exemplar based technique with improvised data term. In: 2018 International Conference on Computational Techniques, Electronics and Mechanical Systems (CTEMS), pp. 162–166, Belgaum

  8. Chuan Q, Chin C, Ying H (2012) An inpainting-assisted reversible steganographic scheme using a histogram shifting mechanism. IEEE Trans Circuits Syst Vid Technol 23(7):1109–1118

    Google Scholar 

  9. Fidaner IB (2008) A survey on variational image inpainting, texture synthesis and image completion. Bogazici University

  10. Huang C, Chun H, Sheng L, Ling W (2005) Robust algorithm for exemplar-based image inpainting. In: Proceedings of International Conference on Computer Graphics, Imaging and Visualization, pp. 64–69, Beijing

  11. Jaspreet C, Vijay B (2015) An enhanced technique for exemplar based image inpainting. Int J Comput Appl 975(17):8887

    Google Scholar 

  12. Jing W, Daru P, Ning H, Bing B (2014) Robust object removal with an exemplar-based image inpainting approach. Neurocomputing 123:150–155, Elsevier

    Article  Google Scholar 

  13. Liang D, Ting H, Xi Z (2015) Exemplar-based image inpainting using a modified priority definition. PLoS One 10(10):1–18

    Google Scholar 

  14. Lu X, Wang W, Ma C, Shen J, Shao L, Porikli F (2019) See more, know more: Unsupervised video object segmentation with co-attention siamese networks.  Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 3623–3632

  15. Lu X, Ma C, Ni B, Yang X (2019) Adaptive region proposal with channel regularization for robust object tracking. IEEE Trans Circuits Syst Vid Technol

  16. Lu X, Wang W, Shen J, Tai YW, Crandall DJ, Hoi SC (2020) Learning video object segmentation from unlabeled videos. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 8960–8970

  17. Mahajan KS, Vaidya MB (2012) Image inpainting techniques: A survey. IOSR J Comp Eng (IOSRJCE) 5(4):45–49

    Article  Google Scholar 

  18. V. Mahalingam (2010) Digital inpainting algorithms and evaluation. PhD thesis, University of Kentucky

  19. Sergio P, Justo A, Joao F (2018) Digital Image Inpainting by Estimating Wavelet Coefficient Decays From Regularity Property and Besov Spaces. IEEE Access 7:3459–3471

    Google Scholar 

  20. Smit T, Hemant M (2016) Image inpainting based on Discrete Wavelet Transform (DWT) technique. In: 2016 Online International Conference on Green Engineering and Technologies (IC-GET), pp. 1–6, IEEE, Coimbatore

  21. Xu Y, Shuwen W (2013) Image inpainting base on color differences and structure differences. In: Proceedings of 2013 3rd International Conference on Computer Science and Network Technology, pp. 364–368, IEEE, Dalian

  22. Yogesh T, Pottigar L, Ubale V (2015) An analysis of robust exemplar-based inpainting algorithm using region segmentation and block computation. Int J Comp Sci Info Technol (IJCSIT) 6(5):4559–4562

    Google Scholar 

  23. Zahra N, Ghazale G, Nader K, Shadrokh S (2020) Image inpainting by adaptive fusion of variable spline interpolations. 25th International Computer Conference, Computer Society (CSICC), pp. 1–5, IEEE

  24. Zongben X, Jian S (2010) Image inpainting by patch propagation using patch sparsity. IEEE Trans Image Process 19(5):1153–1165

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alan Anwer Abdulla.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Abdulla, A.A., Ahmed, M.W. An improved image quality algorithm for exemplar-based image inpainting. Multimed Tools Appl 80, 13143–13156 (2021). https://doi.org/10.1007/s11042-020-10414-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10414-6

Keywords

Navigation