Skip to main content
SpringerLink
Log in

Image Inpainting Algorithm Based on Saliency Map and Gray Entropy

  • Research Article - Computer Engineering and Computer Science
  • Published:
Arabian Journal for Science and Engineering Aims and scope Submit manuscript

Abstract

Image inpainting algorithms based on separated priority are easily misled by image texture information, have poor accuracy in searching for matching patches with high priority and often result in inconsistent texture propagation and edge structure. Additionally, it is difficult to obtain the best-matching patch within a fixed range based on only color information. By considering the attention point of human vision and the statistical information of an image, an image inpainting algorithm based on saliency mapping and gray entropy is proposed. A saliency map is added to the priority stage, which ensures that the parts with strong structural information and visual importance are completed preferentially. The best-matching patch is determined by comprehensively considering the color information and saliency features. The search range of the matching patch is adaptively controlled based on gray entropy. Experiments concerning scratch damage, text removal and large area object removal are compared. The results of the proposed method have better visual effects and are superior in regard to the consistency of the edge structure and texture. The efficiency is similar to methods with a fixed local search range. The objective evaluation results also validate the performance of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Guillemot, C.; Le Meur, O.: Image inpainting: overview and recent advances. IEEE Signal Process. Mag. 31(1), 127–144 (2014)

    Article  Google Scholar 

  2. Jiexian, Z.; Can, W.: Image completion based on redefined priority and image division. J. Image Graph. 22(9), 1183–1193 (2017)

    Google Scholar 

  3. Peter, P.; Kaufhold, L.; Weickert, J.: Turning diffusion-based image colorization into efficient color compression. IEEE Trans. Image Process. 26(2), 860–869 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  4. Li, H.; Luo, W.; Huang, J.: Localization of diffusion-based inpainting in digital images. IEEE Trans. Inf. Forensics Secur. 12(12), 3050–3064 (2017)

    Article  Google Scholar 

  5. Sharma, N.K.; Sinha, D.G.R.: Reversible steganography using improved curvature driven diffusion based image inpainting. CiiT Int. J. Dig. Image Process. 8(5), 159–164 (2016)

    Google Scholar 

  6. Criminisi, A.; Pérez, P.; Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. Image Process. 13(9), 1200–1212 (2004)

    Article  Google Scholar 

  7. Zhang, Q.; Lin, J.: Exemplar-based image inpainting using color distribution analysis. J. Inf. Sci. Eng. 28(4), 641–654 (2012)

    MathSciNet  Google Scholar 

  8. Buyssens, P.; Daisy, M.; Tschumperlé, D.: Exemplar-based inpainting: technical review and new heuristics for better geometric reconstructions. IEEE Trans. Image Process. 24(6), 1809–1824 (2015)

    MathSciNet  MATH  Google Scholar 

  9. Goyal, P.; Diwakar, S.: Fast enhanced algorithm for exemplar based image inpainting. In: Image and Video Technology (PSIVT), Fourth Pacific-Rim Symposium on IEEE, pp. 325–330 (2010)

  10. Martinez-Noriega, R.; Roumy, A.: Prior and macro-filling order for image completion. In: 2013 IEEE International Conference on Image Processing. IEEE, pp. 719–723 (2013)

  11. He, K.; Sun, J.: Image completion approaches using the statistics of similar patches. IEEE Trans. Pattern Anal. Mach. Intell. 36(12), 2423–2435 (2014)

    Article  Google Scholar 

  12. Ružić, T.; Pižurica, A.: Context-aware patch-based image inpainting using Markov random field modeling. IEEE Trans. Image Process. 24(1), 444–456 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  13. Deng, L.J.; Huang, T.Z.; Zhao, X.L.: Exemplar-based image inpainting using a modified priority definition. PLoS ONE (2015). https://doi.org/10.1371/journal.pone.0141199

  14. Huaming, L.; Xuehui, B.; Zhongfu, Y.; Weilan, W.: Arc promoting image inpainting using exemplar searching and priority filling. J. Image Graph. 21(8), 993–1003 (2016)

    Google Scholar 

  15. Hou, X.; Zhang, L.: Saliency detection: A spectral residual approach. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, pp. 1–8 (2007)

Download references

Author information

Authors and Affiliations

  1. Institute of Computer Vision, Nanchang Hangkong University, Nanchang, 330063, China

    Jiexian Zeng, Xiang Fu, Lu Leng & Can Wang

Authors
  1. Jiexian Zeng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiang Fu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lu Leng
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Can Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiang Fu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zeng, J., Fu, X., Leng, L. et al. Image Inpainting Algorithm Based on Saliency Map and Gray Entropy. Arab J Sci Eng 44, 3549–3558 (2019). https://doi.org/10.1007/s13369-018-3592-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13369-018-3592-5

Keywords

Search

Navigation