Advertisement

Image Inpainting Algorithm Based on Saliency Map and Gray Entropy

  • Jiexian Zeng
  • Xiang Fu
  • Lu Leng
  • Can Wang
Research Article - Computer Engineering and Computer Science

Abstract

Image inpainting algorithms based on separated priority are easily misled by image texture information, have poor accuracy in searching for matching patches with high priority and often result in inconsistent texture propagation and edge structure. Additionally, it is difficult to obtain the best-matching patch within a fixed range based on only color information. By considering the attention point of human vision and the statistical information of an image, an image inpainting algorithm based on saliency mapping and gray entropy is proposed. A saliency map is added to the priority stage, which ensures that the parts with strong structural information and visual importance are completed preferentially. The best-matching patch is determined by comprehensively considering the color information and saliency features. The search range of the matching patch is adaptively controlled based on gray entropy. Experiments concerning scratch damage, text removal and large area object removal are compared. The results of the proposed method have better visual effects and are superior in regard to the consistency of the edge structure and texture. The efficiency is similar to methods with a fixed local search range. The objective evaluation results also validate the performance of the proposed method.

Keywords

Image inpainting Saliency map Gray entropy Priority 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Guillemot, C.; Le Meur, O.: Image inpainting: overview and recent advances. IEEE Signal Process. Mag. 31(1), 127–144 (2014)CrossRefGoogle Scholar
  2. 2.
    Jiexian, Z.; Can, W.: Image completion based on redefined priority and image division. J. Image Graph. 22(9), 1183–1193 (2017)Google Scholar
  3. 3.
    Peter, P.; Kaufhold, L.; Weickert, J.: Turning diffusion-based image colorization into efficient color compression. IEEE Trans. Image Process. 26(2), 860–869 (2017)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Li, H.; Luo, W.; Huang, J.: Localization of diffusion-based inpainting in digital images. IEEE Trans. Inf. Forensics Secur. 12(12), 3050–3064 (2017)CrossRefGoogle Scholar
  5. 5.
    Sharma, N.K.; Sinha, D.G.R.: Reversible steganography using improved curvature driven diffusion based image inpainting. CiiT Int. J. Dig. Image Process. 8(5), 159–164 (2016)Google Scholar
  6. 6.
    Criminisi, A.; Pérez, P.; Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. Image Process. 13(9), 1200–1212 (2004)CrossRefGoogle Scholar
  7. 7.
    Zhang, Q.; Lin, J.: Exemplar-based image inpainting using color distribution analysis. J. Inf. Sci. Eng. 28(4), 641–654 (2012)MathSciNetGoogle Scholar
  8. 8.
    Buyssens, P.; Daisy, M.; Tschumperlé, D.: Exemplar-based inpainting: technical review and new heuristics for better geometric reconstructions. IEEE Trans. Image Process. 24(6), 1809–1824 (2015)MathSciNetGoogle Scholar
  9. 9.
    Goyal, P.; Diwakar, S.: Fast enhanced algorithm for exemplar based image inpainting. In: Image and Video Technology (PSIVT), Fourth Pacific-Rim Symposium on IEEE, pp. 325–330 (2010)Google Scholar
  10. 10.
    Martinez-Noriega, R.; Roumy, A.: Prior and macro-filling order for image completion. In: 2013 IEEE International Conference on Image Processing. IEEE, pp. 719–723 (2013)Google Scholar
  11. 11.
    He, K.; Sun, J.: Image completion approaches using the statistics of similar patches. IEEE Trans. Pattern Anal. Mach. Intell. 36(12), 2423–2435 (2014)CrossRefGoogle Scholar
  12. 12.
    Ružić, T.; Pižurica, A.: Context-aware patch-based image inpainting using Markov random field modeling. IEEE Trans. Image Process. 24(1), 444–456 (2015)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Deng, L.J.; Huang, T.Z.; Zhao, X.L.: Exemplar-based image inpainting using a modified priority definition. PLoS ONE (2015).  https://doi.org/10.1371/journal.pone.0141199 CrossRefGoogle Scholar
  14. 14.
    Huaming, L.; Xuehui, B.; Zhongfu, Y.; Weilan, W.: Arc promoting image inpainting using exemplar searching and priority filling. J. Image Graph. 21(8), 993–1003 (2016)Google Scholar
  15. 15.
    Hou, X.; Zhang, L.: Saliency detection: A spectral residual approach. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, pp. 1–8 (2007)Google Scholar

Copyright information

© King Fahd University of Petroleum & Minerals 2018

Authors and Affiliations

  1. 1.Institute of Computer VisionNanchang Hangkong UniversityNanchangChina

Personalised recommendations