Skip to main content
SpringerLink
Log in

A novel patch matching algorithm for exemplar-based image inpainting

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In the existing exemplar-based image inpainting algorithms, the Sum of Squared Differences (SSD) method is employed to measure the similarities between patches in a fixed size, and then using the most similar one to inpaint the destroyed region. However, sometimes only calculating the SSD difference would produce a discontinuous structure and blur the texture. To solve this problem, we firstly optimize the inpainting priority function and proposed an adaptive patch method to obtain more significant patches. The adaptive patch method changes the size of the patch by computing the patch sparsity. Secondly the proposed method calculates the maximum similarity between patches in different rotation angles so that it obtains the most similar rotation invariant matching patch. From the experimental results, the proposed method can improve the accuracy of the patch selection process compared with the traditional methods, and the proposed method can keep a better global visual appearance, especially for the image which contains more structure contents and the images whose destroyed region has a large width.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Andris S, Peter P, Weickert J (2016) A proof-of-concept framework for PDE-based video compression.  In: Picture Coding Symposium (PCS), 1-5

  2. Bertalmio M, Sapiro G, Caselles V and Ballester C (2000) Image in-painting. In: Proc. SIGGRAPH, 2000:417–424

  3. Chan T, Shen J (2001) Local inpainting models and tv inpainting. SIAM J Appl Math 62(3):1019–1043

    MathSciNet  Google Scholar 

  4. Chan T, Shen J (2001) Non-texture inpainting by curvature-driven diffusions. J Vis Commun Image Represent 4(12):436–449

    Article  Google Scholar 

  5. Criminisi A, Perez P, Toyama K (2004) Region filling and object removal by examplar-based image inpainting. IEEE Trans Image Process 33:1200–1212

    Article  Google Scholar 

  6. Hu H (2015) Application of curvature driven diffusion model in lateral multi-lens video logging image inpainting. 12th IEEE International Conference on Electronic Measurement & Instruments (ICEMI) (3):1167-1171

  7. Huang H-Y, Hsiao C-N (2010) A patch-based image inpainting based on structure consistence. Computer Symposium (ICS): 165-170

  8. Lu H, Zhang Y, Li Y, Zhou Q, Tadoh R, Uemura T, Kim H, Serikawa S (2017) Depth map reconstruction for underwater kinect camera using inpainting and local image mode filtering. IEEE Access 5:7115–7122

    Article  Google Scholar 

  9. Mairal J, Elad M, Sapiro G (2008) Sparse representation for color image restoration. IEEE Trans Image Process 17(1):53–69

    Article  MathSciNet  MATH  Google Scholar 

  10. Munawar A, Creusot C (2015) Structural inpainting of road patches for anomaly detection., 14th IAPR International Conference on Machine Vision Applications (MVA): 41-44

  11. Ou J, Chen W, Pan B, Li Y (2016) A new image inpainting algorithm based on DCT similar patches features. In: Computational Intelligence and Security (CIS): 152-155

  12. Papyan V, Elad M (2016) Multi-scale patch-based image restoration. IEEE Trans Image Process 25(1):249–261

    Article  MathSciNet  Google Scholar 

  13. Ram I, Elad M, Cohen I (2013) Image processing using smooth ordering of its patches. IEEE Trans Image Process 22(7):2764–2774

    Article  MathSciNet  MATH  Google Scholar 

  14. Ružić T, Pižurica A (2015) Context-aware patch-based image Inpainting using Markov random field modeling. IEEE Trans Image Process 24(1):444–456

    Article  MathSciNet  Google Scholar 

  15. Telea A (2004) An image in-painting technique based on the fast marching method. J Graph Tools 9(1):23–34

    Article  Google Scholar 

  16. Ullo SL, Di Bisceglie M, Galdi C (2011) A new algorithm for noise reduction and quality improvement in SAR interferograms using inpainting and diffusion. In: Geoscience and Remote Sensing Symposium (IGARSS): 3602-3605

  17. Umarani AT, Kulkarni PJ (2016) A novel scheme of color image inpainting by prioritized patches, in Advanced Communication Control and Computing Technologies (ICACCCT): 233-237

  18. Wang H (2015) Inpainting of Potala Palace murals based on sparse representation. In: Biomedical Engineering and Informatics (BMEI): 737-741

  19. Xu Z, Sun J (2010) Image inpainting by patch propagation using patch sparsity. IEEE Trans Image Process 19(5):1153–1165

    Article  MathSciNet  MATH  Google Scholar 

  20. Yang Y, Juan X (2009) An improved image in-painting algorithm based on fast marching method. J Xi'an Univ Technol 25(2):129–134

    MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering and Electronics, Kyushu Institute of Technology, Sensui-cho 1-1, Tobata-ku, Kitakyushu-shi, Fukuoka, 804-0015, Japan

    Qian Fan & Lifeng Zhang

Authors
  1. Qian Fan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lifeng Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qian Fan.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fan, Q., Zhang, L. A novel patch matching algorithm for exemplar-based image inpainting. Multimed Tools Appl 77, 10807–10821 (2018). https://doi.org/10.1007/s11042-017-5077-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-5077-z

Keywords

Search

Navigation