Digital Image Completion Techniques

Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 107)

Abstract

Image completion is a hot research topic in the multi-disciplinary area of computer graphics, image and video processing, and computer vision. It provides a strong tool for the reuse of captured images and photos, and shows its extensive applications in cultural heritage protection, special visual effects, image and video editing, and virtual reality. As the existing survey papers are out of date, its recent developments are summarized in three parts. First, its technical background is described for readers who are not familiar with it. Then, a comprehensive survey of the state-of-the-art methods is made to guide readers that are interested. Finally, a vision for future work is sketched to help motivate its further progress.

Keywords

Image completion Inpainting Repairing Retouching Object removal 

Notes

Acknowledgments

This project is supported by the National Natural Science Foundation of China under Grant No. 61003188, and Technology Plan Program of Zhejiang Province under Grant No. 2009C11034, and Zhejiang Provincial Natural Science Foundation of China under Grant No. Y1111159, No. Z1101243 and No. Z1111051.

References

  1. 1.
    Collis B, Kokaram A (2004) Filling in the gaps. IEE Electron Syst Softw 2(4):22–28CrossRefGoogle Scholar
  2. 2.
    Shen JH (2003) Inpainting and the fundamental problem of image processing. SIAM News 36(5):1–4Google Scholar
  3. 3.
    Shih TK, Chang RC (2005) Digital inpainting—survey and multilayer image inpainting algorithms. In: Proceedings of ICITA, pp 15–24Google Scholar
  4. 4.
    Tauber Z, Li ZN, Drew MS (2007) Review and preview: disocclusion by inpainting for image-based rendering. IEEE Trans on Syst Man,Cybernetics–Part C: Appl Rev 37(4):527–540CrossRefGoogle Scholar
  5. 5.
    Bertalmio M, Sapiro G, Caselles V, Ballester C (2000) Image inpainting. In: Proceedings of the ACM SIGGRAPH 2000. New Orleans, pp 417–424Google Scholar
  6. 6.
    Chan TF, Shen J (2001) Nontexture inpainting by curvature-driven diffusions. J Vis Commun Image Represent 12:436–449CrossRefGoogle Scholar
  7. 7.
    Acton AT, Mukherjee DP, Havlicek JP, Bovik AC (2001) Oriented texture completion by AM-FM reaction-diffusion. IEEE Trans Image Process 10(6):885–896CrossRefMATHGoogle Scholar
  8. 8.
    Chan TF, Shen JH (2005) Variational image inpainting. Commun Pure Appl Math 58(5):579–619CrossRefMATHMathSciNetGoogle Scholar
  9. 9.
    Chan TF, Shen JH, Zhou HM (2006) Total variation wavelet inpainting. J Math Imaging Vis 25(1):107–125CrossRefMathSciNetGoogle Scholar
  10. 10.
    Dobrosotskaya JA, Bertozzi AL (2008) A Wavelet-Laplace variational technique for image deconvolution and inpainting. IEEE Trans Image Process 17(5):657–663CrossRefMathSciNetGoogle Scholar
  11. 11.
    Drori I, Cohen-Or D, Yeshurum H (2003) Fragment-based image completion. ACM Trans Graph 22(3):303–312CrossRefGoogle Scholar
  12. 12.
    Criminisi A, Pérez P, Toyama K (2004) Region filling and object removal by exemplar-based image inpainting. IEEE Trans Image Process 13(9):1200–1212CrossRefGoogle Scholar
  13. 13.
    Tang F, Ying YT, Wang J, Peng QS (2004) A Novel Texture Synthesis Based Algorithm for Object Removal in Photographs. In: Proceedings of the 9th Asian Computing Science Conf. LNCS 3321, Chiang Mai, 248-258Google Scholar
  14. 14.
    Komodakis N, Tziritas G (2007) Image completion using efficient belief propagation via priority scheduling and dynamic pruning. IEEE Trans Image Process 16(11):2649–2661CrossRefMathSciNetGoogle Scholar
  15. 15.
    Bertalmio M, Vese L, Sapiro G, Osher S (2003) Simultaneous structure and texture image inpainting. IEEE Trans Image Process 12(8):882–889CrossRefGoogle Scholar
  16. 16.
    Rane SD, Sapiro G, Bertalmio M (2003) Structure and texture filling-in of missing image blocks in wireless transmission and compression applications. IEEE Trans Image Process 12(3):296–303CrossRefMathSciNetGoogle Scholar
  17. 17.
    Grossauer H (2004) A combined PDE and texture synthesis approach to inpainting. Lecture Notes in Computer Science, ECCV’2004, 3022, 214–224 Google Scholar
  18. 18.
    Elad M, Starck JL, Querre P, Donoho DL (2005) Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA). Appl Comput Harmon Anal 19:340–358Google Scholar
  19. 19.
    Jia JY, Tang CK (2003) Image repairing: robust image synthesis by adaptive ND tensor voting. In: Proceedings of the IEEE CVPR 1, pp 643–650Google Scholar
  20. 20.
    Levin A, Zomet A, Weiss Y (2003) Learning how to inpaint from global image statistics. In: Proceedings of the IEEE ICCV 1, pp 305–312Google Scholar
  21. 21.
    Fadili MJ, Starck JL (2005) EM Algorithm for sparse representation-based image inpainting. In: Proceedings of the IEEE ICIP. 2, pp 61–64Google Scholar
  22. 22.
    Zhu B, Li HD (2005) Image Completion from Low-Level Learning. In: Proceedings of the Digital Imaging Computing: Techniques and Applications (DICTA’2005)Google Scholar
  23. 23.
    Roth S, Black MJ (2005) Fields of experts: a framework for learning image priors. Proceedings of the IEEE CVPR 2, pp 860–867Google Scholar
  24. 24.
    Sun J, Lu Y, Jia JY, Shum HY (2005) Image completion with structure propagation. ACM Trans Graph 24(3):861–868CrossRefGoogle Scholar
  25. 25.
    Pavić D, Schonefeld V, Kobbelt L (2006) Interactive image completion with perspective correction. The Vis Comput PG 2006, 22(9–11), pp 671–681Google Scholar
  26. 26.
    Barnes C, Shechtman E, Finkelstein A, Goldman DB (2009) Patch-Match: a randomized correspondence algorithm for structural image editing. ACM Trans Graph 28(3), Article 24:1–11Google Scholar
  27. 27.
    Hays JH, Efros AA (2007) Scene completion using millions of photographs. ACM Trans Graph 26(3):4–1–7CrossRefGoogle Scholar
  28. 28.
    Liu CX, Yang YZ, Peng QS, Wang J, Chen W (2008) Distortion optimization based image completion from a large displacement view. Comput Graph Forum 27(7):1755–1764CrossRefGoogle Scholar
  29. 29.
    Liu CX, Guo YW, Pan L, Peng QS, Zhang FY (2007) Image completion based on the views of large displacement. The Vis Comput 23(9):833–841CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media B.V. 2012

Authors and Affiliations

  • Chao Huang
    • 1
  • Huadong Hu
    • 1
  • Chunxiao Liu
    • 1
  • Caiyan Xie
    • 1
  1. 1.College of Computer Science and Information EngineeringZhejiang Gongshang UniversityHangzhouPeople’s Republic of China

Personalised recommendations