Image In-painting by Band Matching, Seamless Cloning and Area Sub-division

  • Subin Lee
  • Yongduek Seo
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4872)


We propose a novel image in-painting method composed of two parts: band matching and seamless cloning. In band matching, a band enclosing the boundary of a missing region is compared to those from the other parts of the image. The inner area of the minimum difference band is then copied to the missing region. Even though this band matching results in successful in-painting in many practical applications, brightness discontinuity (a seam) may appear between the filled missing region and its neighborhood. We apply seamless-cloning to remove such discontinuity between the two regions. Examples show that this two step approach can provide a very fast and effective image in-painting. However, since this basic method using one patch may not deal with cases where there are abrupt changes of color or brightness along the boundary, we furthermore devise one more step: target sub-division. The target area is subdivided into small sub-areas, and the band matching and seamless cloning is applied to each of them. This sub-division is done also when the missing region is too large or the user wants to see more candidates to choose a better one. The multiple results from the sub-division are then ordered according to in-painting quality, which is measured based the edge map or discontinuity map along the boundary band. Our algorithm is demonstrated with various experiments using real images.


image in-painting band matching seamless cloning area sub-division 


  1. 1.
    Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image Inpainting. In: Proc. ACM SIGGRAPH, New Orleans, Louisiana, USA, pp. 417–424 (2000)Google Scholar
  2. 2.
    Bertalmío, M., Bertozzi, A., Sapiro, G.: Navier-Stokes, Fluid-Dynamics and Image and Video Inpainting. In: Proc. Conference on Computer Vision and Pattern Recognition, Hawaii, USA, pp. 355–362 (2001)Google Scholar
  3. 3.
    Chan, T., Shen, J.: Mathematical Models for Local Nontexture Inpaintings. SIAM Journal on Applied Mathematics, 1019–1043 (2002) Google Scholar
  4. 4.
    Criminisi, A., Perez, P., Toyama, K.: Object Removal By Exemplar-Based Inpainting. In: Proc. Conference on Computer Vision and Pattern Recognition, Wisconsin, USA, pp. 721–728 (2003)Google Scholar
  5. 5.
    Drori, I., Cohen-Or, D., Yeshurun, H.: Fragment-Based Image Completion. In: Proc. ACM Transactions on Graphics, SIGGRAPH, San Diego, California, USA, pp. 303–312 (2003)Google Scholar
  6. 6.
    Efros, A.A., Leung, T.K.: Texture Synthesis by Non-parametric Sampling. In: Proc. International Conference on Computer Vision, Kerkyra, Corfu, Greece, pp. 1033–1038 (1999)Google Scholar
  7. 7.
    Georgiev, T.: Covariant Derivatives and Vision. In: Proc. European Conference on Computer Vision, Graz, Austria, pp. 56–69 (2006)Google Scholar
  8. 8.
    Jia, J., Sun, J., Tang, C.K., Shum, H.Y.: Drag-and-Drop Pasting. In: Proc. ACM SIGGRAPH, Los Angeles, California, USA, pp. 631–637 (2005)Google Scholar
  9. 9.
    Komodakis, N., Tziritas, G.: Image Completion Using Global Optimization. In: Proc. Conference on Computer Vision and Pattern Recognition, New York, NY, USA, pp. 442–452 (2006)Google Scholar
  10. 10.
    Kwatra, V., Schodl, A., Essa, I., Turk, G., Bobick, A.: Graphcut Textures: Image and Video Synthesis Using Graph Cuts. In: Proc. ACM SIGGRAPH, San Diego, USA, pp. 277–286 (2003)Google Scholar
  11. 11.
    Perez, P., Gangnet, M., Blake, A.: PatchWorks: Example-Based Region Tiling for Image Editing, Technical Report MSR-TR-2004-04 Google Scholar
  12. 12.
    Perez, P., Gangnet, M., Blake, A.: Poisson Image Editing. In: Proc. ACM SIGGRAPH, San Diego, California, USA, pp. 313–318 (2003)Google Scholar
  13. 13.
    Shen, J., Jin, X., Zhou, C., Wang, C.C.L.: Gradient Based Image Completion by Solving Poisson Equation. PCM, 257–268 (2005)Google Scholar
  14. 14.
    Sun, J., Yuan, L., Jia, J., Shum, H.Y.: Image Completion with Structure Propagation. In: Proc. ACM SIGGRAPH, Los Angeles, California, USA, pp. 861–868 (2005)Google Scholar
  15. 15.
    Wilczkowiak, M., Brostow, G.J., Tordoff, B., Cipolla, R.: Hole Filling Through Photomontage. In: British Machine Vision Conference, Oxford, UK, pp. 492–501 (2005)Google Scholar
  16. 16.
    Yamauchi, H., Harber, J., Seidel, H.P.: Image Restoration using Multiresolution Texture Synthesis and Image Inpainting. In: Proc. Computer Graphics International, Tokyo, Japan, pp. 120–125 (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Subin Lee
    • 1
  • Yongduek Seo
    • 1
  1. 1.Sogang University, SeoulKorea

Personalised recommendations