Abstract
A novel inpainting method based on probabilistic structure estimation has been developed. The method consists of two steps. First, an initial image, which captures rough structure and colors in the missing region, is estimated. This image is generated by probabilistically interpolating the gradient inside the missing region, and then by flooding the colors on the boundary into the missing region using Markov Random Field. Second, by locally replacing the missing region with local patches similar to both the adjacent patches and the initial image, the inpainted image is synthesized. Since the patch replacement process is guided by the initial image, the inpainted image is guaranteed to preserve the underlying structure. This also enables patches to be replaced in a greedy manner, i.e. without optimization. Experiments show the proposed method outperforms previous methods in terms of both subjective image quality and computational speed.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.B.: Patchmatch: A randomized correspondence algorithm for structural image editing. In: Proc. of ACM SIGGRAPH, vol. 29 (2009)
Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: Proc. of ACM SIGGRAPH, pp. 417–424 (2000)
Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. on PAMI 23, 1222–1239 (2001)
Chan, F.T., Shen, J.: Non-texture inpainting by curvature-driven diffusions. J. of VCIR 12, 436–449 (2001)
Chen, Y., Luan, Y., Li, H., Au, C.O.: Sketch-guided texture-based image inpainting. In: Proc. of ICIP, pp. 1997–2000 (2006)
Criminisi, A., Pérez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. on IP 13, 1200–1212 (2004)
Harrison, P.: A Non-hierarchical procedure for re-synthesis of complex texture. In: Proc. of WSCG, pp. 190–197 (2001)
Jia, J., Tang, K.C.: Image repairing: robust image synthesis by adaptive ND tensor voting. In: Proc. of CVPR, pp. 643–650 (2003)
Kawai, N., Sato, T., Yokoya, N.: Image inpainting considering brightness change and spatial locality of textures. In: Proc. of VISAPP, vol. 1, pp. 66–73 (2008)
Komodakis, N., Tziritas, G.: Image completion using efficient belief propagation via priority scheduling and dynamic pruning. IEEE Trans. on IP 16, 2649–2661 (2007)
Li, R.B., Qi, Y., Shen, K.X.: An image inpainting method. In: Conf. on CAD and Computer Graphics, pp. 531–536 (2005)
Pritch, Y., Kav-Venaki, E., Peleg, S.: Shift-map image editing. In: Proc. of ICCV, pp. 151–158 (2009)
Sun, J., Yuan, L., Jia, J., Shum, Y.H.: Image completion with structure propagation. In: Proc. of ACM SIGGRAPH, pp. 861–868 (2005)
Wexler, Y., Shechtman, E., Irani, M.: Space-time completion of video. IEEE Trans. of PAMI 29, 463–476 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Shibata, T., Iketani, A., Senda, S. (2011). Image Inpainting Based on Probabilistic Structure Estimation. In: Kimmel, R., Klette, R., Sugimoto, A. (eds) Computer Vision – ACCV 2010. ACCV 2010. Lecture Notes in Computer Science, vol 6494. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19318-7_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-19318-7_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-19317-0
Online ISBN: 978-3-642-19318-7
eBook Packages: Computer ScienceComputer Science (R0)