Abstract
In this paper, we explore the problem of deleting objects in still pictures. We present an interactive system based on a novel intuitive user-friendly interface for removing undesirable objects in digital pictures. To erase an object in an image, a user indicates which object is to be removed by simply pinpointing it with the mouse cursor. As the mouse cursor rolls over the image, the current implicit selected object’s border is highlighted, providing a visual feedback. In case the computer-segmented area does not match the users’ perception of the object, users can further provide a few inside/outside object cues by clicking on a small number of object or nonobject pixels. Experimentally, a small number of such cues is generally enough to reach a correct matching, even for complex textured images. Afterwards, the user removes the object by clicking the left mouse button, and a hole-filling technique is initiated to generate a seamless background portion. Our image manipulation system consists of two components: (i) fully automatic or partially user-steered image segmentation based on an improved fast statistical region-growing segmentation, and (ii) texture synthesis or image inpainting of irregular shaped hole regions. Experiments on a variety of photographs display the ability of the system to handle complex scenes with highly textured objects.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Barrett, W.A., Cheney, A.S.: Object-based image editing. In: ACM SIGGRAPH, pp. 777–784 (2002)
Criminisi, P.: Perez, and K. Toyama. Region filling and object removal by exemplar-based inpainting. IEEE Transactions on Image Processing 13(9), 1200–1212 (2004)
Falcão, X., Lotufo, R.A., Araújo, G.: The image foresting transformation. Technical Report #IC-00-12 (2000)
Gleicher, M.: Image snapping. In: ACM SIGGRAPH, pp. 183–190 (1995)
Li, Y., Sun, J., Tang, C.-K., Shum, H.-Y.: Lazy snapping. ACM Trans. Graph. 23(3), 303–308 (2004)
Lin, S., Zhang, Q., Shi, J.: Alpha estimation in perceptual color space. In: Proc. IEEE ICASSP (2005)
Mortensen, E.N., Barrett, W.A.: Intelligent scissors for image composition. In: ACM SIGGRAPH, pp. 191–198 (1995)
Mortensen, E.N., Barrett, W.A.: Toboggan-based intelligent scissors with a four-parameter edge model. In: IEEE CVPR, pp. 2452–2458 (1999)
Nielsen, F.: Visual Computing: Geometry, Graphics, and Vision. Charles River Media, Hingham (2005) ISBN: 1-58450-427-7
Nock, R., Nielsen, F.: Semi-supervised statistical region refinement for color image segmentation. Pattern Recognition 38(6), 835–846 (2005)
Pérez, P., Blake, A., Gangnet, M.: Jetstream: Probabilistic contour extraction with particles. In: IEEE ICCV, pp. 524–531 (2001)
Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. ACM Trans. Graph. 22(3), 313–318 (2003)
Rosenfeld, A.: Picture processing by computer. Academic Press, London (1969)
Rother, C., Kolmogorov, V., Blake, A.: Grabcut: Interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. 23(3), 309–314 (2004)
Sun, J., Jia, J., Tang, C.-K., Shum, H.-Y.: Poisson matting. ACM Trans. Graph. 23(3), 315–321 (2004)
Tan, K.-H., Ahuja, N.: Selecting objects with freehand sketches. In: IEEE ICCV, pp. 337–344 (2001)
Tarjan, R.E.: Efficiency of a good but not linear set union algorithm. J. ACM 22 (2), 215–225 (1975)
Telea, A.: An image inpainting technique based on the fast marching method. Journal of Graphics Tools 9(1), 23–34 (2004)
Wei, L.-Y., Levoy, M.: Fast texture synthesis using tree-structured vector quantization. In: ACM SIGGRAPH, pp. 479–488 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nielsen, F., Nock, R. (2005). Interactive Point-and-Click Segmentation for Object Removal in Digital Images. In: Sebe, N., Lew, M., Huang, T.S. (eds) Computer Vision in Human-Computer Interaction. HCI 2005. Lecture Notes in Computer Science, vol 3766. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11573425_13
Download citation
DOI: https://doi.org/10.1007/11573425_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29620-1
Online ISBN: 978-3-540-32129-3
eBook Packages: Computer ScienceComputer Science (R0)