Interactive Point-and-Click Segmentation for Object Removal in Digital Images

  • Frank Nielsen
  • Richard Nock
Conference paper

DOI: 10.1007/11573425_13

Part of the Lecture Notes in Computer Science book series (LNCS, volume 3766)
Cite this paper as:
Nielsen F., Nock R. (2005) Interactive Point-and-Click Segmentation for Object Removal in Digital Images. In: Sebe N., Lew M., Huang T.S. (eds) Computer Vision in Human-Computer Interaction. HCI 2005. Lecture Notes in Computer Science, vol 3766. Springer, Berlin, Heidelberg


In this paper, we explore the problem of deleting objects in still pictures. We present an interactive system based on a novel intuitive user-friendly interface for removing undesirable objects in digital pictures. To erase an object in an image, a user indicates which object is to be removed by simply pinpointing it with the mouse cursor. As the mouse cursor rolls over the image, the current implicit selected object’s border is highlighted, providing a visual feedback. In case the computer-segmented area does not match the users’ perception of the object, users can further provide a few inside/outside object cues by clicking on a small number of object or nonobject pixels. Experimentally, a small number of such cues is generally enough to reach a correct matching, even for complex textured images. Afterwards, the user removes the object by clicking the left mouse button, and a hole-filling technique is initiated to generate a seamless background portion. Our image manipulation system consists of two components: (i) fully automatic or partially user-steered image segmentation based on an improved fast statistical region-growing segmentation, and (ii) texture synthesis or image inpainting of irregular shaped hole regions. Experiments on a variety of photographs display the ability of the system to handle complex scenes with highly textured objects.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Frank Nielsen
    • 1
  • Richard Nock
    • 2
  1. 1.Sony Computer Science Laboratories, Inc. 
  2. 2.Université Antilles-Guyane 

Personalised recommendations