User-Steered Image Segmentation Using Live Markers

  • Thiago Vallin Spina
  • Alexandre Xavier Falcão
  • Paulo André Vechiatto Miranda
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6854)

Abstract

Interactive image segmentation methods have been proposed based on region constraints (user-drawn markers) and boundary constraints (anchor points). However, they have complementary strengths and weaknesses, which can be addressed to further reduce user involvement. We achieve this goal by combining two popular methods in the Image Foresting Transform (IFT) framework, the differential IFT with optimum seed competition (DIFT-SC) and live-wire-on-the-fly (LWOF), resulting in a new method called Live Markers (LM). DIFT-SC can cope with complex object silhouettes, but presents a leaking problem on weaker parts of the boundary. LWOF provides smoother segmentations and blocks the DIFT-SC leaking, but requires more user interaction. LM combines their strengths and eliminates their weaknesses at the same time, by transforming optimum boundary segments from LWOF into internal and external markers for DIFT-SC. This hybrid approach allows linear-time execution in the first interaction and sublinear-time corrections in the subsequent ones. We demonstrate its ability to reduce user involvement with respect to LWOF and DIFT-SC using several natural and medical images.

Keywords

Image Segmentation Anchor Point Connectivity Function External Marker Live Marker 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Falcão, A.X., Udupa, J.K., Samarasekera, S., Sharma, S., Hirsch, B.E., Lotufo, R.A.: User-steered image segmentation paradigms: Live-wire and live-lane. Graphical Models and Image Processing 60, 233–260 (1998)CrossRefGoogle Scholar
  2. 2.
    Mortensen, E., Barrett, W.: Interactive segmentation with intelligent scissors. Graphical Models and Image Processing 60, 349–384 (1998)CrossRefMATHGoogle Scholar
  3. 3.
    Boykov, Y., Funka-Lea, G.: Graph cuts and efficient N-D image segmentation. Intl. Journal of Computer Vision 70, 109–131 (2006)CrossRefGoogle Scholar
  4. 4.
    Falcão, A.X., Bergo, F.P.G.: Interactive volume segmentation with differential image foresting transforms. IEEE Trans. on Medical Imaging 23, 1100–1108 (2004)CrossRefGoogle Scholar
  5. 5.
    Bai, X., Sapiro, G.: Geodesic matting: A framework for fast interactive image and video segmentation and matting. Intl. Journal of Computer Vision 82, 113–132 (2009)CrossRefGoogle Scholar
  6. 6.
    Miranda, P.A.V., Falcão, A.X., Udupa, J.K.: Synergistic arc-weight estimation for interactive image segmentation using graphs. Computer Vision and Image Understanding 114, 85–99 (2010), doi:10.1016/j.cviu.2009.08.001.CrossRefGoogle Scholar
  7. 7.
    Yang, W., Cai, J., Zheng, J., Luo, J.: User-friendly interactive image segmentation through unified combinatorial user inputs. IEEE Trans. on Image Processing 19, 2470–2479 (2010)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Martelli, A.: Edge detection using heuristic search methods. Computer Graphics and Image Processing 1, 169–182 (1972)CrossRefGoogle Scholar
  9. 9.
    Falcão, A.X., Udupa, J.K., Miyazawa, F.K.: An ultra-fast user-steered image segmentation paradigm: Live-wire-on-the-fly. IEEE Trans. on Medical Imaging 19, 55–62 (2000)CrossRefGoogle Scholar
  10. 10.
    Malmberg, F., Vidholm, E., Nystrom, I.: A 3D live-wire segmentation method for volume images using haptic interaction. In: Kuba, A., Nyúl, L.G., Palágyi, K. (eds.) DGCI 2006. LNCS, vol. 4245, pp. 663–673. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  11. 11.
    Liu, J., Udupa, J.: Oriented active shape models. IEEE Trans. on Medical Imaging 28, 571–584 (2009)CrossRefGoogle Scholar
  12. 12.
    Audigier, R., Lotufo, R.: Watershed by image foresting transform, tie-zone, and theoretical relationship with other watershed definitions. In: Proceedings of the 8th Intl. Symposium on Mathematical Morphology and its Applications to Signal and Image Processing (ISMM), Rio de Janeiro, Brazil, MCT/INPE, pp. 277–288 (2007)Google Scholar
  13. 13.
    Cousty, J., Bertrand, G., Najman, L., Couprie, M.: Watershed cuts: Thinnings, shortest path forests, and topological watersheds. IEEE Trans. on Pattern Analysis and Machine Intelligence 32, 925–939 (2010)CrossRefGoogle Scholar
  14. 14.
    Udupa, J., Saha, P., Lotufo, R.: Relative fuzzy connectedness and object definition: Theory, algorithms, and applications in image segmentation. IEEE Trans. on Pattern Analysis and Machine Intelligence 24, 1485–1500 (2002)CrossRefGoogle Scholar
  15. 15.
    Ciesielski, K.C., Udupa, J.K., Falcão, A.X., Miranda, P.A.V.: Fuzzy connectedness and graph cut image segmentation: similarities and differences. In: Proceedings of SPIE on Medical Imaging: Image Processing (to appear, 2011)Google Scholar
  16. 16.
    Rother, C., Kolmogorov, V., Blake, A.: “grabcut”: Interactive foreground extraction using iterated graph cuts. ACM Trans. on Graphics 23, 309–314 (2004)CrossRefGoogle Scholar
  17. 17.
    Miranda, P.A.V., Falcão, A.X.: Links between image segmentation based on optimum-path forest and minimum cut in graph. Journal of Mathematical Imaging and Vision 35, 128–142 (2009), doi:10.1007/s10851-009-0159-9.MathSciNetCrossRefGoogle Scholar
  18. 18.
    Falcão, A.X., Stolfi, J., Lotufo, R.A.: The image foresting transform: Theory, algorithms, and applications. IEEE Trans. on Pattern Analysis and Machine Intelligence 26, 19–29 (2004)CrossRefGoogle Scholar
  19. 19.
    Miranda, P.A.V., Falcão, A.X., Spina, T.V.: The Riverbed approach for user-steered image segmentation. In: 18th International Conference on Image Processing (ICIP), Brussels, Belgium (to appear, 2011)Google Scholar
  20. 20.
    Spina, T.V., Falcão, A.X.: Intelligent understanding of user input applied to arc-weight estimation for graph-based foreground segmentation. In: Proceedings of the XXIII Conference on Graphics, Patterns and Images (SIBGRAPI), Gramado, Brazil. IEEE, Los Alamitos (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Thiago Vallin Spina
    • 1
  • Alexandre Xavier Falcão
    • 1
  • Paulo André Vechiatto Miranda
    • 1
  1. 1.Institute of ComputingUniversity of Campinas (UNICAMP)CampinasBrazil

Personalised recommendations