Shape Sharing for Object Segmentation

  • Jaechul Kim
  • Kristen Grauman
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7578)


We introduce a category-independent shape prior for object segmentation. Existing shape priors assume class-specific knowledge, and thus are restricted to cases where the object class is known in advance. The main insight of our approach is that shapes are often shared between objects of different categories. To exploit this “shape sharing” phenomenon, we develop a non-parametric prior that transfers object shapes from an exemplar database to a test image based on local shape matching. The transferred shape priors are then enforced in a graph-cut formulation to produce a pool of object segment hypotheses. Unlike previous multiple segmentation methods, our approach benefits from global shape cues; unlike previous top-down methods, it assumes no class-specific training and thus enhances segmentation even for unfamiliar categories. On the challenging PASCAL 2010 and Berkeley Segmentation datasets, we show it outperforms the state-of-the-art in bottom-up or category-independent segmentation.


Test Image Global Shape Object Segmentation Segmentation Quality Shape Prior 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Hoiem, D., Efros, A., Hebert, M.: Geometric context from a single image. In: ICCV (2005)Google Scholar
  2. 2.
    Malisiewicz, T., Efros, A.: Improving Spatial Support for Objects via Multiple Segmentations. In: BMVC (2007)Google Scholar
  3. 3.
    Carreira, J., Sminchisescu, C.: Constrained Parametric Min-Cuts for Automatic Object Segmentation. In: CVPR (2010)Google Scholar
  4. 4.
    Endres, I., Hoiem, D.: Category Independent Object Proposals. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part V. LNCS, vol. 6315, pp. 575–588. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  5. 5.
    van de Sande, E., Uijlingsy, J., Gevers, T., Smeulders, A.: Segmentation as Selective Search for Object Recognition. In: ICCV (2011)Google Scholar
  6. 6.
    Borenstein, E., Ullman, S.: Class-Specific, Top-Down Segmentation. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part II. LNCS, vol. 2351, pp. 109–122. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  7. 7.
    Levin, A., Weiss, Y.: Learning to Combine Bottom-Up and Top-Down Segmentation. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 581–594. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  8. 8.
    Mairal, J., Leordeanu, M., Bach, F., Hebert, M., Ponce, J.: Discriminative Sparse Image Models for Class-Specific Edge Detection and Image Interpretation. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part III. LNCS, vol. 5304, pp. 43–56. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  9. 9.
    Chan, T., Zhu, W.: Level Set Based Shape Prior Segmentation. In: CVPR (2005)Google Scholar
  10. 10.
    Arbelaez, P., Maire, M., Fowlkes, C., Malik, J.: Contour Detection and Hierarchical Image Segmentation. PAMI, 33 (2011)Google Scholar
  11. 11.
    Vu, N., Manjunath, B.: Shape Prior Segmentation of Multiple Objects with Graph Cuts. In: CVPR (2008)Google Scholar
  12. 12.
    Brox, T., Bourdev, L., Maji, S., Malik, J.: Object Segmentation by Alignment of Poselet Activations to Image Contours. In: CVPR (2011)Google Scholar
  13. 13.
    Torralba, A., Murphy, K., Freeman, W.: Sharing Visual Features for Multiclass and Multiview Object Detection. PAMI 29 (2007)Google Scholar
  14. 14.
    Opelt, A., Pinz, A., Zisserman, A.: Incremental Learning of Object Detectors Using a Visual Shape Alphabet. In: CVPR (2006)Google Scholar
  15. 15.
    Zhu, L., Chen, Y., Yuille, A., Freeman, W.: Latent Hierarchical Structure Learning for Object Detection. In: CVPR (2010)Google Scholar
  16. 16.
    Fidler, S., Boben, M., Leonardis, A.: Similarity-Based Cross-Layered Hierarchical Representation for Object Categorization. In: CVPR (2008)Google Scholar
  17. 17.
    Fei-Fei, L., Fergus, R., Perona, P.: A Bayesian Approach to Unsupervised One-Shot Learning of Object Categories. In: ICCV (2003)Google Scholar
  18. 18.
    Stark, M., Goesele, M., Schiele, B.: A Shape-based Object Class Model for Knowledge Transfer. In: ICCV (2009)Google Scholar
  19. 19.
    Levinshtein, A., Sminchisescu, C., Dickinson, S.: Multiscale Symmetric Part Detection and Grouping. In: ICCV (2009)Google Scholar
  20. 20.
    Biederman, I.: Recognition-by-Components: A Theory of Human Image Understanding. Psychological Review 44, 115–147 (1987)CrossRefGoogle Scholar
  21. 21.
    Ren, X., Fowlkes, C.C., Malik, J.: Figure/Ground Assignment in Natural Images. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 614–627. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  22. 22.
    Russell, B., Efros, A., Sivic, J., Freeman, W., Zisserman, A.: Segmenting Scenes by Matching Image Composites. In: NIPS (2009)Google Scholar
  23. 23.
    Rosenfeld, A., Weinshall, D.: Extracting Foreground Masks towards Object Recognition. In: ICCV (2011)Google Scholar
  24. 24.
    Kuettel, D., Ferrari, V.: Figure-Ground Segmentation by Transferring Window Masks. In: CVPR (2012)Google Scholar
  25. 25.
    Kim, J., Grauman, K.: Boundary Preserving Dense Local Regions. In: CVPR (2011)Google Scholar
  26. 26.
    Rothwell, C., Zisserman, A., Forsyth, D., Mundy, J.: Canonical Frames for Planar Object Recognition. In: Sandini, G. (ed.) ECCV 1992. LNCS, vol. 588, pp. 757–772. Springer, Heidelberg (1992)CrossRefGoogle Scholar
  27. 27.
    Leibe, B., Leonardis, A., Schiele, B.: Combined Object Categorization and Segmentation with an Implicit Shape Model. In: Workshop on Statistical Learning in Computer Vision (2004)Google Scholar
  28. 28.
    Rother, C., Komogorov, V., Blake, A.: Grabcut: Interactive Foreground Extraction Using Iterated Graph Cuts. In: SIGGRAPH (2004)Google Scholar
  29. 29.
    Muja, M., Lowe, D.: Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration. In: VISAPP (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Jaechul Kim
    • 1
  • Kristen Grauman
    • 1
  1. 1.Department of Computer ScienceThe University of Texas at AustinUSA

Personalised recommendations