SpatialBoost: Adding Spatial Reasoning to AdaBoost

  • Shai Avidan
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3954)


SpatialBoost extends AdaBoost to incorporate spatial reasoning. We demonstrate the effectiveness of SpatialBoost on the problem of interactive image segmentation. Our application takes as input a tri-map of the original image, trains SpatialBoost on the pixels of the object and the background and use the trained classifier to classify the unlabeled pixels. The spatial reasoning is introduced in the form of weak classifiers that attempt to infer pixel label from the pixel labels of surrounding pixels, after each boosting iteration. We call this variant of AdaBoost — SpatialBoost. We then extend the application to work with “GrabCut”. In GrabCut the user casually marks a rectangle around the object, instead of tediously marking a tri-map, and we pose the segmentation as the problem of learning with outliers, where we know that only positive pixels (i.e. pixels that are assumed to belong to the object) might be outliers and in fact should belong to the background.


Feature Vector Image Segmentation Gesture Recognition Neural Information Processing System Lower Error Rate 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Adobe System, Adobe Photoshop User Guide (2002)Google Scholar
  2. 2.
    Blake, A., Rother, C., Brown, M., Perez, P., Torr, P.: Interactive image segmentation using an adaptive GMMRF model. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 428–441. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  3. 3.
    Boykov, Y., Jolly, M.-P.: Interactive graph cuts for optimal boundary and region segmentation of objects in N-D images. In: Proc. IEEE International Conference on Computer Vision (2001)Google Scholar
  4. 4.
    Chuang, y.-y., Curless, B., Salesin, D., Szeliski, R.: A Bayesian approach to digital matting. In: Proc IEEE Conf. on Computer Vision and Pattern Recognition (2001)Google Scholar
  5. 5.
    Dalal, N., Triggs, B.: Histograms of Oriented Gradients for Human Detection. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2005)Google Scholar
  6. 6.
    Freeman, W.T., Roth, M.: Orientation histograms for hand gesture recognition. In: Intl. Workshop on Automatic Face and Gesture Recognition (1995)Google Scholar
  7. 7.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision (IJCV) 60(2), 91–110 (2004)CrossRefGoogle Scholar
  8. 8.
    Fink, M., Perona, P.: Mutual Boosting for Contextual Inference. In: Adv. in Neural Information Processing Systems, NIPS (2003)Google Scholar
  9. 9.
    Freund, Y.: An adaptive version of the boost by majority algorithm. Machine Learning 43(3), 293–318 (2001)CrossRefMATHGoogle Scholar
  10. 10.
    Newman, D.J., Hettich, S., Blake, C.L., Merz, C.J.: UCI Repository of machine learning databases, University of California, Irvine, Dept. of Information and Computer Sciences (1998),
  11. 11.
    Rother, C., Kolmogorov, V., Blake, A.: GrabCut - Interactive Foreground Extraction using Iterated Graph Cuts. In: Proc. ACM Siggraph (2004)Google Scholar
  12. 12.
    Ruzon, M., Tomasi, C.: Alpha estimation in natural images. In: Proc IEEE Conf. on Computer Vision and Pattern Recognition (2000)Google Scholar
  13. 13.
    Torralba, A., Murphy, K.P., Freeman, W.T.: contextual Models for Object Detection using Boosted Random Fields. In: Adv. in Neural Information Processing Systems (NIPS) (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Shai Avidan
    • 1
  1. 1.Mitsubishi Electric Research LabsCambridgeUSA

Personalised recommendations