Advertisement

Simultaneous Object Recognition and Segmentation by Image Exploration

  • Vittorio Ferrari
  • Tinne Tuytelaars
  • Luc Van Gool
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4170)

Abstract

Methods based on local, viewpoint invariant features have proven capable of recognizing objects in spite of viewpoint changes, occlusion and clutter. However, these approaches fail when these factors are too strong, due to the limited repeatability and discriminative power of the features. As additional shortcomings, the objects need to be rigid and only their approximate location is found. We present an object recognition approach which overcomes these limitations. An initial set of feature correspondences is first generated. The method anchors on it and then gradually explores the surrounding area, trying to construct more and more matching features, increasingly farther from the initial ones. The resulting process covers the object with matches, and simultaneously separates the correct matches from the wrong ones. Hence, recognition and segmentation are achieved at the same time. Only very few correct initial matches suffice for reliable recognition. Experimental results on still images and television news broadcasts demonstrate the stronger power of the presented method in dealing with extensive clutter, dominant occlusion, large scale and viewpoint changes. Moreover non-rigid deformations are explicitly taken into account, and the approximative contours of the object are produced. The approach can extend any viewpoint invariant feature extractor.

Keywords

Test Image Object Recognition Model Image Expansion Phase Correct Match 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Baumberg, A.: Reliable feature matching across widely separated views. In: Proceedings of the International Conference on Computer Vision, pp. 774–781 (2000)Google Scholar
  2. 2.
    Bebis, G., Georgiopoulos, M., Lobo, N.V.: Learning geometric hashing functions for model-based object recognition. In: Proceedings of the International Conference on Computer Vision, pp. 543–548 (1995)Google Scholar
  3. 3.
    Chum, O., Matas, J., Obdrzalek, S.: Epipolar geometry from three correspondences. In: Proceedings of Computer Vision Winter Workshop (2003)Google Scholar
  4. 4.
    Cyr, C., Kimia, B.: 3d object recognition using similarity-based aspect graph. In: Proceedings of the International Conference on Computer Vision (2001)Google Scholar
  5. 5.
    Ferrari, V.: Affine Invariant Regions ++. Ph.D Thesis, Selected Readings in Vision and Graphics, Springer Verlag, Zuerich, CH (2004)Google Scholar
  6. 6.
    Ferrari, V., Tuytelaars, T., Van Gool, L.: Wide-baseline multiple-view correspondences. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2003)Google Scholar
  7. 7.
    Ferrari, V., Tuytelaars, T., Van Gool, L.: Integrating multiple model views for object recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2004)Google Scholar
  8. 8.
    Ferrari, V., Tuytelaars, T., Van Gool, L.: Simultaneous object recognition and segmentation by image exploration. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 40–54. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  9. 9.
    Ferrari, V., Tuytelaars, T., Van Gool, L.: Simultaneous object recognition and segmentation from single or multiple model views. International Journal of Computer Vision (to appear, 2006)Google Scholar
  10. 10.
    Leibe, B., Schiele, B.: Scale-invariant object categorization using a scale-adaptive mean-shift search. In: Rasmussen, C.E., Bülthoff, H.H., Schölkopf, B., Giese, M.A. (eds.) DAGM 2004. LNCS, vol. 3175, pp. 145–153. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  11. 11.
    Lhuillier, M., Quan, L.: Match propagation for image-based modeling and rendering. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(12) (2002)Google Scholar
  12. 12.
    Lowe, D.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision (to appear, 2004)Google Scholar
  13. 13.
    Matas, J., Chum, O., Urban, M., Pajdla, T.: Robust wide baseline stereo from maximally stable extremal regions. In: Proceedings of the British Machine Vision Conference (2002)Google Scholar
  14. 14.
    Mikolajczyk, K., Schmid, C.: Indexing based on scale-invariant interest points. In: Proceedings of the International Conference on Computer Vision (2001)Google Scholar
  15. 15.
    Mikolajczyk, K., Schmid, C.: An affine invariant interest point detector. In: Proceedings of the European Conference on Computer Vision (2002)Google Scholar
  16. 16.
    Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol.II, pp. 257–263 (2003)Google Scholar
  17. 17.
    Murase, H., Nayar, S.: Visual learning and recognition of 3d objects from appearance. International Journal of Computer Vision 14(1) (1995)Google Scholar
  18. 18.
    Obrdzalek, S., Matas, J.: Object recognition using local affine frames on distinguished regions. In: Proceedings of the British Machine Vision Conference, pp. 414–431 (2002)Google Scholar
  19. 19.
    Osian, M., Van Gool, L.: Video shot characterization. In: Proceedings of the TRECVID Workshop (2003)Google Scholar
  20. 20.
    Pritchett, P., Zisserman, A.: Wide baseline stereo matching. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (1998)Google Scholar
  21. 21.
    Rothganger, F., Lazebnik, S., Schmid, C., Ponce, J.: 3d object modeling and recognition using affine-invariant image descriptors and multi-view spatial constraints. International Journal of Computer Vision (to appear, 2005)Google Scholar
  22. 22.
    Schaffalitzky, F., Zisserman, A.: Automated scene matching in movies. In: Proceedings of the Workshop on Content-based Image and Video Retrieval (2002)Google Scholar
  23. 23.
    Schaffalitzky, F., Zisserman, A.: Multi-view matching for unordered image sets. In: Proceedings of the European Conference on Computer Vision (2002)Google Scholar
  24. 24.
    Schmid, C.: Combining greyvalue invariants with local constraints for object recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 872–877 (1996)Google Scholar
  25. 25.
    Selinger, A., Nelson, R.C.: A perceptual grouping hierarchy for appearance-based 3d object recognition. Computer Vision and Image Understanding 76(1), 83–92 (1999)CrossRefGoogle Scholar
  26. 26.
    Sivic, J., Zisserman, A.: Video google: A text retrieval approach to object matching in videos. In: Proceedings of the International Conference on Computer Vision (2003)Google Scholar
  27. 27.
    Swain, M.J., Ballard, B.H.: Color indexing. International Journal of Computer Vision 7(1), 11–32 (1991)CrossRefGoogle Scholar
  28. 28.
    Tell, D., Carlsson, S.: Combining appearance and topology for wide baseline matching. In: Proceedings of the European Conference on Computer Vision, pp. 68–81 (2002)Google Scholar
  29. 29.
    Torr, P.H.S., Murray, D.W.: The development and comparison of robust methods for estimating the fundamental matrix. International Journal of Computer Vision 24(3), 271–300 (1997)CrossRefGoogle Scholar
  30. 30.
    Tuytelaars, T., Van Gool, L.: Wide baseline stereo based on local, affinely invariant regions. In: Proceedings of the British Machine Vision Conference (2000)Google Scholar
  31. 31.
    Tuytelaars, T., Van Gool, L., Dhaene, L., Koch, R.: Matching affinely invariant regions for visual servoing. In: Proceedings of the IEEE Conference on Robotics and Automation, pp. 1601–1606 (1999)Google Scholar
  32. 32.
    Yu, S.X., Gross, R., Shi, J.: Concurrent object recognition and segmentation by graph partitioning. In: Neural Information Processing Systems (2002)Google Scholar
  33. 33.
    Zhang, Z., Deriche, R., Faugeras, O., Luong, Q.: A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry. Artificial Intelligence 78, 87–119 (1995)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Vittorio Ferrari
    • 1
  • Tinne Tuytelaars
    • 2
  • Luc Van Gool
    • 1
    • 2
  1. 1.Computer Vision Group (BIWI)ETH ZürichSwitzerland
  2. 2.ESAT-PSIUniversity of LeuvenBelgium

Personalised recommendations