Skip to main content

SURE: Surface Entropy for Distinctive 3D Features

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNAI,volume 7463)

Abstract

In this paper, we present SURE features – a novel combination of interest point detector and descriptor for 3D point clouds and depth images. We propose an entropy-based interest operator that selects distinctive points on surfaces. It measures the variation in surface orientation from surface normals in the local vicinity of a point. We complement our approach by the design of a view-pose-invariant descriptor that captures local surface curvature properties, and we propose optional means to incorporate colorful texture information seamlessly. In experiments, we compare our approach to a state-of-the-art feature detector in depth images (NARF) and demonstrate similar repeatability of our detector. Our novel pair of detector and descriptor achieves superior results for matching interest points between images and also requires lower computation time.

Keywords

  • Depth image interest points
  • local shape-texture descriptor

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (Canada)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bay, H., Tuytelaars, T., Van Gool, L.: SURF: Speeded Up Robust Features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 404–417. Springer, Heidelberg (2006)

    CrossRef  Google Scholar 

  2. Belongie, S., Malik, J., Puzicha, J.: Shape context: A new descriptor for shape matching and object recognition. In: NIPS, pp. 831–837 (2000)

    Google Scholar 

  3. Brown, M., Lowe, D.: Automatic panoramic image stitching using invariant features. Int’l Journal of Computer Vision 74, 59–73 (2007)

    CrossRef  Google Scholar 

  4. Calonder, M., Lepetit, V., Strecha, C., Fua, P.: BRIEF: Binary Robust Independent Elementary Features. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6314, pp. 778–792. Springer, Heidelberg (2010)

    CrossRef  Google Scholar 

  5. Fergus, R., Perona, P., Zisserman, A.: Object class recognition by unsupervised scale-invariant learning (2003)

    Google Scholar 

  6. Förstner, W., Dickscheid, T., Schindler, F.: Detecting interpretable and accurate scale-invariant keypoints. In: 12th IEEE International Conference on Computer Vision (ICCV 2009), Kyoto, Japan (2009)

    Google Scholar 

  7. Frahm, J.-M., Fite-Georgel, P., Gallup, D., Johnson, T., Raguram, R., Wu, C., Jen, Y.-H., Dunn, E., Clipp, B., Lazebnik, S., Pollefeys, M.: Building Rome on a Cloudless Day. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6314, pp. 368–381. Springer, Heidelberg (2010)

    CrossRef  Google Scholar 

  8. Frome, A., Huber, D., Kolluri, R., Bülow, T., Malik, J.: Recognizing Objects in Range Data Using Regional Point Descriptors. In: Pajdla, T., Matas, J. (eds.) ECCV 2004. LNCS, vol. 3023, pp. 224–237. Springer, Heidelberg (2004)

    CrossRef  Google Scholar 

  9. Johnson, A., Hebert, M.: Using spin images for efficient object recognition in cluttered 3d scenes. Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 21(5), 433–449 (1999)

    CrossRef  Google Scholar 

  10. Kadir, T., Brady, M.: Saliency, scale and image description. Int’l J. of Computer Vision 45(2), 83–105 (2001)

    CrossRef  MATH  Google Scholar 

  11. Kadir, T., Zisserman, A., Brady, M.: An Affine Invariant Salient Region Detector. In: Pajdla, T., Matas, J. (eds.) ECCV 2004. LNCS, vol. 3021, pp. 228–241. Springer, Heidelberg (2004)

    CrossRef  Google Scholar 

  12. Lee, W.T., Chen, H.T.: Histogram-based interest point detectors. In: Int’l Conf. on Computer Vision and Pattern Recognition, CVPR (2009)

    Google Scholar 

  13. Lo, T.W.R., Siebert, J.P.: Local feature extraction and matching on range images: 2. 5D SIFT. Computer Vision and Image Understanding 113(12) (2009)

    Google Scholar 

  14. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision (2), 91 (2004)

    CrossRef  Google Scholar 

  15. Matas, J., Chum, O., Urban, M., Pajdla, T.: Robust wide baseline stereo from maximally stable extremal regions. In: Proc. of the British Machine Vision Conference (2002)

    Google Scholar 

  16. Mikolajczyk, K., Schmid, C.: Scale & affine invariant interest point detectors. Int’l Journal of Computer Vision (2004)

    Google Scholar 

  17. Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Transactions of Pattern Analysis and Machine Intelligence 27(10) (2005)

    Google Scholar 

  18. Moreels, P., Perona, P.: Evaluation of feature detectors and descriptors based on 3d objects. Int’l Journal of Computer Vision 73, 263–284 (2007)

    CrossRef  Google Scholar 

  19. Mori, G., Belongie, S., Malik, J.: Efficient shape matching using shape contexts. Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 27(11), 1832–1837 (2005)

    CrossRef  Google Scholar 

  20. Novatnack, J., Nishino, K.: Scale-dependent 3D geometric features. In: Proc. of the IEEE Int. Conf. on Computer Vision, ICCV (2007)

    Google Scholar 

  21. Novatnack, J., Nishino, K.: Scale-Dependent/Invariant Local 3D Shape Descriptors for Fully Automatic Registration of Multiple Sets of Range Images. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part III. LNCS, vol. 5304, pp. 440–453. Springer, Heidelberg (2008)

    CrossRef  Google Scholar 

  22. Pauly, M., Keiser, R., Gross, M.: Multi-scale feature extraction on point-sampled surfaces. In: Eurographics (2003)

    Google Scholar 

  23. Pele, O., Werman, M.: Fast and robust earth mover’s distances. In: Proc. of the Int. Conference on Computer Vision, ICCV (2009)

    Google Scholar 

  24. Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: An efficient alternative to SIFT or SURF. In: International Conference on Computer Vision (2011)

    Google Scholar 

  25. Rubner, Y., Tomasi, C., Guibas, L.J.: The earth mover’s distance as a metric for image retrieval. Int. J. of Computer Vision 40, 99–121 (2000)

    CrossRef  MATH  Google Scholar 

  26. Rusu, R.B., Blodow, N., Beetz, M.: Fast point feature histograms (fpfh) for 3d registration. In: The IEEE Int. Conf. on Robotics and Automation, ICRA (2009)

    Google Scholar 

  27. Se, S., Lowe, D., Little, J.: Mobile robot localization and mapping with uncertainty using scale-invariant visual landmarks. Int’l Journal of Robotics Research 21(8), 735–758 (2002)

    CrossRef  Google Scholar 

  28. Shah, T.R.: Automatic reconstruction of industrial installations using point clouds and images. Ph.D. thesis, TU Delft (2006)

    Google Scholar 

  29. Steder, B., Grisetti, G., Burgard, W.: Robust place recognition for 3D range data based on point features. In: Proc. of the IEEE Int. Conf. on Robotics and Automation, ICRA (2010)

    Google Scholar 

  30. Steder, B., Ruhnke, M., Grzonka, S., Burgard, W.: Place recognition in 3D scans using a combination of bag of words and point feature based relative pose estimation. In: Proc. of the IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS (2011)

    Google Scholar 

  31. Steder, B., Rusu, R.B., Konolige, K., Burgard, W.: NARF: 3D range image features for object recognition. In: Workshop on Defining and Solving Realistic Perception Problems in Personal Robotics at the IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS) (2010)

    Google Scholar 

  32. Stückler, J., Behnke, S.: Interest point detection in depth images through scale-space surface analysis. In: Proceedings of the IEEE International Conference on Robotics and Automation, ICRA (2011)

    Google Scholar 

  33. Tombari, F., Salti, S., Di Stefano, L.: A combined texture-shape descriptor for enhanced 3d feature matching. In: Proc. of the IEEE International Conference on Image Processing, ICIP (2011)

    Google Scholar 

  34. Tombari, F., Salti, S., Di Stefano, L.: Unique Signatures of Histograms for Local Surface Description. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part III. LNCS, vol. 6313, pp. 356–369. Springer, Heidelberg (2010)

    CrossRef  Google Scholar 

  35. Tuytelaars, T., Mikolajczyk, K.: Local invariant feature detectors: A survey. Foundations and Trends in Computer Graphics and Vision 3(3), 177–280 (2007)

    CrossRef  Google Scholar 

  36. Tuzel, O., Porikli, F., Meer, P.: Region Covariance: A Fast Descriptor for Detection and Classification. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part II. LNCS, vol. 3952, pp. 589–600. Springer, Heidelberg (2006)

    CrossRef  Google Scholar 

  37. Unnikrishnan, R., Hebert, M.: Multi-scale interest regions from unorganized point clouds. In: Workshop on Search in 3D, IEEE Int. Conf. on Computer Vision and Pattern Recognition, CVPR (2008)

    Google Scholar 

  38. Wahl, E., Hillenbrand, G., Hirzinger, G.: Surflet-pair-relation histograms: a statistical 3D-shape representation for rapid classification. In: Proc. of the Int. Conf. on 3-D Digital Imaging and Modeling (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Fiolka, T., Stückler, J., Klein, D.A., Schulz, D., Behnke, S. (2012). SURE: Surface Entropy for Distinctive 3D Features. In: Stachniss, C., Schill, K., Uttal, D. (eds) Spatial Cognition VIII. Spatial Cognition 2012. Lecture Notes in Computer Science(), vol 7463. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32732-2_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-32732-2_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-32731-5

  • Online ISBN: 978-3-642-32732-2

  • eBook Packages: Computer ScienceComputer Science (R0)