Abstract
3D object recognition from local features is robust to occlusions and clutter. However, local features must be extracted from a small set of feature rich keypoints to avoid computational complexity and ambiguous features. We present an algorithm for the detection of such keypoints on 3D models and partial views of objects. The keypoints are highly repeatable between partial views of an object and its complete 3D model. We also propose a quality measure to rank the keypoints and select the best ones for extracting local features. Keypoints are identified at locations where a unique local 3D coordinate basis can be derived from the underlying surface in order to extract invariant features. We also propose an automatic scale selection technique for extracting multi-scale and scale invariant features to match objects at different unknown scales. Features are projected to a PCA subspace and matched to find correspondences between a database and query object. Each pair of matching features gives a transformation that aligns the query and database object. These transformations are clustered and the biggest cluster is used to identify the query object. Experiments on a public database revealed that the proposed quality measure relates correctly to the repeatability of keypoints and the multi-scale features have a recognition rate of over 95% for up to 80% occluded objects.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Angel, E. (2009). Interactive computer graphics, a top-down approach using OpenGL (5th ed.). Reading: Wesley.
Ashbrook, A., Fisher, R., Robertson, C., & Werghi, N. (1998). Finding surface correspondence for object recognition and registration using pairwise geometric histograms. International Journal of Pattern Recognition and Artificial Intelligence, 2, 674–686.
Besl, P. J., & McKay, N. D. (1992). A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis Machine Intelligence, 14(2), 239–256.
Bowyer, K. W., Chang, K., & Flynn, P. (2006). A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition. Computer Vision and Image Understanding, 101(1), 1–15.
Campbell, R. J., & Flynn, P. J. (2001). A survey of free-form object representation and recognition techniques. Computer Vision and Image Understanding, 81(2), 166–210.
Castellani, U., Cristani, M., Fantoni, S., & Murino, V. (2008). Sparse points matching by combining 3D mesh saliency with statistical descriptors. Eurographics, 27(2), 643–652.
Chua, C. S., & Jarvis, R. (1997). Point signatures: a new representation for 3D object recognition. International Journal of Computer Vision, 25(1), 63–85.
D’Erico, J. (2008). Surface fitting using gridfit. MATLAB Central File Exchange.
Dorai, C., & Jain, A. K. (1997). COSMOS: a representation scheme for 3D free-form objects. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(10), 1115–1130.
Gelfand, N., & Ikemoto, L. (2003). Geometrically stable sampling for the ICP algorithm. 3D digital imaging and modeling.
Gelfand, N., Mitra, N., Guibas, L., & Pottmann, H. (2005). Robust Global Registration. In Eurographics symposium on geometry processing.
Gonzalez, R. C., & Woods, R. E. (2008). Digital image processing (3rd ed.). Reading: Wesley.
Hebert, M., Ikeuchi, K., & Delingette, H. (1995). A spherical representation for recognition of free-form surfaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(7), 681–690.
Hetzel, G., Leibe, B., Levi, P., & Schiele, B. (2001). 3D object recognition from range images using local feature histograms. In IEEE conference on computer vision and pattern recognition (pp. 394–399).
Johnson, A. E., & Hebert, M. (1999). Using spin images for efficient object recognition in cluttered 3D scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(5), 674–686.
Joshi, T., Ponce, J., Vijayakumar, B., & Kriegman, D. (1994). Hot curves for modeling and recognition of smooth curved 3D objects. In IEEE conference on computer vision and pattern recognition (pp. 876–880).
Lee, C. H., Varshney, A., & Jacobs, D. W. (2005). Mesh saliency. In SIGGRAPH (pp. 659–666).
Mesh ToolBox (2009). Vision and Mobile Robotics Laboratory, Carnegie Mellon University. http://www.cs.cmu.edu/~vmr/software/meshtoolbox/executables.html.
Mian, A., Bennamoun, M., & Owens, R. (2008). Keypoint detection and local feature matching for textured 3D face recognition. International Journal of Computer Vision, 79(1), 1–12.
Mian, A., Bennamoun, M., & Owens, R. (2006a). A novel representation and feature matching algorithm for automatic pairwise registration of range images. International Journal of Computer Vision, 66, 19–40.
Mian, A., Bennamoun, M., & Owens, R. (2006b). 3D Model-based object recognition and segmentation in cluttered scenes. IEEE Transactions in Pattern Analysis and Machine Intelligence, 28(10), 1584–1601.
Mian, A. (2009). Home Page, 3D modeling and 3D object recognition data. http://www.csse.uwa.edu.au/~ajmal/.
Lowe, D. (2004). Distinctive image features from scale-invariant key points. International Journal of Computer Vision, 60(2), 91–110.
Murase, H., & Nayar, S. (1995). Visual learning and recognition of 3D objects from appearance. International Journal of Computer Vision, 14, 5–24.
Novatnack, J., & Nishino, K. (2007). Scale-dependent 3D geometric features, International Conference on Computer Vision (pp. 1–8).
Novatnack, J., & Nishino, K. (2008). Scale-dependent/invariant local 3D shape descriptors for fully automatic registration of multiple sets of range images. In ECCV (pp. 440–453).
Passalis, G., Kakadiaris, I., & Theoharis, T. (2007). Intraclass retrieval of nonrigid 3D objects: application to face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(2), 218–229.
Petitjean, S. (2002). A survey of methods for recovering quadrics in triangle meshes. ACM Computing Surveys, 34(2), 211–262.
Ponce, J., & Kriegman, D. J. (1989). On recognizing and positioning curved 3D objects from image contours. Image understanding workshop (pp. 461–470).
Shi, J., & Tomasi, C. (1994). Good features to track. In IEEE conference on computer vision and pattern recognition.
Subbarao, R., & Meer, P. (2006). Nonlinear mean shift for clustering over analytic manifolds. In CVPR (pp. 1168–1175).
Sumi, Y., Kawai, Y., Yoshimi, T., & Tomita, F. (2002). 3D object recognition in cluttered environments by segment-based stereo vision. International Journal of Computer Vision, 46(1), 5–23.
Unnikrishnan, R., Lalonde, J., Vandapel, N., & Hebert, M. (2006). Scale selection for the analysis of point-sampled curves. In 3DPVT (pp. 1026–1033).
Unnikrishan, R., & Hebert, M. (2008). Multi-scale interest regions from unorganized point clouds. CVPR Workshop.
Wessel, R., Baranowski, R., & Klein, R. (2008). Learning distinctive local object characteristics for 3D shape retrieval. In Vision, modeling, and visualization (pp. 167–178).
Author information
Authors and Affiliations
Corresponding author
Additional information
Supported by ARC Grants DP0881813, DP0664228 and LE0775672.
Rights and permissions
About this article
Cite this article
Mian, A., Bennamoun, M. & Owens, R. On the Repeatability and Quality of Keypoints for Local Feature-based 3D Object Retrieval from Cluttered Scenes. Int J Comput Vis 89, 348–361 (2010). https://doi.org/10.1007/s11263-009-0296-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11263-009-0296-z