Abstract
Holistic face recognition algorithms are sensitive to expressions, illumination, pose, occlusions and makeup. On the other hand, feature-based algorithms are robust to such variations. In this paper, we present a feature-based algorithm for the recognition of textured 3D faces. A novel keypoint detection technique is proposed which can repeatably identify keypoints at locations where shape variation is high in 3D faces. Moreover, a unique 3D coordinate basis can be defined locally at each keypoint facilitating the extraction of highly descriptive pose invariant features. A 3D feature is extracted by fitting a surface to the neighborhood of a keypoint and sampling it on a uniform grid. Features from a probe and gallery face are projected to the PCA subspace and matched. The set of matching features are used to construct two graphs. The similarity between two faces is measured as the similarity between their graphs. In the 2D domain, we employed the SIFT features and performed fusion of the 2D and 3D features at the feature and score-level. The proposed algorithm achieved 96.1% identification rate and 98.6% verification rate on the complete FRGC v2 data set.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Al-Osaimi, F., Bennamoun, M., & Mian, A. S. (2006). Illumination normalization for color face images. In International symposium on visual computing (pp. 90–101).
Belhumeur, P., Hespanha, J., & Kriegman, D. (1997). Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19, 711–720.
Besl, P. J., & McKay, N. D. (1992). Reconstruction of real-world objects via simultaneous registration and robust combination of multiple range images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2), 239–256.
Bowyer, K. W., Chang, K., & Flynn, P. (2006). A survey of approaches and challenges in 3D and Multi-modal 3D + 2D face recognition. Computer Vision and Image Understanding, 101(1), 1–15.
D’Erico, J. (2006). Surface fitting using gridfit. MATLAB Central File Exchange Select.
Gokberk, G., Salah, A., & Akarun, L. (2005). Rank-based decision fusion for 3d shape-based face recognition. In International conference on audio and video-based biometric person authentication (pp. 1019–1028).
Gonzalez, R. C., & Woods, R. E. (1992). Digital image processing. Reading: Addison–Wesley.
Huang, J., Heisele, B., & Blanz, V. (2003). Component-based face recognition with 3d morphable models. In International conference on audio and video-based biometric person authentication.
Husken, M., Brauckmann, M., Gehlen, S., & Malsburg, C. (2005), Strategies and benefits of fusion of 2d and 3d face recognition. In IEEE workshop on FRGC experiments.
Jain, A. K., Ross, A., & Prabhakar, S. (2004). An introduction to biometric recognition. IEEE Transactions on Circuits and Systems for Video Technology, 14(1), 4–20.
Jones, M., & Viola, P. (2003). Face recognition using boosted local features. In IEEE international conference on computer vision.
Lowe, D. (2004). Distinctive image features from scale-invariant key points. International Journal of Computer Vision, 60(2), 91–110.
Lu, X., Jain, A. K., & Colbry, D. (2006). Matching 2.5D scans to 3D models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(1), 31–43.
Maurer, T., Guigonis, D., Maslov, I., Pesenti, B., Tsaregorodtsev, A., West, D., & Medioni, G. (2005). Performance of geometrix ActiveIDTM 3D face recognition engine on the FRGC data. In IEEE workshop on FRGC experiments.
Mian, A. S., Bennamoun, M., & Owens, R. A. (2006a). 2D and 3D multimodal hybrid face recognition. In European conference on computer vision (pp. 344–355).
Mian, A. S., Bennamoun, M., & Owens, R. A. (2006b). A novel representation and feature matching algorithm for automatic pairwise registration of range images. International Journal of Computer Vision, 66(1), 19–40.
Mian, A. S., Bennamoun, M., & Owens, R. A. (2006c). Automatic 3D face detection, normalization and recognition. In 3D data processing, visualization and transmission.
Mian, A. S., Bennamoun, M., & Owens, R. A. (2006d). Face recognition using 2D and 3D multimodal local features. In International symposium on visual computing (pp. 860–870).
Mian, A. S., Bennamoun, M., & Owens, R. A. (2006e). Three-dimensional model-based object recognition and segmentation in cluttered scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(10), 1584–1601.
Mian, A. S., Bennamoun, M., & Owens, R. A. (2007). An efficient multimodal 2D–3D hybrid approach to automatic face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(11), 1927–1943.
Passalis, G., Kakadiaris, I., Theoharis, T., Tederici, G., & Murtaza, N. (2005). Evaluation of 3D face recognition in the presence of facial expressions: an annotated deformable model approach. In IEEE workshop on FRGC experiments.
Phillips, P. J., Flynn, P. J., Scruggs, T., Bowyer, K. W., Chang, J., Hoffman, K., Marques, J., Min, J., & Worek, W. (2005). Overview of the face recognition grand challenge. In IEEE computer vision and pattern recognition (pp. 947–954).
Ross, A., & Govindarajan, R. (2005) Feature Level Fusion Using Hand and Face Biometrics. In Biometric technology for human identification. Bellingham: SPIE.
Turk, M., & Pentland, A. (1991). Eigenfaces for recognition. Journal of Cognitive Neuroscience, 3, 71–86.
Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A. (2003). Face recognition: a literature survey. In ACM computing survey (pp. 399–458).
Author information
Authors and Affiliations
Corresponding author
Additional information
This work is supported by ARC grant number DP0664228.
Rights and permissions
About this article
Cite this article
Mian, A.S., Bennamoun, M. & Owens, R. Keypoint Detection and Local Feature Matching for Textured 3D Face Recognition. Int J Comput Vis 79, 1–12 (2008). https://doi.org/10.1007/s11263-007-0085-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11263-007-0085-5