ECCV 2006: Computer Vision – ECCV 2006 pp 344-355 | Cite as
2D and 3D Multimodal Hybrid Face Recognition
Abstract
We present a 2D and 3D multimodal hybrid face recognition algorithm and demonstrate its performance on the FRGC v1.0 data. We use hybrid (feature-based and holistic) matching for the 3D faces and a holistic matching approach on the 2D faces. Feature-based matching is performed by offline segmenting each 3D face in the gallery into three regions, namely the eyes-forehead, the nose and the cheeks. The cheeks are discarded to avoid facial expressions and hair. During recognition, each feature in the gallery is automatically matched, using a modified ICP algorithm, with a complete probe face. The holistic 3D and 2D face matching is performed using PCA. Individual matching scores are fused after normalization and the results are compared to the BEE baseline performances in order to provide some answers to the first three conjectures of the FRGC. Our multimodal hybrid algorithm substantially outperformed others by achieving 100% verification rate at 0.0006 FAR.
Keywords
Face Recognition Face Match Skin Detection Face Recognition Algorithm Face Recognition Grand ChallengePreview
Unable to display preview. Download preview PDF.
References
- 1.Besl, P.J., McKay, N.D.: Reconstruction of Real-world Objects via Simultaneous Registration and Robust Combination of Multiple Range Images. IEEE TPAMI 14(2), 239–256 (1992)Google Scholar
- 2.Boehnen, C., Russ, T.: A Fast Multi-Modal Approach to Facial Feature Detection. In: IEEE WACV (2005)Google Scholar
- 3.Boussaid, F., Chai, D., Bouzerdoum, A.: A Current-mode VLSI Architecture for Skin Detection. ISSPA 1, 629–632 (2003)Google Scholar
- 4.Bowyer, K.W., Chang, K., Flynn, P.: A Survey Of Approaches to Three-Dimensional Face Recognition. In: IEEE ICPR, pp. 358–361 (2004)Google Scholar
- 5.Chang, K.I., Bowyer, K.W., Flynn, P.J.: Face Recognition Using 2D and 3D Facial Data. In: MMUA, pp. 25–32 (2003)Google Scholar
- 6.Huang, J., Heisele, B., Blanz, V.: Component-based Face Recognition with 3D Morphable Models. In: AVBPA (2003)Google Scholar
- 7.Jain, A.K., Ross, A., Prabhakar, S.: An Introduction to Biometric Recognition. IEEE TCSVT 14(1), 4–20 (2004)Google Scholar
- 8.Lu, X., Jain, A.K., Colbry, D.: Matching 2.5D Face Scans to 3D Models. IEEE TPAMI 28(1), 31–43 (2006)Google Scholar
- 9.Mian, A.S., Bennamoun, M., Owens, R.A.: Region-based Matching for Robust 3D Face Recognition. BMVC 1, 199–208 (2005)Google Scholar
- 10.Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the Face Recognition Grand Challenge. In: IEEE CVPR (2005)Google Scholar
- 11.Taubin, G.: Curve and Surface Smoothing without Shrinkage. In: ICCV, pp. 852–857 (1995)Google Scholar
- 12.Turk, M., Pentland, A.: Eigenfaces for Recognition. JOCN 3 (1991)Google Scholar
- 13.Viola, P., Jones, M.J.: Robust Real-Time Face Detection. IJCV 57(2), 137–154 (2004)CrossRefGoogle Scholar
- 14.Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face Recognition: A Literature Survey. In: ACM Computing Survey, pp. 399–458 (2003)Google Scholar