Robust Learning from Normals for 3D Face Recognition

  • Ioannis Marras
  • Stefanos Zafeiriou
  • Georgios Tzimiropoulos
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7584)


We introduce novel subspace-based methods for learning from the azimuth angle of surface normals for 3D face recognition. We show that the normal azimuth angles combined with Principal Component Analysis (PCA) using a cosine-based distance measure can be used for robust face recognition from facial surfaces. The proposed algorithms are well-suited for all types of 3D facial data including data produced by range cameras (depth images), photometric stereo (PS) and shade-from-X (SfX) algorithms. We demonstrate the robustness of the proposed algorithms both in 3D face reconstruction from synthetically occluded samples, as well as, in face recognition using the FRGC v2 3D face database and the recently collected Photoface database where the proposed method achieves state-of-the-art results. An important aspect of our method is that it can achieve good face recognition/verification performance by using raw 3D scans without any heavy preprocessing (i.e., model fitting, surface smoothing etc.).


Face Recognition Azimuth Angle Equal Error Rate Facial Surface Photometric Stereo 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Barsky, S., Petrou, M.: The 4-source photometric stereo technique for three-dimensional surfaces in the presence of highlights and shadows. IEEE T-PAMI 25(10), 1239–1252 (2003)CrossRefGoogle Scholar
  2. 2.
    Berretti, S., Del Bimbo, A., Pala, P.: 3D face recognition using isogeodesic stripes. IEEE T-PAMI 32(12), 2162–2177 (2010)CrossRefGoogle Scholar
  3. 3.
    Blanz, V., Scherbaum, K., Seidel, H.: Fitting a morphable model to 3D scans of faces. In: ICCV, pp. 1–8 (2007)Google Scholar
  4. 4.
    Bowyer, K., Chang, K., Flynn, P.: A survey of approaches and challenges in 3D and multi-modal 3d+ 2D face recognition. CVIU 101(1), 1–15 (2006)Google Scholar
  5. 5.
    Bronstein, A., Bronstein, M., Kimmel, R.: Expression-invariant representations of faces. IEEE T-IP 16(1), 188–197 (2007)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Chang, K., Bowyer, K., Flynn, P.: Multiple nose region matching for 3D face recognition under varying facial expression. IEEE T-PAMI, 1695–1700 (2006)Google Scholar
  7. 7.
    Faltemier, T., Bowyer, K., Flynn, P.: A region ensemble for 3-D face recognition. IEEE T-IFS 3(1), 62–73 (2008)Google Scholar
  8. 8.
    Fisher, R.: Dispersion on a sphere. Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences 217(1130), 295–305 (1953)zbMATHCrossRefGoogle Scholar
  9. 9.
    Fletcher, P., Lu, C., Pizer, S., Joshi, S.: Principal geodesic analysis for the study of nonlinear statistics of shape. IEEE T-MI 23(8), 995–1005 (2004)Google Scholar
  10. 10.
    Foley, J.: Computer graphics: principles and practice. Addison-Wesley Professional (1996)Google Scholar
  11. 11.
    Gokberk, B., Dutagaci, H., Ulas, A., Akarun, L., Sankur, B.: Representation plurality and fusion for 3-D face recognition. IEEE T-SMCS, Part B 38(1), 155–173 (2008)Google Scholar
  12. 12.
    Kakadiaris, I.A., Passalis, G., Toderici, G., Murtuza, N., Lu, Y., Karampatziakis, N., Theoharis, T.: Recognition in the presence of facial expressions: An annotated deformable model approach. IEEE T-PAMI 29(4), 640–649 (2007)CrossRefGoogle Scholar
  13. 13.
    Krzanowski, W.: Between-groups comparison of principal components. Journal of the American Statistical Association, 703–707 (1979)Google Scholar
  14. 14.
    Passalis, G., Perakis, P., Theoharis, T., Kakadiaris, I.: Using facial symmetry to handle pose variations in real-world 3D face recognition. IEEE T-PAMI 33(10), 1938–1951 (2011)CrossRefGoogle Scholar
  15. 15.
    Phillips, P.J., Flynn, P., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the face recognition grand challenge. In: CVPR, pp. 947–954 (2005)Google Scholar
  16. 16.
    Samir, C., Srivastava, A., Daoudi, M.: Three-dimensional face recognition using shapes of facial curves. IEEE T-PAMI 28(11), 1858–1863 (2006)CrossRefGoogle Scholar
  17. 17.
    Smith, W., Hancock, E.: Recovering facial shape using a statistical model of surface normal direction. IEEE T-PAMI 28(12), 1914–1930 (2006)CrossRefGoogle Scholar
  18. 18.
    Smith, W., Hancock, E.: Facial shape-from-shading and recognition using principal geodesic analysis and robust statistics. IJCV 76(1), 71–91 (2008)CrossRefGoogle Scholar
  19. 19.
    Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: Subspace learning from image gradient orientations. IEEE T-PAMI (accepted for publication, 2012)Google Scholar
  20. 20.
    Wang, Y., Liu, J., Tang, X.: Robust 3d face recognition by local shape difference boosting. IEEE T-PAMI 32(10), 1858–1870 (2010)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Ioannis Marras
    • 1
  • Stefanos Zafeiriou
    • 1
  • Georgios Tzimiropoulos
    • 1
    • 2
  1. 1.Department of ComputingImperial College LondonLondonU.K.
  2. 2.School of Computer ScienceUniversity of LincolnLincolnU.K.

Personalised recommendations