Automatic 3D Face Feature Points Extraction with Spin Images

  • Cristina Conde
  • Licesio J. Rodríguez-Aragón
  • Enrique Cabello
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4142)


We present a novel 3D facial feature location method based on the Spin Images registration technique. Three feature points are localized: the nose tip and the inner corners of the right and left eye. The points are found directly in the 3D mesh, allowing a previous normalization before the depth map calculation. This method is applied after a preprocess stage where the candidate points are selected measuring curvatures on the surface and applying clustering techniques. The system is tested on a 3D Face Database called FRAV3D with 105 people and a widely variety of acquisition conditions in order to test the method in a non-controlled environment. The success location rate is 99.5% in the case of the nose tip and 98% in the case of eyes, in frontal conditions. This rate is similar even if the conditions change allowing small rotations. Results in more extremely acquisition conditions are shown too. A complete study of the influence of the mesh resolution over the spin images quality and therefore over the face feature location rate is presented. The causes of the errors are discussed in detail.


Feature Point Face Recognition Face Database Mesh Resolution Spin Image 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face Recognition: A Literature Survey. ACM Computing Surveys 35(4) (December 2003)Google Scholar
  2. 2.
    Bowyer, K.W., Chang, K., Flynn, P.: A Survey of 3D and Multi-Modal 3D+2D Face Recognition. In: International Conference on Pattern Recognition (August 2004)Google Scholar
  3. 3.
    Kittler, J., Hilton, A., Hamouz, M., Illingworth, J.: 3D Assisted Face Recognition: A Survey of 3D imaging, Modelling and Recognition Approaches. In: IEEE CVPR 2005 Workshop on Advanced 3D Imaging for Safety and Security, San Diego, CA (2005)Google Scholar
  4. 4.
    Johnson, A.E.: Spin-images: A representation for 3-D surface matching. PhD Thesis. Robotics Institute. Carnegie Mellon University (1997)Google Scholar
  5. 5.
  6. 6.
    Ming-Hsuan, Y., Kriegman, D.J., Ahuja, N.: Detecting faces in images: a survey. Pattern Analysis and Machine Intelligence. IEEE Transactions on 24(1), 34–58 (2002)Google Scholar
  7. 7.
    Colbry, D., Stockman, G., Jain, A.: Detection of Anchor Points for 3D Face Verification. In: Proc. IEEE Workshop on Advanced 3D Imaging for Safety and Security A3DISS, San Diego, CA, June 25 (2005)Google Scholar
  8. 8.
    Lu, X., Colbry, D., Jain, A.K.: Three dimensional model based face recognition. In: ICPR, Cambridge UK (August 2004)Google Scholar
  9. 9.
    Irfanoglu, M.O., Gokberk, B., Akarun, L.: 3D shape-based face recognition using automatically registered facial surfaces. Pattern Recognition, 2004. In: ICPR 2004. Proceedings of the 17th International Conference on, August 23-26, 2004, vol. 4, pp. 183–186 (2004)Google Scholar
  10. 10.
  11. 11.
    Gordon, G.: Face recognition based on depth and curvature features. In: CVPR, pp. 108-110 (1992)Google Scholar
  12. 12.
    Boehnen, C., Russ, T.: A fast multi-modal approach to facial feature detection. In: Workshop on Applications of Computer Vision (2004)Google Scholar
  13. 13.
    University of Notre Dame Database,
  14. 14.
    Wang, Y., Chua, C., Ho, Y.: Facial feature detection and face recognition from 2D and 3D images. Pattern Recognition Letters 23(10), 1191–1202 (2002)MATHCrossRefGoogle Scholar
  15. 15.
    Xiao, J., Baker, S., Mathews, I., Kanade, T.: Real-time combined 2D + 3D active appearance models. In: CVPR (June 2004)Google Scholar
  16. 16.
    Lee, Y., Lee, K., Pan, S.: In: Kanade, T., Jain, A., Ratha, N.K. (eds.) AVBPA 2005. LNCS, vol. 3546, p. 219. Springer, Heidelberg (2005)Google Scholar
  17. 17.
    Johnson, A.E., Hebert, M.: Surface matching for object recognition in complex three-dimensional scenes. Image Vision Computing 16, 635–651 (1998)CrossRefGoogle Scholar
  18. 18.
    Johnson, A.E., Hebert, M.: Using Spin Images for efficient object recognition in cluttered 3D scenes. IEEE Trans. PAMI 21(5), 433–449 (1999)Google Scholar
  19. 19.
    Joachims, T.: Making large-Scale SVM Learning Practical. Advances in Kernel Methods, p. 169Google Scholar
  20. 20.
    Lyche, T., Schumaker, L.L. (eds.): Mathematical Methods for Curves and Surfaces. Oslo, pp. 135–146. Vanderbilt University Press, Nashville, TN 2000, Copyright 2001, ISBN 0-8265-1378-6Google Scholar
  21. 21.
    Theodoridis, S., Koutroumbas, K.: Pattern Recognition, ch. 11. Academic Press, London (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Cristina Conde
    • 1
  • Licesio J. Rodríguez-Aragón
    • 1
  • Enrique Cabello
    • 1
  1. 1.Universidad Rey Juan Carlos (ESCET)MóstolesSpain

Personalised recommendations