Facial Feature Extraction Using a 4D Stereo Camera System

  • Soumya Kanti Datta
  • Philip Morrow
  • Bryan Scotney
Part of the Studies in Computational Intelligence book series (SCI, volume 395)


Facial feature recognition has received much attention among the researchers in computer vision. This paper presents a new approach for facial feature extraction. The work can be broadly classified into two stages, face acquisition and feature extraction. Face acquisition is done by a 4D stereo camera system from Dimensional Imaging and the data is available in ‘obj’ files generated by the camera system. The second stage illustrates extraction of important facial features. The algorithm developed for this purpose is inspired from the natural biological shape and structure of human face. The accuracy of identifying the facial points has been shown using simulation results. The algorithm is able to identify the tip of the nose, the point where nose meets the forehead, and near corners of both the eyes from the faces acquired by the camera system.


Facial feature extraction obj file format 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kar, S., Hiremath, S., Joshi, D.G., Chadda, V.K., Bajpai, A.: A Multi-Algorithmic Face Recognition System. In: International Conference on Advanced Computing and Communications, pp. 321–326 (2006)Google Scholar
  2. 2.
    Jahanbim, S., Choi, H., Jahanbin, R., Bovik, A.C.: Automated facial feature detection and face recognition using Gabor features on range and portrait images. In: 15th IEEE International Conference on Image Processing, pp. 2768–2771 (2008)Google Scholar
  3. 3.
    Ghosh, M., Chakrabarty, A., Konar, A., Nagar, A.: Prediction of the Interactive Dynamics of Stimulated Emotions: Chaos, Limit Cycles and Stability. In: Second UKSIM European Symposium on Computer Modeling and Simulation, pp. 105–110 (2008)Google Scholar
  4. 4.
    Kawaguchi, T., Hidaka, D., Rizon, M.: Detection of eyes from human faces by Hough transform and separability filter. In: IEEE International Conference on Image Processing, vol. 1, pp. 49–52 (2000)Google Scholar
  5. 5.
    Viola, P., Jones, M.: Robust real-time face detection. International Journal of Computer Vision, 137–154 (2004)Google Scholar
  6. 6.
    Jones, M., Viola, P.: Face Recognition Using Boosted Local Features. In: IEEE International Conference on Computer Vision (2003)Google Scholar
  7. 7.
    Liao, S., Fan, W., Chung, A.C.S., Yeung, D.-Y.: Facial Expression Recognition Using Advanced Local Binary Patterns, Tsallis Entropies And Global Appearance Features. In: IEEE International Conference on Image Processing, pp. 665–668 (2006)Google Scholar
  8. 8.
    Liu, C., Wechsler, H.: Gabor Feature Based Classification Using the Enhanced Fisher Linear Discriminant Model for Face Recognition. IEEE Trans. Image Processing 11(4), 467–476 (2002)CrossRefGoogle Scholar
  9. 9.
    Yuille, A.L., Cohen, D.S., Hallinan, P.W.: Feature Extraction From Faces Using Deformable Templates. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 104–109 (1989)Google Scholar
  10. 10.
    Zhang, L.: Estimation Of The Mouth Features Using Deformable Templates. In: IEEE International Conference on Image Processing, vol. 3, pp. 328–333 (1997)Google Scholar
  11. 11.
    Kuo, P., Hannah, J.: An Improved Eye Feature Extraction Algorithm Based On Deformable Templates. In: IEEE International Conference on Image Processing, vol. 2, pp. 1206–1209 (2005)Google Scholar
  12. 12.
    Phung, S.L., Bouzerdoum, A., Chai, D.: Skin Segmentation Using Color And Edge Information. In: International Conference on Signal Processing and Its Applications, vol. 1, pp. 525–528 (July 2003)Google Scholar
  13. 13.
    Sawangsri, T., Patanavijit, V., Jitapunkul, S.: Face Segmentation Using Novel Skin-Color Map And Morphological Technique. In: Proceedings of World Academy of Science, Engineering and Technology, vol. 2 (January 2005) ISSN 1307-6884Google Scholar
  14. 14.
    Thai, H.L., Tri, M.N., Hang, T.N.: Proposal of a new method of feature extraction for face recognition. In: National Conference about Information Technology, DaLat City (2006)Google Scholar
  15. 15.
    Turk, M., Pentland, A.: Face recognition using eigenfaces. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 586–591 (1991)Google Scholar
  16. 16.
    Draper, B.A., Baek, K., Bartlett, M.S., Ross BeveRidge, J.: Recognizing Face with PCA and ICA. Computer Vision and Image Understanding 91, 115–137 (2003)CrossRefGoogle Scholar
  17. 17.
    Comon, P.: Independent component analysis—A new concept? Signal Processing 36, 287–314 (1994)zbMATHCrossRefGoogle Scholar
  18. 18.
    Bartlett, M.S., Movellan, J.R., Sejnowski, T.J.: Face Recognition by Independent Component Analysis. IEEE Transactions on Neural Networks 13(6) (November 2002)Google Scholar
  19. 19.
    Gonzalez, R.C., Woods, R.E.: Digital Image Processing. Addison-Wesley Pub. Co. (January 2002)Google Scholar
  20. 20.
    Wang, Z., Huangfu, F.K., Wan, J.W.: Human Face Feature Extraction Using Deformable Templates. Journal of Computer Aided Design and Computer Graphics of China 12(5), 333–336 (2000)Google Scholar
  21. 21.
    Chakraborty, A., Konar, A., Chakraborty, U.K., Chatterjee, A.: Emotion Recognition From Facial Expressions and Its Control Using Fuzzy Logic. IEEE Transactions on Systems, Man and Cybernetics 39(4), 726–743 (2009)CrossRefGoogle Scholar
  22. 22.

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Soumya Kanti Datta
    • 1
  • Philip Morrow
    • 2
  • Bryan Scotney
    • 2
  1. 1.Communication & Computer SecurityInstitut EurecomSophia AntipolisFrance
  2. 2.School of Computing & Information EngineeringUniversity of UlsterColeraineUK

Personalised recommendations