Accurate Facial Feature Localization on Expressional Face Images Based on a Graphical Model Approach

  • Chia-Te Liao
  • Chih-Hsueh Duan
  • Shang-Hong Lai
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6298)


Recent emergent face-related applications, such as face recognition and facial expression recognition, usually rely on accurate facial feature point localization. However, the variations in facial appearance, especially due to expressions, often make accurate localization of facial features very difficult. This paper proposes a graphical-model based approach for facial feature localization on expressional face images. By using the model, for localization while the influence between its local appearance and relative position is balanced. The experimental results show that our algorithm gives more accurate results than ASM and the AdaBoost-based facial feature detectors on Cohn-Kanade face database.


Facial feature detection facial feature localization graphical model facial expression 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Lee, K.K., Xu, Y.: Real-time Estimation of Facial Expression Intensity. In: Proc. the 2003 IEEE Internatiol Conference on Robotics and Automation, pp. 2567–2572 (2003)Google Scholar
  2. 2.
    Tian, Y., Kanade, T., Cohn, J.: Recognizing Action Units for Facial Expression Analysis. IEEE Trans. Pattern Anal. Mach. Intell. 23, 97–115 (2001)CrossRefGoogle Scholar
  3. 3.
    MPEG-4 Video and SNHC. Text of ISO/IEC FDIS 14496-2: Visual. Doc. ISO/IEC N2502, Atlantic City MPEG Meeting (October 1998)Google Scholar
  4. 4.
    Viola, P., Jones, M.J.: Robust Real-time Face Detection. Intern. J. Computer Vision 57(2), 151–173 (2004)Google Scholar
  5. 5.
    Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active Shape Models - Their Training and Application. Computer Vision and Image Understanding 61(1), 38–59 (1995)CrossRefGoogle Scholar
  6. 6.
    Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active Appearance Models. In: Burkhardt, H., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1407, pp. 484–498. Springer, Heidelberg (1998)CrossRefGoogle Scholar
  7. 7.
    Cristinacce, D., Cootes, T., Scott, I.: A Multi-Stage Approach to Facial Feature Detection. In: Proc. 15th British Machine Vision Conference, pp. xx-yy (2004)Google Scholar
  8. 8.
    Cristinacce, D., Cootes, T.: Automatic Feature Localization with Constrained Local Models. Pattern Recognition 41, 3054–3067 (2008)zbMATHCrossRefGoogle Scholar
  9. 9.
    Lai, J.H., Yuen, P.C., Chen, W.S., Lao, S., Kawade, M.: Robust Facial Feature Point Detection under Nonlinear Illuminations. In: Proc. ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, pp. 168–174 (2001)Google Scholar
  10. 10.
    Gargesha, M., Panchanathan, S.: A Hybrid Technique for Facial Feature Point Detection. In: Proc. the 5th IEEE Southwest Symposium on Image Analysis and Interpretation, pp. 134–138 (2002)Google Scholar
  11. 11.
    Hamouz, M., Kittler, J., Kamarainen, J.-K., Paalanen, P., Kalviainen, H.: Affine-invariant Face Detection and Localization Using GMM-based Feature Detectors and Enhanced Appearance Model. In: Proc. the 6th IEEE Intern. Conf. Automatic Face and Gesture Recognition, pp. 67–72 (2004)Google Scholar
  12. 12.
    Jesorsky, O., Kirchberg, K.J., Frischholz, R.W.: Robust Face Detection Using the Hausdorff Distance. In: Proc. the 3rd Intern. Conf. Audio- and Video-Based Biometric Person Authentication, pp. 90–95 (2001)Google Scholar
  13. 13.
    Feris, R.S., Gemmell, J., Toyama, K., Kruger, V.: Hierarchical Wavelet Networks for Facial Feature Localization. In: Proc. the 5th Intern. Conf. Automatic Face and Gesture Recognition, pp. 118–123 (2002)Google Scholar
  14. 14.
    Kanade, T., Cohn, J., Tian, Y.: Comprehensive Database for Facial Expression Analysis. In: Proc. Int’l Conf. Face and Gesture Recognition, pp. 46–53 (2000)Google Scholar
  15. 15.
    Intel, Intel Open Source Computer Vision Library, v2.1 (April 2010),
  16. 16.
    Milborrow, S., Nicolls, F.: Locating Facial Features with an Extended Active Shape Model. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol. 5305, pp. 504–513. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  17. 17.
    Castrillón, M., Déniz, O., Hernández, D., Lorenzo, J.: A Comparison of Face and Facial Feature Detectors based on the Viola-Jones General Object Detection Framework. Machine Vision and Applications (Published online: February 9, 2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Chia-Te Liao
    • 1
  • Chih-Hsueh Duan
    • 1
  • Shang-Hong Lai
    • 1
  1. 1.Dept. of Computer ScienceNational Tsing Hua UniversityHsinchuTaiwan

Personalised recommendations