Skip to main content

Real-Time Facial Expression Recognition System Based-On Geometric Features

  • Conference paper
  • First Online:
Proceedings of the 2012 International Conference on Information Technology and Software Engineering

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 212))

Abstract

This paper presents a real-time facial expression recognition system based on geometric features. The geometric feature extraction is based on a hybrid method. This method first uses ASM to track the fiducial points coarsely and then applies a method based on threshold segmentation and deformable model to correct the mouth fiducial points due to the incorrect locations in the presence of non-linear image variations such as those caused by large facial expression changes. The geometric features extracted from the fiducial points are classified in one of the seven basic expressions by SVM classifier. The experiment shows the recognition speed can achieve about 12 fps.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Dail MN, Garrison Y, Cottrell W (1999) PCA and Gabor for expression recognition UCSD computer science and engineering technical report CS—629, August

    Google Scholar 

  2. Lisetti CL, Rumelhart DE (2002). Facial expression recognition using a neural network. In: Proceedings of the 11th international flairs conference, 16–18 May

    Google Scholar 

  3. Hong H, Neven H, Von Der Malsburg C (1998) Online facial expression recognition based on personalized galleries. In: Proceedings of third international conference on automatic face and gesture recognition

    Google Scholar 

  4. Abboud B, Davoine F, Dang M (2004) Facial expression recognition and synthesis based on an appearance model. Sign Proces Image Commun 19(8):723–740

    Article  Google Scholar 

  5. Bartlett MS, Littlewort I, Fasel G, Movellan JR (2003) Real time face detection and expression recognition: development and application to human–computer interaction. In: CVPR workshop on computer vision and pattern recognition for human–computer interaction

    Google Scholar 

  6. Lien JJ, Kanade T (1998) Automatic facial expression recognition based on FACS action units. In: Proceedings of FG’98, Nara, 14–16 April

    Google Scholar 

  7. Lien JJ-J, Kanade T (1999) Detection, tacking, and classification of action units in facial expression. J Robot Auton Syst (In press)

    Google Scholar 

  8. Dubuisson S, Davoine F, Masson M (2002) A solution for facial expression representation and recognition. Sign Proces Image Commun 17(9):657–673

    Article  Google Scholar 

  9. Koutlas A, Fotiadis DI (2008) An automatic region based methodology for facial expression recognition. In: Proceedings IEEE SMC, pp 662–666

    Google Scholar 

  10. Huang C-L, Huang Y-M (1997) Facial expression recognition using model-based feature extraction and action parameters classification. Vis Commun Image Represent 8(3):278–290

    Article  Google Scholar 

  11. Gao Y, Leung M, Hui S, Tananda M (2003) Facial expression recognition from line-based caricatures. IEEE Trans Syst Man Cybern A Syst Hum 33(3):407–412

    Article  Google Scholar 

  12. Lyons M, Akamatsu S (1998) Coding facial expressions with gabor wavelets. In: Procedings 3rd international conference automatic face and gesture recognition, pp 200–205

    Google Scholar 

  13. Cootes TF, Taylor CJ, Cooper DH, Graham J (1995) Active shape models—their training and application. Comput Vis Image Underst 61(1):38–59

    Article  Google Scholar 

  14. Milborrow S, Nicolls F (2008) Locating facial features with an extended active shape model. In: Proceedings of European conference on computer vision, pp 504–513

    Google Scholar 

  15. Wenjuan Y, Yaling L, Minghui D (2010) A real-time lip localization and tracking for lip reading, 3rd international conference on advanced computer theory and engineering (ICACTE)

    Google Scholar 

  16. Yong-hui et al H (2010) A kind of method about adaptive lip location, computer engineering and application (in Chinese)

    Google Scholar 

  17. Ekman P, Friesen WV (1978) Facial action coding system: a technique for the measurement of facial movement. Consulting Psychologists Press, Palo Alto

    Google Scholar 

  18. Tian Y, Kanade T, Cohn J (2001) Recognizing action units for facial expression analysis. IEEE Trans Pattern Anal Mach Intell 23(2):97–115

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Qiqiang Zhou .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zhou, Q., Wang, X. (2013). Real-Time Facial Expression Recognition System Based-On Geometric Features. In: Lu, W., Cai, G., Liu, W., Xing, W. (eds) Proceedings of the 2012 International Conference on Information Technology and Software Engineering. Lecture Notes in Electrical Engineering, vol 212. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34531-9_47

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-34531-9_47

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-34530-2

  • Online ISBN: 978-3-642-34531-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics