Skip to main content
SpringerLink
Log in

Semi-dynamic Facial Expression Recognition Based on Masked Displacement Image

  • Conference paper
  • First Online:
Artificial Intelligence and Signal Processing (AISP 2013)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 427))

Abstract

Facial expression recognition, as an interesting problem in pattern recognition and computer vision, has been performed by means of dynamic and static methods in recent years. Though dynamic information plays important role in facial expression recognition, utilizing the entire dynamic information of expression image sequences have high computational cost compared to the static cases. In order to reduce the computational cost, only neutral and emotional faces can be used instead of entire image sequence. In the previous research, this idea has been employed by means of DLBPHS method which vanish facial important small displacements by subtracting LBP features of neutral and emotional face images. In this paper, a novel semi-dynamic approach is proposed to utilize two face images by subtracting neutral image from emotional image. In this method, LBP features are extracted from masked difference image. In the masking procedure, eyes and mouth being important regions in facial expression recognition are selected for feature extraction step. Evaluation of the proposed algorithm on the standard databases shows a significant accuracy improvement compared to DLBPHS method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Fasel, B., Luettin, J.: Automatic facial expression analysis: a survey. Pattern Recogn. 36, 259–275 (2003)

    Article  MATH  Google Scholar 

  2. Ekman, P., Friesen, W.V.: Constants across cultures in the face and emotion. J. Pers. Soc. Psychol. 17(2), 124–129 (1971)

    Article  Google Scholar 

  3. Ekman, P.: Facial expressions of emotion: an old controversy and new findings. Philos. Trans. Royal Soc. Lond. B335, 63–69 (1992)

    Article  Google Scholar 

  4. Tian, Y., Kanade, T., Cohn, J.: Chapter 11. Facial expression analysis. In: Handbook of Face Recognition. Springer, Heidelberg (2005)

    Google Scholar 

  5. Pai, N.S., Chang, S.P.: An embedded system for real-time facial expression recognition based on the extension theory. Comput. Math. Appl. 61(8), 2101–2106 (2011)

    Article  MATH  Google Scholar 

  6. Kobayashi, H., Hara, F.: Recognition of six basic facial expression and their strength by neural network. In: Proceedings of International Workshop Robot and Human Communication, pp. 381–386 (1992)

    Google Scholar 

  7. Kobayashi, H., Hara, F.: Recognition of mixed facial expression by neural network. In: IEEE International Workshop Robot and Human Communication, pp. 387–391 (1992)

    Google Scholar 

  8. Ma, L., Khorasani, K.: Facial expression recognition using constructive feedforward neural networks. IEEE Trans. Syst. Man Cybern. Part B Cybern. 34(3), 1588–1595 (2004)

    Article  Google Scholar 

  9. Zhao, G., Pietikäinen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. Pattern Anal. Mach. Intell. 29(6), 915–928 (2007)

    Article  Google Scholar 

  10. Sadeghi, H., Raie, A.A., Mohammadi, M.R.: Facial expression recognition using geometric normalization and appearance representation. In: 8th Iranian Conference on Machine Vision and Image Processing (MVIP 2013), Zanjan, Iran, pp. 856–860 (2013)

    Google Scholar 

  11. Shan, C., Gong, Sh, McOwan, P.W.: Facial expression recognition based on local binary patterns: a comprehensive study. Image Vis. Comput. 27(6), 803–816 (2009)

    Article  Google Scholar 

  12. Lanitis, A., Taylor, C., Cootes, T.: Automatic interpretation and coding of face images using flexible models. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 743–756 (1997)

    Article  Google Scholar 

  13. Cootes, T., Edwards, G., Taylor, C.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 681–685 (2001)

    Article  Google Scholar 

  14. Edwards, G.J., Cootes, Tim F., Taylor, C.J.: Face recognition using active appearance models. In: Burkhardt, H., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1407, pp. 581–595. Springer, Heidelberg (1998)

    Google Scholar 

  15. Xiao, R., Zhao, Q., Zhang, D., Shi, P.: Facial expression recognition on multiple manifolds. Pattern Recogn. 44(1), 107–116 (2011)

    Article  MATH  Google Scholar 

  16. Zhang, L., Chen, S., Wang, T., Liu, Z.: Automatic facial expression recognition based on hybrid features. In: International Conference on Future Electrical Power and Energy Systems, Energy Procedia, vol. 17, pp. 1817–1823 (2012)

    Google Scholar 

  17. Valstar, M., Patras, I., Pantic, M.: Facial action unit detection using probabilistic actively learned support vector machines on tracked facial point data. In: Proceedings of CVPR, vol. 3, pp. 76–84 (2005)

    Google Scholar 

  18. Valstar, M., Pantic, M.: Fully automatic facial action unit detection and temporal analysis. In: Proceedings of CVPR, p. 149 (2006)

    Google Scholar 

  19. Daugmen, J.: Complete discrete 2d Gabor transforms by neutral networks for image analysis and compression. IEEE Trans. Acoust. Speech Signal Process. 36(7), 1169–1179 (1988)

    Article  Google Scholar 

  20. Bashyal, S., Venayagamoorthy, G.K.: Recognition of facial expression using Gabor wavelets and learning vector quantization. Eng. Appl. Artif. Intell. 21(7), 1056–1064 (2008)

    Article  Google Scholar 

  21. Gu, W., Xiang, C., Venkatesh, Y.V., Huang, D., Lin, H.: Facial expression recognition using radial encoding of local Gabor features and classifier synthesis. Pattern Recogn. 45, 80–91 (2012)

    Article  Google Scholar 

  22. Zhang, L., Tjondronegoro, D.: Facial expression recognition using facial movement features. IEEE Trans. Affect. Comput. 2(4), 219–229 (2011)

    Article  Google Scholar 

  23. Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study of texture measures with classification based on featured distribution. Pattern Recogn. 29, 51–59 (1996)

    Article  Google Scholar 

  24. Huang, D., Shan, C., Ardabilian, M., Wang, Y., Chen, L.: Local binary patterns and its application to facial image analysis: a survey. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 41(6), 765–781 (2011)

    Article  Google Scholar 

  25. Bassili, J.N.: Emotion recognition: the role of facial movement and the relative importance of upper and lower area of the face. J. Pers. Soc. Psychol. 37(11), 2049–2058 (1979)

    Article  Google Scholar 

  26. Ahonen, T., Hadid, A., Pietikäinen, M.: Face recognition with local binary patterns. In: Pajdla, T., Matas, J. (eds.) ECCV 2004. LNCS, vol. 3021, pp. 469–481. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  27. Ojala, T., Pietikäinen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)

    Article  Google Scholar 

  28. Hadid, A., Pietikäinen, M., Ahonen, T.: A discriminative feature space for detecting and recognizing faces. In: Proceedings of CVPR, pp. 797–804 (2004)

    Google Scholar 

  29. Ahonen, T., Hadid, A., Pietikäinen, M.: Face description with local binary patterns: Application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)

    Article  Google Scholar 

  30. Liu, W.F., Wang, Y.J.: Expression feature extraction based on difference of local binary pattern histogram sequences. In: Proceedings of IEEE International Conference on signal processing, pp. 2082–2084 (2008)

    Google Scholar 

  31. Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended cohn-kanade dataset (ck+): a complete expression dataset for action unit and emotion-specified expression. In: Proceedings of the Third International Workshop on CVPR for Human Communicative Behavior Analysis, San Francisco, USA, pp. 94–101 (2010)

    Google Scholar 

  32. Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. In: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition (FG’00), Grenoble, France, pp 46–53 (2000)

    Google Scholar 

  33. Chang, C.C., Lin, C.J.: (2012) LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. http://www.csie.ntu.edu.tw/~cjlin/papers/libsvm.pdf

  34. Ptucha, R., Savakis, A.: manifold based sparse representation for facial understanding in natural images. Image Vis. Comput. 31(5), 365–378 (2013)

    Article  Google Scholar 

  35. Lyons, M.J., Budynek, J., Akamatsu, S.: Automatic classification of single facial images. IEEE Trans. Pattern Anal. Mach. Intell. 21(12), 1357–1362 (1999)

    Article  Google Scholar 

  36. Islam, M.S., Auwatanamongkol, S.: A novel feature extraction technique for facial expression recognition. Int. J. Comput. Sci. Issues 10(3), 9–14 (2013)

    Google Scholar 

  37. Yang, S., Bhanu, B.: Understanding discrete facial expressions in video using an emotion avatar image. IEEE Trans. Syst. Man Cybern. Part B Cybern. 42(4), 980–992 (2012)

    Article  Google Scholar 

  38. Rivera, A.R., Castillo, J.R., Chae, O.: Local directional number pattern for face analysis: face and expression recognition. IEEE Trans. Image Process. 22(5), 1740–1752 (2013)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Electrical Engineering Department, Amirkabir University of Technology, Tehran, Iran

    Hamid Sadeghi & Abolghasem Asadollah Raie

Authors
  1. Hamid Sadeghi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abolghasem Asadollah Raie
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hamid Sadeghi .

Editor information

Editors and Affiliations

  1. Department of Computer Engineering, Sharif University of Technology, Tehran, Iran

    Ali Movaghar

  2. Department of Computer Engineering, Sharif University of Technology, Tehran, Iran

    Mansour Jamzad

  3. Sharif University of Technology, Tehran, Iran

    Hossein Asadi

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Sadeghi, H., Raie, A.A. (2014). Semi-dynamic Facial Expression Recognition Based on Masked Displacement Image. In: Movaghar, A., Jamzad, M., Asadi, H. (eds) Artificial Intelligence and Signal Processing. AISP 2013. Communications in Computer and Information Science, vol 427. Springer, Cham. https://doi.org/10.1007/978-3-319-10849-0_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-10849-0_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-10848-3

  • Online ISBN: 978-3-319-10849-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation