Skip to main content

Spontaneous Facial Expression Recognition: Automatic Aggression Detection

  • Conference paper
Hybrid Artificial Intelligent Systems (HAIS 2012)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 7208))

Included in the following conference series:

Abstract

The study presents results of analysis of spontaneous facial expression. Their purpose was to isolate aggression from the facial expressions. Based on tracking specific points of a face, selected from a video sequence, a trajectory of the face’s movement was made. Then, using the Gabor filter and Local Binary Patterns (LBP) operator, extraction and analysis of the facial features was performed, from which vectors of aggression features have been detailed. Using the support vector machine (SVM) classifier, classification of the spontaneous facial data was made in order to detect the aggression. A correct recognition rate of the method, as high as 85% as well as a high ability for generalization was obtained.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abraham, A., Corchado, E., Corchado, J.M.: Hybrid Learning Machines. Neurocomputing 72(13-15), 2729–2730 (2009)

    Article  Google Scholar 

  2. Ahonen, T., Hadid, A., Pietikäinen, M.: Face Recognition with Local Binary Patterns. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 469–481. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  3. Bartlett, M., Littlewort, G., Lainscsek, C., Fasel, I., Movellan, J.: Machine Learning Methods for Fully Automatic Recognition of Facial Expressions and Facial Actions. In: IEEE Int. Conf. on Systems, Man and Cybernetics, pp. 592–597 (2004)

    Google Scholar 

  4. Brzozowska, K., Dawidowicz, A.L.: Partial Filter Method. Applied Mathematics 10, 69–107 (2009)

    Google Scholar 

  5. Cohen, I., Sebe, N., Garg, A., Chen, L., Huang, T.: Facial Expression Recognition from Video Sequences: Temporal and Static Modeling. Computer Vision and Image Understanding 91(1-2), 160–187 (2003)

    Article  Google Scholar 

  6. Cohn, J.F., Schmidt, K.L.: The Timing of Facial Motion in Posed and Spontaneous Smiles. Int. Journal of Wavelets, Multiresolution and Information Processing 2, 1–12 (2004)

    Article  Google Scholar 

  7. Corchado, E., Abraham, A., Carvalho, A.: Hybrid Intelligent Algorithms and Applications. Information Sciences 180(14), 2633–2634 (2010)

    Article  MathSciNet  Google Scholar 

  8. Corchado, E., Graña, M., Wozniak, M.: New Trends and Applications on Hybrid Artificial Intelligence Systems. Neurocomputing 75(1), 61–63 (2012)

    Article  Google Scholar 

  9. Ekman, P., Friesen, W.: Facial Action Coding Systems: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)

    Google Scholar 

  10. Essa, I., Pentland, A.: Coding, Analysis, Interpretation, and Recognition of Facial Expressions. IEEE Trans. on PAMI 19, 757–763 (1997)

    Article  Google Scholar 

  11. Fasel, B., Luettin, J.: Automatic Facial Expression Analysis: A Survey. Pattern Recognition 36(1), 259–275 (2003)

    Article  MATH  Google Scholar 

  12. Hadid, A., Pietikainen, M., Ahonen, T.: A Discriminative Feature Space for Detecting and Recognizing Faces. In: Proc. Computer Vision and Pattern Recognition, pp. 797–804 (2004)

    Google Scholar 

  13. Ioannou, S., Raoouzaiou, A., Tzouvaras, V., Mailis, T., Kaollias, K.: Emotion Recognition Through Facial Expression Analysis Based on a Neurofuzzy Method. Neural Networks 18, 423–435 (2005)

    Article  Google Scholar 

  14. Ojala, T., Pietikainen, M., Harwood, D.: A Comparative Study of Texture Measures with Classification Based on Featured Distribution. Pattern Recognition 29(1), 51–59 (1996)

    Article  Google Scholar 

  15. Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution Gray-scale and Rotation Invariant Texture with Local Binary Patterns. IEEE Trans. on Pattern Analysis and Machine Intelligence 7(7), 971–987 (2002)

    Article  Google Scholar 

  16. Pantic, M., Rothkrantz, L.: Automatic Analysis of Facial Expressions: The State of the Art. IEEE Trans. on Pattern Analysis and Machine Intelligence 22(12), 1424–1445 (2000)

    Article  Google Scholar 

  17. Samal, A., Iyengar, P.A.: Automatic Recognition and Analysis of Human Faces and Facial Expressions: A Survey. Pattern Recognition 25(1), 65–77 (1992)

    Article  Google Scholar 

  18. Sohail, A.S.M., Bhattacharya, P.: Detection of Facial Feature Points Using Anthropometric Face Model. In: Signal Processing for Image Enhancement and Multimedia Processing, pp. 189–200. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  19. Tao, H., Huang, T.S.: Explanation-based Facial Motion Tracking Using a Piecewise Bezier Volume Deformation Mode. In: IEEE CVPR 1999, pp. 611–617 (1999)

    Google Scholar 

  20. Vapnik, V.N.: Statistical Learning Theory. John Wiley, New York (1998)

    MATH  Google Scholar 

  21. Viola, P., Jones, M.J.: Rapid Object Detection Using a Boosted Cascade of Simple Features. In: IEEE CVPR 2001, pp. 511–518 (2001)

    Google Scholar 

  22. Wallhoff, F.: Facial Expressions and Emotion Database, Technische Univesität München (2006), http://www.mmk.ei.tum.de/~waf/fgnet/feedtum.html

  23. Zeng, Z., Pantic, M., Roisman, G.I., Wen, Z., Hu, Y., Huang, T.S.: Spontaneous Emotional Facial Expression Detection. Journal of Multimedia 1(5), 1–8 (2006)

    Article  Google Scholar 

  24. Zeng, Z., Pantic, M., Roisman, G.I., Huang, T.S.: A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions. IEEE Trans. on Pattern Analysis and Machine Intelligence 31(1), 39–58 (2009)

    Article  Google Scholar 

  25. Zhao, W., Challappa, R., Phillips, P., Rosenfeld, A.: Face Recognition: a Literature Survey. ACM Computing Surveys 35(4), 399–458 (2003)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Piątkowska, E., Martyna, J. (2012). Spontaneous Facial Expression Recognition: Automatic Aggression Detection. In: Corchado, E., Snášel, V., Abraham, A., Woźniak, M., Graña, M., Cho, SB. (eds) Hybrid Artificial Intelligent Systems. HAIS 2012. Lecture Notes in Computer Science(), vol 7208. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28942-2_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-28942-2_14

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-28941-5

  • Online ISBN: 978-3-642-28942-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics