Continuous Emotion Recognition Using Gabor Energy Filters

  • Mohamed Dahmane
  • Jean Meunier
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6975)


Automatic facial expression analysis systems try to build a mapping between the continuous emotion space and a set of discrete expression categories (e.g. happiness, sadness). In this paper, we present a method to recognize emotions in terms of latent dimensions (e.g. arousal, valence, power). The method we applied uses Gabor energy texture descriptors to model the facial appearance deformations, and a multiclass SVM as base learner of emotions. To deal with more naturalistic behavior, the SEMAINE database of naturalistic dialogues was used.


Support Vector Machine Emotion Recognition Local Binary Pattern Gesture Recognition Baseline Method 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Dahmane, M., Meunier, J.: Emotion recognition using dynamic grid-based hog features. In: 2011 IEEE International Conference on Automatic Face Gesture Recognition and Workshops (FG 2011), pp. 884–888 (March 2011)Google Scholar
  2. 2.
    Donato, G., Bartlett, M.S., Hager, J.C., Ekman, P., Sejnowski, T.J.: Classifying facial actions. IEEE Transactions on Pattern Analysis and Machine Intelligence 21(10), 974–989 (1999)CrossRefGoogle Scholar
  3. 3.
    Fasel, B., Luettin, J.: Automatic facial expression analysis: a survey. Pattern Recognition 36(1), 259–275 (2003)CrossRefzbMATHGoogle Scholar
  4. 4.
    Flaton, K., Toborg, S.: An approach to image recognition using sparse filter graphs. In: International Joint Conference on Neural Networks, vol. (1), pp. 313–320 (1989)Google Scholar
  5. 5.
    Grigorescu, C., Petkov, N., Westenberg, M.A.: Contour detection based on nonclassical receptive field inhibition. IEEE Transactions on Image Processing 12(7), 729–739 (2003)CrossRefGoogle Scholar
  6. 6.
    Lades, M., Vorbrüggen, J.C., Buhmann, J., Lange, J., von der Malsburg, C., Würtz, R.P., Konen, W.: Distortion invariant object recognition in the dynamic link architecture. IEEE Transactions on Computers 3(42), 300–311 (1993)CrossRefGoogle Scholar
  7. 7.
    Liu, C., Wechsler, H.: Independent component analysis of gabor features for face recognition. IEEE Trans. on Neural Networks 4(14), 919–928 (2003)Google Scholar
  8. 8.
    Lyons, M., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding facial expressions with gabor wavelets. In: Proceedings of the 3rd International Conference on Face & Gesture Recognition, FG 1998, p. 200. IEEE Computer Society, Washington, DC, USA (1998)Google Scholar
  9. 9.
    McKeown, G., Valstar, M., Pantic, M., Cowie, R.: The semaine corpus of emotionnally coloured character interactions. In: Proc. Int’l Conf. Mutlimedia & Expo., pp. 1–6 (2010)Google Scholar
  10. 10.
    Pantic, M., Rothkrantz, L.: Automatic Analysis of Facial Expressions: The State of the Art. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12), 1424–1445 (2000)CrossRefGoogle Scholar
  11. 11.
    Petkov, N., Westenberg, M.A.: Suppression of contour perception by band-limited noise and its relation to non-classical receptive field inhibition. Biological Cybernetics 88(10), 236–246 (2003)CrossRefzbMATHGoogle Scholar
  12. 12.
    Schuller, B., Valstar, M., Eyben, F., McKeown, G., Cowie, R., Pantic, M.: Avec 2011 - the First International Audio/Visual Emotion Challenge. In: D´Mello, S., et al. (eds.) ACII 2011, Part II. LNCS, vol. 6975, pp. 415–424. Springer, Heidelberg (2011)Google Scholar
  13. 13.
    Shen, L., Bai, L.: A review on gabor wavelets for face recognition. Pattern Analysis and Applications 2(9), 273–292 (2006)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Tian, Y., Kanade, T., Cohn, J.: Evaluation of gabor wavelet–based facial action unit recognition in image sequences of increasing complexity. In: Proc. of the 5th IEEE Int. Conf. on Automatic Face and Gesture Recognition (2002)Google Scholar
  15. 15.
    Valstar, M., Pantic, M.: Fully automatic facial action unit detection and temporal analysis. In: CVPRW, p. 149 (2006)Google Scholar
  16. 16.
    Whitehill, J., Littlewort, G., Fasel, I., Bartlett, M., Movellan, J.: Toward Practical Smile Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 31(11), 2106–2111 (2009)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Mohamed Dahmane
    • 1
  • Jean Meunier
    • 1
  1. 1.CP 6128, Succursale Centre-VilleDIRO, University of MontrealMontrealCanada

Personalised recommendations