Mood and Its Mapping onto Facial Expressions

  • Diana Arellano
  • Francisco J. Perales
  • Javier Varona
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8563)


This paper presents a method for the representation of mood in FACS-based facial expressions. To achieve this, a mapping of FACS Action Units (AUs) into the Pleasure-Arousal-Dominance (PAD) space is done. The PAD space is used as our mood model. From this mapping a set of rules are obtained, which compute the activation areas and intensities of each AU in the PAD. To validate these rules, we conducted an experiment, shedding light on the AUs combinations that result in recognizable expressions of certain mood.


Affect recognition Facial Expressions Mood FACS 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ekman, P.: Darwin’s contributions to our understanding of emotional expressions. Philos. T. Roy. Soc. B. 364(1535), 3449–3451 (2009)CrossRefGoogle Scholar
  2. 2.
    Sedikides, C.: Changes in the Valence of the Self as a Function of Mood. Review of Personality and Social Psychology 14, 271–311 (1992)Google Scholar
  3. 3.
    Neumann, R., Seibt, B., Strack, F.: The influence of mood on the intensity of emotional responses: Disentangling feeling and knowing. Cogn. Emot. 15(6), 725–747 (2001), doi:10.1080/02699930143000266CrossRefGoogle Scholar
  4. 4.
    Faigin, G.: The Artist’s Complete Guide to Facial Expressions. Watson-Guptill, New York (1990)Google Scholar
  5. 5.
    Ekman, P., Friesen, W.V., Hager, J.C.: The Facial Action Coding System. Weidenfeld & Nicolson, London (2002)Google Scholar
  6. 6.
    Mehrabian, A.: Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament. Curr. Psychol. 14(4), 261–292 (1996)CrossRefMathSciNetGoogle Scholar
  7. 7.
    Payne, L.L., Shaw, T., Caldwell, L.L.: Movies and Mood - An Exploration of the Critical Variables related to Mood States. In: Proceedings of the 1997 Northeastern Recreation Research Symposium, pp. 60–63 (1998)Google Scholar
  8. 8.
    Wassermann, K.C., Eng, K., Verschure, P., Manzolli, J.: Live Soundscape Composition Based on Synthetic Emotions. IEEE MultiMedia 10(4), 82–90 (2003)CrossRefGoogle Scholar
  9. 9.
    Gebhard, P.: ALMA: A layered model of affect. In: AAMAS 2005, pp. 29–36 (2005)Google Scholar
  10. 10.
    Burkitt, M., Romano, D.M.: The Mood and Memory of Believable Adaptable Socially Intelligent Characters. In: Prendinger, H., Lester, J., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 372–379. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  11. 11.
    Peña, L., Peña, J.-M., Ossowski, S.: Representing emotion and mood states for virtual agents. In: Klügl, F., Ossowski, S. (eds.) MATES 2011. LNCS, vol. 6973, pp. 181–188. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  12. 12.
    Santos, R., Marreiros, G., Ramos, C., Neves, J., Bulas-Cruz, J.: Personality, Emotion, and Mood in Agent-Based Group Decision Making. IEEE Intell. Syst. 26(6), 58–66 (2011), doi:10.1109/MIS.2011.92CrossRefGoogle Scholar
  13. 13.
    Kasap, Z., Ben Moussa, M., Chaudhuri, P., Magnenat-Thalmann, N.: Making Them Remember - Emotional Virtual Characters with Memory. IEEE Comput. Graph. Appl. 29(1), 20–29 (2009)CrossRefGoogle Scholar
  14. 14.
    Ben Moussa, M., Magnenat-Thalmann, N.: Applying Affect Recognition in Serious Games: The PlayMancer Project. In: Egges, A., Geraerts, R., Overmars, M. (eds.) MIG 2009. LNCS, vol. 5884, pp. 53–62. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  15. 15.
    Courgeon, M., Clavel, C., Martin, J.C.: Appraising emotional events during a real-time interactive game. In: AFFINE 2009, pp. 7:1–7:5. ACM, New York (2009)Google Scholar
  16. 16.
    Fabri, M., Moore, D.J., Hobbs, D.J.: Designing Avatars for Social Interactions. In: Canamero, L., Aylett, R. (eds.) Animating Expressive Characters for Social Interaction. Advances in Consciousness Research Series, Benjamins Publishing (2008)Google Scholar
  17. 17.
    Gebhard, P.: Emotionalisierung interaktiver Virtueller Charaktere. Dissertation, Universität des Saarlandes (2007)Google Scholar
  18. 18.
    Russell, J.A., Mehrabian, A.: Evidence for a three-factor theory of emotions. J. Res. Pers. 11(3), 273–294 (1977)CrossRefGoogle Scholar
  19. 19.
    Facial Expression Repertoire (FER),
  20. 20.
    Lance, B., Marsella, S.: Glances, glares, and glowering: How should a virtual human express emotion through gaze? In: AAMAS, vol. 20, pp. 50–69 (2010)Google Scholar
  21. 21.
    Bee, N., Falk, B., André, E.: Simplified Facial Animation Control Utilizing Novel Input Devices: A Comparative Study. In: IUI 2009, pp. 197–206 (2009)Google Scholar
  22. 22.
    Bradley, M.M., Lang, P.J.: Measuring emotion: The self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psy. 25, 49–59 (1994)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Diana Arellano
    • 1
  • Francisco J. Perales
    • 2
  • Javier Varona
    • 2
  1. 1.Institute of AnimationFilmakademie Baden-WürttembergGermany
  2. 2.Computer Graphics, Computer Vision and Artificial Intelligence GroupUniversity of Balearic IslandsSpain

Personalised recommendations