Modeling Emotions in Simulated Computer-Mediated Human-Human Interactions in a Virtual Game Environment

  • Andreas Scheck
  • Holger Hoffmann
  • Harald C. Traue
  • Henrik Kessler
Part of the Cognitive Technologies book series (COGTECH)


Emotions form a major part of humans’ day-to-day lives, especially in the areas of communication and interaction with others. They modify our gesture or facial expression and therefore serve as an additional communication channel. Furthermore, they have an impact on decision-making. This has two possible implications for computer science in the field of human-computer-interaction. First, computers should be able to adequately recognize and model human emotions if they genuinely want to help users in applied fields of human-human interactions. Second, a reliable and valid computer model of users’ emotions is the basis of effective implementations for human-computer interaction, with the computer thus being able to adapt to users’ emotions flexibly in any given application.

From an empirical point of view, though, computerized recognition of human emotions still lacks substantial reliability and validity. In our opinion there are two main reasons for this shortcoming. First, triggers of emotional responses, i.e. eliciting situations, are typically complex in nature and thus difficult to predict or even assess once apparent. Second, the emotional response itself is a complex reaction involving subjects’ individual learning history, appraisal, preparedness, bodily reactions, and so forth. Both factors make it difficult for any algorithm to recognize real-life emotions.

In a venture to approach this problem, the main goal of our study is to test an implementation of a computer model (COMPLEX) that predicts user emotions in a simulated human-human interaction. The prediction is supported by an elaborate appraisal model of emotions and the assessment of user bodily reactions, facial expression and speech. This article will give an overview of the theoretical background, the practical implementation of our new approach and first results of an empirical validation.



This work was done within the Transregional Collaborative Research Centre SFB/TRR 62 “Companion-Technology for Cognitive Technical Systems” funded by the German Research Foundation (DFG).


  1. 1.
    Becker, C.: Simulation der emotionsdynamik eines künstlichen humanoiden agenten. Master’s thesis, Bielefeld (2003)Google Scholar
  2. 2.
    Egges, A., Kshirsagar, S., Magnenat-Thalmann, N.: A model for personality and emotion simulation. Lecture Notes in Artificial Intelligence, vol. 1, pp. 453–461. Springer, Berlin/Heidelberg (2003)Google Scholar
  3. 3.
    Ekman, P.: Are there basic emotions? Psychol. Rev. 99(3), 550–553 (1992)CrossRefGoogle Scholar
  4. 4.
    Ekman, P.: Facial expression and emotion. Am. Psychol. 48(4), 384–92 (1993)CrossRefGoogle Scholar
  5. 5.
    Ekman, P.: Strong evidence for universals in facial expressions: a reply to Russell’s mistaken critique. Pychol. Bull. 115(2), 268–287 (1994)CrossRefGoogle Scholar
  6. 6.
    Gebhard, P.: Alma: a layered model of affect. In: Proceedings of the 4th International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS ’05, pp. 29–36. ACM, New York, NY (2005). doi:
  7. 7.
    Hoffmann, H., Scheck, A., Schuster, T., Walter, S., Limbrecht, K., Traue, H.C., Kessler, H.: Mapping discrete emotions into the dimensional space: an empirical approach. In: 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 3316–3320. IEEE, Piscataway (2012)Google Scholar
  8. 8.
    Marsella, S., Gratch, J., Petta, P.: Computational models of emotion. In: Blueprint for Affective Computing. Series in Affective Science, pp. 21–46. Oxford University Press, Oxford (2010)Google Scholar
  9. 9.
    Mehrabian, A.: Pleasure-arousal-dominance: a general framework for describing and measuring individual differences in temperament. Curr. Psychol. 14(4), 261–292 (1996)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Ortony, A., Clore, G.L., Collins A.: The Cognitive Structure of Emotions. Cambridge University Press, Cambridge (1988)CrossRefGoogle Scholar
  11. 11.
    Reilly, W.S.N.: Believable social and emotional agents. Master’s thesis, Carnegie Mellon University Pittsburgh (1996)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Andreas Scheck
    • 1
  • Holger Hoffmann
    • 1
  • Harald C. Traue
    • 1
  • Henrik Kessler
    • 2
  1. 1.Medical PsychologyUniversity of UlmUlmGermany
  2. 2.University Clinic for Psychosomatic Medicine and PsychotherapyBochumGermany

Personalised recommendations