Advertisement

Conveying Real-Time Ambivalent Feelings through Asymmetric Facial Expressions

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7660)

Abstract

Achieving effective facial emotional expressivity within a real-time rendering constraint requests to leverage on all possible inspiration sources and especially from the observations of real individuals. One of them is the frequent asymmetry of facial expressions of emotions, which allows to express complex emotional feelings such as suspicion, smirk, and hidden emotion due to social conventions. To achieve such a higher degree of facial expression, we propose a new model for mapping emotions onto a small set of 1D Facial Part Actions (FPA)s that act on antagonist muscle groups or on individual head orientation degree of freedoms. The proposed linear model can automatically drive a large number of autonomous virtual humans or support the interactive design of complex facial expressions over time.

Keywords

VAD emotional model facial parameters asymmetric facial expression real-time application 
This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Ahn, J., Gobron, S., Silvestre, Q., Thalmann, D.: Asymmetrical facial expressions based on an advanced interpretation of two-dimensional russells emotional model. In: ENGAGE Summer School Workshop (2010)Google Scholar
  2. 2.
    Albrecht, I., Schröder, M., Haber, J., Seidel, H.P.: Mixed feelings: expression of non-basic emotions in a muscle-based talking head. VR 8(4), 201–212 (2005)Google Scholar
  3. 3.
    Averill, J.R.: A semantic atlas of emotional concepts. JSAS Catalog of Selected Documents in Psychology 5(330), 1–64 (1975)Google Scholar
  4. 4.
    Bassili, J.N.: Emotion recognition: The role of facial movement and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology 37(11), 2049–2058 (1979)CrossRefGoogle Scholar
  5. 5.
    Borod, J., Haywood, C., Koff, E.: Neuropsychological aspects of facial asymmetry during emotional expression: A review of the normal adult literature. Neuropsychology Review 7(1), 41–60 (1997)CrossRefGoogle Scholar
  6. 6.
    Borod, J.C., Caron, H.S.: Facedness and emotion related to lateral dominance, sex and expression type. Neuropsychologia 18(2), 237–241 (1980)CrossRefGoogle Scholar
  7. 7.
    Borod, J.C., Koff, E., Yecker, S., Santschi, C., Schmidt, J.M.: Facial asymmetry during emotional expression: Gender, valence, and measurement technique. Neuropsychologia 36(11), 1209–1215 (1998)CrossRefGoogle Scholar
  8. 8.
    Boucher, J.D., Ekman, P.: Facial areas and emotional information. Journal of Communication 25(2), 21–29 (1975)CrossRefGoogle Scholar
  9. 9.
    Bradley, M.M., Lang, P.J.: Affective norms for english words (anew): Stimuli, instruction manual and affective ratings. C-1, University of Florida, Center for Research in Psychophysiology, Gainesville (1999)Google Scholar
  10. 10.
    Bush, L.E.: Individual differences multidimensional scaling of adjectives denoting feelings. Journal of Personality and Social Psychology 25(1), 50–57 (1973)CrossRefGoogle Scholar
  11. 11.
    Campbell, R.: The lateralisation of emotion: A critical review. International Journal of Psychology 17(1-4), 211–229 (1982)CrossRefGoogle Scholar
  12. 12.
    Chmiel, A., Sienkiewicz, J., Paltoglou, G., Buckley, K., Thelwall, M., Holyst, J.A.: Negative emotions accelerating users activity in bbc forum. CoRR 1011.5459 (2010)Google Scholar
  13. 13.
    Cowie, R.: Perceiving emotion: towards a realistic understanding of the task. Philosophical Transactions of the Royal Society B 364, 3515–3525 (2009)CrossRefGoogle Scholar
  14. 14.
    Deng, Z., Neumann, U.: Data-Driven 3D Facial Animation. Springer (2007)Google Scholar
  15. 15.
    Dimberg, U., Petterson, M.: Facial reactions to happy and angry facial expressions: Evidence for right hemisphere dominance. Psychophysiology 37(5), 693–696 (2000)CrossRefGoogle Scholar
  16. 16.
    Egges, A., Kshirsagar, S., Magnenat-Thalmann, N.: Generic personality and emotion simulation for conversational agents. CAVW 15, 1–13 (2004)Google Scholar
  17. 17.
    Ekman, P.: Universals and cultural differences in facial expressions of emotions. In: Nebraska Symposium on Motivation, pp. 207–283. Univ. of Nebraska Press (1971)Google Scholar
  18. 18.
    Ekman, P.: About brows: Emotional and conversational signals. In: von Cranach, M., Foppa, K., Lepenies, W., Ploog, D. (eds.) Human Ethology, pp. 169–248. Cambridge University Press, Cambridge (1979)Google Scholar
  19. 19.
    Ekman, P., Friesen, W.V.: Facial action coding system. Consulting Psychologists Press, CA (1978)Google Scholar
  20. 20.
    Ekman, P., Friesen, W.V.: Felt, false, and miserable smiles. Journal of Nonverbal Behavior 6(4), 238–252 (1982)CrossRefGoogle Scholar
  21. 21.
    Ekman, P., Friesen, W.V., Ancoli, S.: Facial signs of emotional experience. Journal of Personality and Social Psychology 39(6), 1125–1134 (1980)CrossRefGoogle Scholar
  22. 22.
    Ekman, P., Roper, G., Hager, J.C.: Deliberate facial movement. Child Development 51(3), 886–891 (1980)CrossRefGoogle Scholar
  23. 23.
    Krumhuber, E., Kappas, A.: Moving smiles: The role of dynamic components for the perception of the genuineness of smiles. Journal of Nonverbal Behavior 29(1), 3–24 (2005)CrossRefGoogle Scholar
  24. 24.
    Lance, B., Marsella, S.: Glances, glares, and glowering: how should a virtual human express emotion through gaze? AAMAS 20(1), 50–69 (2010)Google Scholar
  25. 25.
    Magnenat-Thalmann, N., Thalmann, D.: Handbook of Virtual Humans. Wiley (2004)Google Scholar
  26. 26.
    Martin, J.C., Niewiadomski, R., Devillers, L., Buisine, S., Pelachaud, C.: Multimodal complex emotions: Gesture expressivity and blended facial expressions. International Journal of Humanoid Robotics 3(3), 269–291 (2006)CrossRefGoogle Scholar
  27. 27.
    Mehrabian, A., Russell, J.A.: An Approach to Environmental Psychology. The MIT Press (1974)Google Scholar
  28. 28.
    Parke, F.I., Waters, K.: Computer Facial Animation. AK Peters (2008)Google Scholar
  29. 29.
    Paterson, H.M., Pollick, F.E., Sanford, A.J.: The role of velocity in affect discrimination. In: Proceedings of the 23rd Annual Conference of the Cognitve Science Society, pp. 756–761 (2001)Google Scholar
  30. 30.
    Pelachaud, C.: Modelling multimodal expression of emotion in a virtual agent. Philosophical Transactions of The Royal Society B 364(1535), 3539–3548 (2009)CrossRefGoogle Scholar
  31. 31.
    Pelachaud, C., Poggi, I.: Subtleties of facial expressions in embodied agents. Journal of Visualization and Computer Animation 13(5), 301–312 (2002)CrossRefzbMATHGoogle Scholar
  32. 32.
    Pighin, F., Hecker, J., Lischinski, D., Szeliski, R., Salesin, D.H.: Synthesizing realistic facial expressions from photographs. In: SIGGRAPH 1998, pp. 75–84. ACM, New York (1998)Google Scholar
  33. 33.
    Russell, J.A.: A circumplex model of affect. Journal of Personality and Social Psychology 39(6), 1161–1178 (1980)CrossRefGoogle Scholar
  34. 34.
    Sackeim, H.A., Gur, R.C., Saucy, M.C.: Emotions are expressed more intensely on the left side of the face. Science 202(4366), 434–436 (1978)CrossRefGoogle Scholar
  35. 35.
    Schatz, H.: CHARACTER. Bulfinch Press (2006)Google Scholar
  36. 36.
    Schiff, B.B., MacDonald, B.: Facial asymmetries in the spontaneous response to positive and negative emotional arousal. Neuropsychologia 28(8), 777–785 (1990)CrossRefGoogle Scholar
  37. 37.
    Schwartz, G.E., Ahern, G.L., Brown, S.L.: Lateralized facial muscle response to positive and negative emotional stimuli. Psychophysiology 16(6), 561–571 (1979)CrossRefGoogle Scholar
  38. 38.
    Tena, J.R., De la Torre, F., Matthews, I.: Interactive region-based linear 3d face models. ACM Trans. Graph. 30(4), 76:1–76:10 (2011)Google Scholar
  39. 39.
    Thelwall, M., Buckley, K., Paltoglou, G., Cai, D., Kappas, A.: Sentiment in short strength detection informal text. JASIST 61(12), 2544–2558 (2010)CrossRefGoogle Scholar
  40. 40.
    Vinayagamoorthy, V., Gillies, M., Steed, A., Tanguy, E., Pan, X., Loscos, C., Slater, M.: Building expression into virtual characters. In: Eurographics Conference State of the Art Report (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  1. 1.Immersive Interaction Group (IIG), EPFLSwitzerland
  2. 2.Institute of Information and Communication Systems (ISIC), HE-ArcSwitzerland
  3. 3.Institute of Media Innovation (IMI), NTUSingapore

Personalised recommendations

Cite paper

Buy options