Skip to main content
SpringerLink
Log in

Conveying Real-Time Ambivalent Feelings through Asymmetric Facial Expressions

  • Conference paper
Motion in Games (MIG 2012)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 7660))

Included in the following conference series:

Abstract

Achieving effective facial emotional expressivity within a real-time rendering constraint requests to leverage on all possible inspiration sources and especially from the observations of real individuals. One of them is the frequent asymmetry of facial expressions of emotions, which allows to express complex emotional feelings such as suspicion, smirk, and hidden emotion due to social conventions. To achieve such a higher degree of facial expression, we propose a new model for mapping emotions onto a small set of 1D Facial Part Actions (FPA)s that act on antagonist muscle groups or on individual head orientation degree of freedoms. The proposed linear model can automatically drive a large number of autonomous virtual humans or support the interactive design of complex facial expressions over time.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ahn, J., Gobron, S., Silvestre, Q., Thalmann, D.: Asymmetrical facial expressions based on an advanced interpretation of two-dimensional russells emotional model. In: ENGAGE Summer School Workshop (2010)

    Google Scholar 

  2. Albrecht, I., Schröder, M., Haber, J., Seidel, H.P.: Mixed feelings: expression of non-basic emotions in a muscle-based talking head. VR 8(4), 201–212 (2005)

    Google Scholar 

  3. Averill, J.R.: A semantic atlas of emotional concepts. JSAS Catalog of Selected Documents in Psychology 5(330), 1–64 (1975)

    Google Scholar 

  4. Bassili, J.N.: Emotion recognition: The role of facial movement and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology 37(11), 2049–2058 (1979)

    Article  Google Scholar 

  5. Borod, J., Haywood, C., Koff, E.: Neuropsychological aspects of facial asymmetry during emotional expression: A review of the normal adult literature. Neuropsychology Review 7(1), 41–60 (1997)

    Article  Google Scholar 

  6. Borod, J.C., Caron, H.S.: Facedness and emotion related to lateral dominance, sex and expression type. Neuropsychologia 18(2), 237–241 (1980)

    Article  Google Scholar 

  7. Borod, J.C., Koff, E., Yecker, S., Santschi, C., Schmidt, J.M.: Facial asymmetry during emotional expression: Gender, valence, and measurement technique. Neuropsychologia 36(11), 1209–1215 (1998)

    Article  Google Scholar 

  8. Boucher, J.D., Ekman, P.: Facial areas and emotional information. Journal of Communication 25(2), 21–29 (1975)

    Article  Google Scholar 

  9. Bradley, M.M., Lang, P.J.: Affective norms for english words (anew): Stimuli, instruction manual and affective ratings. C-1, University of Florida, Center for Research in Psychophysiology, Gainesville (1999)

    Google Scholar 

  10. Bush, L.E.: Individual differences multidimensional scaling of adjectives denoting feelings. Journal of Personality and Social Psychology 25(1), 50–57 (1973)

    Article  Google Scholar 

  11. Campbell, R.: The lateralisation of emotion: A critical review. International Journal of Psychology 17(1-4), 211–229 (1982)

    Article  Google Scholar 

  12. Chmiel, A., Sienkiewicz, J., Paltoglou, G., Buckley, K., Thelwall, M., Holyst, J.A.: Negative emotions accelerating users activity in bbc forum. CoRR 1011.5459 (2010)

    Google Scholar 

  13. Cowie, R.: Perceiving emotion: towards a realistic understanding of the task. Philosophical Transactions of the Royal Society B 364, 3515–3525 (2009)

    Article  Google Scholar 

  14. Deng, Z., Neumann, U.: Data-Driven 3D Facial Animation. Springer (2007)

    Google Scholar 

  15. Dimberg, U., Petterson, M.: Facial reactions to happy and angry facial expressions: Evidence for right hemisphere dominance. Psychophysiology 37(5), 693–696 (2000)

    Article  Google Scholar 

  16. Egges, A., Kshirsagar, S., Magnenat-Thalmann, N.: Generic personality and emotion simulation for conversational agents. CAVW 15, 1–13 (2004)

    Google Scholar 

  17. Ekman, P.: Universals and cultural differences in facial expressions of emotions. In: Nebraska Symposium on Motivation, pp. 207–283. Univ. of Nebraska Press (1971)

    Google Scholar 

  18. Ekman, P.: About brows: Emotional and conversational signals. In: von Cranach, M., Foppa, K., Lepenies, W., Ploog, D. (eds.) Human Ethology, pp. 169–248. Cambridge University Press, Cambridge (1979)

    Google Scholar 

  19. Ekman, P., Friesen, W.V.: Facial action coding system. Consulting Psychologists Press, CA (1978)

    Google Scholar 

  20. Ekman, P., Friesen, W.V.: Felt, false, and miserable smiles. Journal of Nonverbal Behavior 6(4), 238–252 (1982)

    Article  Google Scholar 

  21. Ekman, P., Friesen, W.V., Ancoli, S.: Facial signs of emotional experience. Journal of Personality and Social Psychology 39(6), 1125–1134 (1980)

    Article  Google Scholar 

  22. Ekman, P., Roper, G., Hager, J.C.: Deliberate facial movement. Child Development 51(3), 886–891 (1980)

    Article  Google Scholar 

  23. Krumhuber, E., Kappas, A.: Moving smiles: The role of dynamic components for the perception of the genuineness of smiles. Journal of Nonverbal Behavior 29(1), 3–24 (2005)

    Article  Google Scholar 

  24. Lance, B., Marsella, S.: Glances, glares, and glowering: how should a virtual human express emotion through gaze? AAMAS 20(1), 50–69 (2010)

    Google Scholar 

  25. Magnenat-Thalmann, N., Thalmann, D.: Handbook of Virtual Humans. Wiley (2004)

    Google Scholar 

  26. Martin, J.C., Niewiadomski, R., Devillers, L., Buisine, S., Pelachaud, C.: Multimodal complex emotions: Gesture expressivity and blended facial expressions. International Journal of Humanoid Robotics 3(3), 269–291 (2006)

    Article  Google Scholar 

  27. Mehrabian, A., Russell, J.A.: An Approach to Environmental Psychology. The MIT Press (1974)

    Google Scholar 

  28. Parke, F.I., Waters, K.: Computer Facial Animation. AK Peters (2008)

    Google Scholar 

  29. Paterson, H.M., Pollick, F.E., Sanford, A.J.: The role of velocity in affect discrimination. In: Proceedings of the 23rd Annual Conference of the Cognitve Science Society, pp. 756–761 (2001)

    Google Scholar 

  30. Pelachaud, C.: Modelling multimodal expression of emotion in a virtual agent. Philosophical Transactions of The Royal Society B 364(1535), 3539–3548 (2009)

    Article  Google Scholar 

  31. Pelachaud, C., Poggi, I.: Subtleties of facial expressions in embodied agents. Journal of Visualization and Computer Animation 13(5), 301–312 (2002)

    Article  MATH  Google Scholar 

  32. Pighin, F., Hecker, J., Lischinski, D., Szeliski, R., Salesin, D.H.: Synthesizing realistic facial expressions from photographs. In: SIGGRAPH 1998, pp. 75–84. ACM, New York (1998)

    Google Scholar 

  33. Russell, J.A.: A circumplex model of affect. Journal of Personality and Social Psychology 39(6), 1161–1178 (1980)

    Article  Google Scholar 

  34. Sackeim, H.A., Gur, R.C., Saucy, M.C.: Emotions are expressed more intensely on the left side of the face. Science 202(4366), 434–436 (1978)

    Article  Google Scholar 

  35. Schatz, H.: CHARACTER. Bulfinch Press (2006)

    Google Scholar 

  36. Schiff, B.B., MacDonald, B.: Facial asymmetries in the spontaneous response to positive and negative emotional arousal. Neuropsychologia 28(8), 777–785 (1990)

    Article  Google Scholar 

  37. Schwartz, G.E., Ahern, G.L., Brown, S.L.: Lateralized facial muscle response to positive and negative emotional stimuli. Psychophysiology 16(6), 561–571 (1979)

    Article  Google Scholar 

  38. Tena, J.R., De la Torre, F., Matthews, I.: Interactive region-based linear 3d face models. ACM Trans. Graph. 30(4), 76:1–76:10 (2011)

    Google Scholar 

  39. Thelwall, M., Buckley, K., Paltoglou, G., Cai, D., Kappas, A.: Sentiment in short strength detection informal text. JASIST 61(12), 2544–2558 (2010)

    Article  Google Scholar 

  40. Vinayagamoorthy, V., Gillies, M., Steed, A., Tanguy, E., Pan, X., Loscos, C., Slater, M.: Building expression into virtual characters. In: Eurographics Conference State of the Art Report (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Immersive Interaction Group (IIG), EPFL, Switzerland

    Junghyun Ahn & Ronan Boulic

  2. Institute of Information and Communication Systems (ISIC), HE-Arc, Switzerland

    Stéphane Gobron

  3. Institute of Media Innovation (IMI), NTU, Singapore

    Daniel Thalmann

Authors
  1. Junghyun Ahn
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stéphane Gobron
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Daniel Thalmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ronan Boulic
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Engineering, University of California, Merced, 5200 N. Lake Road, 95343, Merced, CA, USA

    Marcelo Kallmann

  2. Department of Computer Science, Rutgers University, 110 Frelinghuysen Road, 08854, Piscataway, NJ, USA

    Kostas Bekris

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ahn, J., Gobron, S., Thalmann, D., Boulic, R. (2012). Conveying Real-Time Ambivalent Feelings through Asymmetric Facial Expressions. In: Kallmann, M., Bekris, K. (eds) Motion in Games. MIG 2012. Lecture Notes in Computer Science, vol 7660. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34710-8_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-34710-8_12

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-34709-2

  • Online ISBN: 978-3-642-34710-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation