Skip to main content

Effect of Emotion and Articulation of Speech on the Uncanny Valley in Virtual Characters

  • Conference paper
Affective Computing and Intelligent Interaction (ACII 2011)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 6975))

Abstract

This paper presents a study of how exaggerated facial expression in the lower face region affects perception of emotion and the Uncanny Valley phenomenon in realistic, human-like, virtual characters. Characters communicated the six basic emotions, anger, disgust, fear, sadness and surprise with normal and exaggerated mouth movements. Measures were taken for perceived familiarity and human-likeness. The results showed that: an increased intensity of articulation significantly reduced the uncanny for anger; yet increased perception of the uncanny for characters expressing happiness with an exaggeration of mouth movement. The practical implications of these findings are considered when controlling the uncanny in virtual characters.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Mori, M.: Bukimi No Tani (The Uncanny Valley). Energy 7, 33–35 (1970)

    Google Scholar 

  2. Brenton, H., Gillies, M., Ballin, D., Chatting, D.: The Uncanny Valley: does it exist? In: HCI Annual Conference: Animated Characters Workshop, Edinburgh, UK (2005)

    Google Scholar 

  3. Plantec, P.: Crossing the Great Uncanny Valley (December 19, 2007), http://www.awn.com/articles/production/crossing-great-uncanny-valley

  4. Ho, C.-C., MacDorman, K.F.: Revisiting the uncanny valley theory: Developing and validating an alternative to the Godspeed indices. CHB 26, 1508–1518 (2010)

    Google Scholar 

  5. MacDorman, K.F., Green, R.D., Ho, C.-C., Koch, C.T.: Too real for comfort? Uncanny responses to computer generated faces. CHB 25, 695–710 (2009)

    Google Scholar 

  6. Tinwell, A., Grimshaw, M., Abdel-Nabi, D., Williams, A.: Facial expression of emotion and perception of the Uncanny Valley in virtual characters. CHB 27, 741–749 (2011)

    Google Scholar 

  7. Green, R.D., MacDorman, K.F., Ho, C.-C., Vasudevan, S.K.: Sensitivity to the proportions of faces that vary in human likeness. CHB 24, 2456–2474 (2008)

    Google Scholar 

  8. Tinwell, A.: Uncanny as Usability Obstacle. In: Ozok, A.A., Zaphiris, P. (eds.) OCSC 2009. LNCS, vol. 5621, pp. 622–631. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  9. Ho, C.-C., MacDorman, K.F., Pramono, Z.A.: Human emotion and the uncanny valley. A GLM, MDS, and ISOMAP analysis of robot video ratings. In: The Third ACM/IEEE International Conference on Human-Robot Interaction, Amsterdam, pp. 169–176 (2008)

    Google Scholar 

  10. Vinayagamoorthy, V., Steed, A., Slater, M.: Building characters: Lessons drawn from virtual environments. Cog. Sci., 119–126 (2005)

    Google Scholar 

  11. Tinwell, A., Grimshaw, M., Williams, A.: Uncanny behaviour in survival horror games. J. of Gaming and Virtual Worlds 2, 23–25 (2010)

    Article  Google Scholar 

  12. Tinwell, A., Grimshaw, M., Williams, A.: Uncanny speech. In: Grimshaw, M. (ed.) Game Sound Technology and Player Interaction, pp. 213–234. IGI Global, Hershey (2011)

    Chapter  Google Scholar 

  13. MacDorman, K.F., Coram, J.A., Ho, C.-C., Patel, H.: Gender differences in the impact of presentational factors in human character animation on decisions in ethical dilemmas. Presence: Tel. and Vir. Env. 19, 213–229 (2010)

    Article  Google Scholar 

  14. Bartneck, C., Kanda, T., Ishiguro, H., Hagita, N.: My robotic doppelganger - A critical look at the Uncanny Valley theory. In: 18th IEEEIS, Japan, pp. 269–276 (2009)

    Google Scholar 

  15. Ekman, P., Friesen, W.V.: Facial action coding system: A technique for the measurement of facial movement. Consulting Psychologists Press, Palo Alto (1978)

    Google Scholar 

  16. Busso, C., Narayanan, S.S.: Interplay between linguistic and affective goals in facial expression during emotional utterances. In: 7th ISSP, Brazil, pp. 549–556 (2006)

    Google Scholar 

  17. Ekman, P.: An argument for basic emotions. Cognition and Emotion 6, 169–200 (1992)

    Article  Google Scholar 

  18. Ekman, P.: About brows: emotional and conversational signals. In: Von Cranach, M., Foppa, K., Lepenies, W., Ploog, D. (eds.) Human Ethology: Claims and Limits of a New Discipline, pp. 169–202. CUP, New York (1979)

    Google Scholar 

  19. Ekman, P., Friesen, W.V.: Felt, false and miserable smiles. J. of NVB 6, 238–252 (1982)

    Google Scholar 

  20. Darwin, C.: The expression of the emotions in man and animals. University of Chicago Press, Chicago (1965) (Original work published 1872)

    Google Scholar 

  21. Chevalier-Skolnikoff, S.: Facial expression of emotion in nonhuman primates. In: Ekman, P. (ed.) Darwin and Facial Expression, pp. 11–83. Academic Press, New York (1973)

    Google Scholar 

  22. Fagel, S.: Effects of Smiling on Articulation: Lips, Larynx and Acoustics. In: COST 2102 Training School, pp. 294–303 (2009)

    Google Scholar 

  23. Shor, R.E.: The production and judgment of smile magnitude. Gen. Psy. 98, 79–96 (1978)

    Article  Google Scholar 

  24. Cao, Y., Faloustsos, P., Kohler, E., Pighin, F.: Real-time Speech Motion Synthesis from Recorded Motions. In: ACM SIGGRAPH/Eurographics, France, pp. 345–353 (2004)

    Google Scholar 

  25. Tinwell, A., Grimshaw, M.: Bridging the uncanny: an impossible traverse? In: Sotamaa, O., Lugmayr, A., Franssila, H., Näränen, P., Vanhala, J. (eds.) 13th Int. MindTrek Conf.: Everyday Life in the Ubiquitous Era, pp. 66–73. ACM, New York (2009)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Tinwell, A., Grimshaw, M., Abdel-Nabi, D. (2011). Effect of Emotion and Articulation of Speech on the Uncanny Valley in Virtual Characters. In: D’Mello, S., Graesser, A., Schuller, B., Martin, JC. (eds) Affective Computing and Intelligent Interaction. ACII 2011. Lecture Notes in Computer Science, vol 6975. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24571-8_69

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-24571-8_69

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-24570-1

  • Online ISBN: 978-3-642-24571-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics