ACII 2011: Affective Computing and Intelligent Interaction pp 557-566 | Cite as
Effect of Emotion and Articulation of Speech on the Uncanny Valley in Virtual Characters
Abstract
This paper presents a study of how exaggerated facial expression in the lower face region affects perception of emotion and the Uncanny Valley phenomenon in realistic, human-like, virtual characters. Characters communicated the six basic emotions, anger, disgust, fear, sadness and surprise with normal and exaggerated mouth movements. Measures were taken for perceived familiarity and human-likeness. The results showed that: an increased intensity of articulation significantly reduced the uncanny for anger; yet increased perception of the uncanny for characters expressing happiness with an exaggeration of mouth movement. The practical implications of these findings are considered when controlling the uncanny in virtual characters.
Keywords
Emotion Video Games Uncanny Valley Characters ExpressionPreview
Unable to display preview. Download preview PDF.
References
- 1.Mori, M.: Bukimi No Tani (The Uncanny Valley). Energy 7, 33–35 (1970)Google Scholar
- 2.Brenton, H., Gillies, M., Ballin, D., Chatting, D.: The Uncanny Valley: does it exist? In: HCI Annual Conference: Animated Characters Workshop, Edinburgh, UK (2005)Google Scholar
- 3.Plantec, P.: Crossing the Great Uncanny Valley (December 19, 2007), http://www.awn.com/articles/production/crossing-great-uncanny-valley
- 4.Ho, C.-C., MacDorman, K.F.: Revisiting the uncanny valley theory: Developing and validating an alternative to the Godspeed indices. CHB 26, 1508–1518 (2010)Google Scholar
- 5.MacDorman, K.F., Green, R.D., Ho, C.-C., Koch, C.T.: Too real for comfort? Uncanny responses to computer generated faces. CHB 25, 695–710 (2009)Google Scholar
- 6.Tinwell, A., Grimshaw, M., Abdel-Nabi, D., Williams, A.: Facial expression of emotion and perception of the Uncanny Valley in virtual characters. CHB 27, 741–749 (2011)Google Scholar
- 7.Green, R.D., MacDorman, K.F., Ho, C.-C., Vasudevan, S.K.: Sensitivity to the proportions of faces that vary in human likeness. CHB 24, 2456–2474 (2008)Google Scholar
- 8.Tinwell, A.: Uncanny as Usability Obstacle. In: Ozok, A.A., Zaphiris, P. (eds.) OCSC 2009. LNCS, vol. 5621, pp. 622–631. Springer, Heidelberg (2009)CrossRefGoogle Scholar
- 9.Ho, C.-C., MacDorman, K.F., Pramono, Z.A.: Human emotion and the uncanny valley. A GLM, MDS, and ISOMAP analysis of robot video ratings. In: The Third ACM/IEEE International Conference on Human-Robot Interaction, Amsterdam, pp. 169–176 (2008)Google Scholar
- 10.Vinayagamoorthy, V., Steed, A., Slater, M.: Building characters: Lessons drawn from virtual environments. Cog. Sci., 119–126 (2005)Google Scholar
- 11.Tinwell, A., Grimshaw, M., Williams, A.: Uncanny behaviour in survival horror games. J. of Gaming and Virtual Worlds 2, 23–25 (2010)CrossRefGoogle Scholar
- 12.Tinwell, A., Grimshaw, M., Williams, A.: Uncanny speech. In: Grimshaw, M. (ed.) Game Sound Technology and Player Interaction, pp. 213–234. IGI Global, Hershey (2011)CrossRefGoogle Scholar
- 13.MacDorman, K.F., Coram, J.A., Ho, C.-C., Patel, H.: Gender differences in the impact of presentational factors in human character animation on decisions in ethical dilemmas. Presence: Tel. and Vir. Env. 19, 213–229 (2010)CrossRefGoogle Scholar
- 14.Bartneck, C., Kanda, T., Ishiguro, H., Hagita, N.: My robotic doppelganger - A critical look at the Uncanny Valley theory. In: 18th IEEEIS, Japan, pp. 269–276 (2009)Google Scholar
- 15.Ekman, P., Friesen, W.V.: Facial action coding system: A technique for the measurement of facial movement. Consulting Psychologists Press, Palo Alto (1978)Google Scholar
- 16.Busso, C., Narayanan, S.S.: Interplay between linguistic and affective goals in facial expression during emotional utterances. In: 7th ISSP, Brazil, pp. 549–556 (2006)Google Scholar
- 17.Ekman, P.: An argument for basic emotions. Cognition and Emotion 6, 169–200 (1992)CrossRefGoogle Scholar
- 18.Ekman, P.: About brows: emotional and conversational signals. In: Von Cranach, M., Foppa, K., Lepenies, W., Ploog, D. (eds.) Human Ethology: Claims and Limits of a New Discipline, pp. 169–202. CUP, New York (1979)Google Scholar
- 19.Ekman, P., Friesen, W.V.: Felt, false and miserable smiles. J. of NVB 6, 238–252 (1982)Google Scholar
- 20.Darwin, C.: The expression of the emotions in man and animals. University of Chicago Press, Chicago (1965) (Original work published 1872) Google Scholar
- 21.Chevalier-Skolnikoff, S.: Facial expression of emotion in nonhuman primates. In: Ekman, P. (ed.) Darwin and Facial Expression, pp. 11–83. Academic Press, New York (1973)Google Scholar
- 22.Fagel, S.: Effects of Smiling on Articulation: Lips, Larynx and Acoustics. In: COST 2102 Training School, pp. 294–303 (2009) Google Scholar
- 23.Shor, R.E.: The production and judgment of smile magnitude. Gen. Psy. 98, 79–96 (1978)CrossRefGoogle Scholar
- 24.Cao, Y., Faloustsos, P., Kohler, E., Pighin, F.: Real-time Speech Motion Synthesis from Recorded Motions. In: ACM SIGGRAPH/Eurographics, France, pp. 345–353 (2004)Google Scholar
- 25.Tinwell, A., Grimshaw, M.: Bridging the uncanny: an impossible traverse? In: Sotamaa, O., Lugmayr, A., Franssila, H., Näränen, P., Vanhala, J. (eds.) 13th Int. MindTrek Conf.: Everyday Life in the Ubiquitous Era, pp. 66–73. ACM, New York (2009)CrossRefGoogle Scholar