Abstract
Emotional bonds don’t arise from a simple exchange of facial displays, but often emerge through the dynamic give and take of face-to-face interactions. This article explores the phenomenon of rapport, a feeling of connectedness that seems to arise from rapid and contingent positive feedback between partners and is often associated with socio-emotional processes. Rapport has been argued to lead to communicative efficiency, better learning outcomes, improved acceptance of medical advice and successful negotiations. We provide experimental evidence that a simple virtual character that provides positive listening feedback can induce stronger rapport-like effects than face-to-face communication between human partners. Specifically, this interaction can be more engaging to storytellers than speaking to a human audience, as measured by the length and content of their stories.
Keywords
- Speech Rate
- Virtual Character
- Virtual Human
- Human Listener
- Speech Fluency
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Chapter PDF
References
Alibali, M.W., Heath, D.C., Myers, H.J.: Effects of visibility between speaker and listener on gesture production: some gestures are meant to be seen. Journal of Memory and Language 44, 169–188 (2001)
Allwood, J., Cerrato, L.: A study of gestural feedback expressions. In: Paper presented at the First Nordic Symposium on Multimodal Communication, Copenhagen (2003)
Bailenson, J.N., Swinth, K.R., Hoyt, C.L., Persky, S., Dimov, A., Blascovich, J.: The independent and interactive effects of embodied agent appearance and behavior on self-report, cognitive, and behavioral markers of copresence in Immersive Virtual Environments. PRESENCE: Teleoperators and Virtual Environments 14, 379–393 (2005)
Bailenson, J.N., Yee, N.: Digital Chameleons: Automatic assimilation of nonverbal gestures in immersive virtual environments. Psychological Science 16, 814–819 (2005)
Bavelas, J.B., Coates, L., Johnson, T.: Listeners as Co-narrators. Journal of Personality and Social Psychology 79(6), 941–952 (2000)
Brand, M.: Voice puppetry. In: Paper presented at the ACM SIGGRAPH (1999)
Breazeal, C., Aryananda, L.: of Affective Communicative Intent in Robot-Directed Speech. Autonomous Robots 12, 83–104 (2002)
Burns, M.: Rapport and relationships: The basis of child care. Journal of Child Care. 2, 47–57 (1984)
Capella, J.N.: On defining conversational coordination and rapport. Psychological Inquiry 1(4), 303–305 (1990)
Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjálmsson, H., et al.: Embodiment in Conversational Interfaces: Rea. In: Paper presented at the Conference on Human Factors in Computing Systems, Pittsburgh, PA (1999)
Cassell, J., Thórisson, K.R.: The Power of a Nod and a Glance: Envelope vs. Emotional Feedback in Animated Conversational Agents. International Journal of Applied Artificial Intelligence 13(4-5), 519–538 (1999)
Chartrand, T.L., Bargh, J.A.: The Chameleon Effect: The Perception-Behavior Link and Social Interaction. Journal of Personality and Social Psychology 76(6), 893–910 (1999)
Cogger, J.W.: Are you a skilled interviewer? Personnel Journal 61, 840–843 (1982)
Drolet, A.L., Morris, M.W.: Rapport in conflict resolution: accounting for how face-to-face contact fosters mutual cooperation in mixed-motive conflicts. Experimental Social Psychology 36, 26–50 (2000)
Ekman, P.: An argument for basic emotions. Cognition and Emotion 6, 169–2000 (1992)
Ellsworth, P.C., Scherer, K.R.: Appraisal processes in emotion. In: Davidson, R.J., Goldsmith, H.H., Scherer, K.R. (eds.) Handbook of the affective sciences, pp. 572–595. Oxford University Press, New York (2003)
Fogel, A.: Developing through relationships: Origins of communication, self and culture. Harvester Wheatsheaf, New York (1993)
Frank, R.: Passions with reason: the strategic role of the emotions. W. W. Norton, New York (1988)
Frank, R.H., Gilovich, T., Regan, D.T.: The evolution of one-shot cooperation: an experiment. Ethology and Sociobiology 14, 247–256 (1993)
Fuchs, D.: Examiner familiarity effects on test performance: implications for training and practice. Topics in Early Childhood Special Education 7, 90–104 (1987)
Grammer, K., Kruck, K.B., Magnusson, M.S.: The courtship dance: Patterns of nonverbal synchronization in opposit-sex encounters. Journal of Nonverbal Behavior 22, 3–29 (1998)
Gratch, J., Marsella, S.: A domain independent framework for modeling emotion. Journal of Cognitive Systems Research 5(4), 269–306 (2004)
Gratch, J., Okhmatovskaia, A., Lamothe, F., Marsella, S., Morales, M., van der Werf, R., et al.: Virtual Rapport. In: Paper presented at the 6th International Conference on Intelligent Virtual Agents, Marina del Rey, CA (2006)
Kallmann, M., Marsella, S.: Hierarchical Motion Controllers for Real-Time Autonomous Virtual Humans. In: Paper presented at the 5th International Working Conference on Intelligent Virtual Agents, Kos, Greece (2005)
Keltner, D., Haidt, J.: Social Functions of Emotions at Four Levels of Anysis. Cognition and Emotion 13(5), 505–521 (1999)
Kopp, S., Krenn, B., Marsella, S., Marshall, A., Pelachaud, C., Pirker, H., et al.: Towards a common framework for multimodal generation in ECAs: The behavior markup language. In: Paper presented at the Intelligent Virtual Agents, Marina del Rey, CA (2006)
Kramer, N.C., Tietz, B., Bente, G.: Effects of embodied interface agents and their gestural activity. In: Paper presented at the Intelligent Virtual Agents, Kloster Irsee, Germany (2003)
Marsella, S., Johnson, W.L., LaBore, C.: Interactive pedagogical drama for health interventions. In: Paper presented at the Conference on Artificial Intelligence in Education, Sydney, Australia (2003)
McNeill, D.: Hand and mind: What gestures reveal about thought. The University of Chicago Press, Chicago, IL (1992)
Morency, L.-P., Sidner, C., Lee, C., Darrell, T.: Contextual Recognition of Head Gestures. In: Paper presented at the 7th International Conference on Multimodal Interactions, Torento, Italy (2005)
Nass, C., Moon, Y.: Machines and mindlessness: Social responses to computers. Journal of Social Issues 56(1), 81–103 (2000)
Nass, C., Reeves, B.: The Media Equation. Cambridge University Press, Cambridge (1996)
Neal Reilly, W.S.: Believable Social and Emotional Agents (Ph.D Thesis No. CMU-CS-96-138). Carnegie Mellon University, Pittsburgh, PA (1996)
Oppenheim, A.V., Schafer, R.W.: From Frequency to Quefrency: A History of the Cepstrum. IEEE Signal Processing Magazine, pp. 95-106 (September 2004)
Parkinson, B.: Putting appraisal in context. In: Scherer, K., Schorr, A., Johnstone, T. (eds.) Appraisal processes in emotion: Theory, methods, research, pp. 173–186. Oxford University Press, London (2001)
Robins, B., Dautenhahn, K., Boekhorst, R.t., Billard, A.: Robotic Assistants in Therapy and Education of Children with Autism: Can a Small Humanoid Robot Help Encourage Social Interaction Skills? Special issue, Design for a more inclusive world of Universal Access in the Information Society, 4(2) (2005)
Sakaguchi, K., Jonsson, G.K., Hasegawa, T.: Initial interpersonal attraction between mixed-sex dyad and movement synchrony. In: Anolli, L., Duncan Jr, S., Magnusson, M.S., Riva, G. (eds.) The hidden structure of interaction: from neurons to culture patterns. Amsterdam (2005)
Scherer, K.: Comment: interpersonal expectations, social influence, and emotion transfer. In: Blanck, P.D. (ed.) Interpersonal Expectations: theory, research, and applications, pp. 316–333. Combridge University Press, Paris (1993)
Tatar, D.: Social and personal consequences of a preoccupied listener. Stanford University, Stanford, CA (1997)
Tickle-Degnen, L., Rosenthal, R.: The Nature of Rapport and its Nonverbal Correlates. Psychological Inquiry 1(4), 285–293 (1990)
Tosa, N.: Neurobaby. ACM SIGGRAPH, 212–213 (1993)
Tsui, P., Schultz, G.L.: Failure of Rapport: Why psychotheraputic engagement fails in the treatment of Asian clients. American Journal of Orthopsychiatry 55, 561–569 (1985)
Ward, N., Tsukahara, W.: Prosodic features which cue back-channel responses in English and Japanese. Journal of Pragmatics 23, 1177–1207 (2000)
Welji, H., Duncan, S.: Characteristics of face-to-face interactions, with and without rapport: Friends vs. strangers. In: Paper presented at the Symposium on Cognitive Processing Effects of ’Social Resonance’ in Interaction, 26th Annual Meeting of the Cognitive Science Society (2004)
Yngve, V.H.: On getting a word in edgewise. In: Paper presented at the Sixth regional Meeting of the Chicago Linguistic Society (1970)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gratch, J. et al. (2007). Can Virtual Humans Be More Engaging Than Real Ones?. In: Jacko, J.A. (eds) Human-Computer Interaction. HCI Intelligent Multimodal Interaction Environments. HCI 2007. Lecture Notes in Computer Science, vol 4552. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73110-8_30
Download citation
DOI: https://doi.org/10.1007/978-3-540-73110-8_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73108-5
Online ISBN: 978-3-540-73110-8
eBook Packages: Computer ScienceComputer Science (R0)