Abstract
The functions of social dialogue between people in the context of performing a task is discussed, as well as approaches to modelling such dialogue in embodied conversational agents. A study of an agent’s use of social dialogue is presented, comparing embodied interactions with similar interactions conducted over the phone, assessing the impact these media have on a wide range of behavioural, task and subjective measures. Results indicate that subjects’ perceptions of the agent are sensitive to both interaction style (social vs. task-only dialogue) and medium.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Altman, I. and Taylor, D. (1973). Social Penetration: The Development of Interpersonal Relationships. New York: Holt, Rinhart & Winston.
Andersen, P. and Guerrero, L. (1998). The Bright Side of Relational Communication: Interpersonal Warmth as a Social Emotion. In Andersen, P. and Guerrero, L., editors, Handbook of Communication and Emotion, pages 303–329. New York: Academic Press.
André, E., Muller, J., and Rist, T. (1996). The PPP Persona: A Multipurpose Animated Presentation Agent. In Proceedings of Advanced Visual Interfaces, pages 245–247, Gubbio, Italy.
André, E., Rist, T., and Muller, J. (1998). Integrating Reactive and Scripted Behaviors in a Life-Like Presentation Agent. In Proceedings of the Second International Conference on Autonomous Agents, pages 261–268, Minneapolis, Minnesota, USA.
Argyle, M. (1988). Bodily Communication. New York: Methuen & Co. Ltd.
Argyle, M. (1990). The Biological Basis of Rapport. Psychological Inquiry, 1:297–300.
Beskow, J. and McGlashan, S. (1997). Olga: A Conversational Agent with Gestures. In André, E., editor, Proceedings of the IJCAI 1997 Workshop on Animated Interface Agents: Making Them Intelligent, Nagoya, Japan. San Francisco: Morgan-Kaufmann Publishers.
Bickmore, T. (2002). When Etiquette Really Matters: Relational Agents and Behavior Change. In Proceedings of AAAI Fall Symposium on Etiquette for Human-Computer Work, pages 9–10, Falmouth, MA.
Bickmore, T. and Cassell, J. (2001). Relational Agents: A Model and Implementation of Building User Trust. In Proceedings of CHI 2001, pages 396–403, Seattle, WA.
Bos, N., Olson, J. S., Gergle, D., Olson, G. M., and Wright, Z. (2002). Effects of Four Computer-Mediated Communications Channels on Trust Development. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 135–140, Minneapolis, Minnesota, USA.
Boyle, E., Anderson, A., and Newlands, A. (1994). The Effects of Visibility in a Cooperative Problem Solving Task. Language and Speech, 37(1):1–20.
Brown, P. and Levinson, S. (1978). Universals in Language Usage: Politeness Phenomena. In Goody, E., editor, Questions and Politeness: Strategies in Social Interaction, pages 56–289. Cambridge: Cambridge University Press.
Brown, R. and Gilman, A. (1972). The Pronouns of Power and Solidarity. In Giglioli, P., editor, Language and Social Context, pages 252–282. Harmondsworth: Penguin.
Brown, R. and Gilman, A. (1989). Politeness Theory and Shakespeare’s Four Major Tragedies. Language in Society, 18:159–212.
Cassell, J. and Bickmore, T. (2003). Negotiated Collusion: Modeling Social Language and its Relationship Effects in Intelligent Agents. User Modeling and Adaptive Interfaces, 13(1–2):89–132.
Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjálmsson, H., and Yan, H. (1999). Embodiment in Conversational Interfaces: Rea. In Proceedings of ACM SIGCHI Conference on Human Factors in Computing Systems, pages 520–527, Pittsburgh, PA.
Cassell, J., Bickmore, T., Campbell, L., Vilhjálmsson, H., and Yan, H. (2000a). Human Conversation as a System Framework: Designing Embodied Conversational Agents. In Embodied Conversational Agents, pages 29–63. Cambridge, MA: MIT Press.
Cassell, J., Bickmore, T., H, Vilhjálmsson, and Yan, H. (2000b). More Than Just a Pretty Face: Affordances of Embodiment. In Proceedings of the 5th International Conference on Intelligent User Interfaces, pages 52–59, New Orleans, Louisiana.
Cassell, J., Sullivan, J., Prevost, S., and Churchill, E. (2000c). Embodied Conversational Agents. Cambridge, MA: MIT Press.
Cheepen, C. (1988). The Predictability of Informal Conversation. New York: Pinter.
Chovil, N. (1991). Discourse-Oriented Facial Displays in Conversation. Research on Language and Social Interaction, 25(1991/1992):163–194.
Clark, H. H. (1996). Using Language. Cambridge: Cambridge University Press.
Coupland, J., Coupland, N., and Robinson, J. D. (1992). How Are You? Negotiating Phatic Communion. Language in Society, 21:207–230.
Daly-Jones, O., Monk, A. F., and Watts, L. A. (1998). Some Advantages of Video Conferencing over High-Quality Audio Conferencing: Fluency and Awareness of Attentional Focus. International Journal of Human-Computer Studies, 49(1):21–58.
Dehn, D. M. and van Mulken, S. (2000). The Impact of Animated Interface Agents: A Review of Empirical Research. International Journal of Human-Computer Studies, 52:1–22.
Dunbar, R. (1996). Grooming, Gossip, and the Evolution of Language. Cambridge, MA: Harvard University Press.
Duncan, S. (1974). On the Structure of Speaker-Auditor Interaction during Speaking Turns. Language in Society, 3:161–180.
Garros, D. (1999). Real Estate Agent, Home and Hearth Realty. Personal communication.
Goffman, I. (1967). On Face-Work. In Interaction Ritual: Essays on Face-to-Face Behavior, pages 5–46. New York: Pantheon.
Gustafson, J., Lindberg, N., and Lundeberg, M. (1999). The August Spoken Dialogue System. In Proceedings of the Eurospeech 1999 Conference, pages 1151–1154, Budapest, Hungary.
Hauptmann, A. G. and Rudnicky, A. I. (1988). Talking to Computers: An Empirical Investigation. International Journal of Man-Machine Studies, 8(6):583–604.
Jakobson, R. (1960). Concluding Statement: Linguistics and Poetics. In Sebeok, T., editor, Style in Language, pages 351–377. New York: Wiley.
Kendon, A. (1980). Conducting Interaction: Patterns of Behavior in Focused Encounters, volume 7. Cambridge: Cambridge University Press.
Kiesler, S. and Sproull, L. (1997). Social Human-Computer Interaction. In Friedman, B., editor, Human Values and the Design of Computer Technology, pages 191–199. Stanford, CA: CSLI Publications.
Koda, T. and Maes, P. (1996). Agents with Faces: The Effect of Personification. In Proceedings of the Fifth IEEE International Workshop on Robot and Human Communication (RO-MAN 1996), pages 189–194, Tsukuba, Japan.
Laver, J. (1975). Communicative Functions of Phatic Communion. In Kendon, A., Harris, R., and Key, M., editors, The Organization of Behavior in Face-to-Face Interaction, pages 215–238. The Hague: Mouton.
Laver, J. (1981). Linguistic Routines and Politeness in Greeting and Parting. In Coulmas, F., editor, Conversational Routine, pages 289–304. The Hague: Mouton.
Lester, J., Stone, B., and Stelling, G. (1999). Lifelike Pedagogical Agents for Mixed-Initiative Problem Solving in Constuctivist Learning Environments. User Modeling and User-Adapted Interaction, 9(1–2):1–44.
Maes, P. (1989). How to Do the Right Thing. Connection Science Journal, 1(3):291–323.
Malinowski, B. (1923). The Problem of Meaning in Primitive Languages. In Ogden, C. K. and Richards, I. A., editors, The Meaning of Meaning, pages 296–346. Routledge & Kegan Paul.
McNeill, D. (1992). Hand and Mind: What Gestures Reveal about Thought. Cambridge: Cambridge University Press.
Moon, Y. and Nass, C. I. (1996). How “Real” are Computer Personalities? Psychological Responses to Personality Types in Human-Computer Interaction. Communication Research, 23(6):651–674.
Nass, C. and Gong, L. (2000). Speech Interfaces from an Evolutionary Perspective. Communications of the ACM, 43(9):36–43.
Onkvisit, S. and Shaw, J. J. (1994). Consumer Behavior: Strategy and Analysis. New York: Macmillan College Publishing Company.
Oviatt, S. (1995). Predicting Spoken Disfluencies during Human-Computer Interaction. Computer Speech and Language, 9:19–35.
Oviatt, S. and Adams, B. (2000). Designing and Evaluating Conversational Interfaces with Animated Characters. In Cassell, J., Sullivan, J., Prevost, S., and Churchill, E., editors, Embodied Conversational Agents, pages 319–345. Cambridge, MA: MIT Press.
Oviatt, S. L. (1998). User-Centered Modeling for Spoken Language and Multimodal Interfaces. In Maybury, M. T. and Wahlster, W., editors, Readings in Intelligent User Interfaces, pages 620–630. San Francisco, CA: Morgan Kaufmann Publishers, Inc.
Petty, R. and Wegener, D. (1998). Attitude Change: Multiple Roles for Persuasion Variables. In Gilbert, D., Fiske, S., and Lindzey, G., editors, The Handbook of Social Psychology, pages 323–390. New York: McGraw-Hill.
Prus, R. (1989). Making Sales: Influence as Interpersonal Accomplishment. Mewbury Park, CA: Sage.
Reeves, B. and Nass, C. (1996). The Media Equation. Cambridge: Cambridge University Press.
Resnick, P. V. and Lammers, H. B. (1985). The Influence of Self-Esteem on Cognitive Responses to Machine-Like versus Human-Like Computer Feedback. The Journal of Social Psychology, 125(6):761–769.
Richmond, V. and McCroskey, J. (1995). Immediacy-Nonverbal Behavior in Interpersonal Relations. Boston: Allyn & Bacon.
Rickel, J. and Johnson, W. L. (1998). Task-Oriented Dialogs with Animated Agents in Virtual Reality. In Proceedings of the First Workshop on Embodied Conversational Characters, pages 39–46.
Rickenberg, R. and Reeves, B. (2000). The Effects of Animated Characters on Anxiety, Task Performance, and Evaluations of User Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 49–56, The Hague, Amsterdam.
Rutter, D. R. (1987). Communicating by Telephone. New York: Pergamon Press.
Schneider, K. P. (1988). Small Talk: Analysing Phatic Discourse. Marburg: Hitzeroth.
Sidner, C. and Dzikovska, M. (2005). A First Experiment in Engagement for Human-Robot Interaction in Hosting Activities. In van Kuppevelt, J., Dybkjær, L., and Bernsen, N. O., editors, Advances in Natural Multimodal Dialogue Systems. Springer. This volume.
Sproull, L., Subramani, M., Kiesler, S., Walker, J., and Waters, K. (1997). When the Interface is a Face. In Friedman, B., editor, Human Values and the Design of Computer Technology, pages 163–190. Stanford, CA: CSLI Publications.
Stone, M. and Doran, C. (1997). Sentence Planning as Description Using Tree-Adjoining Grammar. In Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and 8th Conference of the European Chapter of the Association for Computational Linguistics (ACL/EACL 1997), pages 198–205, Madrid, Spain.
Svennevig, J. (1999). Getting Acquainted in Conversation. Philadelphia: John Benjamins.
Takeuchi, A. and Naito, T. (1995). Situated Facial Displays: Towards Social Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 450–455, Denver, Colorado.
van Mulken, S., André, E., and Muller, J. (1999). An Empirical Study on the Trustworthiness of Lifelike Interface Agents. In Bullinger, H.-J. and Ziegler, J., editors, Human-Computer Interaction (Proceedings of HCI-International 1999), pages 152–156. Mahwah, NJ: Lawrence Erlbaum Associates.
Wheeless, L. and Grotz, J. (1977). The Measurement of Trust and Its Relationship to Self-Disclosure. Human Communication Research, 3(3):250–257.
Whittaker, S. and O’Conaill, B. (1993). An Evaluation of Video Mediated Communication. In Proceedings of Human Factors and Computing Systems (INTERACT/CHI 1993), pages 73–74, Amsterdam, The Netherlands.
Whittaker, S. and O’Conaill, B. (1997). The Role of Vision in Face-to-Face and Mediated Communication. In Finn, K., Sellen, A., and Wilbur, S., editors, Video-Mediated Communication, pages 23–49. Lawrence Erlbaum Associates, Inc.
Wiggins, J. (1979). A Psychological Taxonomy of Trait-Descriptive Terms. Journal of Personality and Social Psychology, 37(3):395–412.
Wilson, G. (1977). Introversion/Extraversion. In Blass, T., editor, Personality Variables in Social Behavior, pages 179–218. New York: John Wiley & Sons.
Zheng, J., Veinott, E. S., Bos, N., Olson, J. S., and Olson, G. M. (2002). Trust without Touch: Jumpstarting Long-Distance Trust with Initial Social Activities. In Proceedings of the International Conference for Human-Computer Interaction (CHI), pages 141–146.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer
About this chapter
Cite this chapter
Bickmore, T., Cassell, J. (2005). Social Dialongue with Embodied Conversational Agents. In: van Kuppevelt, J.C.J., Dybkjær, L., Bernsen, N.O. (eds) Advances in Natural Multimodal Dialogue Systems. Text, Speech and Language Technology, vol 30. Springer, Dordrecht. https://doi.org/10.1007/1-4020-3933-6_2
Download citation
DOI: https://doi.org/10.1007/1-4020-3933-6_2
Publisher Name: Springer, Dordrecht
Print ISBN: 978-1-4020-3932-4
Online ISBN: 978-1-4020-3933-1
eBook Packages: Humanities, Social Sciences and LawSocial Sciences (R0)