How Turn-Taking Strategies Influence Users’ Impressions of an Agent

  • Mark ter Maat
  • Khiet P. Truong
  • Dirk Heylen
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6356)


Different turn-taking strategies of an agent influence the impression that people have of it. We recorded conversations of a human with an interviewing agent, controlled by a wizard and using a particular turn-taking strategy. A questionnaire with 27 semantic differential scales concerning personality, emotion, social skills and interviewing skills was used to capture these impressions. We show that it is possible to influence factors such as agreeableness, assertiveness, conversational skill and rapport by varying the agent’s turn-taking strategy.


Impression Management Late Strategy Dialogue System Female Agent Female Voice 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Atterer, M., Baumann, T., Schlangen, D.: Towards Incremental End-of-Utterance Detection in Dialogue Systems. In: Proceedings of the 22nd International Conference on Computational Linguistics, pp. 11–14 (August 2008)Google Scholar
  2. 2.
    Brown, P., Levinson, S.C.: Politeness: Some universals in language use. Cambridge University Press, Cambridge (1987)Google Scholar
  3. 3.
    Clark, H.H.: Using Language. Cambridge University Press, Cambridge (1996)CrossRefGoogle Scholar
  4. 4.
    de Kok, I., Heylen, D.: Multimodal End-of-Turn Prediction in Multi-Party Meetings. In: ICMIMLMI 2009 Proceedings, pp. 91–98. ACM Press, New York (2009)Google Scholar
  5. 5.
    Edelsky, C.: Who’s got the floor? Language and Speech 10, 383–421 (1981)Google Scholar
  6. 6.
    Endrass, B., Rehm, M., André, E., Nakano, Y.I.: Talk is silver, silence is golden: A cross cultural study on the usage of pauses in speech. In: Proceedings of the IUI-Workshop on Enculturating Interfaces, ECI 2008 (2008)Google Scholar
  7. 7.
    Fukayama, A., Ohno, T., Mukawa, N., Sawaki, M., Hagita, N.: Messages embedded in gaze of interface agents impression management with agent’s gaze. In: Proceedings of the SIGCHI conference on Human factors in computing systems (CHI 2002), pp. 41–48 (2002)Google Scholar
  8. 8.
    Goldberg, J.A.: Interrupting the Discourse on Interruptions: an Analysis in Terms of Relationally Neutral, Power- and Rapport-Oriented Acts. Journal of Pragmatics 14, 883–903 (1990)CrossRefGoogle Scholar
  9. 9.
    Goldberg, L.R.: The structure of phenotypic personality traits. American Psychologist 48(1), 26–34 (1993)CrossRefGoogle Scholar
  10. 10.
    Gratch, J., Marsella, S., Okhmatovskaia, A., Lamothe, F., Morales, M., Werf, R.J., Morency, L.P.: Virtual rapport. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 14–27. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  11. 11.
    Jonsdottir, G.R., Thorisson, K.R.: Teaching Computers to Conduct Spoken Interviews: Breaking the Realtime Barrier with Learning. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds.) IVA 2009. LNCS, vol. 5773, pp. 446–459. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  12. 12.
    Jonsdottir, G.R., Thorisson, K.R., Nivel, E.: Learning Smooth, Human-Like Turntaking in Realtime Dialogue. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 162–175. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  13. 13.
    O’Connell, D.C., Kowal, S., Kaltenbacher, E.: Turn-Taking: A Critical Analysis of the Research Tradition. Journal of Psycholinguistic Research 19(6), 345–373 (1990)CrossRefGoogle Scholar
  14. 14.
    Robinson, L.F., Reis, H.T.: The Effects of Interruption, Gender, and Status on Interpersonal Perceptions. Journal of Nonverbal Behavior 13(3), 141–153 (1989)CrossRefGoogle Scholar
  15. 15.
    Sacks, H., Schegloff, E.A., Jefferson, G.: A Simplest Systematics for the Organization of Turn-Takiing for Conversation. Language 50(4), 696–735 (1974)CrossRefGoogle Scholar
  16. 16.
    Schlangen, D.: From Reaction To Prediction Experiments with Computational Models of Turn-Taking. In: Proceedings of Interspeech 2006, pp. 2010–2013 (2006)Google Scholar
  17. 17.
    ter Maat, M., Heylen, D.: Turn Management or Impression Management? In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds.) IVA 2009. LNCS, vol. 5773, pp. 467–473. Springer, Heidelberg (2009)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Mark ter Maat
    • 1
  • Khiet P. Truong
    • 1
  • Dirk Heylen
    • 1
  1. 1.Human Media InteractionUniversity of TwenteEnschedeThe Netherlands

Personalised recommendations