Hand Gestures and Verbal Acknowledgments Improve Human-Robot Rapport

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10652)


Enhancing the rapport between the human and the robot will be an essential element in successfully developing robotic assistants, especially ones working in our homes. We use a personality survey task to assess how humans initially perceive rapport between themselves and a robot. Robots administering the survey presented relational behaviors designed to improve human-robot rapport. Participants preferred it when the robot provided verbal acknowledgments or was more engaging, such as when the robot supplemented its speech with iconic gestures.


  1. 1.
    Berry, D.S., Pennebaker, J.W., Mueller, J.S., Hiller, W.S.: Linguistic bases of social perception. Pers. Soc. Psychol. Bull. 23(5), 526–537 (1997)CrossRefGoogle Scholar
  2. 2.
    Bickmore, T.W., Picard, R.W.: Establishing and maintaining long-term human-computer relationships. ACM Trans. Comput.-Hum. Interact. 12(2), 293–327 (2005)CrossRefGoogle Scholar
  3. 3.
    Briggs, P., Scheutz, M., Tickle-degnen, L.: Are robots ready for administering health status surveys? first results from an HRI study with subjects with Parkinson’s Disease. In: 10th ACM/IEEE International Conference on Human-Robot Interaction, pp. 327–334. ACM, Portland (2015)Google Scholar
  4. 4.
    Bronstein, I., Nelson, N., Livnat, Z., Ben-Ari, R.: Rapport in negotiation: the contribution of the verbal channel. J. Confl. Resolut. 56(6), 1089–1115 (2012)CrossRefGoogle Scholar
  5. 5.
    Burns, M.: Rapport and relationships: the basis of child care. J. Child Care (1984)Google Scholar
  6. 6.
    Cordella, M., Kokubu, C.: Creating, Maintaining and challenging rapport across languages and age groups. In: Cordella, M., Huang, H. (eds.) Rethinking Second Language Learning: Using Intergenerational Community Resources, chap. 7, pp. 110–148. Multilingual Matters (2016)Google Scholar
  7. 7.
    Drolet, A.L., Morris, M.W.: Rapport in conflict resolution: accounting for how face-to-face contact fosters mutual cooperation in mixed-motive conflicts. J. Exp. Soc. Psychol. 36(1), 26–50 (2000)CrossRefGoogle Scholar
  8. 8.
    Duggan, P., Parrott, L.: Physicians’ nonverbal rapport building and patients’ talk about the subjective component of illness. Hum. Comm. Res. 27(2), 299–311 (2001)Google Scholar
  9. 9.
    Gadde, P., Kharrazi, H., Patel, H., MacDorman, K.F.: Toward monitoring and increasing exercise adherence in older adults by robotic intervention: a proof of concept study. J. Robot. 2011, 1–11 (2011)CrossRefGoogle Scholar
  10. 10.
    Grahe, J.E., Bernieri, F.J.: The importance of nonverbal cues in judging rapport. J. Nonverbal Behav. 23(4), 253–269 (1999)CrossRefGoogle Scholar
  11. 11.
    Gratch, J., Wang, N., Gerten, J., Fast, E., Duffy, R.: Creating rapport with virtual agents. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS, vol. 4722, pp. 125–138. Springer, Heidelberg (2007). doi: 10.1007/978-3-540-74997-4_12 CrossRefGoogle Scholar
  12. 12.
    Harrigan, J.A., Oxman, T.E., Rosenthal, R.: Rapport expressed through nonverbal behavior. J. Nonverbal Behav. 9(2), 95–110 (1985)CrossRefGoogle Scholar
  13. 13.
    Haskard, K.B., Williams, S.L., DiMatteo, M.R., Heritage, J., Rosenthal, R.: The providers voice: patient satisfaction and the content-filtered speech of nurses and physicians in primary medical care. J. Nonverbal Behav. 32(1), 1–20 (2008)CrossRefGoogle Scholar
  14. 14.
    Jefferson, G.: Notes on a systematic deployment of the acknowledgement tokens yeah; and mm hm (1984)Google Scholar
  15. 15.
    Kanda, T., Ishiguro, H., Ishida, T.: Psychological analysis on human-robot interaction. In: Proceedings of the 2001 ICRA IEEE International Conference on Robotics and Automation, vol. 4, pp. 4166–4173. IEEE (2001)Google Scholar
  16. 16.
    Kang, S.H., Gratch, J.: Socially anxious people reveal more personal information with virtual counselors that talk about themselves using intimate human back stories. Ann. Rev. Cyberther. Telemed. 181, 202–207 (2012)Google Scholar
  17. 17.
    Kang, S.H., Watt, J.H., Ala, S.K.: Social copresence in anonymous social interactions using a mobile video telephone. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1535–1544. ACM (2008)Google Scholar
  18. 18.
    Kleinke, C.L.: Gaze and eye contact: a research review. Psychol. Bull. 100(1), 78 (1986)CrossRefGoogle Scholar
  19. 19.
    Lambertz, K.: Back-channelling: the use of yeah and mm to portray engaged listenership. Griffiths Working Papers Pragmat. Intercult. Commun. 4(1/2), 11–18 (2011)Google Scholar
  20. 20.
    McNeill, D.: Hand and Mind: What Gestures Reveal About Thought. University of Chicago Press, Chicago (1992)Google Scholar
  21. 21.
    Myers, I.B., McCaulley, M.H., Most, R.: Manual: A Guide to the Development and use of the Myers-Briggs Type Indicator, vol. 1985. Consulting Psychologists Press, Palo Alto (1985)Google Scholar
  22. 22.
    Nowak, K.L., Biocca, F.: The effect of the agency and anthropomorphism on users’ sense of telepresence, copresence, and social presence in virtual environments. Presence: Teleoper. Virtual Environ. 12(5), 481–494 (2003)CrossRefGoogle Scholar
  23. 23.
    Pollack, M., Brown, L., Colbry, D.: Pearl: a mobile robotic assistant for the elderly. In: AAAI Workshop on Automation as Eldercare, pp. 85–91 (2002)Google Scholar
  24. 24.
    von der Pütten, A.M., Krämer, N.C., Gratch, J., Kang, S.H.: “It doesn’t matter what you are!” explaining social effects of agents and avatars. Comput. Hum. Behav. 26(6), 1641–1650 (2010)CrossRefGoogle Scholar
  25. 25.
    Riek, L.D., Paul, P.C., Robinson, P.: When my robot smiles at me: enabling human-robot rapport via real-time head gesture mimicry. J. Multimodal User Interf. 3, 99–108 (2010)CrossRefGoogle Scholar
  26. 26.
    Sharpley, C.F., Sagris, A.: When does counsellor forward lean influence client-perceived rapport? Br. J. Guid. Counsell. 23(3), 387–394 (1995)CrossRefGoogle Scholar
  27. 27.
    Sidner, C.L., Lee, C., Kidd, C.D., Lesh, N., Rich, C.: Explorations in engagement for humans and robots. Artif. Intell. 166(1–2), 140–164 (2005)CrossRefGoogle Scholar
  28. 28.
    Tickle-Degnen, L.: Therapeutic Rapport. In: Radomski, M.V., Latham, C.A.T. (eds.) Occupational Therapy for Physical Dysfunction, 6th edn., chap. 15, pp. 402–419. Lippincott Williams & Wilkins (2008)Google Scholar
  29. 29.
    Tickle-Degnen, L., Rosenthal, R.: The nature of rapport and its nonverbal correlates. Psychol. Inq. 1(4), 285–293 (1990)CrossRefGoogle Scholar
  30. 30.
    Tsui, P., Schultz, G.L.: Failure of rapport: why psychotherapeutic engagement fails in the treatment of asian clients. Am. J. Orthopsychiatry 55(4), 561 (1985)CrossRefGoogle Scholar
  31. 31.
    Wang, N., Gratch, J.: Can virtual human build rapport and promote learning. In: 14th International Conference on Artificial Intelligence in Education, pp. 737–739 (2009)Google Scholar
  32. 32.
    Wilson, J.R., Tickle-Degnen, L., Scheutz, M.: Designing a social robot to assist in medication sorting. In: Agah, A., Cabibihan, J.-J., Howard, A.M., Salichs, M.A., He, H. (eds.) ICSR 2016. LNCS, vol. 9979, pp. 211–221. Springer, Cham (2016). doi: 10.1007/978-3-319-47437-3_21 CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Human-Robot Interaction LabTufts UniversityMedfordUSA
  2. 2.Department of Occupational TherapyTufts UniversityMedfordUSA

Personalised recommendations