Skip to main content

Non-verbal Signals in HRI: Interference in Human Perception

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9388))

Abstract

Non-verbal cues of communication can influence the human understanding of verbal signals in human-human communication. We present two illustrative experimental studies showing how non-verbal cues can both interfere and facilitate communication when passing a message to a user in HRI. In the first study, participants found that the cues enabling them to discriminate between two conditions : permissive or authoritative robots were mainly verbal. The verbal message was however unchanged between these two conditions and in this case, non-verbal cues of communication (gestures, posture, voice tone and gaze) substituted the neutral verbal message. The second study highlights the fact that verbal and non-verbal communication can facilitate the understanding of messages when combined appropriately. This study is based on a Stroop task of identifying the colour of the LEDs of a robot while the robot says words that are either facilitating, neutral or disturbing for the participant. These two studies put into perspective the importance of understanding interrelations between non-verbal and verbal signals in HRI.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aldebaran nao robot (2013). https://community.aldebaran-robotics.com/

  2. Robopec reeti robot (2013). http://reeti.fr/index.php/en/

  3. Bethel, C.L., Murphy, R.R.: Survey of non-facial/non-verbal affective expressions for appearance-constrained robots. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 38(1), 83–92 (2008)

    Article  Google Scholar 

  4. Breazeal, C.: Emotion and sociable humanoid robots. International Journal of Human-Computer Studies 59(1–2), 119–155 (2003)

    Article  Google Scholar 

  5. van den Brule, R., Dotsch, R., Bijlstra, G., Wigboldus, D.H., Haselager, P.: Do robot performance and behavioral style affect human trust? International Journal of Social Robotics 6(4), 519–531 (2014)

    Article  Google Scholar 

  6. Embgen, S., Luber, M., Becker-Asano, C., Ragni, M., Evers, V., Arras, K.O.: Robot-specific social cues in emotional body language. In: 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication, pp. 1019–1025 (2012)

    Google Scholar 

  7. Fong, T., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. Robotics and autonomous systems 42(3), 143–166 (2003)

    Article  MATH  Google Scholar 

  8. Gallaher, P.E.: Individual differences in nonverbal behavior: Dimensions of style. Journal of Personality and Social Psychology 63(1), 133–145 (1992)

    Article  Google Scholar 

  9. Hall, J.A., Coats, E.J., LeBeau, L.S.: Nonverbal behavior and the vertical dimension of social relations: a meta-analysis. Psychological bulletin 131(6), 898–924 (2005)

    Article  Google Scholar 

  10. Johal, W., Pesty, S., Calvary, G.: Towards companion robots behaving with style. In: 2014 RO-MAN: The 23rd IEEE International Symposium on Robot and Human Interactive Communication, pp. 1063–1068. IEEE (2014)

    Google Scholar 

  11. Knapp, M., Hall, J., Horgan, T.: Nonverbal communication in human interaction. Cengage Learning (2013)

    Google Scholar 

  12. MacLeod, C.M.: The stroop task: The “gold standard” of attentional measures. Journal of Experimental Psychology: General 121(1), 12 (1992)

    Article  Google Scholar 

  13. Mehlmann, G., Häring, M., Janowski, K., Baur, T., Gebhard, P., André, E.: Exploring a model of gaze for grounding in multimodal HRI. In: ICMI 2014, pp. 247–254. ACM, New York (2014)

    Google Scholar 

  14. Pelachaud, C.: Studies on gesture expressivity for a virtual agent. Speech Communication 51(7), 630–639 (2009)

    Article  Google Scholar 

  15. Vernon, D., Hofsten, C., Fadiga, L.: A roadmap for cognitive development in humanoid robots. In: Cognitive Systems Monographs, vol. 11. Springer, Heidelberg (2011)

    Google Scholar 

  16. Wallbott, H.: Bodily expression of emotion. European Journal of Social Psychology 896(November 1997) (1998)

    Google Scholar 

  17. Walters, M.L., Syrdal, D.S., Dautenhahn, K., Te Boekhorst, R., Koay, K.L.: Avoiding the uncanny valley: robot appearance, personality and consistency of behavior in an attention-seeking home scenario for a robot companion. Autonomous Robots 24(2), 159–178 (2008)

    Article  Google Scholar 

  18. Williams, J.M.G., Mathews, A., MacLeod, C.: The emotional stroop task and psychopathology. Psychological bulletin 120(1), 3 (1996)

    Article  Google Scholar 

  19. Xu, J., Broekens, J.: Mood expression through parameterized functional behavior of robots. RO-MAN (2013)

    Google Scholar 

  20. Xu, J., Broekens, J., Hindriks, K., Neerincx, M.A.: Bodily mood expression: recognize moods from functional behaviors of humanoid robots. In: Pearson, M.J., Leonards, U., Herrmann, G., Lenz, A., Bremner, P., Spiers, A. (eds.) ICSR 2013. LNCS, vol. 8239, pp. 511–520. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  21. Yaffe, P.: The 7% rule: Fact, fiction, or misunderstanding. ACM Ubiquity 2011(October), 1:1–1:5 (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wafa Johal .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Johal, W., Calvary, G., Pesty, S. (2015). Non-verbal Signals in HRI: Interference in Human Perception. In: Tapus, A., André, E., Martin, JC., Ferland, F., Ammi, M. (eds) Social Robotics. ICSR 2015. Lecture Notes in Computer Science(), vol 9388. Springer, Cham. https://doi.org/10.1007/978-3-319-25554-5_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-25554-5_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-25553-8

  • Online ISBN: 978-3-319-25554-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics