Social Emotions for Social Robots - Studies on Affective Impressions in Human-Human and Human-Robot Interactions

  • Kristiina JokinenEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11876)


In this paper, social emotions and expressive interaction are discussed in the context of human-robot interaction. The focus is on understanding natural human behaviour and how human socio-emotional stance manifests itself in various interactive settings. The paper compares two different types of agents, human partners and humanoid robot agents, and studies how the subjects’ behaviour and their impressions of the interaction differ depending on the agent type. The paper concludes that there is no statistically significant difference between the two conditions, but that the subjects are more certain and unanimous about their views when interacting with humans, but less sure and also less unanimous about their socio-emotional stance concerning a robot partner.


Social robots Human-robot interaction Affect 



The paper is based on the results obtained from the project commissioned by the New Energy and Industrial Technology Development Organization (NEDO).


  1. 1.
    Aylett, R., Paiva, A., Vannini, N., Enz, S., Andre, E., Hall, L.: But that was in another country: agents and intercultural empathy. In: The 8th International Conference on Autonomous Agents and Multiagent Systems (2009)Google Scholar
  2. 2.
    Barrett, L.F.: Solving the emotion paradox: categorization and the experience of emotion. Pers. Soc. Psychol. Rev. 10(1), 20–46 (2006)CrossRefGoogle Scholar
  3. 3.
    Cowie, R., et al.: Emotion recognition in human computer interaction. IEEE Sig. Process. Mag. 18(1), 32–80 (2001)CrossRefGoogle Scholar
  4. 4.
    Endrass, B., Andre, E., Rehm, M., Nakano, Y.: Investigating culture-related aspects of behavior for virtual characters. In: The 12th International Conference on Autonomous Agents and Multiagent Systems, AAMAS (2013)Google Scholar
  5. 5.
    Ekman, P., Friesen, W.V., O’Sullivan, M., Chan, A., et al.: Universals and cultural differences in the judgments of facial expressions of emotion. J. Pers. Soc. Psychol. 53(4), 712 (1987)CrossRefGoogle Scholar
  6. 6.
    Grieco, L.A., et al.: IoT-aided robotics applications: technological implications, target domains and open issues. Comput. Commun. 54, 32–47 (2014)CrossRefGoogle Scholar
  7. 7.
    Heberlein, A.S., Saxe, R.: Dissociation between emotion and personality judgments: convergent evidence from functional neuroimaging. Neuroimage 28, 770–777 (2005)CrossRefGoogle Scholar
  8. 8.
    Heylen, D., Krenn, B., Payr, S.: Companions, virtual butlers, assistive robots: empirical and theoretical insights for building long-term social relationships. In: Trappl, R. (ed.) Cybernetics and Systems 2010, pp. 539–570. Austrian Society for Cybernetic Studies, Vienna (2010)Google Scholar
  9. 9.
    Ijuin, K., Jokinen, K., Kato, T., Yamamoto, S.: Eye-gaze in social robot interactions. In: Grounding of Information and Eye-Gaze Patterns. JSAI 2019 (2019)Google Scholar
  10. 10.
    Jokinen, K.: Constructive Dialogue Modelling: Speech Interaction with Rational Agents. Wiley, Chichester (2009)CrossRefGoogle Scholar
  11. 11.
    Jokinen, K.: Dialogue models for social robots. In: Proceedings of ICSR 2018, Qingdao, China (2018)Google Scholar
  12. 12.
    Jokinen, K.: The AICO corpus. Technical report, AI Research Center, AIST (2019)Google Scholar
  13. 13.
    Jokinen, K., Nishimura, S., Watanabe, K., Nishimura, T.: Human-robot dialogues for explaining activities. In: D’Haro, L.F., Banchs, R.E., Li, H. (eds.) 9th International Workshop on Spoken Dialogue System Technology. LNEE, vol. 579, pp. 239–251. Springer, Singapore (2019). Scholar
  14. 14.
    Jokinen, K., et al.: Privacy and sensor information in the interactive service applications for elder people. In: Proceedings of 7th National Conference of Servicology, Tokyo (2019)Google Scholar
  15. 15.
    Kanda, T., Hirano, T., Eaton, D., Ishiguro, H.: Interactive robots as social partners and peer tutors for children: a field trial. Hum.-Comput. Interact. 19(1–2), 61–84 (2004)CrossRefGoogle Scholar
  16. 16.
    Laohagangvalvit, T., Jokinen, K.: Eye-gaze behaviours in natural human-human and human-robot interactions. In: ECEM Conference, Alicante (2019)Google Scholar
  17. 17.
    Leite, I., Martinho, C., Paiva, A.: Social robots for long-term interaction: a survey. Int. J. Soc. Robot. 5(2), 291–308 (2013)CrossRefGoogle Scholar
  18. 18.
    Montemayor, J., et al.: From pets to storykit: creating new technology with and intergenerational design team. In: Proceedings of the Workshop on Interactive Robots and Entertainment (WIRE), Pittsburgh (2000)Google Scholar
  19. 19.
    Montemerlo, M., Pineau, J., Roy, N., Thrun, S., Verma, V.: Experiences with a mobile robotic guide for the elderly. In: Proceedings of AAAI National Conference on Artificial Intelligence (2002)Google Scholar
  20. 20.
    Navarretta, C., Ahlsen, E., Allwood, J., Jokinen, K., Paggio, P.: Feedback in Nordic first encounters: a comparative study. In: The 8th International Conference on Language Resources and Evaluation (LREC) (2012)Google Scholar
  21. 21.
    Okada, S., Nguyen, L.S., Aran, O., Gatica-Perez, D.: Modeling dyadic and group impressions with intermodal and interpersonal features. ACM Trans. Multimed. Comput. Commun. Appl. 15, 13 (2019)CrossRefGoogle Scholar
  22. 22.
    Petrica, R., Moscovitch, M., Grady, C.: Proficiency in positive vs. negative emotion identification and subjective well-being among long-term married elderly couples. Front. Psychol. 5, 338 (2014)Google Scholar
  23. 23.
    Pollack, M.E.: Intelligent technology for an aging population: the use of AI to assist elders with cognitive impairment. AI Mag. 26(2), 9–24 (2005)Google Scholar
  24. 24.
    Sidner, C., Rich, C., Shayganfar, M., Bickmore, T., Ring, L., Zhang, Z.: A robotic companion for social support of isolated older adults. In: The 10th Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts, pp. 289–289 (2015)Google Scholar
  25. 25.
    Wilcock, G., Jokinen, K.: Advances in Wikipedia-based interaction with robots. In: Proceedings of ICMI Workshop on Multi-Modal, Multi-Party, Real-World Human-Robot Interaction, pp. 13–18 (2014)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.AI Research CenterAIST Tokyo WaterfrontTokyoJapan

Personalised recommendations