Adaptive Emotional Chatting Behavior to Increase the Sociability of Robots

  • Igor RodriguezEmail author
  • José María Martínez-Otzeta
  • Elena Lazkano
  • Txelo Ruiz
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10652)


Emotion expression is one of the characteristics that make us social beings. It is one of the main forms, along with oral and written language, that gives us a glimpse into the inner mental state of another individual. One of the aims of social robotics is the effortless communication between humans and robots. To achieve this goal, robotic emotional expression is a key ability, as it offers a more natural way to interact in a human-robot environment. In this paper a system to express the emotional content of a spoken text is presented. Head and arms movements, along with eye LED lighting and voice intonation are combined to make a humanoid robot express the sadness-happiness emotion continuum. The robot is able to express the emotional meaning of texts in English, Spanish and Basque languages.


Emotion expression Humanoid robot Sentiment analysis Body language 



This work has been partially supported by the Basque Government (IT900-16), the Spanish Ministry of Economy and Competitiveness MINECO/FEDER (TIN 2015-64395-R, MINECO/FEDER,EU). Author Rodriguez has received the UPV/EHU research Grant PIF13/104.


  1. 1.
    Knight, H.: Eight lessons learned about non-verbal interactions through robot theater. In: Social Robotics, pp. 42–51 (2011)Google Scholar
  2. 2.
    Breazeal, C., Siegel, M., Berlin, M., Gray, J., Grupen, R., Deegan, P., Weber, J., Narendran, K., McBean, J.: Mobile, dexterous, social robots for mobile manipulation and human-robot interaction. p. 27. ACM (2008)Google Scholar
  3. 3.
    Breazeal, C.: Emotion and sociable humanoid robots. Int. J. Hum. Comput. Stud. 59(1–2), 119–155 (2003)CrossRefGoogle Scholar
  4. 4.
    Cassell, J., Vilhjálmsson, H.H., Bickmore, T.: BEAT: the behavior expression animation toolkit. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 477–486. ACM (2001)Google Scholar
  5. 5.
    Lee, J., Marsella, S.: Nonverbal behavior generator for embodied conversational agents. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 243–255. Springer, Heidelberg (2006). doi: 10.1007/11821830_20 CrossRefGoogle Scholar
  6. 6.
    Lhommet, M., Xu, Y., Marsella, S.: Cerebella: automatic generation of nonverbal behavior for virtual humans. In: AAAI, pp. 4303–4304 (2015)Google Scholar
  7. 7.
    Breazeal, C.: Designing sociable robots. In: Intelligent Robotics and Autonomous Agents. MIT Press, Cambridge MA, USA (2004)Google Scholar
  8. 8.
    Johnson, D.O., Cuijpers, R.H., van der Pol, D.: Imitating human emotions with artificial facial expressions. Int. J. Soc. Robot. 5(4), 503–513 (2013)CrossRefGoogle Scholar
  9. 9.
    Paradeda, R.B., Hashemian, M., Rodrigues, R.A., Paiva, A.: How facial expressions and small talk may influence trust in a robot. In: Agah, A., Cabibihan, J.-J., Howard, A.M., Salichs, M.A., He, H. (eds.) ICSR 2016. LNCS (LNAI), vol. 9979, pp. 169–178. Springer, Cham (2016). doi: 10.1007/978-3-319-47437-3_17 CrossRefGoogle Scholar
  10. 10.
    Feldmaier, J., Marmat, T., Kuhn, J., Diepold, K.: Evaluation of a RGB-LED-based emotion display for affective agents. arXiv preprint arXiv:1612.07303 (2016)
  11. 11.
    Beck, A., Cañamero, L., Bard, K.A.: Towards an affect space for robots to display emotional body language. In: IEEE RO-MAN, pp. 464–469 (2010)Google Scholar
  12. 12.
    Beck, A., Cañamero, L., Hiolle, A., Damiano, L., Cosi, P., Tesser, F., Sommavilla, G.: Interpretation of emotional body language displayed by a humanoid robot: a case study with children. Int. J. Soc. Robot. 5(3), 325–334 (2013)CrossRefGoogle Scholar
  13. 13.
    Tielman, M., Neerincx, M., Meyer, J.J., Looije, R.: Adaptive emotional expression in robot-child interaction. In: Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction, pp. 407–414. ACM (2014)Google Scholar
  14. 14.
    McColl, D., Nejat, G.: Recognizing emotional body language displayed by a human-like social robot. Int. J. Soc. Robot. 6(2), 261–280 (2014)CrossRefGoogle Scholar
  15. 15.
    Bretan, M., Hoffman, G., Weinberg, G.: Emotionally expressive dynamic physical behaviors in robots. Int. J. Hum. Comput. Stud. 78, 1–16 (2015)CrossRefGoogle Scholar
  16. 16.
    Ekman, P.: Are there basic emotions? Psychol. Rev. 99(3), 550–553 (1992)CrossRefGoogle Scholar
  17. 17.
    San Vicente, I., Saralegi, X., Agerri, R., Sebastián, D.S.: EliXa: a modular and flexible ABSA platform. In: Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval), pp. 748–752 (2015)Google Scholar
  18. 18.
    Rodriguez, I., Astigarraga, A., Ruiz, T., Lazkano, E.: Singing minstrel robots, a means for improving social behaviors. In: International Conference on Robotics and Automation (ICRA), Stockholm, Sweden, pp. 2901–2907, May 2016Google Scholar
  19. 19.
    Hernaez, I., Navas, E., Murugarren, J., Etxebarria, B.: Description of the AhoTTS system for the Basque language. In: 4th ISCA Tutorial and Research Workshop (ITRW) on Speech Synthesis, Perthshire, Scotland (2001)Google Scholar
  20. 20.
    Bänziger, T., Scherer, K.R.: The role of intonation in emotional expressions. Speech Commun. 46(3), 252–267 (2005)CrossRefGoogle Scholar
  21. 21.
    Lhommet, M., Marsella, S.C.: Expressing emotion through posture and gesture. In: The Oxford Handbook of Affective Computing, pp. 273–285. Oxford University Press (2015)Google Scholar
  22. 22.
    Amaya, K., Bruderlin, A., Calvert, T.: Emotion from motion. In: Graphics Interface. vol. 96, Toronto, Canada, pp. 222–229 (1996)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Igor Rodriguez
    • 1
    Email author
  • José María Martínez-Otzeta
    • 1
  • Elena Lazkano
    • 1
  • Txelo Ruiz
    • 2
  1. 1.Computer Sciences and Artificial IntelligenceUniversity of Basque Country (UPV/EHU)DonostiaSpain
  2. 2.Computer Architecture and TechnologyUniversity of Basque Country (UPV/EHU)DonostiaSpain

Personalised recommendations