Human Robot Social Interaction Framework Based on Emotional Episodic Memory

  • Won-Hyong Lee
  • Sahng-Min Yoo
  • Jae-Woo Choi
  • Ue-Hwan Kim
  • Jong-Hwan KimEmail author
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 1015)


Nowadays the application of robots are emerging in areas of modern life. It is expected we will be living in a new era in which robots such as socially interactive robots will make an important effect on our daily lives. Considering emotions play a critical role in human social communication, emotional episodes are necessary for human-robot social interactions. In this regard, we propose a framework that can form a social relationship between human and robot using an emotional episodic memory. Proposed framework enables personalized social interactions with each user by identifying the user and retrieving the matching episode in the memory. The interaction is not fixed, the emotional episodic memory is developmental through additional experiences with the user. The proposed framework is applied to an interactive humanoid robot platform, named Mybot to verify the effectiveness. As demonstration scenarios, photo shooting, and user identification and robot’s emotional reactions are used.



This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (No. NRF-2017R1A2A1A17069837).


  1. 1.
    Lin, P., Abney, K., Bekey, G.A.: Robot Ethics: The Ethical and Social Implications of Robotics. The MIT Press, Cambridge (2014)Google Scholar
  2. 2.
    Scheutz, M.: What is robot ethics? [TC spotlight]. IEEE Robot. Autom. Mag. 20(4), 20–165 (2013)CrossRefGoogle Scholar
  3. 3.
    Fong, T., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. Robot. Auton. Syst. 42(3–4), 143–166 (2003)CrossRefGoogle Scholar
  4. 4.
    Knight, H.: How Humans Respond to Robots: Building Public Policy Through Good Design. Brookings, Washington, DC (2014)Google Scholar
  5. 5.
    Bartneck, C., Forlizzi, J.: A design-centred framework for social human-robot interaction. In: 13th IEEE International Workshop on Robot and Human Interactive Communication 2004, ROMAN 2004. IEEE (2004)Google Scholar
  6. 6.
    Belpaeme, T., et al.: Multimodal child-robot interaction: building social bonds. J. Hum. Robot Interact. 1(2), 33–53 (2013)CrossRefGoogle Scholar
  7. 7.
    Gorostiza, J.F., et al.: Multimodal human-robot interaction framework for a personal robot. In: The 15th IEEE International Symposium on Robot and Human Interactive Communication 2006, ROMAN 2006. IEEE (2006)Google Scholar
  8. 8.
    Glas, D., et al.: An interaction design framework for social robots. Robot. Sci. Syst. 7, 89 (2012)Google Scholar
  9. 9.
    Duffy, B.R., Dragone, M., O’Hare, G.M.P.: Social robot architecture: a framework for explicit social interaction. In: Android Science: Towards Social Mechanisms, CogSci 2005 Workshop, Stresa, Italy (2005)Google Scholar
  10. 10.
    Breazeal, C.L.: Designing Sociable Robots with CDROM. MIT Press, Cambridge (2004)CrossRefGoogle Scholar
  11. 11.
    Złotowski, J., Strasser, E., Bartneck, C.: Dimensions of anthropomorphism: from humanness to humanlikeness. In: Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction. ACM (2014)Google Scholar
  12. 12.
    Arkin, R.C., et al.: An ethological and emotional basis for human–robot interaction. Robot. Auton. Syst. 42(3–4), 191–201 (2003)CrossRefGoogle Scholar
  13. 13.
    Kim, H.-R., Lee, K.W., Kwon, D.-S.: Emotional interaction model for a service robot. In: IEEE International Workshop on Robot and Human Interactive Communication, ROMAN 2005. IEEE (2005)Google Scholar
  14. 14.
    Lee, W.H., et al.: Motivational emotion generation and behavior selection based on emotional experiences for social robots. In: Workshops in ICSR 2014 (2014)Google Scholar
  15. 15.
    Miwa, H., et al.: A new mental model for humanoid robots for human friendly communication introduction of learning system, mood vector and second order equations of emotion. In: IEEE International Conference on Robotics and Automation, ICRA 2003, vol. 3. IEEE (2003)Google Scholar
  16. 16.
    Kwon, D.-S., et al.: Emotion interaction system for a service robot. In: The 16th IEEE International Symposium on Robot and Human interactive Communication, RO-MAN 2007. IEEE (2007)Google Scholar
  17. 17.
    Lee, W.-H., Kim, J.-H.: Hierarchical emotional episodic memory for social human robot collaboration. Auton. Robots 42(5), 1087–1102 (2018)CrossRefGoogle Scholar
  18. 18.
    Carpenter, G.A., et al.: Fuzzy ARTMAP: a neural network architecture for incremental supervised learning of analog multidimensional maps. IEEE Trans. Neural Netw. 3(5), 698–713 (1992)CrossRefGoogle Scholar
  19. 19.
    Park, G.-M., Kim, J.-H.: Deep adaptive resonance theory for learning biologically inspired episodic memory. In: 2016 International Joint Conference on Neural Networks (IJCNN). IEEE (2016)Google Scholar
  20. 20.
    Park, G.-M., et al.: Deep art neural model for biologically inspired episodic memory and its application to task performance of robots. IEEE Trans. Cybern. 48(6), 1786–1799 (2018)CrossRefGoogle Scholar
  21. 21.
    Yun, J., et al.: Cost-efficient 3D face reconstruction from a single 2D image. In: 2017 19th International Conference on Advanced Communication Technology (ICACT). IEEE (2017)Google Scholar
  22. 22.
    Cho, S., Lee, W.-H., Kim, J.-H.: Implementation of human-robot VQA interaction system with dynamic memory networks. In: 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE (2017)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  • Won-Hyong Lee
    • 1
  • Sahng-Min Yoo
    • 1
  • Jae-Woo Choi
    • 1
  • Ue-Hwan Kim
    • 1
  • Jong-Hwan Kim
    • 1
    Email author
  1. 1.School of Electrical EngineeringKAIST (Korea Advanced Institute of Science and Technology)DaejeonRepublic of Korea

Personalised recommendations