Skip to main content
SpringerLink
Log in

A new emotional robot assistant that facilitates human interaction and persuasion

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

The development of robots that are truly sociable requires understanding how human interactions can be applied to the interaction between humans and robots. A sociable robot must be able to interact with people taking into account aspects like verbal and non-verbal communications (emotions, postures, gestures). This work presents a social robot which main goal is to provide assistance to older people in carrying out their daily activities (through suggestions or reminders). In addition, the robot presents non-verbal communications like perceiving emotions and displaying human identifiable emotions in order to express empathy. A prototype of the robot is being tested in a daycare center in the northern area of Portugal.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Notes

  1. https://keras.io/.

  2. https://www.tensorflow.org/.

  3. http://www.arduino.cc/.

  4. http://www.lattepanda.com/.

References

  1. Broekens J, Heerink M, Rosendal H (2009) Assistive social robots in elderly care: a review. Grontechnology 8:94–103

    Google Scholar 

  2. Calvo MG, Lundqvist D (2008) Facial expressions of emotion (kdef): identification under different display-duration conditions. Behav Res Methods 40(1):109–115. https://doi.org/10.3758/BRM.40.1.109

    Article  Google Scholar 

  3. Caramazza P, Boccolini A, Buschek D, Hullin M, Higham CF, Henderson R, Murray-Smith R, Faccio D (2017) Neural network identification of people hidden from view with a single-pixel, single-photon detector. CoRR abs/1709.07244. http://arxiv.org/abs/1709.07244

  4. Castro FM, Marín-Jiménez MJ, Guil N, Pérez de la Blanca N (2017) Automatic learning of gait signatures for people identification. In: Rojas I, Joya G, Catala A (eds) Advances in computational intelligence. Springer, Cham, pp 257–270

    Chapter  Google Scholar 

  5. Chidambaram V, Chiang YH, Mutlu B (2012) Designing persuasive robots: how robots might persuade people using vocal and nonverbal cues. In: Proceedings of the seventh annual ACM/IEEE international conference on human–robot interaction. ACM, New York, HRI ’12, pp 293–300

  6. Costa A, Castillo JC, Novais P, Fernández-Caballero A, Simões R (2012) Sensor-driven agenda for intelligent home care of the elderly. Expert Syst Appl 39(15):12192–12204. https://doi.org/10.1016/j.eswa.2012.04.058

    Article  Google Scholar 

  7. Costa A, Heras S, Palanca J, Jordán J, Novais P, Julián V (2016) Using argumentation schemes for a persuasive cognitive assistant system. In: Multi-agent systems and agreement technologies—14th European conference, EUMAS 2016, and 4th international conference, AT 2016, Valencia, Spain, December 15–16, 2016, Revised Selected Papers, pp 538–546, https://doi.org/10.1007/978-3-319-59294-7_43

  8. Costa A, Heras S, Palanca J, Jordán J, Novais P, Julián V (2017a) Argumentation schemes for events suggestion in an e-health platform. In: de Vries P (ed) Persuasive technology: development and implementation of personalized technologies to change attitudes and behaviors. Springer, Berlin, pp 17–30. https://doi.org/10.1007/978-3-319-55134-0_2

    Chapter  Google Scholar 

  9. Costa A, Novais P, Julian V (2017b) A survey of cognitive assistants. In: Intelligent systems reference library. Springer, Berlin pp 3–16, https://doi.org/10.1007/978-3-319-62530-0_1

  10. Dynamics I (2018) AIDO. https://www.startengine.com/aido. Accessed Jan 2018

  11. Feil-Seifer D, Mataric M (2005) Socially assistive robotics. in: 9th international conference on rehabilitation robotics. In: 9th international conference on rehabilitation robotics (ICORR 2005), Institute of electrical and electronics engineers (IEEE)

  12. Ham J, Midden CJH (2014) A persuasive robot to stimulate energy conservation: the influence of positive and negative social feedback and task similarity on energy-consumption behavior. Int J Soc Robot 6(2):163–171

    Article  Google Scholar 

  13. Krämer NC (2008) Social effects of virtual assistants. A review of empirical results with regard to communication. In: Prendinger H, Lester J, Ishizuka M (eds) Intelligent virtual agents. Springer, Berlin, pp 507–508

    Chapter  Google Scholar 

  14. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 1:1097–1105

    Google Scholar 

  15. Lupiani E, Juarez JM, Palma J, Marin R (2017) Monitoring elderly people at home with temporal case-based reasoning. Know-Based Syst 134:116–134. https://doi.org/10.1016/j.knosys.2017.07.025

    Article  Google Scholar 

  16. Martinez-Martin E, del Pobil AP (2017a) Conflict resolution in robotics: an overview. In: Novais P, Carneiro D (eds) Advances in linguistics and communication studies, IGI Global, pp 263–278, https://doi.org/10.4018/978-1-5225-0245-6.ch015

  17. Martinez-Martin E, del Pobil AP (2017b) Personal robot assistants for elderly care: An overview. In: Novais P, Carneiro D (eds) Intelligent Systems Reference Library. Springer, Berlin, pp 77–91. https://doi.org/10.1007/978-3-319-62530-0_5

    Google Scholar 

  18. McCrae RR, John OP (1992) An introduction to the five-factor model and its applications. J Personal 60(2):175–215

    Article  Google Scholar 

  19. Mehrabian A (1997) Comparison of the PAD and PANAS as models for describing emotions and for differentiating anxiety from depression. J Psychopathol Behav Assess 19(4):331–357

    Article  Google Scholar 

  20. Niemela M, Ylikauppila M, Talja H (2016) Long-term use of paro the therapy robot seal the caregiver perspective. In: 10th world conference of gerontechnology 2016 (ISG 2016)

  21. Ortony A (1990) The cognitive structure of emotions. Cambridge University Press, Cambridge

    Google Scholar 

  22. Rincon J, de la Prieta F, Zanardini D, Julian V, Carrascosa C (2017) Influencing over people with a social emotional model. Neurocomputing 231:47–54. https://doi.org/10.1016/j.neucom.2016.03.107

    Article  Google Scholar 

  23. Rincon JA, Bajo J, Fernandez A, Julian V, Carrascosa C (2016) Using emotions for the development of human-agent societies. Frontiers Inf Technol Electr Eng 17(4):325–337. https://doi.org/10.1631/FITEE.1500343

    Article  Google Scholar 

  24. Rincon JA, Costa A, Novais P, Julián V, Carrascosa C (2016b) Using non-invasive wearables for detecting emotions with intelligent agents. In: Proceedings of international joint conference SOCO’16-CISIS’16-ICEUTE’16 - San Sebastián, Spain, October 19th–21st, 2016, pp 73–84, https://doi.org/10.1007/978-3-319-47364-2_8,

  25. Siegel M, Breazeal C, Norton MI (2009) Persuasive robotics: the influence of robot gender on human behavior. In: 2009 IEEE/RSJ international conference on intelligent robots and systems, pp 2563–2568, https://doi.org/10.1109/IROS.2009.5354116

  26. SoftBank (2018) Pepper. https://www.ald.softbankrobotics.com/en/robots/pepper. Accessed Jan 2018

  27. United Nations, department of economic and social affairs, population division (2015) World population ageing 2015. Techical Report ST/ESA/SER.A/390, United Nations

  28. United Nations, department of economic and social affairs, population division (2017) World population prospects: The 2017 revision, key findings and advance tables. Techical Report ESA/P/WP/248, United Nations

  29. Wada K, Shibata T (2008) Social and physiological influences of living with seal robots in an elderly care house for two months. In: The 6th international conference of the international society for gerontechnology

  30. Wada K, Shibata T, Saito T, Tanie K (2003) Effects of robot assisted activity to elderly people who stay at a health service facility for the aged. In: 3 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 2847–2852

Download references

Acknowledgements

This work is partially supported by the MINECO/FEDER TIN2015-65515-C4-1-R and the FPI Grant AP2013-01276 awarded to Jaime-Andres Rincon. This work is supported by COMPETE: POCI-01-0145-FEDER-007043 and FCT - Fundacao para a Ciencia e Tecnologia within the projects UID/CEC/00319/2013 and Post-Doc scholarship SFRH/BPD/102696/2014 (Angelo Costa).

Author information

Authors and Affiliations

  1. D. Sistemas Informáticos y Computación, Universitat Politècnica de València, Valencia, Spain

    Jaime A. Rincon, Vicente Julian & Carlos Carrascosa

  2. Centro ALGORITMI, Escola de Engenharia, Universidade do Minho, Braga, Portugal

    Angelo Costa & Paulo Novais

Authors
  1. Jaime A. Rincon
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Angelo Costa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Paulo Novais
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Vicente Julian
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Carlos Carrascosa
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vicente Julian.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rincon, J.A., Costa, A., Novais, P. et al. A new emotional robot assistant that facilitates human interaction and persuasion. Knowl Inf Syst 60, 363–383 (2019). https://doi.org/10.1007/s10115-018-1231-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-018-1231-9

Keywords

Search

Navigation