Skip to main content
SpringerLink
Log in

Human-Robot Interaction: Exploring the Ability to Express Emotions by a Social Robot

  • Chapter
  • First Online:
Emotional Design in Human-Robot Interaction

Part of the book series: Human–Computer Interaction Series ((HCIS))

Abstract

Robots should have characteristics that make the interaction effective and fluent for a successful Human-Robot Interaction (HRI). Since the emotions play a fundamental role in the human interaction process, many robots are introduced facial expressions, speech, body movements, among others to deepen the HRI. This chapter presents the exploration, design, and evaluation of the recognition of emotions displayed by a social robot. Initially, a pre-experiment was done to program the emotions in a virtual prototype. Afterwards, a pilot study and two experiments were conducted by manipulating the robot facial expressions and body movements to evaluate the recognition of the emotions. The results show that joy, surprise, and sadness have higher correct recognition and fear, disgust, and anger reported as lower recognition. Further study is needed regarding body movement and displacement of the robot for disgust, fear, and anger. Moreover, a robot should be introduced in a specific context to increase the recognition of emotions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Bartneck C (2002) eMuu-an embodied emotional character for the ambient intelligent home. Technische Universiteit Eindhoven

    Google Scholar 

  • Blow M, Dautenhahn K, Appleby A, Nehaniv CL, Lee DC (2006) Perception of robot smiles and dimensions for Human-Robot Interaction design. In: 15th IEEE international symposium on robot and human interactive communication. IEEE, Hatfield, pp 469–474. https://doi.org/10.1109/roman.2006.314372

  • Breazeal C (2003) Toward sociable robots. Robot Autonom Syst 42:167–175. https://doi.org/10.1016/S0921-8890(02)00373-1

    Article  MATH  Google Scholar 

  • Bullock M, Russell JA (1984) Preschool children’s interpretation of facial expressions of emotion. Int J Behav Dev 7:193–214. https://doi.org/10.1177/016502548400700207

    Article  Google Scholar 

  • Cañamero L (2005) Emotion understanding from the perspective of autonomous robots research. Neural Netw 18:445–455. https://doi.org/10.1016/j.neunet.2005.03.003

    Article  Google Scholar 

  • Darwin C (1872) The expression of the emotions in man and animals. John Murray, London, London, UK

    Book  Google Scholar 

  • Ekman P (1999) Facial expressions of emotion. In: Dalgleish T, Power M (eds) Facial expressions. John Wiley, Sussex, UK, pp 301–320

    Google Scholar 

  • Ekman P, Friesen W, Ellsworth P (1982) Emotion in the human face. Cambridge University Press, Cambridge, UK

    Google Scholar 

  • Fairchild G, Van Goozen SHM, Calder AJ, Stollery SJ, Goodyer IM (2009) Deficits in facial expression recognition in male adolescents with early-onset or adolescence-onset conduct disorder. J Child Psychol Psychiatry 50:627–636. https://doi.org/10.1111/j.1469-7610.2008.02020.x

    Article  Google Scholar 

  • Ferreira MIA, Sequeira JS (2017) Designing a robotic interface for children: the monarch robot example. In: Advances in cooperative robotics, pp 652–659

    Google Scholar 

  • Frijda N (1986) The emotions. Cambridge University Press, Cambridge

    Google Scholar 

  • Frith C (2009) Role of facial expressions in social interaction. Philos Trans Royal Soc B 364:3453–3458. https://doi.org/10.1098/rstb.2009.0142

    Article  Google Scholar 

  • Giambattista A, Teixeira L, Ayanoğlu H, Saraiva M, Duarte E (2016) Expression of emotions by a service robot: a pilot study. In: Marcus A (ed), 5th international conference design, user experience, and usability: technological contexts, DUXU 2016, held as part of HCI international 2016, proceedings, Part III. Toronto: Springer International Publishing, pp 328–336. https://doi.org/10.1007/978-3-319-40406-6_31

    Chapter  Google Scholar 

  • Graaf M, Allouch S (2013) Exploring influencing variables for the acceptance of social robots. Robot Autonom Syst 61:1476–1486. https://doi.org/10.1016/j.robot.2013.07.007

    Article  Google Scholar 

  • Hashimoto T, Hitramatsu S, Tsuji T, Kobayashi H (2006) Development of the face robot SAYA for rich facial expressions. In: SICE-ICASE, 2006. International joint conference. IEEE, pp 5423–5428

    Google Scholar 

  • Hwang J, Park T, Hwang W (2013) The effects of overall robot shape on the emotions invoked in users and the perceived personalities of robot. Appl Ergonom 44:459–471. https://doi.org/10.1016/j.apergo.2012.10.010

    Article  Google Scholar 

  • James W (1884) What is an emotion? Mind 9:188–205. https://doi.org/10.1093/mind/LI.202.200

    Article  Google Scholar 

  • Kanoh M, Iwata S, Kato S, Itoh H (2005) Emotive facial expressions of sensitivity communication robot “Ifbot”. Kansei Eng Int 5(3):35–42

    Article  Google Scholar 

  • Kulic D, Croft EA (2007) Affective state estimation for human-robot interaction. IEEE Trans Robot 23:991–1000. https://doi.org/10.1109/TRO.2007.904899

    Article  Google Scholar 

  • Lakatos G, Gácsi M, Konok V, Brúder I, Bereczky B, Korondi P, Miklosi A (2014) Emotion attribution to a non-humanoid robot in different social situations. PLoS ONE 9:e114207. https://doi.org/10.1371/journal.pone.0114207

    Article  Google Scholar 

  • Lazarus RS (1999) Stress and emotion: a new synthesis. Springer, New York

    Google Scholar 

  • Levenson RW (1994) Human emotion: a functional view. In: Ekman P, Davidson R (eds) The nature of emotion: fundamental questions. Oxford University Press, New York, pp 123–126

    Google Scholar 

  • Messias J, Ventura R, Lima P, Sequeira J, Alvito P, Marques C, Carriço P (2014) A robotic platform for edutainment activities in a pediatric hospital. In: 2014 IEEE international conference on autonomous robot systems and competitions (ICARSC). IEEE, pp 193–198

    Google Scholar 

  • Nass C, Moon Y, Green N (1997) Are machines gender neutral? Gender-stereotypic responses to computers with voices. J Appl Soc Psychol 27:864–876. https://doi.org/10.1111/j.1559-1816.1997.tb00275.x

    Article  Google Scholar 

  • Nehaniv C, Dautenhahn K, Kubacki J, Haegele M, Parlitz C, Alami R (2005) A methodological approach relating the classification of gesture to identification of human intent in the context of human-robot interaction. In: Proceedings of the 14th IEEE international symposium on robot and human interactive communication. Nashville, USA. IEEE, pp 371–377

    Google Scholar 

  • Nomura T, Suzuki T, Kanda T, Kato K (2006) Altered attitudes of people toward robots: investigation through the negative attitudes toward robots scale. AAAI-06 workshop on human implications of Human-Robot Interaction. AAAI Press, California, pp 29–35

    Google Scholar 

  • Norman DA (2004) Emotional design: why we love (or hate) everyday things. Basic Civitas Books

    Google Scholar 

  • Panksepp J (2007) Criteria for basic emotions: Is DISGUST a primary “emotion”? Cogn Emot 21:1819–1828. https://doi.org/10.1080/02699930701334302

    Article  Google Scholar 

  • Picard R (2000) Towards computers that recognize and respond to user emotion. IBM Syst J 39:705–719. https://doi.org/10.1147/sj.393.0705

    Article  Google Scholar 

  • Plutchik R (1980) Emotion: a psychoevolutionary synthesis. Harkes & Row, New York

    Google Scholar 

  • Reeves B, Nass C (1998) The media equation: how people treat computers, television, and new media like real people and places. CSLI Publications, California, USA

    Google Scholar 

  • Saldien J, Goris K, Vanderborght B, Vanderfaeillie J, Lefeber D (2010) Expressing emotions with the social robot probo. Int J Soc Robot 2:377–389. https://doi.org/10.1007/s12369-010-0067-6

    Article  Google Scholar 

  • Schachter W, Singer J (1962) Cognitive, social, and physiological determinants of emotional state. Psychol Rev 69:379–399. https://doi.org/10.1037/h0046234

    Article  Google Scholar 

  • Schraft R, Schmierer G (2000) Service robots. A. K. Peters Ltd, Natick, MA, USA

    Book  Google Scholar 

  • Siegel M, Breazeal C, Norton M (2009) Persuasive robotics: the influence of robot gender on human behavior. In: Proceedings of the 2009 IEEE/RSJ international conference on intelligent robots and systems. St. Louis, MO: IEEE, pp 2563–2568. https://doi.org/10.1109/iros.2009.5354116

  • Widen SC, Russell JA (2008) Children acquire emotion categories gradually. Cogn Develop 23:291–312. https://doi.org/10.1016/j.cogdev.2008.01.002

    Article  Google Scholar 

  • Zecca M, Mizoguchi Y, Endo K, Lida F, Kawabata Y, Endo N, Itoh K, Takanishi A (2009) Whole body emotion expressions for KOBIAN humanoid robot—preliminary experiments with different emotional patterns. RO-MAN 2009—The 18th IEEE international symposium on robot and human interactive communication. Toyama, IEEE, pp 381–386

    Google Scholar 

  • Zecca M, Macrì G, Mizoguchi Y, Monaco V, Endo N, Itoh K, Dario P, Takanishi A (2010) Evaluation of the KOBIAN and HABIAN emotion expression humanoid robots with european elderly people. ROMANSY 18 robot design, dynamics and control. Springer, Vienna, pp 449–456

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. IADE – Faculdade de Design, Tecnologia e Comunicação, Universidade Europeia, Av. D. Carlos I, 4, 1200-649, Lisbon, Portugal

    Hande Ayanoğlu & Emília Duarte

  2. UNIDCOM/IADE – Unidade de Investigação em Design e Comunicação, Av. D. Carlos I, 4, 1200-649, Lisbon, Portugal

    Hande Ayanoğlu & Emília Duarte

  3. Centro de Investigação e Intervenção Social (CIS-IUL), Instituto Universitário de Lisboa (ISCTE-IUL), Lisbon, Portugal

    Magda Saraiva

  4. Scientific Software Platform, Champalimaud Foundation, Avenida Brasília, 1400-038, Lisbon, Portugal

    Luís Teixeira

Authors
  1. Hande Ayanoğlu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Magda Saraiva
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Luís Teixeira
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Emília Duarte
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hande Ayanoğlu .

Editor information

Editors and Affiliations

  1. IADE – Faculdade de Design, Tecnologia e Comunicação, Universidade Europeia, Lisbon, Portugal

    Hande Ayanoğlu

  2. IADE – Faculdade de Design, Tecnologia e Comunicação, Universidade Europeia, Lisbon, Portugal

    Emília Duarte

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Ayanoğlu, H., Saraiva, M., Teixeira, L., Duarte, E. (2019). Human-Robot Interaction: Exploring the Ability to Express Emotions by a Social Robot. In: Ayanoğlu, H., Duarte, E. (eds) Emotional Design in Human-Robot Interaction. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-319-96722-6_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-96722-6_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-96721-9

  • Online ISBN: 978-3-319-96722-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation