Skip to main content

Design and Evaluation of Affective Expressions of a Zoomorphic Robot

  • Conference paper
  • First Online:
Social Robotics (ICSR 2020)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 12483))

Included in the following conference series:

Abstract

Social robots that are capable of showing affective expressions can improve human-robot interaction and users’ experiences in many ways. This capability is important in many application areas. In this paper, we describe the design and evaluation of 11 affective expressions for Miro, an animal-like robot. Affective expressions were inspired by the animal and human behavior literature. The designs were evaluated through a video study on Mechanical Turk with 88 participants. Five of the expressions—happy, sad, excited, surprised, and tired—were correctly recognized by more than half of the participants. While fewer participants were able to recognize the other, more complex affective expressions, we observed a significant correlation between the recognition of the robot’s displayed affective states and participants’ understanding of human emotions. This suggested that the reduced accuracy in the recognition of the other affective expressions can be due to the general challenges involved in recognizing complex emotions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    This set was decided to include basic emotions, and a few moods (e.g., fearful and tired) that would be beneficial for applications that involve children and older adults (e.g., dementia care, education, therapy, and rehabilitation).

  2. 2.

    This step provided us with more information about why an expression was confused with another one. Due to space limitation, the results of this part are not discussed here.

  3. 3.

    Two other questionnaires were used to gather additional information about the participants’ experiences, which are beyond the scope of this paper and are therefore not discussed here.

  4. 4.

    http://app.visgraf.impa.br/database/faces/.

References

  1. Bartneck, C., Duenser, A., Moltchanova, E., Zawieska, K.: Comparing the similarity of responses received from studies in amazon mechanical turk to studies conducted online and with direct recruitment. PloS one 10(4), 1–23 (2015)

    Article  Google Scholar 

  2. Breazeal, C.: Emotion and sociable humanoid robots. Int. J. Hum. comput. Stud. 59(1–2), 119–155 (2003)

    Article  Google Scholar 

  3. Buckland, E., Volk, H., Burn, C., Abeyesinghe, S.: Owner perceptions of companion dog expressions of positive emotional states and the contexts in which they occur. Anim. Welf. 23(3), 287–296 (2014)

    Article  Google Scholar 

  4. Burn, C.C.: Bestial boredom: a biological perspective on animal boredom and suggestions for its scientific investigation. Anim. Behav. 130, 141–151 (2017)

    Article  Google Scholar 

  5. Chowanda, A., Flintham, M., Blanchfield, P., Valstar, M.: Playing with social and emotional game companions. In: Traum, D., Swartout, W., Khooshabeh, P., Kopp, S., Scherer, S., Leuski, A. (eds.) IVA 2016. LNCS (LNAI), vol. 10011, pp. 85–95. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-47665-0_8

    Chapter  Google Scholar 

  6. Collins, E.C., Prescott, T.J., Mitchinson, B.: Saying it with light: a pilot study of affective communication using the MIRO robot. In: Wilson, S.P., Verschure, P.F.M.J., Mura, A., Prescott, T.J. (eds.) LIVINGMACHINES 2015. LNCS (LNAI), vol. 9222, pp. 243–255. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-22979-9_25

    Chapter  Google Scholar 

  7. Collins, E.C., Prescott, T.J., Mitchinson, B., Conran, S.: Miro: a versatile biomimetic edutainment robot. In: Proceedings of the 12th International Conference on Advances in Computer Entertainment Technology, pp. 1–4 (2015)

    Google Scholar 

  8. Dautenhahn, K.: Socially intelligent robots: dimensions of human-robot interaction. Philos. Trans. Royal Soc. B Biol. Sci. 362(1480), 679–704 (2007)

    Article  Google Scholar 

  9. Cañamero L.D.: Playing the emotion game with feelix. In: Dautenhahn K., Bond A., Cañamero L., Edmonds B. (eds) Socially Intelligent Agents. Multiagent Systems, Artificial Societies, and Simulated Organizations, vol 3. Springer, Boston, MA (2002). https://doi.org/10.1007/0-306-47373-9_8

  10. Dautenhahn, K., et al.: Kaspar-a minimally expressive humanoid robot for human-robot interaction research. Appl. Bionics Biomech. 6(3–4), 369–397 (2009)

    Article  Google Scholar 

  11. Gácsi, M., Kis, A., Faragó, T., Janiak, M., Muszyński, R., Miklósi, Á.: Humans attribute emotions to a robot that shows simple behavioural patterns borrowed from dog behaviour. Comput. Hum. Behav. 59, 411–419 (2016)

    Article  Google Scholar 

  12. Ghafurian, M., Budnarain, N., Hoey, J.: Role of emotions in perception of humanness of virtual agents. In: Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems, pp. 1979–1981 (2019)

    Google Scholar 

  13. Hampshire, V., Robertson, S.: Using the facial grimace scale to evaluate rabbit wellness in post-procedural monitoring. Lab Anim. 44(7), 259 (2015)

    Article  Google Scholar 

  14. Hasegawa, M., Ohtani, N., Ohta, M.: Dogs’ body language relevant to learning achievement. Anim. 4(1), 45–58 (2014)

    Article  Google Scholar 

  15. Keating, S.C., Thomas, A.A., Flecknell, P.A., Leach, M.C.: Evaluation of emla cream for preventing pain during tattooing of rabbits: changes in physiological, behavioural and facial expression responses. PloS one 7(9), e44437 (2012)

    Article  Google Scholar 

  16. Klausz, B., Kis, A., Persa, E., Miklósi, Á., Gácsi, M.: A quick assessment tool for human-directed aggression in pet dogs. Aggressive Behav. 40(2), 178–188 (2014)

    Article  Google Scholar 

  17. Konok, V., Dóka, A., Miklósi, Á.: The behavior of the domestic dog (canis familiaris) during separation from and reunion with the owner: a questionnaire and an experimental study. Appl. Anim. Behav. Sci. 135(4), 300–308 (2011)

    Article  Google Scholar 

  18. Konok, V., Nagy, K., Miklósi, Á.: How do humans represent the emotions of dogs? the resemblance between the human representation of the canine and the human affective space. Appl. Anim. Behav. Sci. 162, 37–46 (2015)

    Article  Google Scholar 

  19. Korcsok, B., et al.: Biologically inspired emotional expressions for artificial agents. Front. Psychol. 9, 1191 (2018)

    Article  Google Scholar 

  20. Lakatos, G., et al.: Emotion attribution to a non-humanoid robot in different social situations. PloS one 9(12), e114207 (2014)

    Article  Google Scholar 

  21. Matsumiya, L.C., et al.: Using the mouse grimace scale to reevaluate the efficacy of postoperative analgesics in laboratory mice. J. Am. Assoc. Lab. Anim. Sci. 51(1), 42–49 (2012)

    Google Scholar 

  22. Miklósi, Á., Korondi, P., Matellán, V., Gácsi, M.: Ethorobotics: a new approach to human-robot relationship. Front. Psychol. 8, 958 (2017)

    Article  Google Scholar 

  23. Mitchinson, B., Prescott, T.J.: MIRO: a robot “Mammal” with a biomimetic brain-based control system. In: Lepora, N.F.F., Mura, A., Mangan, M., Verschure, P.F.M.J.F.M.J., Desmulliez, M., Prescott, T.J.J. (eds.) Living Machines 2016. LNCS (LNAI), vol. 9793, pp. 179–191. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-42417-0_17

    Chapter  Google Scholar 

  24. Morris, P.H., Doe, C., Godsell, E.: Secondary emotions in non-primate species? behavioural reports and subjective claims by animal owners. Cogn. Emot. 22(1), 3–20 (2008)

    Article  Google Scholar 

  25. Nijdam, N.A.: Mapping Emotion to Color. Book Mapping emotion to color. pp. 2–9 (2009)

    Google Scholar 

  26. O’Brien, H.L., Toms, E.G.: What is user engagement? a conceptual framework for defining user engagement with technology. J. Am. Soc. Inf. Sci. Technol. 59(6), 938–955 (2008)

    Article  Google Scholar 

  27. Quaranta, A., Siniscalchi, M., Vallortigara, G.: Asymmetric tail-wagging responses by dogs to different emotive stimuli. Curr. Biol. 17(6), R199–R201 (2007)

    Article  Google Scholar 

  28. Reisenzein, R., Bördgen, S., Holtbernd, T., Matz, D.: Evidence for strong dissociation between emotion and facial displays: the case of surprise. J. Pers. Soc. Psychol. 91(2), 295 (2006)

    Article  Google Scholar 

  29. Ritschel, H., Aslan, I., Mertes, S., Seiderer, A., André, E.: Personalized synthesis of intentional and emotional non-verbal sounds for social robots. In: 8th International Conference on Affective Computing and Intelligent Interaction, pp. 1–7 (2019)

    Google Scholar 

  30. Saldien, J., Goris, K., Vanderborght, B., Vanderfaeillie, J., Lefeber, D.: Expressing emotions with the social robot probo. Int. J. Soc. Robot. 2(4), 377–389 (2010)

    Article  Google Scholar 

  31. Schirmer, A., Seow, C.S., Penney, T.B.: Humans process dog and human facial affect in similar ways. PLoS One 8(9), e74591 (2013)

    Article  Google Scholar 

  32. Tami, G., Gallagher, A.: Description of the behaviour of domestic dog (canis familiaris) by experienced and inexperienced people. Appl. Anim. Behav. Sci. 120(3–4), 159–169 (2009)

    Article  Google Scholar 

  33. Terwogt, M.M., Hoeksma, J.B.: Colors and emotions: preferences and combinations. J. Gen. Psychol. 122(1), 5–17 (1995)

    Article  Google Scholar 

  34. Topál, J., Miklósi, Á., Csányi, V., Dóka, A.: Attachment behavior in dogs (canis familiaris): a new application of ainsworth’s (1969) strange situation test. J. Comp. Psychol. 112(3), 219 (1998)

    Article  Google Scholar 

  35. Vas, J., Topál, J., Gácsi, M., Miklósi, A., Csányi, V.: A friend or an enemy? dogs’ reaction to an unfamiliar person showing behavioural cues of threat and friendliness at different times. Appl. Anim. Behav. Sci. 94(1–2), 99–115 (2005)

    Article  Google Scholar 

  36. Velásquez, J.D.: An emotion-based approach to robotics. In Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. 1, pp. 235–240. IEEE (1999)

    Google Scholar 

  37. Widen, S.C., Russell, J.A.: The “disgust face” conveys anger to children. Emotion 10(4), 455 (2010)

    Article  Google Scholar 

  38. Widen, S.C., Russell, J.A., Brooks, A.: Anger and disgust: discrete or overlapping categories. In: 2004 APS Annual Convention, Boston College, Chicago, IL (2004)

    Google Scholar 

Download references

Acknowledgment

This research was undertaken, in part, thanks to funding from the Canada 150 Research Chairs Program and the Network for Aging Research at the University of Waterloo. We thank Jesse Hoey, Chrystopher L. Nehaniv, and the anonymous reviewers for their comments on this work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Moojan Ghafurian .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ghafurian, M., Lakatos, G., Tao, Z., Dautenhahn, K. (2020). Design and Evaluation of Affective Expressions of a Zoomorphic Robot. In: Wagner, A.R., et al. Social Robotics. ICSR 2020. Lecture Notes in Computer Science(), vol 12483. Springer, Cham. https://doi.org/10.1007/978-3-030-62056-1_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-62056-1_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-62055-4

  • Online ISBN: 978-3-030-62056-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics