Advertisement

ELE - A Conversational Social Robot for Persons with Neuro-Developmental Disorders

  • Davide FisicaroEmail author
  • Franca Garzotto
  • Mirko Gelsomini
  • Francesco Pozzi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11746)

Abstract

Several studies explore the use of social robots in interventions for persons with cognitive disability. This paper describes ELE, a plush social robot with an elephant appearance that has been designed as a conversational companion for persons with Neuro-Developmental Disorders (NDD). ELE speaks through the live voice of a remote caregiver, enriching the communication through body movements. It is integrated with a tool for automatic gathering and analysis of interaction data that support therapists in monitoring the users during the experience with the robotic companion. The paper describes the design and technology of ELE and presents an empirical study that involved eleven persons with NDD using the robot at a local therapeutic center. We compared user engagement in two story-telling experiences, one with ELE and one with a face-to-face human speaker. According to our results, the participants were more engaged with ELE than with the human storyteller, which indicates, although tentatively, the engagement potential of conversational social robots for persons with NDD.

Keywords

NDD (Neurodevelopmental Disorder) Disability Social robot Conversational companion Engagement Storytelling 

Notes

Acknowledgements

The authors are grateful to Gianmarco Giummarra, Salvatore Ferrigno and Mattia Melli for their contribution to the development of ELE and to the execution of the empirical study. We warmly thank all persons at the therapeutic center Fraternità e Amicizia (Milan) who participated in our research.

Supplementary material

Supplementary material 1 (MP4 11609 kb).

References

  1. 1.
    American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders (DSM-5®). American Psychiatric Pub., Arlington (2013)Google Scholar
  2. 2.
    Bonarini, A., Garzotto, F., Gelsomini, M., Romero, M., Clasadonte, F., Yilmaz, A.N.C.: A huggable, mobile robot for developmental disorder interventions in a multi-modal interaction space. In: 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 823–830. IEEE (2016)Google Scholar
  3. 3.
    Cabibihan, J.J., Javed, H., Ang, M., Aljunied, S.M.: Why robots? A survey on the roles and benefits of social robots in the therapy of children with autism. Int. J. Social Robot. 5(4), 593–618 (2013)CrossRefGoogle Scholar
  4. 4.
    Chapman, P.M.: Models of engagement: intrinsically motivated interaction with multimedia learning software. Ph.D. thesis, University of Waterloo (1997)Google Scholar
  5. 5.
    Dautenhahn, K., Werry, I.: Issues of robot-human interaction dynamics in the rehabilitation of children with autism. Proc. Anim. Animats 6, 519–528 (2000)Google Scholar
  6. 6.
    Dautenhahn, K., Werry, I.: Towards interactive robots in autism therapy: background, motivation and challenges. Pragmat. Cogn. 12(1), 1–35 (2004)CrossRefGoogle Scholar
  7. 7.
    Garzotto, F., Gelsomini, M., Kinoe, Y.: Puffy: a mobile inflatable interactive companion for children with neurodevelopmental disorder. In: Bernhaupt, R., Dalvi, G., Joshi, A., Balkrishan, D.K., O’Neill, J., Winckler, M. (eds.) INTERACT 2017. LNCS, vol. 10514, pp. 467–492. Springer, Cham (2017).  https://doi.org/10.1007/978-3-319-67684-5_29CrossRefGoogle Scholar
  8. 8.
    Garzotto, F., Paolini, P., Sabiescu, A.: Interactive storytelling for children. In: Proceedings of the 9th International Conference on Interaction Design and Children, IDC 2010, pp. 356–359. ACM, New York (2010)Google Scholar
  9. 9.
    Huijnen, C.A., Lexis, M.A., Jansens, R., de Witte, L.P.: Mapping robots to therapy and educational objectives for children with autism spectrum disorder. J. Autism Dev. Disord. 46(6), 2100–2114 (2016)CrossRefGoogle Scholar
  10. 10.
    Jeong, S., et al.: Designing a socially assistive robot for pediatric care. In: Proceedings of the 14th International Conference on Interaction Design and Children, pp. 387–390. ACM (2015)Google Scholar
  11. 11.
    McDuff, D., Mahmoud, A., Mavadati, M., Amr, M., Turcot, J., Kaliouby, R.e.: AFFDEX SDK: a cross-platform real-time multi-face expression recognition toolkit. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA 2016, pp. 3723–3726. ACM, New York (2016)Google Scholar
  12. 12.
    O’Brien, H.L., Toms, E.G.: What is user engagement? A conceptual framework for defining user engagement with technology. J. Am. Soc. Inform. Sci. Technol. 59(6), 938–955 (2008)CrossRefGoogle Scholar
  13. 13.
    Park, H.W., Gelsomini, M., Lee, J.J., Breazeal, C.: Telling stories to robots: the effect of backchanneling on a child’s storytelling. In: Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, pp. 100–108. ACM (2017)Google Scholar
  14. 14.
    Pauli, D., Egerton, J., Carpenter, B.: The sunfield colour impact project. PMl. Dl. inl 12(2), 12–16 (1999)Google Scholar
  15. 15.
    Robins, B., Dautenhahn, K., Te Boekhorst, R., Billard, A.: Robotic assistants in therapy and education of children with autism: can a small humanoid robot help encourage social interaction skills? Univ. Access Inf. Soc. 4(2), 105–120 (2005)CrossRefGoogle Scholar
  16. 16.
    Scassellati, B., Admoni, H., Matarić, M.: Robots for use in autism research. Annu. Rev. Biomed. Eng. 14, 275–294 (2012)CrossRefGoogle Scholar
  17. 17.
    Feil-Seifer, D., Matarić, M.J.: Socially assistive robotics. IEEE Robot. Autom. Mag. 18(1), 24–31 (2011)CrossRefGoogle Scholar
  18. 18.
    Stiehl, W.D., Lieberman, J., Breazeal, C., Basel, L., Lalla, L., Wolf, M.: Design of a therapeutic robotic companion for relational, affective touch. In: IEEE International Workshop on Robot and Human Interactive Communication, ROMAN 2005, pp. 408–415. IEEE, August 2005Google Scholar
  19. 19.
    Chella, A., Barone, R.E., Pilato, G., Sorbello, R.: An emotional storyteller robot. In: AAAI Spring Symposium: Emotion, Personality, and Social Behavior, pp. 17–22, April 2008Google Scholar
  20. 20.
    Den Brok, W.L.J.E., Sterkenburg, P.S.: Self-controlled technologies to support skill attainment in persons with an autism spectrum disorder and/or an intellectual disability: a systematic literature review. Disabil. Rehabil. Assistive Technol. 10(1), 1–10 (2015)CrossRefGoogle Scholar
  21. 21.
    Diehl, J.J., Schmitt, L.M., Villano, M., Crowell, C.R.: The clinical use of robots for individuals with autism spectrum disorders: a critical review. Res. Autism Spectr. Disord. 6(1), 249–262 (2012)CrossRefGoogle Scholar
  22. 22.
    Kozima, H., Michalowski, M.P., Nakagawa, C.: Keepon. Int. J. Social Robot. 1(1), 3–18 (2009)CrossRefGoogle Scholar
  23. 23.
    Michaud, F., Duquette, A., Nadeau, I.: Characteristics of mobile robotic toys for children with pervasive developmental disorders. In: 2003 IEEE International Conference on Systems, Man and Cybernetics, vol. 3, pp. 2938–2943. IEEE, October 2003Google Scholar
  24. 24.
    Ricks, D.J., Colton, M.B.: Trends and considerations in robot-assisted autism therapy. In: 2010 IEEE International Conference on Robotics and Automation (ICRA), pp. 4354–4359. IEEE, May 2010Google Scholar
  25. 25.
    Short, E., et al.: How to train your DragonBot: socially assistive robots for teaching children about nutrition through play. In: 2014 RO-MAN: The 23rd IEEE International Symposium on Robot and Human Interactive Communication, pp. 924–929. IEEE, August 2014Google Scholar
  26. 26.
    Kozima, H., Nakagawa, C., Yasuda, Y.: Children–robot interaction: a pilot study in autism therapy. Prog. Brain Res. 164, 385–400 (2007)CrossRefGoogle Scholar
  27. 27.
    Robins, B., et al.: Scenarios of robot-assisted play for children with cognitive and physical disabilities. Interact. Stud. 13(2), 189–234 (2012)CrossRefGoogle Scholar
  28. 28.
    Bonarini, A., Clasadonte, F., Garzotto, F., Gelsomini, M.: Blending robots and full-body interaction with large screens for children with intellectual disability. In: Proceedings of the 14th International Conference on Interaction Design and Children, pp. 351–354. ACM, June 2015Google Scholar
  29. 29.
    Kory Westlund, J., et al.: Tega: a social robot. In: The Eleventh ACM/IEEE International Conference on Human Robot Interaction, p. 561. IEEE Press, March 2016Google Scholar
  30. 30.
    Dautenhahn, K., Werry, I., Salter, T., Boekhorst, R.T.: Towards adaptive autonomous robots in autism therapy: varieties of interactions. In: Proceedings of the 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation, vol. 2, pp. 577–582. IEEE, July 2003Google Scholar
  31. 31.
    Robins, B., Dautenhahn, K., Dubowski, J.: Does appearance matter in the interaction of children with autism with a humanoid robot? Interact. Stud. 7(3), 509–542 (2006)CrossRefGoogle Scholar
  32. 32.
    Bird, G., Leighton, J., Press, C., Heyes, C.: Intact automatic imitation of human and robot actions in autism spectrum disorders. Proc. Roy. Soc. Lond. B Biol. Sci. 274(1628), 3027–3031 (2007)CrossRefGoogle Scholar
  33. 33.
    Pierno, A.C., Mari, M., Lusher, D., Castiello, U.: Robotic movement elicits visuomotor priming in children with autism. Neuropsychologia 46(2), 448–454 (2008)CrossRefGoogle Scholar
  34. 34.
    Shamsuddin, S., et al.: Initial response of autistic children in human-robot interaction therapy with humanoid robot NAO. In: 2012 IEEE 8th International Colloquium on Signal Processing and its Applications (CSPA), pp. 188–193. IEEE, March 2012Google Scholar
  35. 35.
    Shibata, T., Mitsui, T., Wada, K., Tanie, K.: Subjective evaluation of seal robot: paro-tabulation and analysis of questionnaire results. J. Robot. Mechatron. 14(1), 13–19 (2002)CrossRefGoogle Scholar
  36. 36.
    Breazeal, C.: A motivational system for regulating human-robot interaction. In: AAAI/IAAI, pp. 54–61, July 1998Google Scholar
  37. 37.
    Ferrara, C., Hill, S.D.: The responsiveness of autistic children to the predictability of social and nonsocial toys. J. Autism Dev. Disord. 10(1), 51–57 (1980)CrossRefGoogle Scholar
  38. 38.
    Colombo, S., Garzotto, F., Gelsomini, M., Melli, M., Clasadonte, F.: Dolphin Sam: a smart pet for children with intellectual disability. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 352–353. ACM, June 2016Google Scholar
  39. 39.
    Tam, V., Gelsomini, M., Garzotto, F.: Polipo: a tangible toy for children with neurodevelopmental disorders. In: Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction, pp. 11–20. ACM, March 2017Google Scholar
  40. 40.
    Bonarini, A., Clasadonte, F., Garzotto, F., Gelsomini, M., Romero, M.: Playful interaction with Teo, a mobile robot for children with neurodevelopmental disorders. In: Proceedings of the 7th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion, pp. 223–231. ACM, December 2016Google Scholar
  41. 41.
    Hu, F. (ed.): Virtual Reality Enhanced Robotic Systems for Disability Rehabilitation. IGI Global, Hershey (2016)Google Scholar
  42. 42.
    Armstrong, T., Olatunji, B.O.: Eye tracking of attention in the affective disorders: a meta-analytic review and synthesis. Clin. Psychol. Rev. 32(8), 704–723 (2012)CrossRefGoogle Scholar
  43. 43.
    Stiehl, W.D., et al.: The huggable: a therapeutic robotic companion for relational, affective touch. In: ACM SIGGRAPH 2006 Emerging Technologies, p. 15. ACM, July 2006Google Scholar
  44. 44.
    Beccaluva, E.A., et al.: Exploring engagement with robots among persons with neurodevelopmental disorders. In: 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 903–909. IEEE, August 2017Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2019

Authors and Affiliations

  • Davide Fisicaro
    • 1
    Email author
  • Franca Garzotto
    • 1
  • Mirko Gelsomini
    • 1
  • Francesco Pozzi
    • 1
  1. 1.Politecnico di MilanoMilanItaly

Personalised recommendations