Puffy: A Mobile Inflatable Interactive Companion for Children with Neurodevelopmental Disorder

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10514)

Abstract

Puffy is a robotic companion that has been designed in cooperation with a team of therapists and special educators as a learning & play companion for children with Neurodevelopmental Disorder (NDD). Puffy has a combination of features that support multisensory stimuli and multimodal interaction and make this robot unique with respect to existing robotic devices used for children with NDD. The egg-shaped body of Puffy is inflatable, soft, and mobile. Puffy can interpret child’s gestures and movements, facial expressions and emotions; it communicates with the child using voice, lights and projections embedded in its body, as well as movements in space. The paper discusses the principles and requirements underlying the design of Puffy. They take into account the characteristics of NDD and the special needs of children with disorders in the NDD spectrum, and provide guidelines for designers and developers who work in socially assistive robotics for this target group. We also compare Puffy against 21 existing commercial or research robots that have been used with NDD children, and briefly report a preliminary evaluation of our robot.

Keywords

Neurodevelopmental Disorder Children Inflatable robot Soft robotics Socially assistive robotics Autism Down syndrome Intellectual disability 

Notes

Acknowledgment

Thanks to all teachers, specialists and children from “Via Gallina” and “Munari” kindergarten schools, “Fraternità e Amicizia” and “L’abilità” therapeutic centers.

References

  1. 1.
    American Psychiatric Association: DSM 5. American Psychiatric Association (2013)Google Scholar
  2. 2.
    Bauminger, N.: The facilitation of social-emotional understanding and social interaction in high-functioning children with autism: Intervention outcomes. J. Autism Dev. Disord. 32(4), 283–298 (2002)CrossRefGoogle Scholar
  3. 3.
    Belpaeme, T., Baxter, P.E., Read, R., Wood, R., Cuayáhuitl, H., Kiefer, B., Racioppa, S., Kruijff-Korbayová, I., Athanasopoulos, G., Enescu, V., Looije, R.: Multimodal child-robot interaction: Building social bonds. J. Hum.-Rob. Interact. 1, 33–53 (2012)Google Scholar
  4. 4.
    Best, C.M., Wilson, J.P., Killpack, M.D.: Control of a pneumatically actuated, fully inflatable, fabric-based, humanoid robot. In: 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), pp. 1133–1140. IEEE (2015)Google Scholar
  5. 5.
    Billard, A., Robins, B., Nadel, J., Dautenhahn, K.: Building robota, a mini-humanoid robot for the rehabilitation of children with autism. Assist. Technol. 19, 37–49 (2007)CrossRefGoogle Scholar
  6. 6.
    Bird, G., Leighton, J., Press, C., Heyes, C.: Intact automatic imitation of human and robot actions in autism spectrum disorders. Proc. R. Soc. Lond. B Biol. Sci. 274(1628), 3027–3031 (2007)CrossRefGoogle Scholar
  7. 7.
    Boccanfuso, L., O’Kane, J.M.: CHARLIE: an adaptive robot design with hand and face tracking for use in autism therapy. Int. J. Soc. Rob. 3, 337–347 (2011)CrossRefGoogle Scholar
  8. 8.
    Bonarini, A.: Can my robotic home cleaner be happy? Issues about emotional expression in non-bio-inspired robots. Adapt. Behav. 24(5), 335–349 (2016)CrossRefGoogle Scholar
  9. 9.
    Bonarini, A., Clasadonte, F., Garzotto, F., Gelsomini, M.: Blending robots and full-body interaction with large screens for children with intellectual disability. In: Proceedings of the 14th International Conference on Interaction Design and Children, pp. 351–354. ACM 2015Google Scholar
  10. 10.
    Bonarini, A., Garzotto, F., Gelsomini, M., Romero, M., Clasadonte, F., Yilmaz, A.N.Ç.: A huggable, mobile robot for developmental disorder interventions in a multi-modal interaction space. In: 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 823–830. IEEE (2016)Google Scholar
  11. 11.
    Breazeal, C., Scassellati, B.: A context-dependent attention system for a social robot, rn. 255, p. 3 (1999)Google Scholar
  12. 12.
    Breazeal, C.: A motivational system for regulating human-robot interaction. In: AAAI/IAAI, pp. 54–61 (1998)Google Scholar
  13. 13.
    Brodin, J.: Play in children with severe multiple disabilities: play with toys-a review. Int. J. Disabil. Dev. Educ. 46(1), 25–34 (1999)CrossRefGoogle Scholar
  14. 14.
    Bruner, J.S., Jolly, A., Sylva, K.: Play: its role in development and evolution. J. Pers. Assess. (1976)Google Scholar
  15. 15.
    Cabibihan, J.J., Javed, H., Ang, M., Aljunied, S.M.: Why robots? A survey on the roles and benefits of social robots in the therapy of children with autism. Int. J. Soc. Rob. 5(4), 593–618 (2013)CrossRefGoogle Scholar
  16. 16.
    Chella, A., Barone, R.E., Pilato, G., Sorbello, R.: An emotional storyteller robot. In: AAAI Spring Symposium: Emotion, Personality, and Social Behavior, pp. 17–22 (2008)Google Scholar
  17. 17.
    Ciolek, T.M., Kendon, A.: Environment and the spatial arrangement of conversational encounters. Sociol. Inquiry 50(3–4), 237–271 (1980)CrossRefGoogle Scholar
  18. 18.
    Clark, T., Feehan, C., Tinline, C., Vostanis, P.: Autistic symptoms in children with attention deficit-hyperactivity disorder. Eur. Child Adolesc. Psychiatry 8, 50–55 (1999)CrossRefGoogle Scholar
  19. 19.
    Colombo, S., Garzotto, F., Gelsomini, M., Melli, M., Clasadonte, F.: Dolphin sam: a smart pet for children with intellectual disability. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 352–353. ACM (2016)Google Scholar
  20. 20.
    Dautenhahn, K., Werry, I.: Towards interactive robots in autism therapy: background, motivation and challenges. Pragmat. Cogn. 12(1), 1–35 (2004)CrossRefGoogle Scholar
  21. 21.
    Dautenhahn, K., Werry, I., Salter, T., Boekhorst, R.T.: Towards adaptive autonomous robots in autism therapy: varieties of interactions. In: 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation, vol. 2, pp. 577–582. IEEE (2003)Google Scholar
  22. 22.
    Den Brok, W.L.J.E., Sterkenburg, P.S.: Self-controlled technologies to support skill attainment in persons with an autism spectrum disorder and/or an intellectual disability: a systematic literature review. Disabil. Rehabil.: Assist. Technol. 10, 1–10 (2015)Google Scholar
  23. 23.
    Diehl, J.J., Schmitt, L.M., Villano, M., Crowell, C.R.: The clinical use of robots for individuals with autism spectrum disorders: a critical review. Res. Autism Spectr. Disord. 6(1), 249–262 (2012)CrossRefGoogle Scholar
  24. 24.
    Dunst, C.J., Hamby, D.W., Trivette, C.M., Prior, J., Derryberry, G.: Vocal production of young children with disabilities during child-robot interactions. Social Robots Research Reports, Number 5. Orelena Hawks Puckett Institute (2013)Google Scholar
  25. 25.
    Feil-Seifer, D., Matarić, M.J.: Socially assistive robotics. IEEE Rob. Autom. Mag. 18(1), 24–31 (2011)CrossRefGoogle Scholar
  26. 26.
    Ferrara, C., Hill, S.D.: The responsiveness of autistic children to the predictability of social and nonsocial toys. J. Autism Dev. Disord. 10, 51–57 (1980)CrossRefGoogle Scholar
  27. 27.
    Ferrari, E., Robins, B., Dautenhahn, K.: Therapeutic and educational objectives in robot assisted play for children with autism. In: The 18th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN 2009, pp. 108–114. IEEE (2009)Google Scholar
  28. 28.
    Garzotto, F., Bordogna, M.: Paper-based multimedia interaction as learning tool for disabled children. In: Proceedings of the 9th International Conference on Interaction Design and Children, pp. 79–88. ACM (2010)Google Scholar
  29. 29.
    Garzotto, F.: Interactive storytelling for children: a survey. Int. J. Arts Technol. 7(1), 5–16 (2014)CrossRefGoogle Scholar
  30. 30.
    Gillesen, J.C., Barakova, E.I., Huskens, B.E., Feijs, L.M.: From training to robot behavior: towards custom scenarios for robotics in training programs for ASD. In: 2011 IEEE International Conference on Rehabilitation Robotics (ICORR), pp. 1–7. IEEE (2011)Google Scholar
  31. 31.
    Giullian, N., Ricks, D., Atherton, A., Colton, M., Goodrich, M., Brinton, B.: Detailed requirements for robots in autism therapy. In: 2010 IEEE International Conference on Systems Man and Cybernetics (SMC), pp. 2595–2602. IEEE (2010)Google Scholar
  32. 32.
    Groden, J., Cautela, J., Prince, S., Berryman, J.: The impact of stress and anxiety on individuals with autism and developmental disabilities. In: Schopler, E., Mesibov, G.B. (eds.) Behavioral Issues in Autism, pp. 177–194. Springer, Boston (1994). doi: 10.1007/978-1-4757-9400-7_9 CrossRefGoogle Scholar
  33. 33.
    Grove, N.: Using Storytelling to Support Children and Adults with Special Needs: Transforming Lives Through Telling Tales. Routledge, Abingdon (2012)Google Scholar
  34. 34.
    Hall, E.T.: The Hidden Dimension (1966)Google Scholar
  35. 35.
    Hoa, T.D., Cabibihan, J.J.: Cute and soft: baby steps in designing robots for children with autism. In: Proceedings of the Workshop at SIGGRAPH Asia, pp. 77–79. ACM (2012)Google Scholar
  36. 36.
    Kasari, C., Gulsrud, A.C., Wong, C., Kwon, S., Locke, J.: Randomized controlled caregiver mediated joint engagement intervention for toddlers with autism. J. Autism Dev. Disord. 40(9), 1045–1056 (2010)CrossRefGoogle Scholar
  37. 37.
    Kinoe, Y., Mizuno, N.: Dynamic characteristics of the transformation of interpersonal distance in cooperation. In: Zhou, J., Salvendy, G. (eds.) ITAP 2016. LNCS, vol. 9755, pp. 26–34. Springer, Cham (2016). doi: 10.1007/978-3-319-39949-2_3 Google Scholar
  38. 38.
    Kory Westlund, J., Lee, J.J., Plummer, L., Faridi, F., Gray, J., Berlin, M., Quintus-Bosz, H., Hartmann, R., Hess, M., Dyer, S., Dos Santos, K.: Tega: a social robot. In: The Eleventh ACM/IEEE International Conference on Human Robot Interaction, p. 561. IEEE Press (2016)Google Scholar
  39. 39.
    Kozima, H., Michalowski, M.P., Nakagawa, C.: Keepon. Int. J. Soc. Rob. 1(1), 3–18 (2009)CrossRefGoogle Scholar
  40. 40.
    Kozima, H., Nakagawa, C., Yasuda, Y.: Children–robot interaction: a pilot study in autism therapy. Prog. Brain Res. 164, 385–400 (2007)CrossRefGoogle Scholar
  41. 41.
    Kuypers, L.: The Zones of Regulation. Think Social Publishing, San Jose (2011)Google Scholar
  42. 42.
    Park, H.W., Gelsomini, M., Lee, J.J., Breazeal, C.: Telling stories to robots: the effect of backchanneling on a child’s storytelling. In: Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, pp. 100–108. ACM (2017)Google Scholar
  43. 43.
    Majidi, C.: Soft robotics: a perspective—current trends and prospects for the future. Soft Rob. 1(1), 5–11 (2014)CrossRefGoogle Scholar
  44. 44.
    Mazzei, D., Billeci, L., Armato, A., Lazzeri, N., Cisternino, A., Pioggia, G., Igliozzi, R., Muratori, F., Ahluwalia, A., De Rossi, D.: The face of autism. In: RO-MAN, pp. 791–796. IEEE (2010)Google Scholar
  45. 45.
    Mead, R., Matarić, M.J.: Perceptual models of human-robot proxemics. In: Hsieh, M.A., Khatib, O., Kumar, V. (eds.) Experimental Robotics. STAR, vol. 109, pp. 261–276. Springer, Cham (2016). doi: 10.1007/978-3-319-23778-7_18 CrossRefGoogle Scholar
  46. 46.
    Mehrabian, A.: Nonverbal Communication. Transaction Publishers, Piscataway (1972)Google Scholar
  47. 47.
    Michaud, F., Duquette, A., Nadeau, I.: Characteristics of mobile robotic toys for children with pervasive developmental disorders. In: IEEE International Conference on Systems, Man and Cybernetics, vol. 3, pp. 2938–2943. IEEE (2003)Google Scholar
  48. 48.
    Mori, M., MacDorman, K.F., Kageki, N.: The uncanny valley [from the field]. IEEE Rob. Autom. Mag. 19(2), 98–100 (2012)CrossRefGoogle Scholar
  49. 49.
    Mumm, J., Mutlu, B.: Human-robot proxemics: physical and psychological distancing in human-robot interaction. In: Proceedings of the 6th International Conference on Human-Robot Interaction, pp. 331–338. ACM (2011)Google Scholar
  50. 50.
    Phillips, B., Zhao, H.: Predictors of assistive technology abandonment. Assist. Technol. 5(1), 36–45 (1993)CrossRefGoogle Scholar
  51. 51.
    Pierno, A.C., Mari, M., Lusher, D., Castiello, U.: Robotic movement elicits visuomotor priming in children with autism. Neuropsychologia 46(2), 448–454 (2008)CrossRefGoogle Scholar
  52. 52.
    Qi, R., Lam, T.L., Xu, Y.: Mechanical design and implementation of a soft inflatable robot arm for safe human-robot interaction. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 3490–3495. IEEE (2014)Google Scholar
  53. 53.
    Rabbitt, S.M., Kazdin, A.E., Scassellati, B.: Integrating socially assistive robotics into mental healthcare interventions: applications and recommendations for expanded use. Clin. Psychol. Rev. 35, 35–46 (2015)CrossRefGoogle Scholar
  54. 54.
    Ricks, D.J., Colton, M.B.: Trends and considerations in robot-assisted autism therapy. In: 2010 IEEE International Conference on Robotics and Automation (ICRA), pp. 4354–4359. IEEE (2010)Google Scholar
  55. 55.
    Rios-Martinez, J., Spalanzani, A., Laugier, C.: From proxemics theory to socially-aware navigation: A survey. Int. J. Soc. Rob. 7(2), 137–153 (2015)CrossRefGoogle Scholar
  56. 56.
    Robins, B., Amirabdollahian, F., Dautenhahn, K.: Investigating child-robot tactile interactions: a taxonomical classification of tactile behaviour of children with autism towards a humanoid robot. In: The Sixth International Conference on Advances in Computer-Human Interactions (ACHI), pp. 89–94 (2013)Google Scholar
  57. 57.
    Robins, B., Dautenhahn, K., Dickerson, P.: From isolation to communication: a case study evaluation of robot assisted play for children with autism with a minimally expressive humanoid robot. In: Second International Conferences on Advances in Computer-Human Interactions, ACHI 2009, pp. 205–211. IEEE (2009)Google Scholar
  58. 58.
    Robins, B., Dautenhahn, K., Dubowski, J.: Does appearance matter in the interaction of children with autism with a humanoid robot? Interact. Stud. 7(3), 509–542 (2006)CrossRefGoogle Scholar
  59. 59.
    Robins, B., Dautenhahn, K., Ferrari, E., Kronreif, G., Prazak-Aram, B., Marti, P., Iacono, I., Gelderblom, G.J., Bernd, T., Caprino, F., Laudanna, E.: Scenarios of robot-assisted play for children with cognitive and physical disabilities. Interact. Stud. 13, 189–234 (2012)CrossRefGoogle Scholar
  60. 60.
    Robins, B., Dautenhahn, K., Te Boekhorst, R., Billard, A.: Robotic assistants in therapy and education of children with autism: can a small humanoid robot help encourage social interaction skills? Univ. Access Inf. Soc. 4(2), 105–120 (2005)CrossRefGoogle Scholar
  61. 61.
    Robins, B., Otero, N., Ferrari, E., Dautenhahn, K.: Eliciting requirements for a robotic toy for children with autism-results from user panels. In: The 16th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN 2007, pp. 101–106. IEEE (2007)Google Scholar
  62. 62.
    Rommelse, N.N., Franke, B., Geurts, H.M., Hartman, C.A., Buitelaar, J.K.: Shared heritability of attention-deficit/hyperactivity disorder and autism spectrum disorder. Eur. Child Adolesc. Psychiatry 19(3), 281–295 (2010)CrossRefGoogle Scholar
  63. 63.
    Salter, T., Davey, N., Michaud, F.: Designing & developing QueBall, a robotic device for autism therapy. In: 2014 RO-MAN: The 23rd IEEE International Symposium on Robot and Human Interactive Communication, pp. 574–579. IEEE (2014)Google Scholar
  64. 64.
    Scassellati, B., Admoni, H., Matarić, M.: Robots for use in autism research. Ann. Rev. Biomed. Eng. 14, 275–294 (2012)CrossRefGoogle Scholar
  65. 65.
    Shamsuddin, S., Yussof, H., Ismail, L., Hanapiah, F.A., Mohamed, S., Piah, H.A., Zahari, N.I.: Initial response of autistic children in human-robot interaction therapy with humanoid robot NAO. In: 2012 IEEE 8th International Colloquium on Signal Processing and its Applications (CSPA), pp. 188–193. IEEE (2012)Google Scholar
  66. 66.
    Shibata, T., Mitsui, T., Wada, K., Tanie, K.: Subjective evaluation of seal robot: paro-tabulation and analysis of questionnaire results. J. Rob. Mechatron. 14(1), 13–19 (2002)CrossRefGoogle Scholar
  67. 67.
    Short, E., Swift-Spong, K., Greczek, J., Ramachandran, A., Litoiu, A., Grigore, E.C., Feil-Seifer, D., Shuster, S., Lee, J.J., Huang, S., Levonisova, S.: How to train your dragonbot: socially assistive robots for teaching children about nutrition through play. In: 2014 RO-MAN: The 23rd IEEE International Symposium on Robot and Human Interactive Communication, pp. 924–929. IEEE (2014)Google Scholar
  68. 68.
    Stiehl, W.D., Lieberman, J., Breazeal, C., Basel, L., Lalla, L., Wolf, M.: Design of a therapeutic robotic companion for relational, affective touch. In: IEEE International Workshop on Robot and Human Interactive Communication, ROMAN 2005, pp. 408–415. IEEE (2005)Google Scholar
  69. 69.
    Voisembert, S., Riwan, A., Mechbal, N., Barraco, A.: A novel inflatable robot with constant and continuous volume. In: 2011 IEEE International Conference on Robotics and Automation (ICRA), pp. 5843–5848. IEEE (2011)Google Scholar
  70. 70.
    Wilson, M.: Six views of embodied cognition. Psychon. Bull. Rev. 9, 625–636 (2002)CrossRefGoogle Scholar
  71. 71.
    Valoriani, M., Bartoli, L., Garzotto, F., Gelsomini, M., Oliveto, L.: Designing and evaluating touchless playful interaction for ASD children. In: Proceedings of the 2014 Conference on Interaction Design and Children (IDC 2014), pp. 17–26. ACM, New York (2014)Google Scholar
  72. 72.
    Valoriani, M., Bartoli, L., Corradi, C., Garzotto, F.: Motion-based touchless interaction for autistic children’s learning. In: Proceedings of the ACM Interaction Design and Children (IDC), pp. 53–44 (2013)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2017

Authors and Affiliations

  • Franca Garzotto
    • 1
  • Mirko Gelsomini
    • 1
  • Yosuke Kinoe
    • 2
  1. 1.Department of Information, Electronics and BioengineeringPolitecnico di MilanoMilanItaly
  2. 2.Department of Intercultural CommunicationHosei UniversityTokyoJapan

Personalised recommendations