INTERACT 2017: Human-Computer Interaction - INTERACT 2017 pp 467-492 | Cite as
Puffy: A Mobile Inflatable Interactive Companion for Children with Neurodevelopmental Disorder
Abstract
Puffy is a robotic companion that has been designed in cooperation with a team of therapists and special educators as a learning & play companion for children with Neurodevelopmental Disorder (NDD). Puffy has a combination of features that support multisensory stimuli and multimodal interaction and make this robot unique with respect to existing robotic devices used for children with NDD. The egg-shaped body of Puffy is inflatable, soft, and mobile. Puffy can interpret child’s gestures and movements, facial expressions and emotions; it communicates with the child using voice, lights and projections embedded in its body, as well as movements in space. The paper discusses the principles and requirements underlying the design of Puffy. They take into account the characteristics of NDD and the special needs of children with disorders in the NDD spectrum, and provide guidelines for designers and developers who work in socially assistive robotics for this target group. We also compare Puffy against 21 existing commercial or research robots that have been used with NDD children, and briefly report a preliminary evaluation of our robot.
Keywords
Neurodevelopmental Disorder Children Inflatable robot Soft robotics Socially assistive robotics Autism Down syndrome Intellectual disabilityNotes
Acknowledgment
Thanks to all teachers, specialists and children from “Via Gallina” and “Munari” kindergarten schools, “Fraternità e Amicizia” and “L’abilità” therapeutic centers.
References
- 1.American Psychiatric Association: DSM 5. American Psychiatric Association (2013)Google Scholar
- 2.Bauminger, N.: The facilitation of social-emotional understanding and social interaction in high-functioning children with autism: Intervention outcomes. J. Autism Dev. Disord. 32(4), 283–298 (2002)CrossRefGoogle Scholar
- 3.Belpaeme, T., Baxter, P.E., Read, R., Wood, R., Cuayáhuitl, H., Kiefer, B., Racioppa, S., Kruijff-Korbayová, I., Athanasopoulos, G., Enescu, V., Looije, R.: Multimodal child-robot interaction: Building social bonds. J. Hum.-Rob. Interact. 1, 33–53 (2012)Google Scholar
- 4.Best, C.M., Wilson, J.P., Killpack, M.D.: Control of a pneumatically actuated, fully inflatable, fabric-based, humanoid robot. In: 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), pp. 1133–1140. IEEE (2015)Google Scholar
- 5.Billard, A., Robins, B., Nadel, J., Dautenhahn, K.: Building robota, a mini-humanoid robot for the rehabilitation of children with autism. Assist. Technol. 19, 37–49 (2007)CrossRefGoogle Scholar
- 6.Bird, G., Leighton, J., Press, C., Heyes, C.: Intact automatic imitation of human and robot actions in autism spectrum disorders. Proc. R. Soc. Lond. B Biol. Sci. 274(1628), 3027–3031 (2007)CrossRefGoogle Scholar
- 7.Boccanfuso, L., O’Kane, J.M.: CHARLIE: an adaptive robot design with hand and face tracking for use in autism therapy. Int. J. Soc. Rob. 3, 337–347 (2011)CrossRefGoogle Scholar
- 8.Bonarini, A.: Can my robotic home cleaner be happy? Issues about emotional expression in non-bio-inspired robots. Adapt. Behav. 24(5), 335–349 (2016)CrossRefGoogle Scholar
- 9.Bonarini, A., Clasadonte, F., Garzotto, F., Gelsomini, M.: Blending robots and full-body interaction with large screens for children with intellectual disability. In: Proceedings of the 14th International Conference on Interaction Design and Children, pp. 351–354. ACM 2015Google Scholar
- 10.Bonarini, A., Garzotto, F., Gelsomini, M., Romero, M., Clasadonte, F., Yilmaz, A.N.Ç.: A huggable, mobile robot for developmental disorder interventions in a multi-modal interaction space. In: 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 823–830. IEEE (2016)Google Scholar
- 11.Breazeal, C., Scassellati, B.: A context-dependent attention system for a social robot, rn. 255, p. 3 (1999)Google Scholar
- 12.Breazeal, C.: A motivational system for regulating human-robot interaction. In: AAAI/IAAI, pp. 54–61 (1998)Google Scholar
- 13.Brodin, J.: Play in children with severe multiple disabilities: play with toys-a review. Int. J. Disabil. Dev. Educ. 46(1), 25–34 (1999)CrossRefGoogle Scholar
- 14.Bruner, J.S., Jolly, A., Sylva, K.: Play: its role in development and evolution. J. Pers. Assess. (1976)Google Scholar
- 15.Cabibihan, J.J., Javed, H., Ang, M., Aljunied, S.M.: Why robots? A survey on the roles and benefits of social robots in the therapy of children with autism. Int. J. Soc. Rob. 5(4), 593–618 (2013)CrossRefGoogle Scholar
- 16.Chella, A., Barone, R.E., Pilato, G., Sorbello, R.: An emotional storyteller robot. In: AAAI Spring Symposium: Emotion, Personality, and Social Behavior, pp. 17–22 (2008)Google Scholar
- 17.Ciolek, T.M., Kendon, A.: Environment and the spatial arrangement of conversational encounters. Sociol. Inquiry 50(3–4), 237–271 (1980)CrossRefGoogle Scholar
- 18.Clark, T., Feehan, C., Tinline, C., Vostanis, P.: Autistic symptoms in children with attention deficit-hyperactivity disorder. Eur. Child Adolesc. Psychiatry 8, 50–55 (1999)CrossRefGoogle Scholar
- 19.Colombo, S., Garzotto, F., Gelsomini, M., Melli, M., Clasadonte, F.: Dolphin sam: a smart pet for children with intellectual disability. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 352–353. ACM (2016)Google Scholar
- 20.Dautenhahn, K., Werry, I.: Towards interactive robots in autism therapy: background, motivation and challenges. Pragmat. Cogn. 12(1), 1–35 (2004)CrossRefGoogle Scholar
- 21.Dautenhahn, K., Werry, I., Salter, T., Boekhorst, R.T.: Towards adaptive autonomous robots in autism therapy: varieties of interactions. In: 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation, vol. 2, pp. 577–582. IEEE (2003)Google Scholar
- 22.Den Brok, W.L.J.E., Sterkenburg, P.S.: Self-controlled technologies to support skill attainment in persons with an autism spectrum disorder and/or an intellectual disability: a systematic literature review. Disabil. Rehabil.: Assist. Technol. 10, 1–10 (2015)Google Scholar
- 23.Diehl, J.J., Schmitt, L.M., Villano, M., Crowell, C.R.: The clinical use of robots for individuals with autism spectrum disorders: a critical review. Res. Autism Spectr. Disord. 6(1), 249–262 (2012)CrossRefGoogle Scholar
- 24.Dunst, C.J., Hamby, D.W., Trivette, C.M., Prior, J., Derryberry, G.: Vocal production of young children with disabilities during child-robot interactions. Social Robots Research Reports, Number 5. Orelena Hawks Puckett Institute (2013)Google Scholar
- 25.Feil-Seifer, D., Matarić, M.J.: Socially assistive robotics. IEEE Rob. Autom. Mag. 18(1), 24–31 (2011)CrossRefGoogle Scholar
- 26.Ferrara, C., Hill, S.D.: The responsiveness of autistic children to the predictability of social and nonsocial toys. J. Autism Dev. Disord. 10, 51–57 (1980)CrossRefGoogle Scholar
- 27.Ferrari, E., Robins, B., Dautenhahn, K.: Therapeutic and educational objectives in robot assisted play for children with autism. In: The 18th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN 2009, pp. 108–114. IEEE (2009)Google Scholar
- 28.Garzotto, F., Bordogna, M.: Paper-based multimedia interaction as learning tool for disabled children. In: Proceedings of the 9th International Conference on Interaction Design and Children, pp. 79–88. ACM (2010)Google Scholar
- 29.Garzotto, F.: Interactive storytelling for children: a survey. Int. J. Arts Technol. 7(1), 5–16 (2014)CrossRefGoogle Scholar
- 30.Gillesen, J.C., Barakova, E.I., Huskens, B.E., Feijs, L.M.: From training to robot behavior: towards custom scenarios for robotics in training programs for ASD. In: 2011 IEEE International Conference on Rehabilitation Robotics (ICORR), pp. 1–7. IEEE (2011)Google Scholar
- 31.Giullian, N., Ricks, D., Atherton, A., Colton, M., Goodrich, M., Brinton, B.: Detailed requirements for robots in autism therapy. In: 2010 IEEE International Conference on Systems Man and Cybernetics (SMC), pp. 2595–2602. IEEE (2010)Google Scholar
- 32.Groden, J., Cautela, J., Prince, S., Berryman, J.: The impact of stress and anxiety on individuals with autism and developmental disabilities. In: Schopler, E., Mesibov, G.B. (eds.) Behavioral Issues in Autism, pp. 177–194. Springer, Boston (1994). doi: 10.1007/978-1-4757-9400-7_9 CrossRefGoogle Scholar
- 33.Grove, N.: Using Storytelling to Support Children and Adults with Special Needs: Transforming Lives Through Telling Tales. Routledge, Abingdon (2012)Google Scholar
- 34.Hall, E.T.: The Hidden Dimension (1966)Google Scholar
- 35.Hoa, T.D., Cabibihan, J.J.: Cute and soft: baby steps in designing robots for children with autism. In: Proceedings of the Workshop at SIGGRAPH Asia, pp. 77–79. ACM (2012)Google Scholar
- 36.Kasari, C., Gulsrud, A.C., Wong, C., Kwon, S., Locke, J.: Randomized controlled caregiver mediated joint engagement intervention for toddlers with autism. J. Autism Dev. Disord. 40(9), 1045–1056 (2010)CrossRefGoogle Scholar
- 37.Kinoe, Y., Mizuno, N.: Dynamic characteristics of the transformation of interpersonal distance in cooperation. In: Zhou, J., Salvendy, G. (eds.) ITAP 2016. LNCS, vol. 9755, pp. 26–34. Springer, Cham (2016). doi: 10.1007/978-3-319-39949-2_3 Google Scholar
- 38.Kory Westlund, J., Lee, J.J., Plummer, L., Faridi, F., Gray, J., Berlin, M., Quintus-Bosz, H., Hartmann, R., Hess, M., Dyer, S., Dos Santos, K.: Tega: a social robot. In: The Eleventh ACM/IEEE International Conference on Human Robot Interaction, p. 561. IEEE Press (2016)Google Scholar
- 39.Kozima, H., Michalowski, M.P., Nakagawa, C.: Keepon. Int. J. Soc. Rob. 1(1), 3–18 (2009)CrossRefGoogle Scholar
- 40.Kozima, H., Nakagawa, C., Yasuda, Y.: Children–robot interaction: a pilot study in autism therapy. Prog. Brain Res. 164, 385–400 (2007)CrossRefGoogle Scholar
- 41.Kuypers, L.: The Zones of Regulation. Think Social Publishing, San Jose (2011)Google Scholar
- 42.Park, H.W., Gelsomini, M., Lee, J.J., Breazeal, C.: Telling stories to robots: the effect of backchanneling on a child’s storytelling. In: Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, pp. 100–108. ACM (2017)Google Scholar
- 43.Majidi, C.: Soft robotics: a perspective—current trends and prospects for the future. Soft Rob. 1(1), 5–11 (2014)CrossRefGoogle Scholar
- 44.Mazzei, D., Billeci, L., Armato, A., Lazzeri, N., Cisternino, A., Pioggia, G., Igliozzi, R., Muratori, F., Ahluwalia, A., De Rossi, D.: The face of autism. In: RO-MAN, pp. 791–796. IEEE (2010)Google Scholar
- 45.Mead, R., Matarić, M.J.: Perceptual models of human-robot proxemics. In: Hsieh, M.A., Khatib, O., Kumar, V. (eds.) Experimental Robotics. STAR, vol. 109, pp. 261–276. Springer, Cham (2016). doi: 10.1007/978-3-319-23778-7_18 CrossRefGoogle Scholar
- 46.Mehrabian, A.: Nonverbal Communication. Transaction Publishers, Piscataway (1972)Google Scholar
- 47.Michaud, F., Duquette, A., Nadeau, I.: Characteristics of mobile robotic toys for children with pervasive developmental disorders. In: IEEE International Conference on Systems, Man and Cybernetics, vol. 3, pp. 2938–2943. IEEE (2003)Google Scholar
- 48.Mori, M., MacDorman, K.F., Kageki, N.: The uncanny valley [from the field]. IEEE Rob. Autom. Mag. 19(2), 98–100 (2012)CrossRefGoogle Scholar
- 49.Mumm, J., Mutlu, B.: Human-robot proxemics: physical and psychological distancing in human-robot interaction. In: Proceedings of the 6th International Conference on Human-Robot Interaction, pp. 331–338. ACM (2011)Google Scholar
- 50.Phillips, B., Zhao, H.: Predictors of assistive technology abandonment. Assist. Technol. 5(1), 36–45 (1993)CrossRefGoogle Scholar
- 51.Pierno, A.C., Mari, M., Lusher, D., Castiello, U.: Robotic movement elicits visuomotor priming in children with autism. Neuropsychologia 46(2), 448–454 (2008)CrossRefGoogle Scholar
- 52.Qi, R., Lam, T.L., Xu, Y.: Mechanical design and implementation of a soft inflatable robot arm for safe human-robot interaction. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 3490–3495. IEEE (2014)Google Scholar
- 53.Rabbitt, S.M., Kazdin, A.E., Scassellati, B.: Integrating socially assistive robotics into mental healthcare interventions: applications and recommendations for expanded use. Clin. Psychol. Rev. 35, 35–46 (2015)CrossRefGoogle Scholar
- 54.Ricks, D.J., Colton, M.B.: Trends and considerations in robot-assisted autism therapy. In: 2010 IEEE International Conference on Robotics and Automation (ICRA), pp. 4354–4359. IEEE (2010)Google Scholar
- 55.Rios-Martinez, J., Spalanzani, A., Laugier, C.: From proxemics theory to socially-aware navigation: A survey. Int. J. Soc. Rob. 7(2), 137–153 (2015)CrossRefGoogle Scholar
- 56.Robins, B., Amirabdollahian, F., Dautenhahn, K.: Investigating child-robot tactile interactions: a taxonomical classification of tactile behaviour of children with autism towards a humanoid robot. In: The Sixth International Conference on Advances in Computer-Human Interactions (ACHI), pp. 89–94 (2013)Google Scholar
- 57.Robins, B., Dautenhahn, K., Dickerson, P.: From isolation to communication: a case study evaluation of robot assisted play for children with autism with a minimally expressive humanoid robot. In: Second International Conferences on Advances in Computer-Human Interactions, ACHI 2009, pp. 205–211. IEEE (2009)Google Scholar
- 58.Robins, B., Dautenhahn, K., Dubowski, J.: Does appearance matter in the interaction of children with autism with a humanoid robot? Interact. Stud. 7(3), 509–542 (2006)CrossRefGoogle Scholar
- 59.Robins, B., Dautenhahn, K., Ferrari, E., Kronreif, G., Prazak-Aram, B., Marti, P., Iacono, I., Gelderblom, G.J., Bernd, T., Caprino, F., Laudanna, E.: Scenarios of robot-assisted play for children with cognitive and physical disabilities. Interact. Stud. 13, 189–234 (2012)CrossRefGoogle Scholar
- 60.Robins, B., Dautenhahn, K., Te Boekhorst, R., Billard, A.: Robotic assistants in therapy and education of children with autism: can a small humanoid robot help encourage social interaction skills? Univ. Access Inf. Soc. 4(2), 105–120 (2005)CrossRefGoogle Scholar
- 61.Robins, B., Otero, N., Ferrari, E., Dautenhahn, K.: Eliciting requirements for a robotic toy for children with autism-results from user panels. In: The 16th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN 2007, pp. 101–106. IEEE (2007)Google Scholar
- 62.Rommelse, N.N., Franke, B., Geurts, H.M., Hartman, C.A., Buitelaar, J.K.: Shared heritability of attention-deficit/hyperactivity disorder and autism spectrum disorder. Eur. Child Adolesc. Psychiatry 19(3), 281–295 (2010)CrossRefGoogle Scholar
- 63.Salter, T., Davey, N., Michaud, F.: Designing & developing QueBall, a robotic device for autism therapy. In: 2014 RO-MAN: The 23rd IEEE International Symposium on Robot and Human Interactive Communication, pp. 574–579. IEEE (2014)Google Scholar
- 64.Scassellati, B., Admoni, H., Matarić, M.: Robots for use in autism research. Ann. Rev. Biomed. Eng. 14, 275–294 (2012)CrossRefGoogle Scholar
- 65.Shamsuddin, S., Yussof, H., Ismail, L., Hanapiah, F.A., Mohamed, S., Piah, H.A., Zahari, N.I.: Initial response of autistic children in human-robot interaction therapy with humanoid robot NAO. In: 2012 IEEE 8th International Colloquium on Signal Processing and its Applications (CSPA), pp. 188–193. IEEE (2012)Google Scholar
- 66.Shibata, T., Mitsui, T., Wada, K., Tanie, K.: Subjective evaluation of seal robot: paro-tabulation and analysis of questionnaire results. J. Rob. Mechatron. 14(1), 13–19 (2002)CrossRefGoogle Scholar
- 67.Short, E., Swift-Spong, K., Greczek, J., Ramachandran, A., Litoiu, A., Grigore, E.C., Feil-Seifer, D., Shuster, S., Lee, J.J., Huang, S., Levonisova, S.: How to train your dragonbot: socially assistive robots for teaching children about nutrition through play. In: 2014 RO-MAN: The 23rd IEEE International Symposium on Robot and Human Interactive Communication, pp. 924–929. IEEE (2014)Google Scholar
- 68.Stiehl, W.D., Lieberman, J., Breazeal, C., Basel, L., Lalla, L., Wolf, M.: Design of a therapeutic robotic companion for relational, affective touch. In: IEEE International Workshop on Robot and Human Interactive Communication, ROMAN 2005, pp. 408–415. IEEE (2005)Google Scholar
- 69.Voisembert, S., Riwan, A., Mechbal, N., Barraco, A.: A novel inflatable robot with constant and continuous volume. In: 2011 IEEE International Conference on Robotics and Automation (ICRA), pp. 5843–5848. IEEE (2011)Google Scholar
- 70.Wilson, M.: Six views of embodied cognition. Psychon. Bull. Rev. 9, 625–636 (2002)CrossRefGoogle Scholar
- 71.Valoriani, M., Bartoli, L., Garzotto, F., Gelsomini, M., Oliveto, L.: Designing and evaluating touchless playful interaction for ASD children. In: Proceedings of the 2014 Conference on Interaction Design and Children (IDC 2014), pp. 17–26. ACM, New York (2014)Google Scholar
- 72.Valoriani, M., Bartoli, L., Corradi, C., Garzotto, F.: Motion-based touchless interaction for autistic children’s learning. In: Proceedings of the ACM Interaction Design and Children (IDC), pp. 53–44 (2013)Google Scholar