Personal and Ubiquitous Computing

, Volume 16, Issue 2, pp 157–168 | Cite as

Multitouch tablet applications and activities to enhance the social skills of children with autism spectrum disorders

  • Juan Pablo Hourcade
  • Natasha E. Bullock-Rest
  • Thomas E. Hansen
Original Paper


In spite of great improvements in early diagnosis and interventions, most children diagnosed with autism spectrum disorders (ASD) are unlikely to live independently when they reach adulthood. We have been conducting research on novel computer-based interventions with the goal of promoting social skills. Working with 26 children with ASD, their teachers, and other stakeholders, we have iteratively developed a set of activities based on applications that run on multitouch tablets. Our observations suggest these activities increased pro-social behaviors such as collaboration and coordination, augmented appreciation for social activities, and provided children with novel forms of expression.


Children Autism Multitouch Tablet Social skills 


  1. 1.
    Albinali F, Goodwin MS, Intille S (2009) Recognizing stereotypical motor movements in the laboratory and classroom: a case study with children on the autism spectrum. Proc Ubicomp 2009:71–80Google Scholar
  2. 2.
    American Psychiatric Association (2000) Diagnostic and statistical manual of mental disorders, 4th edn. American Psychiatric Association, Washington, DCGoogle Scholar
  3. 3.
    Bailey JS, Burch MR (2002) Research methods in applied behavior analysis. SAGE Publications, Thousand OaksGoogle Scholar
  4. 4.
    Billstedt E, Gillberg C, Gillberg C (2005) Autism after adolescense: population-based 13–22-year follow-up study of 120 individuals with autism diagnosed in childhood. J Autism Dev Disord 35(3):351–360CrossRefGoogle Scholar
  5. 5.
    Binger C (2008) Classroom-based language goals and intervention for children who use AAC: back to basics. Perspect Augment Altern Commun 17:20–26CrossRefGoogle Scholar
  6. 6.
    Bosseler A, Massaro DW (2003) Development and evaluation of a computer-animated tutor for vocabulary and language learning in children with autism. J Autism Dev Disord 33(6):653–669CrossRefGoogle Scholar
  7. 7.
    CDC (2010) Autism spectrum disorder.
  8. 8.
    Coleman-Martin MB, Wolff-Heller K, Cihak DF, Irvine KL (2005) Using computer-assisted instruction and the nonverbal reading approach to teach word identification. Focus Autism Other Dev Disabl 20:80–90CrossRefGoogle Scholar
  9. 9.
    Davis M, Dautenhahn K, Nehaniv C, Powell S (2006) Touch story: towards an interactive learning environment for helping children with autism to understand narrative. In: Miesenberger K et al (eds) Designing accessible technology. Springer, London, pp 785–792Google Scholar
  10. 10.
    Eaves LC, Ho HH (2008) Young adult outcome of autism spectrum disorders. J Autism Dev Disord 38(4):739–747CrossRefGoogle Scholar
  11. 11.
    Elkeseth S (2009) Outcome of comprehensive psycho-educational interventions for young children with autism. Res Dev Disabil 30(1):158–178CrossRefGoogle Scholar
  12. 12.
    Faja S, Aylward E, Bernier R, Dawson G (2008) Becoming a face expert: a computerized face-training program for high-functioning individuals with autism spectrum disorders. Dev Neuropsychol 33(1):1–24CrossRefGoogle Scholar
  13. 13.
    Farr W, Yuill N, Raffle H (2010) Social benefits of a tangible user interface for children with autistic spectrum conditions. Autism 14(3):237–252CrossRefGoogle Scholar
  14. 14.
    Feil-Seifer D, Mataric MJ (2009) Toward socially assistive robotics for augmenting interventions for children with autism spectrum disorders. In: Siciliano B, Khatib O, Groen F (eds) Experimental robotics. Springer, BerlinGoogle Scholar
  15. 15.
    Gal E, Bauminger N, Goren-Bar D, Pianesi F, Stock O, Zancanaro M, Weiss PL (2009) Enhancing social communication of children with high-functioning autism through a co-located interface. AI Soc 24:75–84CrossRefGoogle Scholar
  16. 16.
    Grynzpan O, Martin JC, Nadel J (2008) Multimedia interfaces for users with high-functioning autism: an empirical investigation. Int J Hum Comput Stud 66:628–639CrossRefGoogle Scholar
  17. 17.
    Hailpern J, Karahalios K, Halle J (2009) Creating a spoken impact: encouraging vocalization through audio visual feedback in children with ASD. In: Proceedings of CHI 2009, pp 453–462Google Scholar
  18. 18.
    Hansen TE, Hourcade JP, Virbel M, Patali S, Serra T (2009) PyMT: a post-WIMP multi-touch user interface toolkit. In: Proceedings of Tabletop 2009, pp 17–24Google Scholar
  19. 19.
    Hayes GR, Kientz JA, Truiong KN, White DR, Abowd GD, Pering T (2004) Designing capture applications to support the education of children with autism. In: Proceedings of Ubicomp 2004, pp 161–178Google Scholar
  20. 20.
    Hayes GR, Hirano S, Marcu G, Monibi M, Nguyen DH, Yeganyan M (2010) Interactive visual supports for children with autism. Pers Ubiquit Comput 14(7):663–680CrossRefGoogle Scholar
  21. 21.
    Hendrix K, van Herk R, Verhaegh J, Markopoulos P (2009) Increasing children’s social competence through games: an exploratory study. In: Proceedings of IDC 2009, pp 182–185Google Scholar
  22. 22.
    Hetzroni OE, Tannous J (2004) Effects of computer-based intervention program on the communicative functions of children with autism. J Autism Dev Disord 34(2):95–113CrossRefGoogle Scholar
  23. 23.
    Hirano SH, Yeganyan MT, Marcu G, Nguyen DH, Boyd L, Hayes GR (2010) vSked: evaluation of a system to support classroom activities for children with autism. In: Proceedings of CHI 2010, pp 1633–1642Google Scholar
  24. 24.
    Hourcade JP, Bederson BB, Druin A, Rose A, Farber A, Takayama Y (2003) The international children’s digital library: viewing digital books online. Interact Comput 15:151–167CrossRefGoogle Scholar
  25. 25.
    Hourcade JP, Bederson BB, Druin A (2004) Building kidpad: an application for children’s collaborative storytelling. Softw Pract Exp 34:895–914CrossRefGoogle Scholar
  26. 26.
    Hourcade JP, Beitler D, Cormenzana F, Flores P (2008) Early OLPC experiences in a rural Uruguayan school. In: Proceedings of extended abstracts of CHI 2008 conference, pp 2503–2512Google Scholar
  27. 27.
    Howlin P, Goode S, Hutton J, Rutter M (2004) Adult outcome for children with autism. J Child Psychol Psychiatr 45(2):212–229CrossRefGoogle Scholar
  28. 28.
    Keay-Bright W (2007) Can computers create relaxation? Designing ReacTickles© software with children on the autistic spectrum. CoDes 3(2):97–110CrossRefGoogle Scholar
  29. 29.
    Kientz JA, Hayes GR, Westeyn TL, Starner T, Abowd GD (2007) Pervasive computing and autism: assisting caregivers of children with special needs. IEEE Perv Comput 6(1):28–35CrossRefGoogle Scholar
  30. 30.
    Madsen M, el Kaliouby R, Goodwin M, Picard R (2008) Technology for just-in-time in situ learning of facial affect for persons diagnosed with an autism spectrum disorder. In: Proceedings of ASSETS 2008, pp 19–26Google Scholar
  31. 31.
    Moore M, Calvert S (2000) Brief report: vocabulary acquisition for children with autism: teacher or computer instruction. J Autism Dev Disord 30(4):359–362CrossRefGoogle Scholar
  32. 32.
    Mottron L, Dawson M, Soulieres I, Hubert B, Burack J (2006) Enhanced perceptual functioning in autism: an update, and eight principles of autistic perception. J Autism Dev Disord 36(1):27–43CrossRefGoogle Scholar
  33. 33.
    Parés N et al (2005) Promotion of creative activity in children with severe autism through visuals in an interactive multisensory environment. In: Proceedings of IDC 2005, pp 110–116Google Scholar
  34. 34.
    Piper AM, O’Brien E, Ringel Morris M, Winograd T (2006) SIDES: a cooperative tabletop computer game for social skills development. In: Proceedings of CSCW 2006, pp 1–10Google Scholar
  35. 35.
    Putnam C, Chong L (2008) Software and technologies designed for people with autism: what do users want? In: Proceedings of ASSETS 2008, pp 3–10Google Scholar
  36. 36.
    Robins B, Dickerson P, Stribling P, Dautenhahn K (2004) Robot-mediated joint attention in children with autism: a case study in robot-human interaction. Interact Stud 5(2):151–198CrossRefGoogle Scholar
  37. 37.
    Tartaro A, Cassell J (2008) Playing with virtual peers: bootstrapping contingent discourse in children with Autism. In: Proceedings of ICLS 2008, pp 23–42Google Scholar
  38. 38.
    Tentori M, Hayes GR (2010) Designing for interaction immediacy to enhance social skills of children with Autism. In: Proceedings of Ubicomp 2010, pp 51–60Google Scholar
  39. 39.
    TI WA (1997) Designing environments for successful kids: a resource manual. Wisconsin Assistive Technology Initiative, OshkoshGoogle Scholar
  40. 40.
    Westeyn TL, Vadas K, Bian X, Starner T, Abowd GD (2005) Recognizing mimicked autistic self-stimulatory behaviors using HMMs. ISWC 2005:164–169Google Scholar
  41. 41.
    Whalen C, Liden L, Ingersoll B, Dallaire E, Liden S (2006) Behavioral improvements associated with computer-assisted instruction for children with developmental disabilities. J Speech Lang Pathol 1(1):11–26Google Scholar
  42. 42.
    Wheelwright S, Baron-Cohen S (2001) The link between autism and skills such as engineering, maths, physics and computing. Autism 5(2):223–227CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  • Juan Pablo Hourcade
    • 1
  • Natasha E. Bullock-Rest
    • 1
  • Thomas E. Hansen
    • 1
  1. 1.Department of Computer ScienceUniversity of IowaIowa CityUSA

Personalised recommendations