Skip to main content
SpringerLink
Log in

Using tangible user interfaces in computer-based training systems for low-functioning autistic children

  • Original Paper
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

In this paper, the design of a computer-based training (CBT) system for low-functioning autistic children is addressed. The emphasis is on ease-of-use and learning efficiency of CBT systems with different interaction styles, namely the WIMP (Window Icon Menu Pointing Device) and TUI (Tangible User Interface) interaction styles. Two WIMP-based CBT systems with different pointing devices were involved in the study. The first system applied a standard computer mouse as a pointing device, while the second one employed a touch screen instead. For the TUI-based CBT system, a tabletop setting was adopted. Based on the known characteristics of TUI and children with autism, as well as related cognitive and learning theories, the benefits of TUI for low-functioning autistic children have been investigated. Elementary skill teaching was chosen as a case study for performance evaluation of these CBT systems. Empirical results show that the touch-based and TUI-based systems offered much better ease-of-use performance than that of the mouse-based system. Regarding learning efficacy, experimental results show that the TUI-based system achieved higher skill improvement, as compared with the WIMP-based system and a non-computer training method. Some guidelines and suggestions for the design of a TUI-based system for children with autism are summarized.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Bernard-Opitz V, Sriram N, Nakhoda-Sapuan S (2001) Enhancing social problem solving in children with autism and normal children through computer-assisted instruction. J Autism Dev Disord 31:377–384

    Article  Google Scholar 

  2. Beth F (1999) Creating a Win-Win IEP for students with autism: a how-to manual for parents and educators. Future Horizons, Arlington

  3. Bruckner C, Yoder P (2007) Restricted object use in young children with autism: definition and construct validity. Autism Int J Res Pract 11:161–171

    Article  Google Scholar 

  4. Boccanfuso L, O’Kane MJ (2010) Adaptive robot-assisted autism therapy using a robot with hand and face tracking. In: Proceedings of second international conference on social robotics, ICSR 2010, Singapore, pp 265–264

  5. Bottocchi A, Pianesi F, Tomasini D et al (2009) Collaborative puzzle game: a tabletop interactive game for foster collaboration in children with autism spectrum disorders (ASD). In: Proceeding of ITS’09, Banff, Alberta, Canada, pp 197–204

  6. Cheng Y, Ye J (2010) Exploring the social competence of students with autism spectrum conditions in a collaborative virtual learning environment: the pilot study. Comput Educ 54:1068–1077

    Article  Google Scholar 

  7. Coleman-Martin M et al (2005) Using computer-assisted instruction and the nonverbal reading approach to teach word identification. Focus Autism Other Dev Disabl 20(2):80–90

    Article  Google Scholar 

  8. Sherman DA (2007) Autism: asserting your child’s right to a special education, 2nd edn. Oxford Churchill, UK

  9. Dautenhahn K, Werry I (2004) Toward interactive robots in autism therapy: background, motivation and challenges. Pragmat Cogn 12(1):1–35

    Article  Google Scholar 

  10. Massaro DW, Bosseler A, Light J (2003) Development and evaluation of computer-animated tutor for vocabulary and language learning. In: Proceeding of 15th international congress of phonetic sciences, Barcelona, Spain, 3–9 August, 2003

  11. Edge D (2008) Tangible user interfaces for peripheral interaction episodic engagement with objects of physical, digital & social significance. Technical reports. University of Cambridge, UK, pp 1–237

    Google Scholar 

  12. Hollander E, Kolevzon A, Coyle JT (2010) Textbook of autism spectrum disorders. American Psychiatric Publishing, Arlington

  13. Fails JA, Druin A, Guha ML et al (2005) Child’s play: a comparison of desktop and physical interactive environment. In: Proceeding of IDC’05, pp 48–55

  14. Volkmar FR (2007) Autism and pervasive development disorder, 2nd edn. Cambridge University Press, UK

  15. Goldsmith TR, LeBlanc LA (2004) Use of technology in interventions for children with autism. J Early Intensive Behav Interv 1(2):166–178

    Google Scholar 

  16. Hayes RG, Hirano S, Marcu G, Monibi N, Nguyen HD, Yeganyan M (2010) Interactive visual supports for children with Autism. Pers Ubiquit Comput 14:663–680

    Article  Google Scholar 

  17. Veague HB, Collins C, Levitt P (2009) Autism: psychological disorders. Infobase Publishing, New York

  18. Heimann M, Nelson K, Tjus T, Gillberg C (1995) Increasing reading and communication skills in children with autism through an interactive multimedia computer program. J Autism Dev Disord 25(5):459–480

    Article  Google Scholar 

  19. Hetzroni O, Tannous J (2004) Effects of a computer-based intervention program on the communicative functions of children with autism. JADD 34(2):95–113

    Google Scholar 

  20. Herrera G, Alcantua F, Jordan RR et al (2005) Development of symbolic play through the use of virtual reality tools in children with autistic spectrum disorders: two case studies. Autism Int J Res Pract 12(2):143–157

    Article  Google Scholar 

  21. Kuhaneck HM (2004) Autism: a comprehensive occupational therapy approach. American Occupational Therapy Association, New York

  22. Higgins K, Boone R (1996) Creating individualized computer assisted instruction for students with autism using multimedia authoring software. Focus Autism Other Dev Disabl 11:69–78

    Article  Google Scholar 

  23. Ishii H, Ullmer B (1997) Tangible bits: human factors in computing systems. In: Proceeding of CHI’97, pp 234–241

  24. Javier M, Eva C, Sandra B et al (2009) User-oriented design and tangible interaction for kindergarten children. In: Proceedings of the 8th international conference on interaction design and children, Como, Italy, pp 190–193

  25. Jin-Ling L, Tung-yun L, Hao-hua C et al (2007) Playful tray: adopting ubicomp and persuasive techniques into play-based occupational therapy for reducing eating behavior in young children. In: Proceeding of UbiComp, LNCS4717, Berlin, Heidelberg, pp 38–55

  26. Judy H (2007) Autism: asserting your child’s right to a special education. Autism Special Education Law, Hartsfield

  27. Keen D (2009) Engagement of children with autism in learning. Australasian J Spec Educ 33(2):130–140

    Article  MathSciNet  Google Scholar 

  28. Kientz JA, Hayes GR, Westeyn T, Abowd GD (2007) Pervasive computing and autism: assisting caregivers of children with special needs. IEEE Pervasive Comput 6(1):28–35

    Article  Google Scholar 

  29. Kinney EM, Vedora J, Stromer R (2003) Computer-presented video models to teach generative spelling to a child with an autism spectrum disorder. J Posit Behav Interv 5:22–29

    Article  Google Scholar 

  30. Kozima H, Nakagawa C, Yasuda Y (2007) Children-robot interaction: a pilot study in autism therapy. Prog Brain Res 164:385–400

    Article  Google Scholar 

  31. Lee CW, Huang JK, Chou WS et al (2008) Development of a geometry learning game with tangible user interfaces. In: Proceedings of world conference on educational multimedia, hypermedia and telecommunications, pp 1548–1553

  32. Lesley X, Alissa N, Nima M (2008) Are tangible more fun? Comparing children’s enjoyment and engagement using physical, graphical and tangible user interface. In: Proceeding of TEI’2008, Bonn, Germany 2008, pp 191–198

  33. Leonard A, Mitchell P, Parson S (2002) Finding a place to sit: a preliminary investigate into the effectiveness of virtual environments for social skills training for people with autistic spectrum disorders. In: Proceeding of 4th International Conference on Disability, Virtual Reality & Associated Tech., Veszprém, Hungary, pp 132–137

  34. Madhure K, Ali M (2007) Teaching table a tangible mentor for pre-K math education. In: Proceeding of TEI’07, LA, USA 2007, pp 191–194

  35. Moore M, Calvert S (2000) Vocabulary acquisition for children with autism: teacher or computer instruction. J Autism Dev Disord 30:359–362

    Article  Google Scholar 

  36. Moore DJ, McGrath P, Thorpe J (2000) Computer aided learning for people with autism -a framework for research and development. Educ Train Int 37(3):218–228

    Article  Google Scholar 

  37. O’Malley C, Fraser DS (2004) Literature review in learning with tangible technologies. NESTA, Futurelab

    Google Scholar 

  38. Oren Z, Saeed A, Mitchel R (2005) Extend tangible interface for education: digital montessori-inspired manipulative. In: Proceedings of CHI’05, Portlang, Oregon, USA, pp 859–868

  39. Paul M (2007) Do tangible interfaces enhance learning? In: Proceeding of TEI’07, Baton Rouge, LA, USA, pp 163–169

  40. Parsons S, Mitchell P (2002) The potential of virtual reality in social skills training for people with autistic spectrum disorders. J Intellect Disabil Res 46:430–443

    Article  Google Scholar 

  41. Caldwell P, Horwood J (2008) Using intensive interaction and sensory integration: a handbook for those who support people with severe autistic spectrum disorder, 1st edn. Jessica Kingsley Publishers, London

  42. Piper AM, O’Brien E, Morris MR, Winograd T (2006) SIDES: a cooperative tabletop computer game for social skills development. In: Proceeding of CSCW’06, Banff, Alberta, Canada, pp 1–4

  43. Price S, Rogers Y, Scaife M et al (2003) Using ‘tangibles’ to promote novel forms of playful learning. J Interact Comput 15(2):169–185

    Article  Google Scholar 

  44. Powell S (1995) The use of computers in teaching people with Autism. In: Understanding and teaching children with Autism, Wiley, New York

  45. Raffle HS, Parkes AJ, Ishii H (2004) Topobo: a constructive assembly system with kinetic memory. In: Proceeding of CHI 2004, ACM Press, pp 647–654

  46. Le Blanc R, Volkers H (2007) What you should know about autism spectrum disorders: signs, symptoms, diagnosis, treatments and effects on life. Cranendonck Coaching

  47. Richmond M, Cynthia EP (2008) Restricted interests as motivators: improving academic engagement and outcomes of children on the autism spectrum. In: TEACHING Exceptional Children Plus, July 2008, vol 4(6), pp 1–15

  48. Ricks D, Colton M (2010) Trends and considerations in robot-assisted autism therapy. In: Proceeding of IEEE international conference on robotics and automation, Alaska, USA, pp 4354–4359

  49. Rieffe C, Meerum Terwogt M, Stockmann L (2000) Understanding atypical emotions among children with autism. J Autism Dev Disord 3:195–203

    Article  Google Scholar 

  50. Robins B, Dautenhahn K, te Boekhorst R, Billard A (2004) Effects of repeated exposure to a humanoid robot on children with autism. In: Keates S, Clarkson J, Langdon P, Robinson P (eds) Designing a more inclusive world. Springer, London, pp 225–236

    Chapter  Google Scholar 

  51. Ruble AL, Robson MD (2007) Individual and environmental determinants of engagement in autism. J Autism Dev Disord 37:1457–1468

    Article  Google Scholar 

  52. Shaer O, Hornecker E (2010) Tangible user interface: past, present and future directions. Foundation and Trends in HCI 3(1–2):1–138

    Google Scholar 

  53. Sitdhisanguan K, Chotikakamthorn N, Dechaboon A, Out P (2007) Comparative study of WIMP and tangible user interfaces in training shape matching skill for autistic children. In: Proceeding of TENCON IEEE region 10 conference, Taipei, Taiwan, pp 1–4

  54. Sitdhisanguan K, Chotikakamthorn N, Dechaboon A, Out P (2008) Evaluation the efficacy of computer-based training using tangible user interface for low-function children with Autism. In: Proceedings of the 2008 second IEEE international conference on digital game and intelligent toy enhanced learning, Banff, Canada, pp 70–74

  55. Silver M, Oakes P (2001) Evaluation of a new computer intervention to teach people with autism or Asperger syndrome to recognize and predict emotions in others. Autism 5(3):299–316

    Article  Google Scholar 

  56. Stagnitti K, Unsworth C (2000) The importance of pretend play in child development: an occupational therapy perspective. British J Occup Ther 63(3):121–127

    Google Scholar 

  57. Strickland D, Marcus LM, Mesibov GB, Hogan K (1996) Brief report: two case studies using virtual reality as a learning tool for autistic children. J Autism Dev Disabil 26:651–659

    Article  Google Scholar 

  58. Adams S (2008) A book about what autism can be like. Jessica Kingsley Publishers, London

  59. Grandin T (1996) Thinking in pictures: and other reports from my life with autism, 1st edn. Vintage Books, UK

  60. Whitman TL (2004) The development of autism: a self-regulatory perspective. Jessica Kingsley Publishers, London

  61. Ullmer B, Ishii H (2001) Emerging frameworks for tangible user interfaces. In: Carroll JM (ed) Human computer interaction in the new millennium. Addison-Wesley, pp 579–601

  62. William S (2007) The autism answer book: more than 300 of the top questions parents ask, 1st edn. Sourcebooks, Inc., Naperville

  63. Williams F, Nicola Y, Hayes R (2009) Collaborative benefits of a tangible interface for autistic children. In: Proceeding of CHI’09, Boston, MA, USA, pp 1–4

  64. Wynn JW, Smith T (2003) Generalization between receptive and expressive language in young children with autism. Behav Interv 18:245–266

    Article  Google Scholar 

  65. Whalen C, Liden L, Ingersoll B et al (2006) Behavioral improvements associated with computer-assisted instruction for children with developmental disabilities. J Speech Lang Pathol Appl Behav Anal 1(1):11–26

    Google Scholar 

  66. Yeganyan TM, Cramer M, Boyd AL, Hayes RG (2010) vSked: an interactive visual schedule system for use in classrooms for children with autism. In: Proceeding of IDC’10, Barcelona, Spain

  67. Ylva F, Jakob T, Martin J (2008) Towards a new set of ideals: consequences of the practice turn in tangible interaction. In: Proceeding of TEI’08, Bonn, Germany, pp 223–230

  68. Zuckerman O, Arida S, Resnick M (2005) Extending tangible interfaces for education: digital montessori-inspired manipulatives. In: Proceedings CHI’05, ACM, New York, NY, pp 859–868

Download references

Author information

Authors and Affiliations

  1. Faculty of Information Technology, King Mongkut’s Institute of Technology Ladkrabang, Bangkok, Thailand

    Karanya Sitdhisanguan & Nopporn Chotikakamthorn

  2. Occupation Department, Chiangrai Hospital, Chiangrai, Thailand

    Ajchara Dechaboon

  3. Pediatric Department, Chiangrai Hospital, Chiangrai, Thailand

    Patcharaporn Out

Authors
  1. Karanya Sitdhisanguan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nopporn Chotikakamthorn
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ajchara Dechaboon
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Patcharaporn Out
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Karanya Sitdhisanguan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sitdhisanguan, K., Chotikakamthorn, N., Dechaboon, A. et al. Using tangible user interfaces in computer-based training systems for low-functioning autistic children. Pers Ubiquit Comput 16, 143–155 (2012). https://doi.org/10.1007/s00779-011-0382-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-011-0382-4

Keywords

Search

Navigation