Virtual Reality Enabled Training for Social Adaptation in Inclusive Education Settings for School-Aged Children with Autism Spectrum Disorder (ASD)

  • Horace H. S. Ip
  • Simpson W. L. Wong
  • Dorothy F. Y. Chan
  • Julia Byrne
  • Chen Li
  • Vanessa S. N. Yuan
  • Kate S. Y. Lau
  • Joe Y. W. Wong
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9757)


The transition from kindergarten to primary school tends to be challenging for children with special needs. These children may benefit from relevant training in advance or in addition to school, yet it is challenging to support such training in an authentic, safe and controllable environment. In this paper, we present a Virtual Reality (VR) enabled system to facilitate social adaptation training for school-aged children with clinical or suspected diagnosis of Autism Spectrum Disorders (ASD) in the inclusive education setting. Six unique VR training scenarios with corresponding training protocols are designed, implemented and being delivered to over 100 school-aged children with normal-ranged IQ (IQ > 70) via a 4-side fully immersive CAVE™ VR installation in 28 sessions (14 weeks). Preliminary results indicate that after training completion, children show significant improvements in three major designated aspects, including emotion recognition, affective expression and social reciprocity.


Virtual reality Inclusive education Social adaptation Autism Spectrum Disorders 



This project is funded by the HKSAR Quality Education Fund (QEF) (Project No.: 2013/0223).


  1. 1.
    DSM-5 American Psychiatric Association. Diagnostic and statistical manual of mental disorders. American Psychiatric Publishing, Arlington (2013)Google Scholar
  2. 2.
    van Steensel, F.J.A., Bögels, S.M., Perrin, S.: Anxiety disorders in children and adolescents with autistic spectrum disorders: A meta-analysis. Clin. Child Fam. Psychol. Rev. 14(3), 302–317 (2011)CrossRefGoogle Scholar
  3. 3.
    Jang, J., Matson, J.L., Williams, L.W., Tureck, K., Goldin, R.L., Cervantes, P.E.: Rates of comorbid symptoms in children with ASD, ADHD, and comorbid ASD and ADHD. Res. Dev. Disabil. 34(8), 2369–2378 (2013)CrossRefGoogle Scholar
  4. 4.
    Strickland, D., Marcus, L.M., Mesibov, G.B., Hogan, K.: Brief report: Two case studies using virtual reality as a learning tool for autistic children. J. Autism Dev. Disord. 26(6), 651–659 (1996)CrossRefGoogle Scholar
  5. 5.
    Moore, D., McGrath, P., Thorpe, J.: Computer-aided learning for people with autism–a framework for research and development. Innovations Educ. Teach. Int. 37(3), 218–228 (2000)Google Scholar
  6. 6.
    Ip, H.H.S., Li, C.: Virtual reality-based learning environments: recent developments and ongoing challenges. In: Cheung, S.K., Kwok, L.-F., Yang, H., Fong, J., Kwan, R. (eds.) ICHL 2015. LNCS, vol. 9167, pp. 3–14. Springer, Heidelberg (2015)CrossRefGoogle Scholar
  7. 7.
    Dalgarno, B., Lee, M.J.W.: What are the learning affordances of 3-D virtual environments? Br. J. Educ. Technol. 41(1), 10–32 (2010)CrossRefGoogle Scholar
  8. 8.
    Cruz-Neira, C., Sandin, D.J., DeFanti, T.A.: Surround-screen projection-based virtual reality: the design and implementation of the CAVE. In: Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques. ACM (1993)Google Scholar
  9. 9.
    Moreno, R.: Does the modality principle hold for different media? A test of the method-affects-learning hypothesis. J. Comput. Assist. Learn. 22(3), 149–158 (2006)CrossRefGoogle Scholar
  10. 10.
    O’Neil, H.F., Mayer, R.E., Herl, H.E., Niemi, C., Olin, K., Thurman, R.A.: Instructional strategies for virtual aviation training environments. In: Aircrew Training and Assessment, pp. 105–130 (2000)Google Scholar
  11. 11.
    Moreno, R., Mayer, R.E.: Learning science in virtual reality multimedia environments: Role of methods and media. J. Educ. Psychol. 94(3), 598 (2002)CrossRefGoogle Scholar
  12. 12.
    Kort, B., Reilly, R., Picard, R.W.: An affective model of interplay between emotions and learning: Reengineering educational pedagogy-building a learning companion. In: ICALT. IEEE (2001)Google Scholar
  13. 13.
    Ron, C.-W.K., Cheng, S.H., Ip, H.H.-S., Joseph, S.-L.K.: Design of affectively evocative smart ambient media for learning. Comput. Educ. 56(1), 101–111 (2011)CrossRefGoogle Scholar
  14. 14.
    Ip, H.H.-S., Byrne, J., Cheng, S.H., Kwok, R.C.-W.: The SAMAL model for affective learning: A multidimensional model incorporating the body, mind and emotion in learning. In: International Conference on Distributed Multimedia Systems (DMS 2011), Florence, 18–20 August 2011Google Scholar
  15. 15.
    Ip, H.H.-S., Byrne, J., Lau, K.S.-Y., Li, R.C., Tso, A., Choi, C.: Interactive sensory program for affective learning (InSPAL): An innovative learning program combining interactive media and virtual reality for severely intellectually disabled students. In: Cheung, S.K., Fong, J., Fong, W., Wang, F.L., Kwok, L.F. (eds.) ICHL 2013. LNCS, vol. 8038, pp. 199–207. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  16. 16.
    Cheng, Y., et al.: Enhancing empathy instruction using a collaborative virtual learning environment for children with autistic spectrum conditions. Comput. Educ. 55(4), 1449–1458 (2010)CrossRefGoogle Scholar
  17. 17.
    Lorenzo, G., Pomares, J., Lledó, A.: Inclusion of immersive virtual learning environments and visual control systems to support the learning of children with Asperger syndrome. Comput. Educ. 62, 88–101 (2013)CrossRefGoogle Scholar
  18. 18.
    Herrera, G., et al.: Development of symbolic play through the use of virtual reality tools in children with autistic spectrum disorders Two case studies. Autism 12(2), 143–157 (2008)CrossRefGoogle Scholar
  19. 19.
    Kandalaft, M.R., et al.: Virtual reality social cognition training for young adults with high-functioning autism. J. Autism Dev. Disord. 43(1), 34–44 (2013)CrossRefGoogle Scholar
  20. 20.
    Smith, M.J., et al.: Brief report: Vocational outcomes for young adults with autism spectrum disorders at six months after virtual reality job interview training. J. Autism Dev. Disord. 45(10), 3364–3369 (2015)CrossRefGoogle Scholar
  21. 21.
    Geurts, H.M., et al.: How specific are executive functioning deficits in attention deficit hyperactivity disorder and autism? J. Child Psychol. Psychiatry 45(4), 836–854 (2004)CrossRefGoogle Scholar
  22. 22.
    Ekman, P., Friesen, W.V.: Pictures of Facial Affect. Consulting Psychologists Press, Palo Alto (1975)Google Scholar
  23. 23.
    Carpenter, P.A., Just, M.A., Shell, P.: What one intelligence test measures: a theoretical account of the processing in the Raven Progressive Matrices Test. Psychol. Rev. 97(3), 404 (1990)CrossRefGoogle Scholar
  24. 24.
    Scott, F.J., et al.: The CAST (Childhood Asperger Syndrome Test) Preliminary development of a UK screen for mainstream primary-school-age children. Autism 6(1), 9–31 (2002)CrossRefGoogle Scholar
  25. 25.
    Baron-Cohen, S., Wheelwright, S., Jolliffe, T.: Is there a “ language of the eyes”? Evidence from normal adults, and adults with autism or Asperger syndrome. Vis. Cogn. 4(3), 311–331 (1997)CrossRefGoogle Scholar
  26. 26.
    Baron-Cohen, S., et al.: Are intuitive physics and intuitive psychology independent? A test with children with Asperger Syndrome. J. Dev. Learn. Disord. 5(1), 47–78 (2001)Google Scholar
  27. 27.
    Schopler, E., Reichler, R.J.: Psychoeducational Profile (1976)Google Scholar
  28. 28.
    Spence, S.H.: A measure of anxiety symptoms among children. Behav. Res. Ther. 36(5), 545–566 (1998)CrossRefGoogle Scholar
  29. 29.
    Baron-Cohen, S., et al.: A new test of social sensitivity: Detection of faux pas in normal children and children with Asperger syndrome. J. Autism Dev. Disord. 29(5), 407–418 (1999)CrossRefGoogle Scholar
  30. 30.
    Klin, A.: Attributing social meaning to ambiguous visual stimuli in higher-functioning autism and asperger syndrome: the social attribution task. J. Child Psychol. Psychiatry 41(7), 831–846 (2000)MathSciNetCrossRefGoogle Scholar
  31. 31.
    Nauta, M.H., et al.: A parent-report measure of children’s anxiety: psychometric properties and comparison with child-report in a clinic and normal sample. Behav. Res. Ther. 42(7), 813–839 (2004)CrossRefGoogle Scholar
  32. 32.
    Bishop, D.V.M.: The Children’s Communication Checklist: CCC-2. Harcourt Assessment, London (2003)Google Scholar
  33. 33.
    Harrison, P., Oakland, T.: Adaptive Behavior Assessment System (ABAS-II). The Psychological Corporation, San Antonio (2003)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Horace H. S. Ip
    • 1
  • Simpson W. L. Wong
    • 2
  • Dorothy F. Y. Chan
    • 3
  • Julia Byrne
    • 1
  • Chen Li
    • 1
  • Vanessa S. N. Yuan
    • 1
  • Kate S. Y. Lau
    • 1
  • Joe Y. W. Wong
    • 1
  1. 1.Centre for Innovative Applications of Internet and Multimedia TechnologiesCity University of Hong KongKowloon TongHong Kong
  2. 2.Department of Psychological StudiesThe Hong Kong Institute of EducationTai PoHong Kong
  3. 3.Department of Paediatrics, Faculty of MedicineThe Chinese University of Hong KongShatinHong Kong

Personalised recommendations