Social Communication between Virtual Characters and Children with Autism
Children with ASD have difficulty with social communication, particularly joint attention. Interaction in a virtual environment (VE) may be a means for both understanding these difficulties and addressing them. It is first necessary to discover how this population interacts with virtual characters, and whether they can follow joint attention cues in a VE. This paper describes a study in which 32 children with ASD used the ECHOES VE to assist a virtual character in selecting objects by following the character’s gaze and/or pointing. Both accuracy and reaction time data suggest that children were able to successfully complete the task, and qualitative data further suggests that most children perceived the character as an intentional being with relevant, mutually directed behaviour.
Keywordsautism spectrum disorder virtual environment virtual character joint attention social communication technology-enhanced learning HCI
Unable to display preview. Download preview PDF.
- 1.DSM-IV, A.P.A.T.F.: DSM-IV: Diagnostic and statistical manual of mental disorders. American Psychiatric Association, Washington, DC (1994)Google Scholar
- 3.Schmidt, C., Schmidt, M.: Three-dimensional virtual learning environments for mediating social skills acquisition among individuals with autism spectrum disorders. In: IDC 2008: Proceedings of the 7th International Conference on Interaction Design and Children, pp. 85–88. ACM, New York (2008)Google Scholar
- 5.Tartaro, A., Cassell, J.: Playing with virtual peers: bootstrapping contingent discourse in children with autism. In: ICLS 2008: Proceedings of the 8th International Conference for the Learning Sciences, pp. 382–389. International Society of the Learning Sciences (2008)Google Scholar
- 6.Foster, M., Avramides, K., Bernardini, S., Chen, J., Frauenberger, C., Lemon, O., Porayska-Pomsta, K.: Supporting Children’s Social Communication Skills through Interactive Narratives with Virtual Characters. In: Proc. of the ACM Multimedia Conference (2010)Google Scholar
- 8.Porayska-Pomsta, K., Bernardini, S., Rajendran, G.: Embodiment as a means for Scaffolding Young Children’s Social Skill Acquisition. In: Proc. IDC 2009 (2009)Google Scholar
- 9.Porayska-Pomsta, K., Frauenberger, C., Pain, H., Rajendran, G., Smith, T.J., Menzies, R., Foster, M.E., Alcorn, A., Wass, S., Bernadini, S., Avramides, K., Keay-Bright, W., Chen, J., Waller, A., Guldberg, K., Good, J., Lemon, O.: Developing Technology for Autism: an interdisciplinary approach. Personal and Ubiquitious Computing (in press)Google Scholar
- 10.Sigman, M., Ruskin, E.: Continuity and change in the social competence of children with autism, Down syndrome, and developmental delays. Wiley-Blackwell, Malden (1999)Google Scholar
- 15.Lord, C., Rutter, M., DiLavore, D., Risi, S.: Autism Diagnostic Observation Schedule (ADOS). Western Psychological Services, Los Angeles (1999)Google Scholar