Design of an Assistive Avatar in Improving Eye Gaze Perception in Children with ASD During Virtual Interaction
Children diagnosed with autism spectrum disorder (ASD) usually experience impairment in social interaction and often display reduced gaze sharing when interacting with another person. The lack of gaze sharing or joint attention early in the children’s developmental stage may create a delay in their ability to learn new things and share information with others. The presented study involved the design of a novel virtual reality (VR)-based training game with an avatar and eye tracker aimed to eventually address the joint attention impairment in children with ASD. The assistive avatar provides necessary cues and hints based on both the eye tracking data recorded by the VR system and the task performance of the participant. The system uses the task performance to adaptively change the difficulty level of the game. We believe that the training game will be able to improve participant’s gaze following skill. A usability study was carried out to validate the system design. The result showed that the system was feasible and able to obtain the expected gaze performance from the participants. The details of the system architecture and result of system validation are presented in this paper.
KeywordsVirtual reality Eye gaze Joint attention Autism spectrum disorder Children with ASD
We are grateful for the support provided by NIH grants 1R21MH111548-01 for this research. The authors are solely responsible for the contents and opinions expressed in this manuscript.
- 1.Centers for Disease Control (CDC): Facts About ASD (2014)Google Scholar
- 3.Pelphrey, K.A., Sasson, N.J., Reznick, J.S., et al.: J. Autism Dev. Disord. 32, 249 (2002). https://doi.org/10.1023/A:1016374617369
- 9.Moore, M., Calvert, S.: J. Autism Dev. Disord. 30, 359 (2000). https://doi.org/10.1023/A:1005535602064
- 10.Bian, D., Wade, J.W., Zhang, L., Bekele, E., Swanson, A., Crittendon, J.A., Sarkar, M., Warren, Z., Sarkar, N.: A novel virtual reality driving environment for autism intervention. In: Stephanidis, C., Antona, M. (eds.) UAHCI 2013 Part II. LNCS, vol. 8010, pp. 474–483. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39191-0_52CrossRefGoogle Scholar
- 14.Caruana, N., et al.: Joint attention difficulties in autistic adults: an interactive eye-tracking study. Autism (2017). https://doi.org/10.1177/1362361316676204
- 18.Zheng, Z., Nie, G., Swanson, A., Weitlauf, A., Warren, Z., Sarkar, N.: Longitudinal impact of autonomous robot-mediated joint attention intervention for young children with ASD. In: Agah, A., Cabibihan, J.-J., Howard, A.M., Salichs, M.A., He, H. (eds.) ICSR 2016. LNCS (LNAI), vol. 9979, pp. 581–590. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-47437-3_57CrossRefGoogle Scholar
- 19.Tobii Eyetracking EyeX. https://help.tobii.com/hc/en-us/categories/201185405-EyeX
- 21.Unity. https://unity3d.com/unity
- 22.Tobii Unity SDK. http://developer.tobii.com/tobii-unity-sdk/
- 23.Maya, 3D animation software. https://www.autodesk.com/education/free-software/maya