A framework to design vocabulary-based serious games for children with autism spectrum disorder (ASD)

  • Kamran KhowajaEmail author
  • Siti Salwah Salim
Long Paper


The use of serious games to help children with autism spectrum disorder (ASD) learn different skills has increased in the recent past. Games, however, have not been exploited to enhance the vocabulary of these children. The serious game design framework (SGDF) and its components provide support throughout the design process, but there are no existing SGDFs that can be used to design serious games for these children to learn vocabulary skills. Therefore, in this research, a SGDF is proposed to overcome the problem of designing serious games for children with ASD. The components of the framework were identified after an extensive review of the literature on ASD and existing SGDFs. The input, process and output model was used as an underlying structure of the framework, and the identified components were logically placed in each phase of the model. The proposed framework was iteratively evaluated through expert reviews with academic experts and researchers working in the area of serious games, as well as game designers. The modified version of the framework was produced based on the comments provided by experts. This modified version was then used in the applicability evaluation of the framework with researchers and game designers. A proposed SGDF was produced based on the comments of experts. The main findings from expert reviews show that the structure, components and details of the proposed framework have been effectively refined. The use of the framework to produce serious game design and the prototype demonstrates its use in real time. The evaluation of the prototype with autistic children shows the improvement in their vocabulary learning before and after using the prototype.


Autism spectrum disorder (ASD) Language comprehension skills Vocabulary Computer-based intervention (CBI) Serious game design Prototype development Virtual reality Augmented reality 



  1. 1.
    Chiang, H.M., Lin, Y.H.: Reading comprehension instruction for students with autism spectrum disorders a review of the literature. Focus Autism Other Dev. Disabil. 22(4), 259–267 (2007)Google Scholar
  2. 2.
    Khowaja, K., Salim, S.S.: A systematic review of strategies and computer-based intervention (CBI) for reading comprehension of children with autism. Res. Autism Spectrum Disord. 7(9), 1111–1121 (2013)Google Scholar
  3. 3.
    Fukkink, R.G., Hulstijn, J., Simis, A.: Does training in second-language word recognition skills affect reading comprehension? An experimental study. Mod. Lang. J. 89(1), 54–75 (2005)Google Scholar
  4. 4.
    Wilkins, D.A.: Linguistics in language teaching: E. Arnold, 1973 (1972)Google Scholar
  5. 5.
    Thornbury, S.: How to Teach Vocabulary. Pearson Education Limited, London (2006)Google Scholar
  6. 6.
    Nation, I.S.P.: Teaching and Learning Vocabulary, 1st edn. Heinle ELT, Boston (1990)Google Scholar
  7. 7.
    Siriwan, M.: English vocabulary learning strategies employed by Rajabhat University students. Unpublished Doctoral Dissertation, Suranaree University of Technology, Thailand (2007)Google Scholar
  8. 8.
    Barbu, E., Martın-Valdivia, M.T., Urena-López, L.A.: Open book: a tool for helping ASD users’ semantic comprehension. In: Paper presented at the Proceedings of the 2th Workshop of Natural Language Processing for Improving Textual Accessibility (NLP4ITA) (2013)Google Scholar
  9. 9.
    Ramdoss, S., Mulloy, A., Lang, R., O’Reilly, M., Sigafoos, J., Lancioni, G., EL Zein, F.: Use of computer-based interventions to improve literacy skills in students with autism spectrum disorders: a systematic review. Res. Autism Spectrum Disord. 5(4), 1306–1318 (2011)Google Scholar
  10. 10.
    Whalon, K.J., Al Otaiba, S., Delano, M.E.: Evidence-based reading instruction for individuals with autism spectrum disorders. Focus Autism Other Dev. Disabl. 24(1), 3–16 (2009). CrossRefGoogle Scholar
  11. 11.
    Iuppa, N.V., Borst, T.: Story and Simulations for Serious Games: Tales from the Trenches. Focal Press, Waltham (2006)Google Scholar
  12. 12.
    Zyda, M.: From visual simulation to virtual reality to games. Computer 38(9), 25–32 (2005)Google Scholar
  13. 13.
    Sawyer, B: Ten Myths About Serious Games. Escapist Magazine (2007)Google Scholar
  14. 14.
    Kiili, K.: Digital game-based learning: towards an experiential gaming model. Internet High. Educ. 8(1), 13–24 (2005)Google Scholar
  15. 15.
    Noor, M., Shahbodin, F., Pee, C.: Serious Game for Autism Children: Review of Literature. In: Paper presented at the World Academy of Science, Engineering and Technology (2012)Google Scholar
  16. 16.
    Zakari, H.M., Ma, M., Simmons, D.: A Review of Serious Games for Children with Autism Spectrum Disorders (ASD) Serious Games Development and Applications, pp. 93–106. Springer, Berlin (2014)Google Scholar
  17. 17.
    Khowaja, K., Salim, S.S.: Design components for serious games of children with autism spectrum disorder (ASD). In: Paper presented at the Serious Games Conference 2014 Kintex Convention Centre, South Korea (2014)Google Scholar
  18. 18.
    Khowaja, K., Al-Thani, D., Salim, S.S.: Vocabulary learning of children with autism spectrum disorder (ASD): from the development to an evaluation of serious game prototype. In: Paper Presented at the 12th European Conference on Games Based Learning, Sophia Antipolis, France (2018)Google Scholar
  19. 19.
    Khowaja, K., Salim, S.S., Al-Thani, D.: Components to design serious games for children with autism spectrum disorder (ASD) to learn vocabulary. In: Paper Presented at the 2018 IEEE 5th International Conference on Engineering Technologies and Applied Sciences (ICETAS) (2018)Google Scholar
  20. 20.
    E-Games: Game Development Process (n.d.). Retrieved from
  21. 21.
    Hayes, G.R., Hirano, S., Marcu, G., Monibi, M., Nguyen, D.H., Yeganyan, M.: Interactive visual supports for children with autism. Pers. Ubiquitous Comput. 14(7), 663–680 (2010)Google Scholar
  22. 22.
    Garris, R., Ahlers, R., Driskell, J.E.: Games, motivation, and learning: a research and practice model. Simul. Gaming 33(4), 441–467 (2002)Google Scholar
  23. 23.
    Winn, B.: The design, play, and experience framework. Handb. Res. Eff. Electron. Gaming Educ. 3, 1010–1024 (2008)Google Scholar
  24. 24.
    Yusoff, A.: A conceptual framework for serious games and its validation. University of Southampton (2010)Google Scholar
  25. 25.
    Arachchilage, N.A.G., Love, S.: A game design framework for avoiding phishing attacks. Comput. Hum. Behav. 29(3), 706–714 (2013)Google Scholar
  26. 26.
    Denis, G., Jouvelot, P.: Motivation-driven educational game design: applying best practices to music education. In: Paper Presented at the Proceedings of the 2005 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (2005)Google Scholar
  27. 27.
    Järvinen, A.: Game design for social networks: interaction design for playful dispositions. In: Paper Presented at the Proceedings of the 2009 ACM SIGGRAPH Symposium on Video Games (2009)Google Scholar
  28. 28.
    Ijsselsteijn, W., Nap, H.H., de Kort, Y., Poels, K.: Digital game design for elderly users. In: Paper Presented at the Proceedings of the 2007 conference on Future Play (2007)Google Scholar
  29. 29.
    Moreno-Ger, P., Burgos, D., Martínez-Ortiz, I., Sierra, J.L., Fernández-Manjón, B.: Educational game design for online education. Comput. Hum. Behav. 24(6), 2530–2540 (2008)Google Scholar
  30. 30.
    Park, J.H., Abirached, B., Zhang, Y.: A framework for designing assistive technologies for teaching children with ASDs emotions. In: Paper Presented at the CHI’12 Extended Abstracts on Human Factors in Computing Systems (2012)Google Scholar
  31. 31.
    Whyte, E.M., Smyth, J.M., Scherf, K.S.: Designing serious game interventions for individuals with autism. J. Autism Dev. Disord. 45(12), 3820–3831 (2015). CrossRefGoogle Scholar
  32. 32.
    Baranowski, T., Buday, R., Thompson, D.I., Baranowski, J.: Playing for real: video games and stories for health-related behavior change. Am. J. Prev. Med. 34(1), 74–82 (2008). CrossRefGoogle Scholar
  33. 33.
    Kapp, K.M.: The Gamification of Learning and Instruction: Game-Based Methods and Strategies for Training and Education. Wiley, New York (2012)Google Scholar
  34. 34.
    Bono, V., Narzisi, A., Jouen, A.L., Tilmont, E., Hommel, S., Jamal, W., Group, M.S.: GOLIAH: a gaming platform for home-based intervention in autism–principles and design. Front Psychiatry 7(70), 70 (2016). CrossRefGoogle Scholar
  35. 35.
    Jouen, A.-L., Narzisi, A., Xavier, J., Tilmont, E., Bodeau, N., Bono, V., Group, M.S.: GOLIAH (Gaming Open Library for Intervention in Autism at Home): a 6-month single blind matched controlled exploratory study. Child Adolesc. Psychiatry Ment. Health 11, 17 (2017). CrossRefGoogle Scholar
  36. 36.
    Malinverni, L., Mora-Guiard, J., Padillo, V., Valero, L., Hervás, A., Pares, N.: An inclusive design approach for developing video games for children with autism spectrum disorder. Comput. Hum. Behav. 71, 535–549 (2016)Google Scholar
  37. 37.
    Miles, M.B., Huberman, A.M.: Qualitative Data Analysis: An Expanded Sourcebook. Sage Publications, Thousand Oaks (1994)Google Scholar
  38. 38.
    Maxwell, J.A.: Qualitative Research Design: An Interactive Approach. Sage Publications, Thousand Oaks (2012)Google Scholar
  39. 39.
    Kitchenham, B.: Procedures for performing systematic reviews. Keele University Technical Report TR/SE-0401 and NICTA Technical Report 0400011T.1. (2004)
  40. 40.
    Case-Smith, J., Weaver, L.L., Fristad, M.A.: A systematic review of sensory processing interventions for children with autism spectrum disorders. Autism 19(2), 133–148 (2015). CrossRefGoogle Scholar
  41. 41.
    Dawson, G., Watling, R.: Interventions to facilitate auditory, visual, and motor integration in autism: a review of the evidence. J. Autism Dev. Disord. 30(5), 415–421 (2000)Google Scholar
  42. 42.
    Rocky Point Academy: Characteristics of autism (1997). Retrieved from
  43. 43.
    American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders: DSM-5, 5th edn. American Psychiatric Association, Washington, D.C (2013)Google Scholar
  44. 44.
    Bosseler, A., Massaro, D.W.: Development and evaluation of a computer-animated tutor for vocabulary and language learning in children with autism. J. Autism Dev. Disord. 33(6), 653–672 (2003)Google Scholar
  45. 45.
    Johnson, C.P.: Early Clinical Characteristics of Children with Autism Autistic Spectrum Disorders in Children, pp. 83–121. CRC Press, Boca Raton (2004)Google Scholar
  46. 46.
    Centers for Disease Control and Prevention [CDC], Signs and symptoms of ASD. (n.d.). Retrieved from
  47. 47.
    Bloom, B.S.: Taxonomy of Educational Objectives Book 1: Cognitive Domain, 2nd edn. Longman, London (1971)Google Scholar
  48. 48.
    Simpson, E.: Educational Objectives in the Psychomotor Domain: The Psychomotor Domain, vol. 3. Gryphon House, Washington, DC (1971)Google Scholar
  49. 49.
    Harrow, A.J.: A Taxonomy of the Psychomotor Domain. A Guide for Developing Behavioral Objectives. David McKay, New York (1972)Google Scholar
  50. 50.
    Dave, R.H.: Psychomotor levels. In: Armstrong, R.J. (ed.) Developing and Writing Educational Objective, pp. 33–34. Educational Innovators Press, Tucson (1970)Google Scholar
  51. 51.
    Krathwohl, D.R., Bloom, B.S., Masia, B.B.: Taxonomy of Educational Objectives, the Classification of Educational Goals: Handbook II: Affective Domain, vol. 2. David McKay Company, Philadelphia (1967)Google Scholar
  52. 52.
    Garris, R., Ahlers, R.: A game-based training model development, application, and evaluation. In: Paper Presented at the The Interservice/Industry Training, Simulation & Education Conference (I/ITSEC) (2001)Google Scholar
  53. 53.
    Kennedy, D., Hyland, Á., Ryan, N.: Writing and Using Learning Outcomes: A Practical Guide. University College Cork, Cork (2006)Google Scholar
  54. 54.
    Gagne, R.M.: The conditions of learning, 4th edn. Holt, Rinehart & Winston, New York (1985)Google Scholar
  55. 55.
    Gilbert, L., Gale, V.: Front-end Analysis Principle of E-Learning Systems Engineering, pp. 77–101. Chandos Publishing, Oxford (2008)Google Scholar
  56. 56.
    Simon, H.A.: Learning and problem solving. In: Kolb, D.A., Rubin, I.M., McIntyre, J.M. (eds.) Organizational Psychology: A Book of Readings, pp. 36–58. Prentice-Hall, Englewood Cliffs (1979)Google Scholar
  57. 57.
    National Autism Center [NAC]: National Standards Report: the national standards project-addressing the need for evidence based practice guidelines for Autism spectrum disorders (2009). Retrieved from
  58. 58.
    Gee, J.P.: What Video Games Have to Teach Us about Learning and Literacy. Palgrave Macmillan, Basingstoke (2007)Google Scholar
  59. 59.
    Hunicke, R., LeBlanc, M., Zubek, R.: MDA: a formal approach to game design and game research. In: Paper Presented at the Proceedings of the AAAI Workshop on Challenges in Game AI, San Jose, California, United States of America (2004)Google Scholar
  60. 60.
    Schreiber, I.: Level 5: Mechanics and Dynamics (2009). Retrieved from
  61. 61.
    Sinclair, K.: The art of storytelling in gaming (2014). Retrieved from
  62. 62.
    Rouse III, R.: Game design: Theory and practice. Jones & Bartlett Learning, Burlington (2010)Google Scholar
  63. 63.
    Adams, E.: Fundamentals of game design, 2nd edn. Pearson Education, London (2010)Google Scholar
  64. 64.
    Aarseth, E.: A narrative theory of games. In: Paper presented at the Proceedings of the International Conference on the Foundations of Digital Games (2012)Google Scholar
  65. 65.
    Techopedia: Bot (2016). Retrieved from
  66. 66.
    Kienzle, J., Denault, A., Vangheluwe, H.: Model-based design of computer-controlled game character behavior. In: Paper Presented at the International Conference on Model Driven Engineering Languages and Systems (2007)Google Scholar
  67. 67.
    Bedwell, W.L., Pavlas, D., Heyne, K., Lazzara, E.H., Salas, E.: Toward a taxonomy linking game attributes to learning an empirical study. Simul. Gaming 43(6), 729–760 (2012)Google Scholar
  68. 68.
    Murphy, C.: Why games work and the science of learning. Paper presented at the Interservice, Interagency Training, Simulations, and Education Conference (2011)Google Scholar
  69. 69.
    Wilson, K.A., Bedwell, W.L., Lazzara, E.H., Salas, E., Burke, C.S., Estock, J.L., Conkey, C.: Relationships between game attributes and learning outcomes review and research proposals. Simul. Gaming 40(2), 217–266 (2009)Google Scholar
  70. 70.
    Nigay, L., Coutaz, J.: A design space for multimodal systems: concurrent processing and data fusion. In: Paper Presented at the Proceedings of the INTERACT’93 and CHI’93 conference on Human factors in computing systems (1993)Google Scholar
  71. 71.
    Oviatt, S.: Multimodal interfaces. In: Jacko, J.A. (ed.) Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications, pp. 286–304. Lawrence Erlbaum, New Jersey (2012)Google Scholar
  72. 72.
    Khowaja, K., Salim, S.S., Asemi, A., Ghulamani, S., Shah, A.: A systematic review of modalities in computer-based interventions (CBIs) for language comprehension and decoding skills of children with autism spectrum disorder (ASD). Universal Access in the Information Society. (2019).
  73. 73.
    Lederman, L.C.: Debriefing: a critical reexamination of the postexperience analytic process with implications for its effective use. Simul. Games 15(4), 415–431 (1984)Google Scholar
  74. 74.
    Seaman, C.B.: Qualitative methods in empirical studies of software engineering. IEEE Trans. Softw. Eng. 25(4), 557–572 (1999)Google Scholar
  75. 75.
    de Freitas, S., Jarvis, S.: A framework for developing serious games to meet learner needs. In: Paper Presented at the The Interservice/Industry Training, Simulation & Education Conference (I/ITSEC) (2006)Google Scholar
  76. 76.
    ISO/IEC 25010—Systems and software engineering—systems and software Quality Requirements and Evaluation (SQuaRE)—system and software quality models ISO/IEC (2010). Retrieved from
  77. 77.
    Lin, H.X., Choong, Y.-Y., Salvendy, G.: A proposed index of usability: a method for comparing the relative usability of different software systems. Behav. Inf. Technol. 16(4–5), 267–277 (1997)Google Scholar
  78. 78.
    Khowaja, K., Salim, S.S.: Serious game for children with autism to learn vocabulary: an experimental evaluation. Int. J. Hum.-Comput. Interact. 35(1), 1–26 (2018). CrossRefGoogle Scholar
  79. 79.
    Basil, C., Reyes, S.: Acquisition of literacy skills by children with severe disability. Child Lang. Teach. Ther. 19(1), 27–48 (2003)Google Scholar
  80. 80.
    Hetzroni, O.E., Shalem, U.: From logos to orthographic symbols: a multilevel fading computer program for teaching nonverbal children with autism. Focus Autism Other Dev. Disabil. 20(4), 201–212 (2005)Google Scholar
  81. 81.
    Hetzroni, O.E., Tannous, J.: Effects of a computer-based intervention program on the communicative functions of children with autism. J. Autism Dev. Disord. 34(2), 95–113 (2004)Google Scholar
  82. 82.
    Massaro, D.W., Bosseler, A.: Read my lips: the importance of the face in a computer-animated tutor for vocabulary learning by children with autism. Autism 10(5), 495–510 (2006). CrossRefGoogle Scholar
  83. 83.
    Moore, M., Calvert, S.: Brief report: vocabulary acquisition for children with autism: teacher or computer instruction. J Autism Dev Disord 30(4), 359–362 (2000).Google Scholar
  84. 84.
    Whalen, C., Moss, D., Ilan, A.B., Vaupel, M., Fielding, P., Macdonald, K., Cernich, S., Symon, J.: Efficacy of TeachTown: basics computer-assisted intervention for the intensive comprehensive autism program in Los Angeles Unified School District. Autism 14(3), 179–197 (2010). CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Isra UniversityHyderabadPakistan
  2. 2.University of MalayaKuala LumpurMalaysia

Personalised recommendations