A framework to design vocabulary-based serious games for children with autism spectrum disorder (ASD)

A Correction to this article was published on 11 November 2019

This article has been updated

Abstract

The use of serious games to help children with autism spectrum disorder (ASD) learn different skills has increased in the recent past. Games, however, have not been exploited to enhance the vocabulary of these children. The serious game design framework (SGDF) and its components provide support throughout the design process, but there are no existing SGDFs that can be used to design serious games for these children to learn vocabulary skills. Therefore, in this research, a SGDF is proposed to overcome the problem of designing serious games for children with ASD. The components of the framework were identified after an extensive review of the literature on ASD and existing SGDFs. The input, process and output model was used as an underlying structure of the framework, and the identified components were logically placed in each phase of the model. The proposed framework was iteratively evaluated through expert reviews with academic experts and researchers working in the area of serious games, as well as game designers. The modified version of the framework was produced based on the comments provided by experts. This modified version was then used in the applicability evaluation of the framework with researchers and game designers. A proposed SGDF was produced based on the comments of experts. The main findings from expert reviews show that the structure, components and details of the proposed framework have been effectively refined. The use of the framework to produce serious game design and the prototype demonstrates its use in real time. The evaluation of the prototype with autistic children shows the improvement in their vocabulary learning before and after using the prototype.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22

Change history

  • 11 November 2019

    In the original article, the acknowledgement section is missing. The funding information is given below:

Notes

  1. 1.

    https://scholar.google.com.

  2. 2.

    https://www.researchgate.net.

  3. 3.

    https://www.google.com.

References

  1. 1.

    Chiang, H.M., Lin, Y.H.: Reading comprehension instruction for students with autism spectrum disorders a review of the literature. Focus Autism Other Dev. Disabil. 22(4), 259–267 (2007)

    Google Scholar 

  2. 2.

    Khowaja, K., Salim, S.S.: A systematic review of strategies and computer-based intervention (CBI) for reading comprehension of children with autism. Res. Autism Spectrum Disord. 7(9), 1111–1121 (2013)

    Google Scholar 

  3. 3.

    Fukkink, R.G., Hulstijn, J., Simis, A.: Does training in second-language word recognition skills affect reading comprehension? An experimental study. Mod. Lang. J. 89(1), 54–75 (2005)

    Google Scholar 

  4. 4.

    Wilkins, D.A.: Linguistics in language teaching: E. Arnold, 1973 (1972)

  5. 5.

    Thornbury, S.: How to Teach Vocabulary. Pearson Education Limited, London (2006)

    Google Scholar 

  6. 6.

    Nation, I.S.P.: Teaching and Learning Vocabulary, 1st edn. Heinle ELT, Boston (1990)

    Google Scholar 

  7. 7.

    Siriwan, M.: English vocabulary learning strategies employed by Rajabhat University students. Unpublished Doctoral Dissertation, Suranaree University of Technology, Thailand (2007)

  8. 8.

    Barbu, E., Martın-Valdivia, M.T., Urena-López, L.A.: Open book: a tool for helping ASD users’ semantic comprehension. In: Paper presented at the Proceedings of the 2th Workshop of Natural Language Processing for Improving Textual Accessibility (NLP4ITA) (2013)

  9. 9.

    Ramdoss, S., Mulloy, A., Lang, R., O’Reilly, M., Sigafoos, J., Lancioni, G., EL Zein, F.: Use of computer-based interventions to improve literacy skills in students with autism spectrum disorders: a systematic review. Res. Autism Spectrum Disord. 5(4), 1306–1318 (2011)

    Google Scholar 

  10. 10.

    Whalon, K.J., Al Otaiba, S., Delano, M.E.: Evidence-based reading instruction for individuals with autism spectrum disorders. Focus Autism Other Dev. Disabl. 24(1), 3–16 (2009). https://doi.org/10.1177/1088357608328515

    Article  Google Scholar 

  11. 11.

    Iuppa, N.V., Borst, T.: Story and Simulations for Serious Games: Tales from the Trenches. Focal Press, Waltham (2006)

    Google Scholar 

  12. 12.

    Zyda, M.: From visual simulation to virtual reality to games. Computer 38(9), 25–32 (2005)

    Google Scholar 

  13. 13.

    Sawyer, B: Ten Myths About Serious Games. Escapist Magazine (2007)

  14. 14.

    Kiili, K.: Digital game-based learning: towards an experiential gaming model. Internet High. Educ. 8(1), 13–24 (2005)

    Google Scholar 

  15. 15.

    Noor, M., Shahbodin, F., Pee, C.: Serious Game for Autism Children: Review of Literature. In: Paper presented at the World Academy of Science, Engineering and Technology (2012)

  16. 16.

    Zakari, H.M., Ma, M., Simmons, D.: A Review of Serious Games for Children with Autism Spectrum Disorders (ASD) Serious Games Development and Applications, pp. 93–106. Springer, Berlin (2014)

  17. 17.

    Khowaja, K., Salim, S.S.: Design components for serious games of children with autism spectrum disorder (ASD). In: Paper presented at the Serious Games Conference 2014 Kintex Convention Centre, South Korea (2014)

  18. 18.

    Khowaja, K., Al-Thani, D., Salim, S.S.: Vocabulary learning of children with autism spectrum disorder (ASD): from the development to an evaluation of serious game prototype. In: Paper Presented at the 12th European Conference on Games Based Learning, Sophia Antipolis, France (2018)

  19. 19.

    Khowaja, K., Salim, S.S., Al-Thani, D.: Components to design serious games for children with autism spectrum disorder (ASD) to learn vocabulary. In: Paper Presented at the 2018 IEEE 5th International Conference on Engineering Technologies and Applied Sciences (ICETAS) (2018)

  20. 20.

    E-Games: Game Development Process (n.d.). Retrieved from http://www.e-games.tech.purdue.edu/GameDevProcess.asp

  21. 21.

    Hayes, G.R., Hirano, S., Marcu, G., Monibi, M., Nguyen, D.H., Yeganyan, M.: Interactive visual supports for children with autism. Pers. Ubiquitous Comput. 14(7), 663–680 (2010)

    Google Scholar 

  22. 22.

    Garris, R., Ahlers, R., Driskell, J.E.: Games, motivation, and learning: a research and practice model. Simul. Gaming 33(4), 441–467 (2002)

    Google Scholar 

  23. 23.

    Winn, B.: The design, play, and experience framework. Handb. Res. Eff. Electron. Gaming Educ. 3, 1010–1024 (2008)

    Google Scholar 

  24. 24.

    Yusoff, A.: A conceptual framework for serious games and its validation. University of Southampton (2010)

  25. 25.

    Arachchilage, N.A.G., Love, S.: A game design framework for avoiding phishing attacks. Comput. Hum. Behav. 29(3), 706–714 (2013)

    Google Scholar 

  26. 26.

    Denis, G., Jouvelot, P.: Motivation-driven educational game design: applying best practices to music education. In: Paper Presented at the Proceedings of the 2005 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (2005)

  27. 27.

    Järvinen, A.: Game design for social networks: interaction design for playful dispositions. In: Paper Presented at the Proceedings of the 2009 ACM SIGGRAPH Symposium on Video Games (2009)

  28. 28.

    Ijsselsteijn, W., Nap, H.H., de Kort, Y., Poels, K.: Digital game design for elderly users. In: Paper Presented at the Proceedings of the 2007 conference on Future Play (2007)

  29. 29.

    Moreno-Ger, P., Burgos, D., Martínez-Ortiz, I., Sierra, J.L., Fernández-Manjón, B.: Educational game design for online education. Comput. Hum. Behav. 24(6), 2530–2540 (2008)

    Google Scholar 

  30. 30.

    Park, J.H., Abirached, B., Zhang, Y.: A framework for designing assistive technologies for teaching children with ASDs emotions. In: Paper Presented at the CHI’12 Extended Abstracts on Human Factors in Computing Systems (2012)

  31. 31.

    Whyte, E.M., Smyth, J.M., Scherf, K.S.: Designing serious game interventions for individuals with autism. J. Autism Dev. Disord. 45(12), 3820–3831 (2015). https://doi.org/10.1007/s10803-014-2333-1

    Article  Google Scholar 

  32. 32.

    Baranowski, T., Buday, R., Thompson, D.I., Baranowski, J.: Playing for real: video games and stories for health-related behavior change. Am. J. Prev. Med. 34(1), 74–82 (2008). https://doi.org/10.1016/j.amepre.2007.09.027

    Article  Google Scholar 

  33. 33.

    Kapp, K.M.: The Gamification of Learning and Instruction: Game-Based Methods and Strategies for Training and Education. Wiley, New York (2012)

    Google Scholar 

  34. 34.

    Bono, V., Narzisi, A., Jouen, A.L., Tilmont, E., Hommel, S., Jamal, W., Group, M.S.: GOLIAH: a gaming platform for home-based intervention in autism–principles and design. Front Psychiatry 7(70), 70 (2016). https://doi.org/10.3389/fpsyt.2016.00070

    Article  Google Scholar 

  35. 35.

    Jouen, A.-L., Narzisi, A., Xavier, J., Tilmont, E., Bodeau, N., Bono, V., Group, M.S.: GOLIAH (Gaming Open Library for Intervention in Autism at Home): a 6-month single blind matched controlled exploratory study. Child Adolesc. Psychiatry Ment. Health 11, 17 (2017). https://doi.org/10.1186/s13034-017-0154-7-&gt

    Article  Google Scholar 

  36. 36.

    Malinverni, L., Mora-Guiard, J., Padillo, V., Valero, L., Hervás, A., Pares, N.: An inclusive design approach for developing video games for children with autism spectrum disorder. Comput. Hum. Behav. 71, 535–549 (2016)

    Google Scholar 

  37. 37.

    Miles, M.B., Huberman, A.M.: Qualitative Data Analysis: An Expanded Sourcebook. Sage Publications, Thousand Oaks (1994)

    Google Scholar 

  38. 38.

    Maxwell, J.A.: Qualitative Research Design: An Interactive Approach. Sage Publications, Thousand Oaks (2012)

    Google Scholar 

  39. 39.

    Kitchenham, B.: Procedures for performing systematic reviews. Keele University Technical Report TR/SE-0401 and NICTA Technical Report 0400011T.1. http://www.it.hiof.no/~haraldh/misc/2016-08-22-smat/Kitchenham-Systematic-Review-2004.pdf (2004)

  40. 40.

    Case-Smith, J., Weaver, L.L., Fristad, M.A.: A systematic review of sensory processing interventions for children with autism spectrum disorders. Autism 19(2), 133–148 (2015). https://doi.org/10.1177/1362361313517762

    Article  Google Scholar 

  41. 41.

    Dawson, G., Watling, R.: Interventions to facilitate auditory, visual, and motor integration in autism: a review of the evidence. J. Autism Dev. Disord. 30(5), 415–421 (2000)

    Google Scholar 

  42. 42.

    Rocky Point Academy: Characteristics of autism (1997). Retrieved from http://www.calgaryautism.com/characteristics.htm

  43. 43.

    American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders: DSM-5, 5th edn. American Psychiatric Association, Washington, D.C (2013)

    Google Scholar 

  44. 44.

    Bosseler, A., Massaro, D.W.: Development and evaluation of a computer-animated tutor for vocabulary and language learning in children with autism. J. Autism Dev. Disord. 33(6), 653–672 (2003)

    Google Scholar 

  45. 45.

    Johnson, C.P.: Early Clinical Characteristics of Children with Autism Autistic Spectrum Disorders in Children, pp. 83–121. CRC Press, Boca Raton (2004)

    Google Scholar 

  46. 46.

    Centers for Disease Control and Prevention [CDC], Signs and symptoms of ASD. (n.d.). Retrieved from http://www.cdc.gov/ncbddd/autism/signs.html

  47. 47.

    Bloom, B.S.: Taxonomy of Educational Objectives Book 1: Cognitive Domain, 2nd edn. Longman, London (1971)

    Google Scholar 

  48. 48.

    Simpson, E.: Educational Objectives in the Psychomotor Domain: The Psychomotor Domain, vol. 3. Gryphon House, Washington, DC (1971)

    Google Scholar 

  49. 49.

    Harrow, A.J.: A Taxonomy of the Psychomotor Domain. A Guide for Developing Behavioral Objectives. David McKay, New York (1972)

    Google Scholar 

  50. 50.

    Dave, R.H.: Psychomotor levels. In: Armstrong, R.J. (ed.) Developing and Writing Educational Objective, pp. 33–34. Educational Innovators Press, Tucson (1970)

    Google Scholar 

  51. 51.

    Krathwohl, D.R., Bloom, B.S., Masia, B.B.: Taxonomy of Educational Objectives, the Classification of Educational Goals: Handbook II: Affective Domain, vol. 2. David McKay Company, Philadelphia (1967)

    Google Scholar 

  52. 52.

    Garris, R., Ahlers, R.: A game-based training model development, application, and evaluation. In: Paper Presented at the The Interservice/Industry Training, Simulation & Education Conference (I/ITSEC) (2001)

  53. 53.

    Kennedy, D., Hyland, Á., Ryan, N.: Writing and Using Learning Outcomes: A Practical Guide. University College Cork, Cork (2006)

    Google Scholar 

  54. 54.

    Gagne, R.M.: The conditions of learning, 4th edn. Holt, Rinehart & Winston, New York (1985)

    Google Scholar 

  55. 55.

    Gilbert, L., Gale, V.: Front-end Analysis Principle of E-Learning Systems Engineering, pp. 77–101. Chandos Publishing, Oxford (2008)

    Google Scholar 

  56. 56.

    Simon, H.A.: Learning and problem solving. In: Kolb, D.A., Rubin, I.M., McIntyre, J.M. (eds.) Organizational Psychology: A Book of Readings, pp. 36–58. Prentice-Hall, Englewood Cliffs (1979)

    Google Scholar 

  57. 57.

    National Autism Center [NAC]: National Standards Report: the national standards project-addressing the need for evidence based practice guidelines for Autism spectrum disorders (2009). Retrieved from http://www.nationalautismcenter.org/pdf/NAC%20Standards%20Report.pdf

  58. 58.

    Gee, J.P.: What Video Games Have to Teach Us about Learning and Literacy. Palgrave Macmillan, Basingstoke (2007)

    Google Scholar 

  59. 59.

    Hunicke, R., LeBlanc, M., Zubek, R.: MDA: a formal approach to game design and game research. In: Paper Presented at the Proceedings of the AAAI Workshop on Challenges in Game AI, San Jose, California, United States of America (2004)

  60. 60.

    Schreiber, I.: Level 5: Mechanics and Dynamics (2009). Retrieved from https://gamedesignconcepts.wordpress.com/2009/07/13/level-5-mechanics-and-dynamics/

  61. 61.

    Sinclair, K.: The art of storytelling in gaming (2014). Retrieved from http://www.sundance.org/blogs/program-spotlight/the-art-of-storytelling-in-gaming

  62. 62.

    Rouse III, R.: Game design: Theory and practice. Jones & Bartlett Learning, Burlington (2010)

    Google Scholar 

  63. 63.

    Adams, E.: Fundamentals of game design, 2nd edn. Pearson Education, London (2010)

    Google Scholar 

  64. 64.

    Aarseth, E.: A narrative theory of games. In: Paper presented at the Proceedings of the International Conference on the Foundations of Digital Games (2012)

  65. 65.

    Techopedia: Bot (2016). Retrieved from https://www.techopedia.com/definition/10459/bot-gaming

  66. 66.

    Kienzle, J., Denault, A., Vangheluwe, H.: Model-based design of computer-controlled game character behavior. In: Paper Presented at the International Conference on Model Driven Engineering Languages and Systems (2007)

  67. 67.

    Bedwell, W.L., Pavlas, D., Heyne, K., Lazzara, E.H., Salas, E.: Toward a taxonomy linking game attributes to learning an empirical study. Simul. Gaming 43(6), 729–760 (2012)

    Google Scholar 

  68. 68.

    Murphy, C.: Why games work and the science of learning. Paper presented at the Interservice, Interagency Training, Simulations, and Education Conference (2011)

  69. 69.

    Wilson, K.A., Bedwell, W.L., Lazzara, E.H., Salas, E., Burke, C.S., Estock, J.L., Conkey, C.: Relationships between game attributes and learning outcomes review and research proposals. Simul. Gaming 40(2), 217–266 (2009)

    Google Scholar 

  70. 70.

    Nigay, L., Coutaz, J.: A design space for multimodal systems: concurrent processing and data fusion. In: Paper Presented at the Proceedings of the INTERACT’93 and CHI’93 conference on Human factors in computing systems (1993)

  71. 71.

    Oviatt, S.: Multimodal interfaces. In: Jacko, J.A. (ed.) Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications, pp. 286–304. Lawrence Erlbaum, New Jersey (2012)

    Google Scholar 

  72. 72.

    Khowaja, K., Salim, S.S., Asemi, A., Ghulamani, S., Shah, A.: A systematic review of modalities in computer-based interventions (CBIs) for language comprehension and decoding skills of children with autism spectrum disorder (ASD). Universal Access in the Information Society. (2019). https://doi.org/10.1007/s10209-019-00646-1

  73. 73.

    Lederman, L.C.: Debriefing: a critical reexamination of the postexperience analytic process with implications for its effective use. Simul. Games 15(4), 415–431 (1984)

    Google Scholar 

  74. 74.

    Seaman, C.B.: Qualitative methods in empirical studies of software engineering. IEEE Trans. Softw. Eng. 25(4), 557–572 (1999)

    Google Scholar 

  75. 75.

    de Freitas, S., Jarvis, S.: A framework for developing serious games to meet learner needs. In: Paper Presented at the The Interservice/Industry Training, Simulation & Education Conference (I/ITSEC) (2006)

  76. 76.

    ISO/IEC 25010—Systems and software engineering—systems and software Quality Requirements and Evaluation (SQuaRE)—system and software quality models ISO/IEC (2010). Retrieved from https://www.iso.org/obp/ui/#iso:std:iso-iec:25010:ed-1:v1:en

  77. 77.

    Lin, H.X., Choong, Y.-Y., Salvendy, G.: A proposed index of usability: a method for comparing the relative usability of different software systems. Behav. Inf. Technol. 16(4–5), 267–277 (1997)

    Google Scholar 

  78. 78.

    Khowaja, K., Salim, S.S.: Serious game for children with autism to learn vocabulary: an experimental evaluation. Int. J. Hum.-Comput. Interact. 35(1), 1–26 (2018). https://doi.org/10.1080/10447318.2017.1420006

    Article  Google Scholar 

  79. 79.

    Basil, C., Reyes, S.: Acquisition of literacy skills by children with severe disability. Child Lang. Teach. Ther. 19(1), 27–48 (2003)

    Google Scholar 

  80. 80.

    Hetzroni, O.E., Shalem, U.: From logos to orthographic symbols: a multilevel fading computer program for teaching nonverbal children with autism. Focus Autism Other Dev. Disabil. 20(4), 201–212 (2005)

    Google Scholar 

  81. 81.

    Hetzroni, O.E., Tannous, J.: Effects of a computer-based intervention program on the communicative functions of children with autism. J. Autism Dev. Disord. 34(2), 95–113 (2004)

    Google Scholar 

  82. 82.

    Massaro, D.W., Bosseler, A.: Read my lips: the importance of the face in a computer-animated tutor for vocabulary learning by children with autism. Autism 10(5), 495–510 (2006). https://doi.org/10.1177/1362361306066599

    Article  Google Scholar 

  83. 83.

    Moore, M., Calvert, S.: Brief report: vocabulary acquisition for children with autism: teacher or computer instruction. J Autism Dev Disord 30(4), 359–362 (2000).

    Google Scholar 

  84. 84.

    Whalen, C., Moss, D., Ilan, A.B., Vaupel, M., Fielding, P., Macdonald, K., Cernich, S., Symon, J.: Efficacy of TeachTown: basics computer-assisted intervention for the intensive comprehensive autism program in Los Angeles Unified School District. Autism 14(3), 179–197 (2010). https://doi.org/10.1177/1362361310363282

    Article  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Kamran Khowaja.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

figurea
figureb
figurec
figured
figuree
figuref
figureg
figureh
figurei

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Khowaja, K., Salim, S.S. A framework to design vocabulary-based serious games for children with autism spectrum disorder (ASD). Univ Access Inf Soc 19, 739–781 (2020). https://doi.org/10.1007/s10209-019-00689-4

Download citation

Keywords

  • Autism spectrum disorder (ASD)
  • Language comprehension skills
  • Vocabulary
  • Computer-based intervention (CBI)
  • Serious game design
  • Prototype development
  • Virtual reality
  • Augmented reality