Abstract
Precise assessment of school readiness is critical because it has practical and theoretical implications for children’s school and life success. However, school readiness assessment mainly relies on teacher reports and a few direct evaluations requiring a trained examiner. Studies indicate that 80% of games and apps target preschool children and education, suggesting that apps are familiar and fun for this age group. Previous reviews have focused on these apps’ training capability but not on their assessment of school readiness. This Scoping review examines 31 studies published from 2011-2019. The Evidence Centred Design (ECD) framework was used to evaluate game-based assessment (GBA) suitability to assess school readiness domains. Results show that it is possible to assess school readiness using GBA. Most studies assessed cognitive domains in school settings and adopted an external assessment of the tasks. However, most studies only evaluated one competency, and few intervention strategies targeted the enhancement of school readiness. Besides, few studies followed the ECD framework strictly. Implications include expanding the assessment to other school readiness domains with a real-time inbuilt assessment that conforms to the ECD framework. GBA provides a new approach to assess school readiness outside or inside the school settings in this online era.
Article PDF
Avoid common mistakes on your manuscript.
References
Agudo, J. E., Rico, M., & Sanchez, H. (2016). Design and Assessment of Adaptive Hypermedia Games for English Acquisition in Preschool. Journal of Universal Computer Science, 22(2), 161–179.
Almond, R. G., Mislevy, R. J., Steinberg, L. S., Yan, D., & Williamson, D. M. (2015). Bayesian networks in educational assessment. Springer. https://doi.org/10.1007/978-1-4939-2125-6
Alonso-Fernández, C., Calvo-Morata, A., Freire, M., Martínez-Ortiz, I., & Fernández-Manjón, B. (2019). Applications of data science to game learning analytics data: A systematic literature review. Computers & Education, 141, 103612–103612. https://doi.org/10.1016/j.compedu.2019.103612
American Psychological Association. (2013). Cautionary Statement for Forensic Use of DSM-5. Diagnostic and Statistical Manual of Mental Disorders (5th ed.). American Psychiatric Publishing. https://doi.org/10.1176/appi.books.9780890425596.744053
Aragon-Mendizabal, E., Aguilar-Villagran, M., Navarro-Guzman, J. I., & Howell, R. (2017). Improving number sense in kindergarten children with low achievement in mathematics. Anales De Psicologia, 33(2), 311–318. https://doi.org/10.6018/analesps.33.2.239391
Arieli-Attali, M., Ward, S., Thomas, J., Deonovic, B., & Davier, A. A. (2019). The Expanded Evidence-Centered Design (e-ECD) for Learning and Assessment Systems: A Framework for Incorporating Learning Goals and Processes Within Assessment Design. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.00853
Arksey, H., & Malley, L. (2005). Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology, 8(1), 19–32. https://doi.org/10.1080/1364557032000119616
Axelsson, A., Andersson, R., & Gulz, A. (2016). Scaffolding Executive Function Capabilities via Play-&-Learn Software for Preschoolers. Journal of Educational Psychology, 108(7), 969–981. https://doi.org/10.1037/edu0000099
Barab, S. A., Gresalfi, M., & Ingram-Goble, A. (2010). Transformational play: Using games to position person, content, and context. Educational Researcher, 39(7), 525–536. https://doi.org/10.3102/0013189X10386593
Barrett, K. C., Józsa, K., & Morgan, G. A. (2017). New computer-based mastery motivation and executive function tasks for school readiness and school success in 3 to 8-year-old children. Hungarian Educational Research Journal, 7(2), 86–105. https://doi.org/10.14413/HERJ/7/2/6
Behnamnia, N., Kamsin, A., Ismail, M. A. B., & Hayati, A. (2018). Game-based social skills apps enhance collaboration among young children: A case study. International Conference for Emerging Technologies in Computing iCETiC 2018: Emerging Technologies in Computing (pp. 285–291). https://doi.org/10.1007/978-3-319-95450-9_24
Bento, G., & Dias, G. (2017). The importance of outdoor play for young children’s healthy development. Porto Biomedical Journal, 2(5), 157–160. https://doi.org/10.1016/j.pbj.2017.03.003
Bhavnani, S., Mukherjee, D., Dasgupta, J., Verma, D., Parameshwaran, D., Divan, G., … Patel, V. (2019). Development, feasibility and acceptability of a gamified cognitive Developmental assessment on an E-Platform (DEEP) in rural Indian pre-schoolers-A pilot study. Global Health Action, 12(1). https://doi.org/10.1080/16549716.2018.1548005
Bottino, R. M., Ricerche, C. N. D., Ott, M., & Tavella, M. (2014). Serious Gaming at School: Reflections on Students’ Performance, Engagement and Motivation. International Journal of Game-Based Learning, 4(1), 21–36.
Burchinal, M., Magnuson, K., Powell, D., & Hong, S. S. (2015). Early Childcare and Education. In R. M. Lerner (Ed.), Handbook of Child Psychology and Developmental Science (pp. 1–45). John Wiley & Sons, Inc. https://doi.org/10.1002/9781118963418.childpsy406
Caballero-Hernández, J. A., Palomo-Duarte, M., & Dodero, J. M. (2017). Skill assessment in learning experiences based on serious games: A Systematic Mapping Study. Computers & Education, 113, 42–60. https://doi.org/10.1016/j.compedu.2017.05.008
Carson, K. L. (2017). Reliability and Predictive Validity of Preschool Web-Based Phonological Awareness Assessment for Identifying School-Aged Reading Difficulty. Communication Disorders Quarterly, 39(1), 259–269. https://doi.org/10.1177/1525740116686166
Carvalho, M. B., Bellotti, F., Berta, R., Gloria, A. D., Sedano, C. I., Hauge, J. B., … Rauterberg, M. (2015). An activity theory-based model for serious games analysis and conceptual design. Computers & Education, 87, 166–181. https://doi.org/10.1016/j.compedu.2015.03.023
Chan, K. Y. G., Tan, S. L., Hew, K. F. T., Koh, B. G., Lim, L. S., & Yong, J. C. (2017). Knowledge for games, games for knowledge: Designing a digital roll-and-move board game for a law of torts class. Research and Practice in Technology Enhanced Learning, 12(1), 1–20. https://doi.org/10.1186/s41039-016-0045-1
Chaudron, S., Beutel, M., Navarrete, V. D., Dreier, M., Fletcher-Watson, B., Heikkilä, A., … Marsh, J. (2015). Young Children (0-8) and digital technology: A qualitative exploratory study across seven countries. JCR/ISPRA.
Chaudy, Y., Connolly, T., & Hainey, T. (2013). Specification and design of a generalised assessment engine for GBL applications. 7th European Conference on Games-Based Learning, Portugal.
Chiu, F. Y., & Hsieh, M. L. (2017). Role-Playing Game-Based Assessment to Fractional Concept in Second Grade Mathematics. EURASIA Journal of Mathematics, 13(4), 1075–1083. https://doi.org/10.12973/eurasia.2017.00659a
Cohrssen, C., & Niklas, F. (2019). Using mathematics games in preschool settings to support the development of children’s numeracy skills. International Journal of Early Years Education, 27(3). https://doi.org/10.1080/09669760.2019.1629882
Craig, A. B., Derosier, M. E., & Watanabe, Y. (2015). Differences Between Japanese and US Children’s Performance on “Zoo U”: A Game-Based Social Skills Assessment. Games for Health Journal, 4(4), 285–294. https://doi.org/10.1089/g4h.2014.0075
Csapó, B., Molnár, G., & Nagy, J. (2014). Computer-based assessment of school readiness and early reasoning. Journal of Educational Psychology, 106(3), 639–650. https://doi.org/10.1037/a0035756
Daudt, H. M., Van Mossel, C., & Scott, S. J. (2013). Enhancing the scoping study methodology: A large, inter-professional team’s experience with Arksey and O’Malley’s framework. BMC Medical Research Methodology, 13(1), 48. https://doi.org/10.1186/1471-2288-13-48
DeRosier, M. E., & Thomas, J. M. (2018). Establishing the criterion validity of Zoo U’s game-based social emotional skills assessment for school-based outcomes. Journal of Applied Developmental Psychology, 55, 52–61. https://doi.org/10.1016/j.appdev.2017.03.001
DiCerbo, K. E. (2017). Building the Evidentiary Argument in Game-Based Assessment. Journal of Applied Testing Technology, 18(S1), 7–18.
Ferrara, S., Lai, E., Reilly, A., & Nichols, P. (2017). Principled Approaches to Assessment Design, Development, and Implementation. In A. A. Rupp & J. Leighton (Eds.), The Handbook of Cognition and Assessment. Wiley. https://doi.org/10.1002/9781118956588.ch3
Ford, C. B., Kim, H. Y., Brown, L., Aber, J. L., & Sheridan, M. A. (2019). A cognitive assessment tool designed for data collection in the field in low- and middle-income countries. Research in Comparative and International Education, 14(1), 141–157. https://doi.org/10.1177/1745499919829217
Geurts, L., Abeele, V. V., Celis, V., Husson, J., Audenaeren, L. V., Den, … Ghesquière, P. (2015). DIESEL-X: A Game-Based Tool for Early Risk Detection of Dyslexia in Preschoolers. In J. Torbeyns, E. Lehtinen, & J. Elen (Eds.), Describing and Studying Domain-Specific Serious Games. Springer. https://doi.org/10.1007/978-3-319-20276-1_7
Godwin, K. E., Lomas, D., Koedinger, K. R., & Fisher, A. V. (2015). Monster Mischief: Designing a video game to assess selective sustained attention. International Journal of Gaming and Computer-Mediated Simulations, 7(4), 18–39. https://doi.org/10.4018/IJGCMS.2015100102
Gresalfi, M. S., Rittle-Johnson, B., Loehr, A. M., Nichols, I. T., & Mccracken, C. (2016). Slicing and Bouncing: Can Implicit Digital Games Support Transfer to Traditional Assessments as Well as Explicit Digital Games. AERA Online Paper Repository.
Grose, M. (2013). The Good and the Bad of Digital Technology for Kids. Retrieved from http://www.lawley.wa.edu.au/upload/pages/parenting-resources-insight/insights_learning_technology.pdf?1445403034
Hsu, C. Y., Tsai, C. C., & Liang, J. C. (2011). Facilitating Preschoolers’ Scientific Knowledge Construction via Computer Games Regarding Light and Shadow: The Effect of the Prediction-Observation-Explanation (POE) Strategy. Journal of Science Education and Technology, 20(5), 482–493. https://doi.org/10.1007/s10956-011-9298-z
Hunter, L. J., Bierman, K. L., & Hall, C. M. (2018). Assessing Non-cognitive Aspects of School Readiness: The Predictive Validity of Brief Teacher Rating Scales of Social-Emotional Competence and Approaches to Learning. Early Education and Development, 29(8), 1081–1094.
Ifenthaler, D., Eseryel, D., & Ge, X. (2012). Assessment for game-based learning. Assessment in game-based learning (pp. 1–8). Springer. https://doi.org/10.1007/978-1-4614-3546-4_1
Jozsa, K., Barrett, K. C., & Morgan, G. A. (2017). Game-like Tablet Assessment of Approaches to Learning: Assessing Mastery Motivation and Executive Functions. Electronic Journal of Research In Educational Psychology, 15(3), 665–695. https://doi.org/10.14204/ejrep.43.17026
Kagan, S. L., Moore, E., & Bredekamp, S. (1995). Reconsidering children’s early development and learning: Toward common views and vocabulary. DIANE Publishing.
Kim, Y. J., Almond, R. G., & Shute, V. J. (2016). Applying Evidence-Centered Design for the Development of Game-Based Assessments in Physics Playground. International Journal of Testing, 16(2), 142–163. https://doi.org/10.1080/15305058.2015.1108322
Klerk, S. D., Veldkamp, B. P., & Eggen, T. J. (2015). Psychometric analysis of the performance data of simulation-based assessment: A systematic review and a Bayesian network example. Computers & Education, 85, 23–34. https://doi.org/10.1016/j.compedu.2014.12.020
Lee, K., Jeong, D., Schindler, R. C., Hlavaty, L. E., Gross, S. I., & Short, E. J. (2018). Interactive Block Games for Assessing Children’s Cognitive Skills: Design and Preliminary Evaluation. Frontiers in Pediatrics, 6. https://doi.org/10.3389/fped.2018.00111
Li, L., Fan, J., & Jin, Z. (2019). Comparing multimethod assessment of approaches to learning among preschool children: Direct measure, teacher report, and parent report. Psychology in the Schools, 56(8), 1271–1286. https://doi.org/10.1002/pits.22274
Loachamín-Valencia, M., Juan, M. C., Méndez-López, M., & Pérez-Hernández, E. (2018). Using a serious game to assess spatial memory in children and adults. LNCS, 10714, 829–829. https://doi.org/10.1007/978-3-319-76270-8_55
Mainieri, B. O., Azevedo, V. L., Braga, P. H. C., & Omar, N. (2018). Development and assessment of an adaptive difficulty arithmetic game-based learning object. Proceedings - 13th Latin American Conference on Learning Technologies, LACLO 2018 (pp. 232–239). https://doi.org/10.1109/LACLO.2018.00051
Merino-Campos, C., & Castillo-Fernández, H. (2016). The Benefits of Active Video Games for Educational and Physical Activity Approaches: A Systematic Review. Journal of New Approaches in Educational Research, 5(2), 115–122. https://doi.org/10.7821/naer.2016.7.164
Miller, T. (2018). Developing numeracy skills using interactive technology in a play-based learning environment. International Journal of Stem Education, 5. https://doi.org/10.1186/s40594-018-0135-2
Mironcika, S., Toussaint, H., Schipper, A. D., Kröse, B., Brons, A., & Schouten, B. (2018). Smart toys design opportunities for measuring children’s fine motor skills development. 2018-January. The Twelfth International Conference (pp. 349–356). Retrieved from https://doi.org/10.1145/3173225.3173256
Mislevy, R. J., Behrens, J. T., Dicerbo, K. E., & Levy, R. (2012). Design and Discovery in Educational Assessment: Evidence-Centered Design, Psychometrics, and Educational Data Mining. Journal of Educational Data Mining, 4(1), 11–48. https://doi.org/10.5281/zenodo.3554641
Mislevy, R. J., Steinberg, L. S., Almond, R. G., & Lukas, J. F. (2006). Concepts, terminology, and basic models of evidence-centred design. In D. M. Williamson, R. J. Mislevy, & I. I. Bejar (Eds.), Automated scoring of complex tasks in computer-based testing (pp. 15–47). Lawrence Erlbaum Associates.
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & Group, P. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med, 6(7).
Moyer-Packenham, P. S., Bullock, E. K., Shumway, J. F., Tucker, S. I., Watts, C. M., Westenskow, A., … Jordan, K. (2016). The role of affordances in children’s learning performance and efficiency when using virtual manipulative mathematics touch-screen apps. Mathematics Education Research Journal, 28(1), 79–105. https://doi.org/10.1007/s13394-015-0161-z
Neumann, M. M., & Neumann, D. L. (2019). Validation of a touch screen tablet assessment of early literacy skills and a comparison with a traditional paper-based assessment. International Journal of Research & Method in Education, 42(4), 385–398. https://doi.org/10.1080/1743727X.2018.1498078
Nichols, P., Kobrin, J. L., Lai, E., & Koepfler, J. (2016). The role of theories of learning and cognition in assessment design and development. In A. A. Rupp & J. P. Leighton (Eds.), The hand-book of cognition and assessment: Frameworks, methodologies, and applications (pp. 15–40). John Wiley & Sons, Inc. https://doi.org/10.1002/9781118956588.ch2
Ninaus, M., Kiili, K., Mcmullen, J., & Moeller, K. (2016). A Game-Based Approach to Examining Students’ Conceptual Knowledge of Fractions. In R. Bottino, J. Jeuring, & R. Veltkamp (Eds.), Games and Learning Alliance. GALA 2016 (Vol. 10056). Springer. https://doi.org/10.1007/978-3-319-50182-6_4
Obradovic, J., Sulik, M. J., Finch, J. E., & Tirado-Strayer, N. (2018). Assessing students’ executive functions in the classroom: Validating a scalable group-based procedure. Journal of Applied Developmental Psychology, 55(SI), 4–13. https://doi.org/10.1016/j.appdev.2017.03.003
Orfanakis, V., & Papadakis, S. (2014). A new programming environment for teaching programming. A first acquaintance with Enchanting. The 2nd international virtual Scientific Conference - Scieconf 2014, EDIS (pp. 268–273). University of Zilina.
Ow, S. H., & Tan, C. M. (2017). Using a computer game to assess the critical thinking skills of preschoolers: A pilot study. IEEE Conference on E-Learning, e-Management and e-Services (IC3e) (pp. 151–156). https://doi.org/10.1109/IC3e.2017.8409254
Papadakis, S., & Kalogiannakis, M. (2017). Mobile educational applications for children: What educators and parents need to know. International Journal of Mobile Learning and Organisation, 11(3), 256–277. https://doi.org/10.1504/IJMLO.2017.085338
Puolakanaho, A., & Latvala, J. M. (2017). Embedding preschool assessment methods into digital learning games to predict early reading skills. Human Technology, 13(2), 216–236. https://doi.org/10.17011/ht/urn.201711104212
Rauschenberger, M., Lins, C., Rousselle, N., Hein, A., & Fudickar, S. (2019). Designing a new puzzle app to target dyslexia screening in pre-readers. ACM International Conference Proceeding Series (pp. 155–159). https://doi.org/10.1145/3342428.3342679
Rupp, A. A., Gushta, M., Mislevy, R. J., & Shaffer, D. W. (2010). Evidence-centered Design of Epistemic Games: Measurement Principles for Complex Learning Environments. The Journal of Technology, Learning and Assessment, 8(4).
Russo, J. M., Williford, A. P., Markowitz, A. J., Vitiello, V. E., & Bassok, D. (2019). Examining the validity of a widely-used school readiness assessment: Implications for teachers and early childhood programs. Early Childhood Research Quarterly, 48, 14–25. https://doi.org/10.1016/j.ecresq.2019.02.003
Sabol, T. J., & Pianta, R. C. (2017). The state of young children in the United States: School readiness. In E. Votruba-Drzal & E. Dearing (Eds.), The Wiley Handbook of Early Childhood Development Programs, Practices, and Policies (pp. 3–17). Wiley. https://doi.org/10.1002/9781118937334.fmatter.
Semmelmann, K., Nordt, M., Sommer, K., Röhnke, R., Mount, L., Prüfer, H., … Weigelt, S. (2016). U Can Touch This: How Tablets Can Be Used to Study Cognitive Development. Frontiers in Psychology, 7. https://doi.org/10.3389/fpsyg.2016.01021
Serrano-Laguna, A., Manero, B., Freire, M., Fernández-Manjón, B., & Serrano-Laguna, A. (2017). A methodology to assess the effectiveness of serious games and infer player learning outcomes. Multimedia Tools and Applications, 77(2), 2849–2871. https://doi.org/10.1007/s11042-017-4467-6
Shih, S. C., Kuo, B. C., & Lee, S. J. (2019). An Online Game-Based Computational Estimation Assessment Combining Cognitive Diagnostic Model and Strategy Analysis. Educational Psychology, 39(10), 1255–1277. https://doi.org/10.1080/01443410.2018.1501468
Stein, K., Veisson, M., Oun, T., & Tammemäe, T. (2019). Estonian preschool teachers’ views on supporting children’s school readiness. Education 3-13, 47(8), 920–932. https://doi.org/10.1080/03004279.2018.1539113
Suleiman, I., Arslan, M., Alhajj, R., & Ridley, M. (2016). The power of online genetic algorithm in stealth assessment for school readiness. Journal of Computers In Education, 3(2), 209–246. https://doi.org/10.1007/s40692-016-0054-5
UNICEF. (2012). School Readiness: A conceptual framework. United Nations Children’s Fund Education Section, Programme Division.
Willoughby, M. T., Piper, B., Oyanga, A., & King, K. (2019). Measuring executive function skills in young children in Kenya: Associations with school readiness. Developmental Science, e12818. https://doi.org/10.1111/desc.12818
Xin, S., Jian, L., & Zhiyu, F. (2018). Using game log-file to predict students’ reasoning ability and mathematical achievement: An application of machine learning. Acta Psychologica Sinica, 50(7), 761–770. https://doi.org/10.3724/SP.J.1041.2018.00761
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Amukune, S., Barrett, K.C. & Józsa, K. Game-Based Assessment of School Readiness Domains of 3-8-year-old-children: A Scoping Review. J. New Approaches Educ. Res. 11, 146–167 (2022). https://doi.org/10.7821/naer.2022.1.741
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.7821/naer.2022.1.741