Abstract
Many professional operations require employees with complex skills. Once these skills have been taught, it is important that the skills are (a) retained, and (b) retrained when the skills start to decay. The ability to determine the precise moment when a skill needs to be retrained will have a positive effect on the productivity of the individual, and therefore also on the cost-effectiveness of scheduled training courses. However, modelling the retention of complex skills remains challenging as it is difficult to gather enough data. In this paper, we present an online adaptive instructional system that serves two purposes: (1) to gather performance data on a complex video game called Space Fortress, so that the skill retention can be modelled, and (2) to apply the newly built model directly to the participants, so that its effectiveness can be analysed. We expect that the lessons learned by building and applying the model in the context of Space Fortress will transfer to complex real-world skills.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Farr, M.J.: The Long-Term Retention of Knowledge and Skills: A Cognitive and Instructional Perspective. Springer, New York (1987). https://doi.org/10.1007/978-1-4612-1062-7
Arthur Jr., W., Bennett Jr., W., Stanush, P.L., McNelly, T.L.: Factors that influence skill decay and retention: a quantitative review and analysis. Hum. Perform. 11(1), 57–101 (1998). https://doi.org/10.1207/s15327043hup1101_3
Arthur Jr., W., Day, E.A.: A look from ‘aFarr’ (1987): the past, present, and future of applied skill decay research. In: Individual and Team Skill Decay: The Science and Implications for Practice, pp. 405–427. Routledge/Taylor & Francis Group, New York (2013)
Vlasblom, J.I.D., Pennings, H.J.M., Van der Pal, J., Oprins, E.A.P.B.: Competence retention in safety-critical professions: a systematic literature review. Educ. Res. Rev. 30 (2020). https://doi.org/10.1016/j.edurev.2020.100330
Mané, A., Donchin, E.: The space fortress game. Acta Physiol. 71(1–3), 17–22 (1989)
Gopher, D., Well, M., Bareket, T.: Transfer of skill from a computer game trainer to flight. Hum. Factors 36(3), 387–405 (1994)
Day, E.A., Arthur Jr., W., Gettman, D.: Knowledge structures and the acquisition of a complex skill. J. Appl. Psychol. 86(5), 1022 (2001)
Regian, J., Goettl, B.M., Ashworth III, A., deBoom, D., Anthony, M.: Training Research in Automated Instruction (TRAIN). Galaxy Scientific Corp, Egg Harbor Township, NJ (2003)
Roessingh, J., Hilburn, B.: The Power Law of Practice in adaptive training applications. National Aerospace Laboratory NLR (2000)
Roessingh, J., Kappers, A., Koenderink, J.: Transfer between training of part-tasks in complex skill training. National Aerospace Laboratory NLR (2002)
Anderson, J.R., Bothell, D., Fincham, J.M., Anderson, A.R., Poole, B., Qin, Y.: Brain regions engaged by part-and whole-task performance in a video game: a model-based test of the decomposition hypothesis. J. Cogn. Neurosci. 23(12), 3983–3997 (2011)
van Oijen, J., Poppinga, G., Brouwer, O., Aliko, A., Roessingh, J.J.: Towards modeling the learning process of aviators using deep reinforcement learning. In: 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 3439–3444 (2017)
Agarwal, A., Sycara, K.: Learning time-sensitive strategies in space fortress, arXiv preprint arXiv:1805.06824 (2018)
Jordan, M.I., Mitchell, T.M.: Machine learning: trends, perspectives, and prospects. Science 349(6245), 255–260 (2015). https://doi.org/10.1126/science.aaa8415
Shen, L., Margolies, L.R., Rothstein, J.H., Fluder, E., McBride, R., Sieh, W.: Deep learning to improve breast cancer detection on screening mammography. Sci Rep. 9(1), 1–12 (2019). https://doi.org/10.1038/s41598-019-48995-4
Settles, B., Brust, C., Gustafson, E., Hagiwara, M., Madnani, N.: Second language acquisition modeling. In: Proceedings of the Thirteenth Workshop on Innovative Use of NLP for Building Educational Applications, New Orleans, Louisiana, pp. 56–65 (2018). https://doi.org/10.18653/v1/w18-0506
Che, Z., Purushotham, S., Cho, K., Sontag, D., Liu, Y.: Recurrent neural networks for multivariate time series with missing values. Sci. Rep. 8(1), 1–12 (2018). https://doi.org/10.1038/s41598-018-24271-9
Sense, F., Jastrzembski, T., Mozer, M.C., Krusmark, M., van Rijn, H.: Perspectives on computational models of learning and forgetting. In: Proceedings of the 17th International Conference on Cognitive Modeling, Montreal, Canada (2019)
Graff, M., Escalante, H.J., Ornelas-Tellez, F., Tellez, E.S.: Time series forecasting with genetic programming. Nat. Comput. 16(1), 165–174 (2017). https://doi.org/10.1007/s11047-015-9536-z
Moskowitz, D.: Implementing the template method pattern in genetic programming for improved time series prediction. Genet. Program Evolvable Mach. 19(1), 271–299 (2018). https://doi.org/10.1007/s10710-018-9320-9
Ribeiro, M.H.D.M., dos Santos Coelho, L.: Ensemble approach based on bagging, boosting and stacking for short-term prediction in agribusiness time series. Appl. Soft Comput. 86, 105837 (2020). https://doi.org/10.1016/j.asoc.2019.105837
Li, J., et al.: Feature selection: a data perspective. ACM Comput. Surv. 50(6), 94:1–94:45 (2017). https://doi.org/10.1145/3136625
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
van der Pal, J., Toubman, A. (2020). An Adaptive Instructional System for the Retention of Complex Skills. In: Sottilare, R.A., Schwarz, J. (eds) Adaptive Instructional Systems. HCII 2020. Lecture Notes in Computer Science(), vol 12214. Springer, Cham. https://doi.org/10.1007/978-3-030-50788-6_30
Download citation
DOI: https://doi.org/10.1007/978-3-030-50788-6_30
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-50787-9
Online ISBN: 978-3-030-50788-6
eBook Packages: Computer ScienceComputer Science (R0)