Abstract
The adaptive learning potential in video games can be increased by incorporating intelligent tutoring system (ITS) approaches. However, very few studies have examined the ITS capability in a game. Across a four-year research project, we implemented a number of intelligent tutoring design alternatives and integrated them into the serious 3D video game. The game, Heuristica, was designed to improve critical thinking by exposing players to different cognitive biases through game play, and then adaptively giving players opportunities to practice avoiding or mitigating each bias. We describe the intelligent tutoring system, and how we structured the learner’s environment, provided learners with tailored feedback, supported spaced and massed practice, and provided opportunities for in-game learner reflection. We describe the design and functionality of the Student Modeler and interface features that support student feedback and interaction. We evaluate the tradeoffs made in the student model design and the impact they had on the game experience, focusing on the open student model summary screen, mixed-initiative opportunities and algorithms for selection of learning opportunities. This paper contributes to the intelligent tutoring literature by describing one of the first intelligent tutoring systems embedded in a 3D game for training and provides lessons learned from implementations in a single game.
Keywords
- Adaptive learning environment
- Intelligent tutoring design
- Video games
This is a preview of subscription content, access via your institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptions





References
Carr, B., Goldstein, I.: Overlays: a theory of modeling for computer-aided instruction. AI Lab Memo 406. MIT, Cambridge (1977)
Chi, M.T., Siler, S.A., Jeong, H.: Can tutors monitor students’ understanding accurately? Cogn. Instr. 22(3), 363–387 (2004)
Goodman, B., Soller, A., Linton, F., Gaimari, R.: Encouraging student reflection and articulation using a learning companion. In: Proceedings of the AI-ED 1997 World Conference on Artificial Intelligence in Education, pp. 151–158 (1997)
Graesser, A.C., Hu, X., Sottilare, R.: Intelligent tutoring systems. In: International Handbook of the Learning Sciences, pp. 246–255. Routledge (2018)
Graesser, A., et al.: Critiquing media reports with flawed scientific findings: Operation ARIES! A game with animated agents and natural language trialogues. In: Aleven, V., Kay, J., Mostow, J. (eds.) ITS 2010. LNCS, vol. 6095, pp. 327–329. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-13437-1_60
Halpern, D.F., Millis, K., Graesser, A.C., Butler, H., Forsyth, C., Cai, Z.: Operation ARA: a computerized learning game that teaches critical thinking and scientific reasoning. Think. Skills Creat. 7(2), 93–100 (2012)
Holden, S., Kay, J.: The scrutable user model and beyond. Basser Department of Computer Science, University of Sydney (1999)
Hwang, G.J.: A conceptual map model for developing intelligent tutoring systems. Comput. Educ. 40(3), 217–235 (2003)
Lynch, C., Ashley, K.D., Aleven, V., Pinkwart, N.: Defining ‘Ill-Defined Domains’: a literature survey. In: Aleven, V., Ashley, K.D., Lynch, C., Pinkwart, N. (eds.) Eighth International Conference on Intelligent Tutoring Systems Workshop on Ill-Defined Domains, Jhongli, Taiwan, pp. 1–10 (2006)
Mayer, R.E.: Computer Games for Learning: An Evidence-Based Approach. MIT Press, Cambridge (2014)
Millis, K., Forsyth, C., Butler, H., Wallace, P., Graesser, A., Halpern, D.: Operation ARIES!: a serious game for teaching scientific inquiry. In: Ma, M., Oikonomou, A., Jain, L. (eds.) Serious Games and Edutainment Applications, pp. 169–195. Springer, London (2011). https://doi.org/10.1007/978-1-4471-2161-9_10
Mullinix, G., et al.: Heuristica: designing a serious game for improving decision making. Paper presented at IEEE Games Innovation Conference (IGIC), Vancouver, BC (2013)
Psotka, J., Massey, L.D., Mutter, S.A.: Intelligent Tutoring Systems: Lessons Learned. Psychology Press, London (1988)
Roose, K., Veinott, E.: Roller coaster park manager by day problem solver by night: effect of video game play on problem solving. In: Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play, Amsterdam, Netherlands, pp. 277–282. ACM (2017)
VanLehn, K.: The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educ. Psychol. 46(4), 197–221 (2011)
Veinott, E., et al.: The effect of 3rd person perspective and session duration on training decision making in a serious video game. In: Proceedings of the Games Innovation Conference (IGIC), 2013 IEEE International, Vancouver, BC, pp. 256–262. IEEE (2013)
Veinott, E., et al.: The effect of cognitive and visual fidelity on decision making: is more information better? In: IEEE Games Innovation Conference (IGIC), 2014 IEEE International, Toronto, ON. IEEE, October 2014
Veinott, E., Whitaker, E.: Leaving hints: Using in-game player reflection to improve and measure learning. In: International Conference on Human Computer Interaction (HCII). Orlando, FL (2019)
Whitaker, E.T., et al.: The effectiveness of intelligent tutoring on training in a video game. In: 2013 IEEE International Games Innovation Conference (IGIC), pp. 267–274. IEEE, September 2013
Woolf, B.P.: Building Intelligent Interactive Tutors: Student-Centered Strategies for Revolutionizing e-Learning. Morgan Kaufmann, San Francisco (2009)
Dempster, F.N.: The spacing effect: a case study in the failure to apply the results of psychological research. Am. Psychol. 43(8), 627 (1988)
Wylie, R., Chi, M.T.: The self-explanation principle in multimedia learning. In: Mayer, R.E. (ed.) The Cambridge Handbook of Multimedia Learning, pp. 271–286. Cambridge University Press, Cambridge (2014)
Acknowledgements
This research was supported by the Intelligence Advanced Research Projects Activity (IARPA) via the Air Force Research Laboratory (Contract #FA8650-11-C-7177). The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright annotation thereon. Disclaimer: The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of IARPA, AFRL, or the U.S. Government.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Whitaker, E., Trewhitt, E., Veinott, E.S. (2019). Intelligent Tutoring Design Alternatives in a Serious Game. In: Sottilare, R., Schwarz, J. (eds) Adaptive Instructional Systems. HCII 2019. Lecture Notes in Computer Science(), vol 11597. Springer, Cham. https://doi.org/10.1007/978-3-030-22341-0_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-22341-0_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-22340-3
Online ISBN: 978-3-030-22341-0
eBook Packages: Computer ScienceComputer Science (R0)
