Abstract
Intelligent Tutoring Systems (ITSs) are usually comprised of three primary models – an expert model, a domain or system model, and a student model. Many of these models are quite complex to enable just about any learner to get the optimum tailored experience possible. These systems have shown great results, typically at least one standard deviation (a letter grade) better than traditional training (e.g. [1] [2]). This complexity not only ensured that ITSs were successful, it also prohibited their widespread use (e.g. [3]). Results of studies in which the expert and system models were simplified show similar gains in effectiveness (e.g. [4] [5]), suggesting that lower-cost ITSs can be just as effective as those developed at higher costs. This paper compares the results of effectiveness studies in which the ITSs had various levels of fidelity and presents some recommended guidelines in determining the level of fidelity for student, expert, and system models of the ITS.
Chapter PDF
Similar content being viewed by others
Keywords
References
Durlach, P.J., Ray, J.M.: Designing adaptive instructional environments: Insights from empirical evidence. Technical Report 1297, Army Research Institute, Arlington, VA (2011)
VanLehn, K.: The Relative Effectiveness of Human Tutoring, Intelligent Tutoring Systems. Educational Psychologist 46(4), 197–221 (2011)
Brawner, K., Holden, H., Goldberg, B., Sottilare, R.: Recommendations for Modern Tools to Author Tutoring Systems. In: Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), Orlando, FL (2012)
Dargue, B.W., Banks, F.Z., Perrin, B.M.: Student vs. Software Pacing of Instruction: An Empirical Comparison of Effectiveness. In: Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), Orlando, FL (2004)
Durlach, P.J., Dargue, B.W.: An Adaptive Training Prototype for Small Unmanned Aerial System Employment. In: 23rd Florida Artificial Intelligence Research Society Conference (FLAIRS-23), Daytona Beach, FL (2010)
Bloom, B.S.: The Two Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring. Educational Researcher 13(4-6) (1984)
Person, N.K., Graesser, A.C.: Human or computer?: AutoTutor in a bystander Turing test. In: Cerri, S.A., Gouardéres, G., Paraguaçu, F. (eds.) ITS 2002. LNCS, vol. 2363, pp. 821–830. Springer, Heidelberg (2002)
Carbonell, J.: Mixed-Initiative Man-Computer Instructional Dialogue. MIT, Cambridge (1970)
Stevens, A.L., Collins, A.: The goal structure of a Socratic tutor. In: Proceedings of the ACM Conference, New York (1977)
Brown, J.S., Burton, R.R., Zdybel, F.: A Model-Driven Question-Answering System for Mixed-Initiative Computer-Assisted Construction. IEEE Transactions on Systems, Man and Cybernetics SMC-3(3), 248–257 (1973)
Corbett, A.T., Koedinger, K.R., Anderson, J.R.: Intelligent Tutoring Systems, Chapter 37. In: Handbook of Human-Computer Interaction, 2nd Completely Revised edn., pp. 849–874. Elsevier, Amsterdam (1997)
Fidelity, http://www.merriam-webster.com/dictionary/fidelity (accessed February 17, 2014)
Pavlik Jr., P., Toth, J.: How to Build Bridges between Intelligent Tutoring System Subfields of Research. In: Aleven, V., Kay, J., Mostow, J. (eds.) ITS 2010, Part II. LNCS, vol. 6095, pp. 103–112. Springer, Heidelberg (2010)
Wikipedia: Intelligent tutoring system (December 3, 2013), http://en.wikipedia.org/wiki/Intelligent_tutoring_system#Structure (accessed February 16, 2014)
Nkambou, R., Bourdeau, J., Mizoguchi, R.: Introduction: What Are Intelligent Tutoring Systems, and Why This Book? In: Nkambou, R., Bourdeau, J., Mizoguchi, R. (eds.) Advances in Intelligent Tutoring Systems. SCI, vol. 308, pp. 1–12. Springer, Heidelberg (2010)
Woolf, B.P.: Building Intelligent Interactive Tutors: Student-centered strategies for revolutionizing e-learning. Morgan Kaufmann Publishers/Elsevier, Amsterdam (2009)
Fidelity, http://www.msco.mil/VVA_RPG.html , http://vva.msco.mil/Special_Topics/Fidelity/default.htm (accessed February 20, 2014)
Gross, D.C.: Report from the Fidelity Definition and Metrics Implementation Study Group (FDM-ISG). Simulation Interoperability Standards Organization (SISO), Orlando (1999)
Stacy, W., Walwanis, M.M., Wiggins, S., Bolton, A.: Layered Fidelity: An Approach to Characterizing Training Environments. In: Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), Orlando, FL (2013)
Perrin, B.: Intelligent tutoring systems: Facilitating learning while holding to standard practice. In: Proceedings to the 2009 ITEC, Brussels (2009)
Brusilovskiy, P.L.: The construction and application of student models in intelligent tutoring systems. Journal of Computer and Systems Sciences International 32(1) (1994)
McCombs, B.L., McDaniel, M.A.: On the design of adaptive treatments for individualized instructional systems. Educational Psychologist 16(1), 11–22 (1981)
del Soldato, T., du Boulay, B.: Implementations of motivational tactics in tutoring systems. Journal of Artificial Intelligence in Education 6(4), 337–378 (1995)
Tong, A., Agelides, M.: Formalising tutoring strategy selection in multimedia tutoring systems. Information and Software Technology 41, 67–90 (1999)
Baker, R.S.: Modeling and understanding students’ off-task behavior in intelligent tutoring systems. In: Computer/Human Interaction (CHI) 2007, San Jose (2007)
Rickel, J., Johnson, W.L.: Animated agents for procedural training in virtual reality: Perception, cognition, and motor control. Applied Artificial Intelligence 13, 343–382 (1999)
Anderson, J.: Rules of the Mind. L. Erlbaum Associates, Hillsdale (1993)
Lane, H.C., Core, M.G., Gomboc, D., Karnavat, A., Rosenberg, M.: Intelligent tutoring for interpersonal and intercultural skills. In: Proceedings to the Interservice/Industry, Training, Simulation & Education Conference (I/ITSEC), Orlando (2007)
D’Mello, S.K., Graesser, A.: Language and discourse are powerful signals of student emotions during tutoring. IEEE Transaction on Learning Technology 5(4), 304–317 (2012)
Sottilare, R.A., Goldberg, B.S., Brawner, K.W., Holden, H.K.: A modular framework to support the authoring and assessment of adaptive computer-based tutoring systems (CBTS). In: Proceedings to the Interservice/Industry, Training, Simulation & Education Conference (I/ITSEC), Orlando (2012)
Olney, A.C.W.: Matching learner models to instructional strategies. In: Design Recommendations for Intelligent Tutoring Systems. Learner Modeling, vol. 1, pp. 23–28
Durlach, P.J.: Vanilla, Chocolate, or Chunky Monkey: Flavors of Adaptation in Instructional Technology. In: iFest 2012, Orland, FL (2012)
Sampson, D.G., Karampiperis, P.: Decision Models In The Design Of Adaptive Educational Hypermedia Systems. In: Graf, S., Lin, F., Kinshuk, McGreal, R. (eds.) Intelligent and Adaptive Learning Systems, Hershey, PA, pp. 1–18. IGI Global (2011)
Durlach, P.J., Dargue, B.W.: Adaptive and Non-Adaptive Training Technology for Small Unmanned Aerial System Employment. Poster Paper for The 27th Army Science Conference (ASC), Orlando, FL (2010)
Aleven, V., McLaren, B., Sewall, J.: Scaling up programming by demonstration for intelligent tutoring systems development: an open-access web site for middle school mathematics learning. IEEE Transactions on Learning Technologies 2(2) (April-June 2009)
VanLehn, K.: The behavior of tutoring systems. International Journal of Artificial Intelligence in Education 16(3), 227–265 (2006)
Woolf, B.P.: Student modeling. In: Nkambou, R., Bourdeau, J., Mizoguchi, R. (eds.) Advances in Intelligent Tutoring Systems. SCI, vol. 308, pp. 267–279. Springer, Heidelberg (2010)
Murray, T.: A overview of the intelligent tutoring system authoring tools: Updated analysis of the state of the art. In: Murray, T., Blessing, S., Ainsworth, S. (eds.) Authoring Tools for Advanced Technological Learning Environments, The Netherlands, pp. 493–546. Kluwer Academic Publishers (2003)
Ohlsson, S., Mitrovic, A.: Fidelity and Efficiency of Knowledge Representations for Intelligent Tutoring Systems. Technology, Instruction, Cognition and Learning (TICL) 5(2-3-4), 101–132 (2007)
Lynch, C., Ashley, K.D., Aleven, V., Pinkwart, N.: Defining ‘Ill-Defined Domains ’: A Literature Survey. In: Eighth International Conference on Intelligent Tutoring Systems Workshop on Intelligent Tutoring Systems for Ill-Defined Domains, Hongli, Taiwan (2006)
Krathwohl, D.R.: A revision of Bloom’s taxonomy: An overview. Theory into Practice 41(4) (2002)
Graesser, A.C., Vanlehn, K., Rosé, C.P., Jordan, P.W., Harter, D.: Intelligent tutoring systems with conversational dialogue. AI Magazine 22, 39–51 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Dargue, B., Biddle, E. (2014). Just Enough Fidelity in Student and Expert Modeling for ITS. In: Schmorrow, D.D., Fidopiastis, C.M. (eds) Foundations of Augmented Cognition. Advancing Human Performance and Decision-Making through Adaptive Systems. AC 2014. Lecture Notes in Computer Science(), vol 8534. Springer, Cham. https://doi.org/10.1007/978-3-319-07527-3_19
Download citation
DOI: https://doi.org/10.1007/978-3-319-07527-3_19
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07526-6
Online ISBN: 978-3-319-07527-3
eBook Packages: Computer ScienceComputer Science (R0)