Advertisement

Just Enough Fidelity in Student and Expert Modeling for ITS

Making the Practice Practical
  • Brandt Dargue
  • Elizabeth Biddle
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8534)

Abstract

Intelligent Tutoring Systems (ITSs) are usually comprised of three primary models – an expert model, a domain or system model, and a student model. Many of these models are quite complex to enable just about any learner to get the optimum tailored experience possible. These systems have shown great results, typically at least one standard deviation (a letter grade) better than traditional training (e.g. [1] [2]). This complexity not only ensured that ITSs were successful, it also prohibited their widespread use (e.g. [3]). Results of studies in which the expert and system models were simplified show similar gains in effectiveness (e.g. [4] [5]), suggesting that lower-cost ITSs can be just as effective as those developed at higher costs. This paper compares the results of effectiveness studies in which the ITSs had various levels of fidelity and presents some recommended guidelines in determining the level of fidelity for student, expert, and system models of the ITS.

Keywords

Cognitive Modeling Perception Emotion and Interaction Machine Learning Neural Networks Techniques for Data Processing Adaptive User Interfaces Human performance improvement Intelligent Tutoring Adaptive training 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Durlach, P.J., Ray, J.M.: Designing adaptive instructional environments: Insights from empirical evidence. Technical Report 1297, Army Research Institute, Arlington, VA (2011)Google Scholar
  2. 2.
    VanLehn, K.: The Relative Effectiveness of Human Tutoring, Intelligent Tutoring Systems. Educational Psychologist 46(4), 197–221 (2011)CrossRefGoogle Scholar
  3. 3.
    Brawner, K., Holden, H., Goldberg, B., Sottilare, R.: Recommendations for Modern Tools to Author Tutoring Systems. In: Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), Orlando, FL (2012)Google Scholar
  4. 4.
    Dargue, B.W., Banks, F.Z., Perrin, B.M.: Student vs. Software Pacing of Instruction: An Empirical Comparison of Effectiveness. In: Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), Orlando, FL (2004)Google Scholar
  5. 5.
    Durlach, P.J., Dargue, B.W.: An Adaptive Training Prototype for Small Unmanned Aerial System Employment. In: 23rd Florida Artificial Intelligence Research Society Conference (FLAIRS-23), Daytona Beach, FL (2010)Google Scholar
  6. 6.
    Bloom, B.S.: The Two Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring. Educational Researcher 13(4-6) (1984)Google Scholar
  7. 7.
    Person, N.K., Graesser, A.C.: Human or computer?: AutoTutor in a bystander Turing test. In: Cerri, S.A., Gouardéres, G., Paraguaçu, F. (eds.) ITS 2002. LNCS, vol. 2363, pp. 821–830. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  8. 8.
    Carbonell, J.: Mixed-Initiative Man-Computer Instructional Dialogue. MIT, Cambridge (1970)Google Scholar
  9. 9.
    Stevens, A.L., Collins, A.: The goal structure of a Socratic tutor. In: Proceedings of the ACM Conference, New York (1977)Google Scholar
  10. 10.
    Brown, J.S., Burton, R.R., Zdybel, F.: A Model-Driven Question-Answering System for Mixed-Initiative Computer-Assisted Construction. IEEE Transactions on Systems, Man and Cybernetics SMC-3(3), 248–257 (1973)CrossRefGoogle Scholar
  11. 11.
    Corbett, A.T., Koedinger, K.R., Anderson, J.R.: Intelligent Tutoring Systems, Chapter 37. In: Handbook of Human-Computer Interaction, 2nd Completely Revised edn., pp. 849–874. Elsevier, Amsterdam (1997)Google Scholar
  12. 12.
    Fidelity, http://www.merriam-webster.com/dictionary/fidelity (accessed February 17, 2014)
  13. 13.
    Pavlik Jr., P., Toth, J.: How to Build Bridges between Intelligent Tutoring System Subfields of Research. In: Aleven, V., Kay, J., Mostow, J. (eds.) ITS 2010, Part II. LNCS, vol. 6095, pp. 103–112. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  14. 14.
    Wikipedia: Intelligent tutoring system (December 3, 2013), http://en.wikipedia.org/wiki/Intelligent_tutoring_system#Structure (accessed February 16, 2014)
  15. 15.
    Nkambou, R., Bourdeau, J., Mizoguchi, R.: Introduction: What Are Intelligent Tutoring Systems, and Why This Book? In: Nkambou, R., Bourdeau, J., Mizoguchi, R. (eds.) Advances in Intelligent Tutoring Systems. SCI, vol. 308, pp. 1–12. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  16. 16.
    Woolf, B.P.: Building Intelligent Interactive Tutors: Student-centered strategies for revolutionizing e-learning. Morgan Kaufmann Publishers/Elsevier, Amsterdam (2009)Google Scholar
  17. 17.
  18. 18.
    Gross, D.C.: Report from the Fidelity Definition and Metrics Implementation Study Group (FDM-ISG). Simulation Interoperability Standards Organization (SISO), Orlando (1999)Google Scholar
  19. 19.
    Stacy, W., Walwanis, M.M., Wiggins, S., Bolton, A.: Layered Fidelity: An Approach to Characterizing Training Environments. In: Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), Orlando, FL (2013)Google Scholar
  20. 20.
    Perrin, B.: Intelligent tutoring systems: Facilitating learning while holding to standard practice. In: Proceedings to the 2009 ITEC, Brussels (2009)Google Scholar
  21. 21.
    Brusilovskiy, P.L.: The construction and application of student models in intelligent tutoring systems. Journal of Computer and Systems Sciences International 32(1) (1994)Google Scholar
  22. 22.
    McCombs, B.L., McDaniel, M.A.: On the design of adaptive treatments for individualized instructional systems. Educational Psychologist 16(1), 11–22 (1981)CrossRefGoogle Scholar
  23. 23.
    del Soldato, T., du Boulay, B.: Implementations of motivational tactics in tutoring systems. Journal of Artificial Intelligence in Education 6(4), 337–378 (1995)Google Scholar
  24. 24.
    Tong, A., Agelides, M.: Formalising tutoring strategy selection in multimedia tutoring systems. Information and Software Technology 41, 67–90 (1999)CrossRefGoogle Scholar
  25. 25.
    Baker, R.S.: Modeling and understanding students’ off-task behavior in intelligent tutoring systems. In: Computer/Human Interaction (CHI) 2007, San Jose (2007)Google Scholar
  26. 26.
    Rickel, J., Johnson, W.L.: Animated agents for procedural training in virtual reality: Perception, cognition, and motor control. Applied Artificial Intelligence 13, 343–382 (1999)CrossRefGoogle Scholar
  27. 27.
    Anderson, J.: Rules of the Mind. L. Erlbaum Associates, Hillsdale (1993)Google Scholar
  28. 28.
    Lane, H.C., Core, M.G., Gomboc, D., Karnavat, A., Rosenberg, M.: Intelligent tutoring for interpersonal and intercultural skills. In: Proceedings to the Interservice/Industry, Training, Simulation & Education Conference (I/ITSEC), Orlando (2007)Google Scholar
  29. 29.
    D’Mello, S.K., Graesser, A.: Language and discourse are powerful signals of student emotions during tutoring. IEEE Transaction on Learning Technology 5(4), 304–317 (2012)CrossRefGoogle Scholar
  30. 30.
    Sottilare, R.A., Goldberg, B.S., Brawner, K.W., Holden, H.K.: A modular framework to support the authoring and assessment of adaptive computer-based tutoring systems (CBTS). In: Proceedings to the Interservice/Industry, Training, Simulation & Education Conference (I/ITSEC), Orlando (2012)Google Scholar
  31. 31.
    Olney, A.C.W.: Matching learner models to instructional strategies. In: Design Recommendations for Intelligent Tutoring Systems. Learner Modeling, vol. 1, pp. 23–28Google Scholar
  32. 32.
    Durlach, P.J.: Vanilla, Chocolate, or Chunky Monkey: Flavors of Adaptation in Instructional Technology. In: iFest 2012, Orland, FL (2012)Google Scholar
  33. 33.
    Sampson, D.G., Karampiperis, P.: Decision Models In The Design Of Adaptive Educational Hypermedia Systems. In: Graf, S., Lin, F., Kinshuk, McGreal, R. (eds.) Intelligent and Adaptive Learning Systems, Hershey, PA, pp. 1–18. IGI Global (2011)Google Scholar
  34. 34.
    Durlach, P.J., Dargue, B.W.: Adaptive and Non-Adaptive Training Technology for Small Unmanned Aerial System Employment. Poster Paper for The 27th Army Science Conference (ASC), Orlando, FL (2010)Google Scholar
  35. 35.
    Aleven, V., McLaren, B., Sewall, J.: Scaling up programming by demonstration for intelligent tutoring systems development: an open-access web site for middle school mathematics learning. IEEE Transactions on Learning Technologies 2(2) (April-June 2009)Google Scholar
  36. 36.
    VanLehn, K.: The behavior of tutoring systems. International Journal of Artificial Intelligence in Education 16(3), 227–265 (2006)Google Scholar
  37. 37.
    Woolf, B.P.: Student modeling. In: Nkambou, R., Bourdeau, J., Mizoguchi, R. (eds.) Advances in Intelligent Tutoring Systems. SCI, vol. 308, pp. 267–279. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  38. 38.
    Murray, T.: A overview of the intelligent tutoring system authoring tools: Updated analysis of the state of the art. In: Murray, T., Blessing, S., Ainsworth, S. (eds.) Authoring Tools for Advanced Technological Learning Environments, The Netherlands, pp. 493–546. Kluwer Academic Publishers (2003)Google Scholar
  39. 39.
    Ohlsson, S., Mitrovic, A.: Fidelity and Efficiency of Knowledge Representations for Intelligent Tutoring Systems. Technology, Instruction, Cognition and Learning (TICL) 5(2-3-4), 101–132 (2007)Google Scholar
  40. 40.
    Lynch, C., Ashley, K.D., Aleven, V., Pinkwart, N.: Defining ‘Ill-Defined Domains ’: A Literature Survey. In: Eighth International Conference on Intelligent Tutoring Systems Workshop on Intelligent Tutoring Systems for Ill-Defined Domains, Hongli, Taiwan (2006)Google Scholar
  41. 41.
    Krathwohl, D.R.: A revision of Bloom’s taxonomy: An overview. Theory into Practice 41(4) (2002)Google Scholar
  42. 42.
    Graesser, A.C., Vanlehn, K., Rosé, C.P., Jordan, P.W., Harter, D.: Intelligent tutoring systems with conversational dialogue. AI Magazine 22, 39–51 (2011)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Brandt Dargue
    • 1
  • Elizabeth Biddle
    • 2
  1. 1.Boeing Research & Technologies (BR&T)St. LouisUSA
  2. 2.Boeing Research & Technologies (BR&T)OrlandoUSA

Personalised recommendations