Rule-Based Cognitive Modeling for Intelligent Tutoring Systems

  • Vincent Aleven
Part of the Studies in Computational Intelligence book series (SCI, volume 308)

Abstract

Rule-based cognitive models serve many roles in intelligent tutoring systems (ITS) development. They help understand student thinking and problem solving, help guide many aspects of the design of a tutor, and can function as the “smarts” of a system. Cognitive Tutors using rule-based cognitive models have been proven to be successful in improving student learning in a range of learning domain. The chapter focuses on key practical aspects of model development for this type of tutors and describes two models in significant detail. First, a simple rule-based model built for fraction addition, created with the Cognitive Tutor Authoring Tools, illustrates the importance of a model’s flexibility and its cognitive fidelity. It also illustrates the model-tracing algorithm in greater detail than many previous publications. Second, a rule-based model used in the Geometry Cognitive Tutor illustrates how ease of engineering is a second important concern shaping a model used in a large-scale tutor. Although cognitive fidelity and ease of engineering are sometimes at odds, overall the model used in the Geometry Cognitive Tutor meets both concerns to a significant degree. On-going work in educational data mining may lead to novel techniques for improving the cognitive fidelity of models and thereby the effectiveness of tutors.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aleven, V., Koedinger, K.R.: An effective meta-cognitive strategy: learning by doing and explaining with a computer-based Cognitive Tutor. Cognitive Science 26(2), 147–179 (2002)CrossRefGoogle Scholar
  2. Aleven, V., McLaren, B.M., Sewall, J.: Scaling up programming by demonstration for intelligent tutoring systems development: An open-access website for middle-school mathematics learning. IEEE Transactions on Learning Technologies 2(2), 64–78 (2009)CrossRefGoogle Scholar
  3. Aleven, V., McLaren, B.M., Sewall, J., Koedinger, K.R.: The Cognitive Tutor Authoring Tools (CTAT): Preliminary evaluation of efficiency gains. In: Ikeda, M., Ashley, K.D., Chan, T.W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 61–70. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  4. Aleven, V., McLaren, B.M., Sewall, J., Koedinger, K.R.: A new paradigm for intelligent tutoring systems: Example-tracing tutors. International Journal of Artificial Intelligence in Education 19(2), 105–154 (2009)Google Scholar
  5. Anderson, J.R.: Rules of the mind. Lawrence Erlbaum Associates, Hillsdale (1993)Google Scholar
  6. Anderson, J.R., Lebiere, C.: The atomic components of thought. Lawrence Erlbaum Associates, Mahwah (1998)Google Scholar
  7. Anderson, J.R., Pelletier, R.: A development system for model-tracing tutors. In: Birnbaum, L. (ed.) Proceedings of the international conference of the learning sciences. Association for the Advancement of Computing in Education, pp. 1–8, Charlottesville, VA (1991)Google Scholar
  8. Anderson, J.R., Boyle, C.F., Reiser, B.J.: Intelligent tutoring systems. Science 228(4698), 456–462 (1985)CrossRefGoogle Scholar
  9. Anderson, J.R., Boyle, C.F., Yost, G.: The geometry tutor. In: Joshi, A. (ed.) Proceedings of the 9th international joint conference on artificial intelligence, pp. 1–7. Morgan Kaufmann, San Francisco (1985)Google Scholar
  10. Anderson, J.R., Corbett, A.T., Koedinger, K.R., Pelletier, R.: Cognitive tutors: Lessons learned. The Journal of the Learning Sciences 4(2), 167–207 (1995)CrossRefGoogle Scholar
  11. Baker, R.S.J.d., Yacef, K.: The state of educational data mining in 2009: A review and future visions. Journal of Educational Data Mining, 1(1): 3-17 (2009)Google Scholar
  12. Baker, R.S.J.d., Corbett, A.T., Koedinger, K.R.: The difficulty factors approach to the design of lessons in intelligent tutor curricula. International Journal of Artificial Intelligence and Education, 17(4): 341-369 (2007)Google Scholar
  13. Butcher, K., Aleven, V.: Integrating visual and verbal knowledge during classroom learning with computer tutors. In: McNamara, D.S., Trafton, J.G. (eds.) Proceedings of the 29th Annual Conference of the Cognitive Science Society. Cognitive Science Society, Austin (2007)Google Scholar
  14. Butcher, K., Aleven, V.: Diagram interaction during intelligent tutoring in geometry: Support for knowledge retention and deep transfer. In: Schunn, C. (ed.) Proceedings of the 30th Annual Meeting of the Cognitive Science Society, CogSci 2008, pp. 894–899. Lawrence Erlbaum, New York (2008)Google Scholar
  15. Butcher, K., Aleven, V.: Learning during intelligent tutoring: when do integrated visual-verbal representations improve student outcomes? In: The 32nd Annual Meeting of the Cognitive Science Society, CogSci 2010 (in press, 2010)Google Scholar
  16. Cen, H., Koedinger, K.R., Junker, B.: Learning factors analysis - A general method for cognitive model evaluation and improvement. In: Ikeda, M., Ashley, K.D., Chan, T.W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 164–175. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  17. Cen, H., Koedinger, K.R., Junker, B.: Is over practice necessary? Improving learning efficiency with the cognitive tutor through educational data mining. In: Luckin, R., Koedinger, K.R., Greer, J. (eds.) Proceedings of the 13th international conference on artificial intelligence in education (AIED 2007), pp. 511–518. IOS Press, Amsterdam (2007)Google Scholar
  18. Clark, R.E., Feldon, D., van Merriënboer, J., Yates, K., Early, S.: Cognitive task analysis. In: Spector, J.M., Merrill, M.D., van Merriënboer, J.J.G., Driscoll, M.P. (eds.) Handbook of research on educational communications and technology, 3rd edn., Lawrence Erlbaum Associates, Mahwah (2007)Google Scholar
  19. Corbett, A.T., Anderson, J.R.: Knowledge tracing: Modeling the acquisition of procedural knowledge. User Modeling and User-Adapted Interaction 4(4), 253–278 (1995)CrossRefGoogle Scholar
  20. Corbett, A., Kauffman, L., MacLaren, B., Wagner, A., Jones, E.: A Cognitive Tutor for genetics problem solving: Learning gains and student modeling. Journal of Educational Computing Research 42(2), 219–239 (2010)CrossRefGoogle Scholar
  21. Corbett, A., McLaughlin, M., Scarpinatto, K.C.: Modeling student knowledge: Cognitive tutors in high school and college. User Modeling and User-Adapted Interaction 10(2-3), 81–108 (2000)CrossRefGoogle Scholar
  22. Crowley, R.S., Medvedeva, O.: An intelligent tutoring system for visual classification problem solving. Artificial Intelligence in Medicine 36(1), 85–117 (2006)CrossRefGoogle Scholar
  23. Friedman-Hill, E.: JESS in action. Manning, Greenwich, CT (2003)Google Scholar
  24. Heathcote, A., Brown, S., Mewhort, D.J.K.: The power law repealed: The case for an exponential law of practice. Psychonomic Bulletin & Review 7(2), 185–207 (2000)Google Scholar
  25. Koedinger, K.R., Aleven, V.: Exploring the assistance dilemma in experiments with Cognitive Tutors. Educational Psychology Review 19(3), 239–264 (2007)CrossRefGoogle Scholar
  26. Koedinger, K.R., Anderson, J.R.: Abstract planning and perceptual chunks: Elements of expertise in geometry. Cognitive Science 14, 511–550 (1990)CrossRefGoogle Scholar
  27. Koedinger, K.R., Anderson, J.R.: Reifying implicit planning in geometry: Guidelines for model-based intelligent tutoring system design. In: Lajoie, S.P., Derry, S.J. (eds.) Computers as cognitive tool. Lawrence Erlbaum, Hillsdale (1993)Google Scholar
  28. Koedinger, K.R., Corbett, A.T.: Cognitive tutors: Technology bringing learning sciences to the classroom. In: Sawyer, R.K. (ed.) The Cambridge handbook of the learning sciences. Cambridge University Press, New York (2006)Google Scholar
  29. Koedinger, K.R., Nathan, M.J.: The real story behind story problems: Effects of representations on quantitative reasoning. The Journal of the Learning Sciences 13(2), 129–164 (2004)CrossRefGoogle Scholar
  30. Koedinger, K.R., Anderson, J.R., Hadley, W.H., Mark, M.A.: Intelligent tutoring goes to school in the big city. International Journal of Artificial Intelligence in Education 8(1), 30–43 (1997)Google Scholar
  31. Koedinger, K.R., Baker, R., Cunningham, K., Skogsholm, A., Leber, B., Stamper, J.: A Data Repository for the EDM community: The PSLC DataShop. In: Romero, C., Ventura, S., Pechenizkiy, M., Baker, R.S.J.d. (eds.) To appear in Handbook of Educational Data Mining. CRC Press, Boca Raton (in press)Google Scholar
  32. Koedinger, K.R., Corbett, A.T., Ritter, S., Shapiro, L.: Carnegie learning’s cognitive tutor: Summary research results. White paper, Carnegie Learning Inc., Pittsburgh, PA (2000) e-mail: info@carnegielearning.com, web: http://www.carnegielearning.com
  33. Mathan, S.A., Koedinger, K.R.: Fostering the intelligent novice: Learning from errors with metacognitive tutoring. Educational Psychologist 40(4), 257–265 (2005)CrossRefGoogle Scholar
  34. Mitrovic, A., Mayo, M., Suraweera, P., Martin, B.: Constraint-based tutors: A success story. In: Monostori, L., Vancza, J., Ali, M. (eds.) Proceedings of the 14th International Conference on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems IEA/AIE-2001. Springer, Berlin (2001)Google Scholar
  35. Mitrovic, A., Martin, B., Suraweera, P., Zakharov, K., Milik, N., Holland, J.: ASPIRE: An authoring system and deployment environment for constraint-based tutors. International Journal of Artificial Intelligence in Education 19(2), 155–188 (2009)Google Scholar
  36. Murray, T.: An overview of intelligent tutoring system authoring tools: Updated analysis of the state of the art. In: Murray, T., Blessing, S., Ainsworth, S. (eds.) Authoring tools for advanced learning environments. Kluwer Academic Publishers, Dordrecht (2003)Google Scholar
  37. NCTM, Professional Standards for Teaching Mathematics. VA, National Council of Teachers of Mathematics, Reston (1991)Google Scholar
  38. Newell, A., Rosenbloom, P.S.: Mechanisms of skill acquisition and the law of practice. In: Anderson, J.R. (ed.) Cognitive skills and their acquisition. Erlbaum, Hillsdale (1981)Google Scholar
  39. Newell, A., Simon, H.A.: Human problem solving. Prentice Hall, Englewood Cliffs (1972)Google Scholar
  40. Ritter, S., Anderson, J.R., Koedinger, K.R., Corbett, A.: Cognitive tutor: Applied research in mathematics education. Psychonomic Bulletin & Review 14(2), 249–255 (2007)Google Scholar
  41. Roll, I., Koedinger, K., Aleven, V.: The Invention Lab: Using a hybrid of model tracing and constraint-based tutoring to offer intelligent support in inquiry environments. To appear in the Proceedings of the 10th International Conference on Intelligent Tutoring Systems, ITS 2010 (in press, 2010)Google Scholar
  42. Sweller, J., van Merriënboer, J.J.G.: Paas FGWC, Cognitive architecture and instructional design. Educational Psychology Review 10(3), 151–296 (1998)CrossRefGoogle Scholar
  43. VanLehn, K.: The behavior of tutoring systems. International Journal of Artificial Intelligence in Education 16(3), 227–265 (2006)Google Scholar
  44. VanLehn, K., Lynch, C., Schultz, K., Shapiro, J.A., Shelby, R.H., Taylor, L., Treacy, D., Weinstein, A., Wintersgill, M.: The Andes physics tutoring system: Lessons learned. International Journal of Artificial Intelligence in Education 15(3), 147–204 (2005)Google Scholar
  45. Woolf, B.P., Cunningham, P.: Building a community memory for intelligent tutoring systems. In: Forbus, K., Shrobe, H. (eds.) Proceedings of the sixth national conference on artificial intelligence. AAAI Press, Menlo Park (1987)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Vincent Aleven
    • 1
  1. 1.Human-Computer Interaction InstituteCarnegie Mellon UniversityPittsburghUSA

Personalised recommendations