Implementing CBM: SQL-Tutor After Fifteen Years



SQL-Tutor is the first constraint-based tutor. The initial conference papers about the system were published in 1998 (Mitrovic 1998a, 1998b, 1998c), with an IJAIED paper published in 1999 (Mitrovic and Ohlsson, International Journal Artificial Intelligence in Education, 10(3–4), 238–256, 1999). We published another IJAIED paper in 2003, focussed on the Web-enabled version of the same system (Mitrovic, Artificial Intelligence in Education, 13(2–4), 173–197, 2003). In this paper, we discuss the reasons for developing the system, our experiences with the early versions, and also provide a history of later projects involving SQL-Tutor.


SQL-Tutor Teaching querying Ill-defined task 



The work reported here could not have been done without the wonderful bunch of students and colleagues at ICTG. Thank you all for the discussions and friendship over the years – we have been privileged to work with you.


  1. Anderson, J. R., Boyle, C. F., Corbett, A. T., & Lewis, M. W. (1990). Cognitive modeling and intelligent tutoring. Artificial Intelligence, 42, 7–49.CrossRefGoogle Scholar
  2. Baghaei, N., & Mitrovic, A. (2006) A Constraint-based collaborative environment for learning UML class diagrams. In M. Ikeda, K. Ashley, T.-W. Chan (Eds.) Proc. 8th Int. Conf. Intelligent Tutoring Systems (pp. 176–186).Google Scholar
  3. Baghaei, N., Mitrovic, A., & Irwin, W. (2007). Supporting collaborative learning and problem-solving in a constraint-based CSCL environment for UML class diagrams. Computer-Supported Collaborative Learning, 2(2–3), 159–190.CrossRefGoogle Scholar
  4. Billingsley, W. & Robinson, P. (2005) Towards an intelligent online book for discrete mathematics. Proc. Int. Conf. Active Media Technology, (pp. 291–296).Google Scholar
  5. Billingsley, W., Robinson, P., Ashdown, M., & Hanson, C. (2004) Intelligent tutoring and supervised problem solving in the browser. Proc. Int. Conf. WWW/Internet (pp. 806–811).Google Scholar
  6. Faria, L., Silva, A., Vale, Z., & Marques, A. (2009). Training control centers’ operators in incident diagnosis and power restoration using intelligent tutoring systems. IEEE Transactions on Learning Technologies, 2(2), 135–147.CrossRefGoogle Scholar
  7. Forgy, C. L. (1982). Rete: a fast algorithm for the many pattern/many object pattern match problem. Artificial Intelligence, 19, 17–37.CrossRefGoogle Scholar
  8. Galvez, J., Guzman, E., Conejo, R. & Millan, E. (2009a) Student knowledge diagnosis using item response theory and constraint-based modeling. In V. Dimitrova, R. Mizoguchi, B. du Boulay, A. Graesser (eds.) Proc 14th Int. Conf. Artificial Intelligence in Education, (pp. 291–298).Google Scholar
  9. Galvez, J., Guzman, E., & Conejo, R. (2009b). A blended e-learning experience in a course of object oriented programming fundamentals’. Knowledge-Based Systems, 22(4), 279–286.CrossRefGoogle Scholar
  10. Holland, J., Mitrovic, A., & Martin, B. (2009) A Constraint-based tutor for java. In S.C. Kong, et al. (Eds.) Proc. 17th Int. Conf. Computers in Education (pp. 142–146).Google Scholar
  11. Kodaganallur, V., Weitz, R., & Rosenthal, D. (2005). A comparison of model-tracing and constraint-based intelligent tutoring paradigms. International Journal Artificial Intelligence in Education, 15(2), 117–144.Google Scholar
  12. Le, N-T. (2006) A constraint-based assessment approach for free-form design of class diagrams using UML. In K. Ashley, N. Pinkwart, C Lynch (Eds.) Proc. Workshop on Intelligent tutoring systems for ill-defined domains, 8th Int. Conf. ITS (pp. 11–19).Google Scholar
  13. Le, N-T., Menzel, W. & Pinkwart, N. (2009) Evaluation of a constraint-based homework assistance system for logic programming. In S.C. Kong, H. Ogata, H. C. Arnseth, C. K. K. Chan, T. Hirashima, F. Klett, J. H. M. Lee, C. C. Liu, C. K. Looi, M. Milrad, A. Mitrovic, K. Nakabayashi, S. L. Wong, S. J. H. Yang (eds.) Proc. 17th Int. Conf. Computers in Education, APSCE (pp. 51–58).Google Scholar
  14. Martin, B., & Mitrovic, A. (2002) Automatic problem generation in constraint-based tutors. In S. Cerri, G. Gouarderes, F. Paraguacu (Eds.) Proc. 6th Int. Conf on Intelligent Tutoring Systems (pp. 388–398).Google Scholar
  15. Martin, B., Mitrovic, A., & Suraweera, P. (2008). ITS domain modelling with ontology. Journal of Universal Computer Science, 14(17), 2758–2776.Google Scholar
  16. Mayo, M., & Mitrovic, A. (2001). Optimising ITS behaviour with bayesian networks and decision theory. Artificial Intelligence in Education, 12(2), 124–153.Google Scholar
  17. Menzel, W. (2006). Constraint-based modeling and ambiguity. Artificial Intelligence in Education, 16(1), 29–63.Google Scholar
  18. Mills, C. & Dalgarno, B. (2007) A conceptual model for game based intelligent tutoring systems. ICT: Providing choices for learners and learning. Proc. ASCILITE (pp. 692–701).Google Scholar
  19. Mitrovic, A. (1997). SQL-Tutor: a preliminary report. Technical Report TR-COSC 08.97, Computer Science Department, University of Canterbury.Google Scholar
  20. Mitrovic, A. (1998a) Learning SQL with a computerized tutor. 29th ACM SIGCSE Technical Symposium (pp. 307–311).Google Scholar
  21. Mitrovic, A. (1998b) A Knowledge-based teaching system for SQL. In T. Ottmann, I. Tomek (Eds.), Proc. ED-MEDIA’98, AACE, VA, 715–720 (pp. 1027–1032).Google Scholar
  22. Mitrovic, A. (1998c) Experiences in implementing constraint-based modeling in SQL-Tutor. In B. Goettl, H. Halff, C. Redfield, V. Shute (Eds.), Proc. Intelligent Tutoring Systems (pp. 414–423).Google Scholar
  23. Mitrovic, A. (2003). An Intelligent SQL tutor on the web. Artificial Intelligence in Education, 13(2–4), 173–197.Google Scholar
  24. Mitrovic, A. (2005) The effect of explaining on learning: A case study with a data normalization tutor. In C-K. Looi, G. McCalla, B. Bredeweg, J. Breuker (Eds.) Proc. Artificial Intelligence in Education (pp. 499–506).Google Scholar
  25. Mitrovic, A. (2012). Fifteen years of constraint-based tutors: what we have achieved and where we are going. User Modeling and User-Adapted Interaction, 22(1–2), 39–72.CrossRefGoogle Scholar
  26. Mitrovic, A. & Martin, B. (2000) Evaluating the effectiveness of feedback in SQL-tutor. In C. Kinshuk, T. Jesshope, Okamoto (Eds.) Proc. Workshop on Advanced Learning Technologies (pp. 143–144).Google Scholar
  27. Mitrovic, A., & Martin, B. (2007). Evaluating the effect of open student models on self-assessment. Artificial Intelligence in Education, 17(2), 121–144.Google Scholar
  28. Mitrovic, A., & Ohlsson, S. (1999). Evaluation of a constraint-based tutor for a database language. International Journal Artificial Intelligence in Education, 10(3–4), 238–256.Google Scholar
  29. Mitrovic, A., & Ohlsson, S. (2006). Critique of Kodaganallur, Weitz and Rosenthal “A comparison of model-tracing and constraint-based intelligent tutoring paradigms”. Artificial Intelligence in Education, 16(3), 277–289.Google Scholar
  30. Mitrovic, A. & Suraweera, P. (2000) Evaluating an animated pedagogical agent In G. Gauthier, C. Frasson, K. VanLehn (Eds.), Proc. Intelligent Tutoring Systems, Springer (pp. 73–82).Google Scholar
  31. Mitrovic, A., & Weerasinghe, A. (2009) Revisiting the Ill-definedness and consequences for ITSs. In V. Dimitrova, R. Mizoguchi, B. du Boulay, A Graesser (Eds.). Proc. Artificial Intelligence in Education (pp. 375–382).Google Scholar
  32. Mitrovic, A., Djordjevic-Kajan, S., & Stoimenov, L. (1996). INSTRUCT: modeling students by asking questions. User Modelling and User-Adapated Interaction, 6(4), 273–302.CrossRefGoogle Scholar
  33. Mitrovic, A., Martin, B., & Mayo, M. (2002). Using evaluation to shape ITS design: results and experiences with SQL-tutor. User Modeling and User-Adapted Interaction, 12(2–3), 243–279.MATHCrossRefGoogle Scholar
  34. Mitrovic, A., Martin, B., Suraweera, P., Zakharov, K., Milik, N., Holland, J., & McGuigan, N. (2009). ASPIRE: an authoring system and deployment environment for constraint-based tutors. Artificial Intelligence in Education, 19(2), 155–188.Google Scholar
  35. Mitrovic, A., Ohlsson, S., & Barrow, D. (2013). The effect of positive feedback in a constraint-based intelligent tutoring system. Computers & Education, 60(1), 264–272.CrossRefGoogle Scholar
  36. Oh, Y., Gross, M.D., Ishizaki, S., & Do, Y-L. (2009) Constraint-based design critic for flat-pack furniture design. In S. C. Kong, H. Ogata, H. C. Arnseth, C. K. K. Chan, T. Hirashima, F. Klett, J. H. M. Lee, C. C. Liu, C. K. Looi, M. Milrad, A. Mitrovic, K. Nakabayashi, S. L. Wong, S. J. H. Yang, (Eds.) Proc. 17th Int. Conf. Computers in Education, APSCE (pp. 19–26).Google Scholar
  37. Ohlsson, S. (1992) Constraint-based Student Modeling. Artificial Intelligence in Education, 3(4), 429–447.Google Scholar
  38. Ohlsson, S. (2008) Computational models of skill acquisition. In R. Sun (Ed.), The Cambridge handbook of computational psychology. Cabmridge University Press. (pp. 359–395)Google Scholar
  39. Ohlsson, S. (2015) Constraint-based modeling: from cognitive theory to computer tutoring – and back again. Artificial Intelligence in Education (this issue).Google Scholar
  40. Ohlsson, S., & Langley, P. (1988). Psychological evaluation of path hypotheses in cognitive diagnosis. In H. Mandl & A. Lesgold (Eds.), Learning issues for intelligent tutoring systems (pp. 42–62). New York: Springer.CrossRefGoogle Scholar
  41. Petry, P.G. & Rosatelli, M. (2006), AlgoLC: A learning companion system for teaching and learning algorithms. In M. Ikeda, K. Ashley, T.-W. Chan (Eds.), Proc. ITS 2006, LNCS 4053 (775–777).Google Scholar
  42. Poitras, G. J., & Poitras, E. G. (2013). Computer-based learning software for engineering students. Proc. Canadian Engineering Education Association.Google Scholar
  43. Riccucci, S., Carbonaro, A., & Casadei, G. (2005) An architecture for knowledge management in intelligent tutoring systems.’ Cognition and Exploratory Learning in Digital Age. Proc. IADIS Int. Cong. (pp. 473–476).Google Scholar
  44. Roll, I., Aleven, V., & Koedinger, K. (2010) The invention Lab: Using a hybrid of model tracing and constraint-based modeling to offer intelligent support in inquiry environments. V. Aleven, J. Kay, J. Mostow (Eds.): ITS 2010, Part I, LNCS 6094 (pp. 115–124).Google Scholar
  45. Rosatelli, M., & Self, J. (2004). A collaborative case study system for distance learning. Artificial Intelligence in Education, 14(1), 1–29.Google Scholar
  46. Shareghi Najar, A., & Mitrovic, A. (2013). Do novices and advanced students benefit differently from worked examples and ITS?. In L. H. Wong, C.-C. Liu, T. Hirashima, P. Sumedi, M. Lukman (Eds.), Proc. Computers in Education (pp. 20–29).Google Scholar
  47. Shareghi Najar, A., Mitrovic, A., & McLaren, B. (2014) Adaptive support versus alternating worked examples and tutored problems: Which leads to better learning? In V. Dimitrova et al. (Eds.) Proc. User Modelling, Adaptation and Personalization (pp. 171–182).Google Scholar
  48. Siddappa, M. & Manjunath, A. S. (2008) Intelligent tutor generator for intelligent tutoring systems. Proc. World Congress on Engineering and Computer Science (pp. 578–583).Google Scholar
  49. Suraweera, P., & Mitrovic, A. (2004). An intelligent tutoring system for entity relationship modelling. Artificial Intelligence in Education, 14(3–4), 375–417.Google Scholar
  50. Wang, T., Mitrovic, A. (2002) Using neural networks to predict student’s behaviour. In Kinshuk, R. Lewis, K. Akahori, R. Kemp, T. Okamoto, L. Henderson, C-H Lee (Eds.) Proc. Computers in Education (pp. 969–973).Google Scholar
  51. Zakharov, K., Mitrovic, A., & Ohlsson, S. (2005) Feedback Micro-engineering in EER-Tutor. In C-K Looi, G. McCalla, B. Bredeweg, J. Breuker (Eds.) Proc. Artificial Intelligence in Education, IOS Press (pp. 718–725).Google Scholar
  52. Zakharov, K., Mitrovic, A., & Johnston, L. (2008) Towards emotionally-intelligent pedagogical agents. In B. Woolf et al. (Eds.) Proc. Intelligent Tutoring Systems (pp. 19–28).Google Scholar
  53. Zinn, C. (2014) A lean constraint-based system to support intelligent tutoring. Proc.14th IEEE Int. Conf. Advanced Learning Technologies (pp. 52–53).Google Scholar

Copyright information

© International Artificial Intelligence in Education Society 2015

Authors and Affiliations

  1. 1.Intelligent Computer Tutoring Group, Department of Computer Science and Software EngineeringUniversity of CanterburyChristchurchNew Zealand
  2. 2.Department of PsychologyUniversity of Illinois at ChicagoChicagoUSA

Personalised recommendations