Evaluating the Inference Mechanism of Adaptive Learning Systems

  • Stephan Weibelzahl
  • Gerhard Weber
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2702)


The evaluation of user modeling systems is an important though often neglected area. Evaluating the inference of user properties can help to identify failures in the user model. In this paper we propose two methods to assess the accuracy of the user model. The assumptions about the user might either be compared to an external test, or might be used to predict the users’ behavior. Two studies with five adaptive learning courses demonstrate the usefulness of the approach.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Weibelzahl, S.: Evaluation of adaptive systems. In Bauer, M., Gmytrasiewicz, P.J., Vassileva, J., eds.: User Modeling: Proceedings of the Eighth International Conference, UM2001. Springer, Berlin (2001) 292–294Google Scholar
  2. 2.
    Eklund, J.: A Study of Adaptive Link Annotation in Educational Hypermedia. PhD thesis, University of Sydney (1999)Google Scholar
  3. 3.
    Höök, K.: Steps to take before intelligent user interfaces become real. Interacting With Computers 12 (2000) 409–426CrossRefGoogle Scholar
  4. 4.
    Brusilovsky, P.: Adaptive hypermedia. User Modeling and User-Adapted Interaction 11 (2001) 87–110zbMATHCrossRefGoogle Scholar
  5. 5.
    Oppermann, R., Rashev, R., Kinshuk: Adaptability and adaptivity in learning systems. In Behrooz, A., ed.: Knowledge Transfer. Volume II. (1997) 173–179Google Scholar
  6. 6.
    Weber, G., Kuhl, H.C., Weibelzahl, S.: Developing adaptive internet based courses with the authoring system NetCoach. In Reich, S., Tzagarakis, M.M., de Bra, P., eds.: Hypermedia: Openness, Structural Awareness, and Adaptivity. Springer, Berlin (2001) 226–238Google Scholar
  7. 7.
    de Bra, P., Calvi, L.: AHA! An open adaptive hypermedia architecture. The New Review of Hypermedia and Multimedia 4 (1998) 115–139CrossRefGoogle Scholar
  8. 8.
    Brusilovsky, P., Eklund, J., Schwarz, E.: Web-based education for all: A tool for developing adaptive courseware. In: Computer Networks and ISDN Systems. Proceedings of the Seventh International World Wide Web Conference, 14–18 April 1998. Volume 30. (1998) 291–300Google Scholar
  9. 9.
    Ardissono, L., Goy, A.: Tailoring the interaction with users in electronic shops. In Kay, J., ed.: User Modeling: Proceedings of the Seventh International Conference, UM99. Springer, Vienna, New York (1999) 35–44Google Scholar
  10. 10.
    Trewin, S., Pain, H.: Dynamic modelling of keyboard skills: Supporting users with motor disabilities. In Jameson, A., Paris, C., Tasso, C., eds.: User Modeling: Proceedings of the Sixth International Conference, UM97. Springer, Vienna, New York (1997) 135–146 Available from Scholar
  11. 11.
    Agresti, A.: An introduction to categorical data analysis. Wiley, New York (1996)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Stephan Weibelzahl
    • 1
  • Gerhard Weber
    • 1
  1. 1.Pedagogical University FreiburgFreiburgGermany

Personalised recommendations