A Qualitative and Quantitative Evaluation of Adaptive Authoring of Adaptive Hypermedia

  • Maurice Hendrix
  • Alexandra Cristea
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4753)


Currently, large amounts of research exist into the design and implementation of adaptive systems. The complex task of authoring of such systems, or their evaluation, is addressed less. We have looked into the causes of this complexity. Manual annotation is a serious bottleneck for authoring of adaptive hypermedia. All means for supporting this authoring process by reusing automatically generated metadata would therefore be helpful. Previously, we proposed the integration of a generic Adaptive Hypermedia authoring environment, MOT, into a semantic desktop environment, indexed by Beagle++. Based upon this approach, a prototype was constructed. The approach in general, as well as the prototype in particular, where evaluated through both qualitative and quantitative experiments. This paper is a synthesis of our work so far, describing theoretical findings and hypotheses, their implementation in short, and finally, the combined results of the evaluations.


Authoring Adaptive Educational Hypermedia CAF Evaluation Metadata RDF Semantic Desktop Semi-automatic adding MOT Beagle++ 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Beagle website (viewed March 21, 2007),
  2. 2.
    Beagle++ website (viewed March 21, 2007),
  3. 3.
    Brailsford, T.J., Ashman, H.L., Stewart, C.D., Zakaria, M.R., Moore, A.: User Control of Adaptation in an Automated Web-Based Learning Environment. In: ICITA 2002. First International Conference on Information Technology & Applications, Bathurst, Australia (2002)Google Scholar
  4. 4.
    Broekstra, J., Kampman, A.: SeRQL: An RDF Query and Transformation (viewed March 21, 2007),
  5. 5.
    Brooke, J.: SUS: a quick and dirty usability scale. In: Jordan, P.W., Thomas, B., Weerdmeester, B.A., McClelland, A.L. (eds.) Usability Evaluation in Industry, Taylor and Francis, London (1996)Google Scholar
  6. 6.
    Brusilovsky, P.: Adaptive hypermedia, User Modelling and User Adapted Interaction. In: Kobsa, A. (ed.) Ten Year Anniversary vol. 11 (1/2), pp. 87–110 (2001)Google Scholar
  7. 7.
    Celik, I., Stewart, C., Ashman, H.: Interoperability as an Aid to Authoring: Accessing User Models in Multiple AEH Systems. In: Proceedings of A3H: 1st International Workshop on Authoring of Adaptive and Adaptable Hypermedia (2006)Google Scholar
  8. 8.
    Chirita, P.-A., Costache, S., Nejdl, W., Paiu, R.: Beagle++ Semantically Enhanced Searching and Ranking on the Desktop. In: Proceedings of the 3rd European Semantic Web Conference, Budva, Montenegro (2006)Google Scholar
  9. 9.
    Chirita, P.-A., Gavriloaie, R., Ghita, S., Nejdl, W., Paiu, R.: Activity-Based Metadata for Semantic Desktop Search. In: Proceedings of the 2nd European Semantic Web Conference, Heraklion, Crete (2005)Google Scholar
  10. 10.
    Cristea, A.I., De Mooij, A.: Adaptive Course Authoring: My Online Teacher. In: Proceedings of ICT 2003, Papeete, French Polynesia (2003)Google Scholar
  11. 11.
    Cristea, A.I., De Mooij, A.: LAOS: Layered WWW AHS Authoring Model and their corresponding Algebraic Operators. In: WWW 2003 (The Twelfth International World Wide Web Conference), Alternate Track on Education, Budapest, Hungary (2003)Google Scholar
  12. 12.
    Cristea, A.I., Smits, D., De Bra, P.: Writing MOT, Reading AHA! - converting between an authoring and a delivery system for adaptive educational hypermedia. In: AIED 2005. A3EH Workshop, The Netherlands, Amsterdam (2005)Google Scholar
  13. 13.
    Cristea, A.I., Stewart, C.: Automatic Authoring of Adaptive Educational Hypermedia. In: Web-Based Intelligent e-Learning Systems: Technologies and Applications, IDEA Publishing group, Zongmin Ma (2005)Google Scholar
  14. 14.
    Hendrix, M., Cristea, A.I.: Evaluating Adaptive authoring of Adaptive Hypermedia. In: A3EH: 5th International Workshop on Authoring of Adaptive & Adaptable Educational Hypermedia, the 11th Internat. Conf. on User Modeling, Corfu Greece (2007)Google Scholar
  15. 15.
    Hendrix, M., Cristea, A.I., Joy, M.S.: Evaluating the automatic and manual creation process of adaptive lessons. In: ICALT. The 7th IEEE International Conference on Advanced Learning Technologies, Niigata, Japan (2007)Google Scholar
  16. 16.
    Hendrix, M., Cristea, A.I., Nejdl, W.: Authoring Adaptive Learning Material on the Semantic Desktop. In: 1st International Workshop on Authoring of Adaptive and Adaptable Hypermedia, Adaptive Hypermedia Dublin Ireland (2006)Google Scholar
  17. 17.
    Hendrix, M., Cristea, A.I., Nejdl, W.: Automatic and Manual Annotation Using Flexible Schemas for Adaptation on the Semantic Desktop. In: Nejdl, W., Tochtermann, K. (eds.) EC-TEL 2006. LNCS, vol. 4227, Springer, Heidelberg (2006)Google Scholar
  18. 18.
    Hendrix, M., Cristea, A.I., Nejdl, W.: Authoring Adaptive Educational Hypermedia on the Semantic Desktop. International Journal of Learning Technologies (IJLT) (to appear, 2007)Google Scholar
  19. 19.
    MOT homepage (viewed March 21, 2007),
  20. 20.
    Nielsen, J.: Usability Engineering. Academic Press, Boston (1993)zbMATHGoogle Scholar
  21. 21.
    Schlieder, T., Naumann, F.: Approximate tree embedding for querying cml data. In: ACM SIGIR Workshop on CML and Information RetrievalGoogle Scholar
  22. 22.
    Semantic Desktop (viewed March 21, 2007),

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Maurice Hendrix
    • 1
  • Alexandra Cristea
    • 1
  1. 1.Department of Computer Science, The University of Warwick, Coventry CV4 7ALUnited Kingdom

Personalised recommendations