An Assessment System on the Semantic Web

  • Sonja Radenković
  • Nenad Krdžavac
  • Vladan Devedžić
Part of the Annals of Information Systems book series (AOIS, volume 6)


This paper presents a way to develop a modern assessment system on the Semantic Web. The system is based on the IMS QTI standard (question and test interoperability) and designed by applying the model driven architecture software engineering standards. It uses the XML meta-data interchange specification and ontologies. We propose the framework for assessment systems that is reusable, extensible, and that facilitates interoperability between its component systems. The central idea here is using description logic reasoning techniques for intelligent analysis of students’ solutions of the problems they are working on during assessment sessions with the system, in order to process open-ended questions. This innovative approach can be applied in the IMS QTI standard.


Unify Modeling Language Assessment System Description Logic Item Bank Object Management Group 


  1. 1.
    ATL (2006) Atlas Tansformation Language - User Manual, verzion 0.7, ATLAS group, Nant. [Online]. Available:{\_}Manual[v0.7].pdf
  2. 2.
    Baader, F., Calvanese, D., McGuinness, D., Nardi, D., and Patel-Schneider, P. (2003) The Description Logic Handbook-Theory, Implementation and Application, Cambridge University Press, Cambridge.Google Scholar
  3. 3.
    Beshears, F.M. (2004) Open Standards and Open Source Development Strategies for e-Learning.Presentation for IS224 Strategic Computing and Communications Technology 10/2/2003. Retrieved October 11, 2004 from Educational Technology Services, University of California, Berkeley, CA.
  4. 4.
    Bezivin, J. (2004) In Search of Basic Principles for Model Driven Architecture, The European Journal for The Informatics Professional, 5(2), 21–24.MathSciNetGoogle Scholar
  5. 5.
    Bezivin, J., Jouault, F., and Paliès, J. (2005) Towards Model Transformation Design Patterns. In: Proceedings of the First European Workshop on Model Transformation (EWMT 2005), Rennes, France.Google Scholar
  6. 6.
    Blackboard (2007) Blackboard. [Online]. Available:
  7. 7.
    Dirckze, R. (spec. leader) (2002) Java Metadata Interface (JMI) Specification Version 1.0. [Online]. Available:
  8. 8.
    Desirée J B., van Bruggen, J., Hermans, H., Latour, I., Burgers, J., Giesbers B., and Koper, R. (2006) Modeling Assessment for Re-use of Traditional and New Types of Assessment [Online]. Available:
  9. 9.
    EMF (2007) Discover the Eclipse Modeling Framework (EMF) and Its Dynamic Capabilities. [Online]. Available:
  10. 10.
    Ferrario, M. and Smyth, B. (2001) Collaborative Knowledge Management and Maintenance. In: Proceedings of German Workshop of Case Based Reasoning, pp. 14–15, Germany.Google Scholar
  11. 11.
    Gorissen, P. (2003). Quickscan QTI. Retrieved November 15, 2005 from De Digitale Universiteit, Utrecht.
  12. 12.
    Horrocks, I. (1997). Optimizing Tableaux Decision Procedures for Description Logics, PhD Thesis, University of Manchester.Google Scholar
  13. 13.
    IMS Global Learning Consortium, Inc. (IMS) (2007) Official Site. [Online].
  14. 14.
    IMS QTI (2006) IMS Question & Test Interoperability. Version 2.1. Public Draft Specification. IMS Global Learning Consortium, Inc. Retrieved May 2, 2006 from
  15. 15.
    Krdzavac, N. and Devedžić, V. (2006) A Tableau Metamodel for Description Logics. In: Proceedings of 13th Workshop on Automated Reasoning (ARW 2006), pp. 7–9, Bristol, UK.Google Scholar
  16. 16.
    Lalos, P., Retalis, S., and Psaromiligkos, Y. (2005) Creating Personalised Quizzes Both to the Learner and to the Access Device Characteristics: The Case of CosyQTI. In: Third International Workshop on Authoring of Adaptive and Adaptable Educational Hypermedia (A3EH), Amsterdam.Google Scholar
  17. 17.
    Lay, S., Pierre, G., IMS Global Learning Consortium (2006b) IMS Question and Test Interoperability Implementation Guide, Version 2.1 Public draft. [Online].{\_}implv2p1pd.html
  18. 18.
    Lay, S., Pierre, G., IMS Global Learning Consortium (2006c) IMS Question and Test Interoperability Overview, Version 2.1 Public draft. [Online].{\_}oviewv2p1pd.html
  19. 19.
    Miller, P. (2004) Interoperability. What Is It and Why Should I Want It?Ariadne, 24. Retrieved March 10, 2004 from
  20. 20.
    Miller, J. and Mukerji, J. (eds.) (2006), MDA Guide Version 1.0.1, OMG, 2003, Retrieved November 25, 2006, from
  21. 21.
    MOF (2002) Meta Object Facility (MOF) Specification, v1.4, [Online]. Available:
  22. 22.
    ODM (2003) Ontology Definition Metamodel, Preliminary Revised Submission to OMG RFP ad/2003-03-40 1, 2004. [Online]. Available:
  23. 23.
    Oracle iLearning (2007) Oracle iLearning. [Online]. Available:
  24. 24.
    Poole, J. D. (2001) Model-Driven Architecture: Vision, Standards and Emerging Technologies. In: Workshop on Metamodeling and Adaptive Object Models ECOOP Google Scholar
  25. 25.
    QMP (2007) Question Mark Perception. [Online]. Available:
  26. 26.
    QVT (2002) Request for Proposal: MOF 2.0 Query/Views/Transformations RFP, OMG Document: ad/2002-04-10 2002. [Online]. Available:
  27. 27.
    Radenković, S., Krdžavac, N., and Devedžić V. (2007) A QTI Metamodel. In: Proceedings of International Multiconference on Computer Science and Information Technology, ISSN 1896-7094, pp. 1123–1132.Google Scholar
  28. 28.
    RIVA Technologies, Inc. (2007) e-Test 3. [Online]. Available:
  29. 29.
    Sclater, N. and Low, B. (2002) IMS Question and Test Interoperability: An Idiot’s Guide, CETIS Assessment Special Interest Group Version 0.5, March 2002. [Online].
  30. 30.
    Simic, G. (2004) The Multi-Courses Tutoring System Design, ComSIS, 1(1), pp. 141–155. [Online]. Available:
  31. 31.
    Sirin, E. and Parsia, B. (2004) An OWL DL Reasoner. In: Proceedings on International Workshop on Description Logics (DL2004), British Columbia, Canada.Google Scholar
  32. 32.
    UML (2007) UML 2.0 Infrastructure Overview. [Online]. Available:
  33. 33.
    UML_Profile (2007) Catalog of UML Profile. [Online]. Available:
  34. 34.
    XMI (2002) OMG XMI Specification, ver. 1.2, OMG Document Formal/02-01-01, 2002. [Online]. Available:

Copyright information

© Springer Science+Business Media, LLC 2010

Authors and Affiliations

  • Sonja Radenković
    • 1
  • Nenad Krdžavac
    • 1
  • Vladan Devedžić
    • 1
  1. 1.FON – School of Business AdministrationUniversity of BelgradeBelgradeSerbia

Personalised recommendations