Ontology Testing - Methodology and Tool

  • Eva Blomqvist
  • Azam Seil Sepour
  • Valentina Presutti
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7603)


Ontology engineering is lacking methods for verifying that ontological requirements are actually fulfilled by an ontology. There is a need for practical and detailed methodologies and tools for carrying out testing procedures and storing data about a test case and its execution. In this paper we first describe a methodology for conducting ontology testing, as well as three examples of this methodology for testing specific types of requirements. Next, we describe a tool that practically supports the methodology. We conclude that there is a need to support users in this crucial part of ontology engineering, and that our proposed methodology is a step in this direction.


Ontology engineering ontology evaluation testing 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Blomqvist, E., Presutti, V., Daga, E., Gangemi, A.: Experimenting with eXtreme Design. In: Cimiano, P., Pinto, H.S. (eds.) EKAW 2010. LNCS, vol. 6317, pp. 120–134. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  2. 2.
    Djedidi, R., Aufaure, M.-A.: ONTO-EVOAL an Ontology Evolution Approach Guided by Pattern Modeling and Quality Evaluation. In: Link, S., Prade, H. (eds.) FoIKS 2010. LNCS, vol. 5956, pp. 286–305. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  3. 3.
    Fernández, M., Gómez-Pérez, A., Juristo, N.: METHONTOLOGY: from Ontological Art towards Ontological Engineering. In: Proceedings of the AAAI 1997 Spring Symposium Series on Ontological Engineering (1997)Google Scholar
  4. 4.
    Gangemi, A., Catenacci, C., Ciaramita, M., Lehmann, J.: Modelling Ontology Evaluation and Validation. In: Sure, Y., Domingue, J. (eds.) ESWC 2006. LNCS, vol. 4011, pp. 140–154. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  5. 5.
    Gangemi, A., Presutti, V.: Ontology Design Patterns. In: Handbook on Ontologies, 2nd edn. International Handbooks on Information Systems. Springer (2009)Google Scholar
  6. 6.
    García-Ramos, S., Otero, A., Fernández-López, M.: OntologyTest: A Tool to Evaluate Ontologies through Tests Defined by the User. In: Omatu, S., Rocha, M.P., Bravo, J., Fernández, F., Corchado, E., Bustillo, A., Corchado, J.M. (eds.) IWANN 2009, Part I. LNCS, vol. 5518, pp. 91–98. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  7. 7.
    Grüninger, M., Fox, M.: Methodology for the Design and Evaluation of Ontologies. In: Proc. of IJCAI 1995, Ws. on Basic Ontological Issues in Knowledge Sharing (1995)Google Scholar
  8. 8.
    Gruninger, M., Fox, M.S.: The role of competency questions in enterprise engineering. In: Proc. of the IFIP WG5.7 Workshop on Benchmarking - Theory and Practice (1994)Google Scholar
  9. 9.
    Hamill, P.: Unit Test Frameworks - Tools for High-Quality Software Development. O’Reilly Media (2004)Google Scholar
  10. 10.
    Horridge, M.: The OWL Unit Test Framework,
  11. 11.
    Liu, Q., Lambrix, P.: Debugging the Missing Is-A Structure of Networked Ontologies. In: Aroyo, L., Antoniou, G., Hyvönen, E., ten Teije, A., Stuckenschmidt, H., Cabral, L., Tudorache, T. (eds.) ESWC 2010, Part II. LNCS, vol. 6089, pp. 478–482. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  12. 12.
    Lambrix, P., Liu, Q.: A System for Debugging is-a Structure in Networked Taxonomies. Demo at the International Semantic Web Confrerence-ISWC 2011, Bonn, Germany (2011)Google Scholar
  13. 13.
    Lopez, V., Uren, V.S., Motta, E., Pasin, M.: Aqualog: An ontology-driven question answering system for organizational semantic intranets. Journal of Web Semantics 5(2), 72–105 (2007)CrossRefGoogle Scholar
  14. 14.
    Nicola, A.D., Missikoff, M., Navigli, R.: A software engineering approach to ontology building. Journal of Information Systems 34(2), 258–275 (2009)CrossRefGoogle Scholar
  15. 15.
    Pinto, H.S., Staab, S., Tempich, C.: DILIGENT: Towards a fine-grained methodology for DIstributed, Loosely-controlled and evolvInG Engineering of oNTologies. In: Proceedings of of ECAI 2004, Valencia, Spain (2004)Google Scholar
  16. 16.
    Presutti, V., Daga, E., Gangemi, A., Blomqvist, E.: eXtreme Design with Content Ontology Design Patterns. In: Proc. of WOP 2009, Collocated with ISWC 2009. CEUR Workshop Proceedings, vol. 516 (2009)Google Scholar
  17. 17.
    Sabou, M., Fernandez, M.: Ontology (Network) Evaluation. In: Ontology Engineering in a Networked World, pp. 193–212. Springer (2012)Google Scholar
  18. 18.
    Sommerville, I.: Software Engineering, 8th edn. Addison-Wesley (2007)Google Scholar
  19. 19.
    Suarez-Figueroa, M.C., Gómez-Pérez, A., Fernández-López, M.: The NeOn Methodology for Ontology Engineering. In: Ontology Engineering in a Networked World, pp. 9–34. Springer (2012)Google Scholar
  20. 20.
    Uschold, M.: Building Ontologies: Towards a Unified Methodology. In: Proceedings of Expert Systems 1996, the 16th Annual Conference of the British Computer Society Specialist Group on Expert Systems, Cambridge, UK (December 1996)Google Scholar
  21. 21.
    Vrandečić, D., Gangemi, A.: Unit Tests for Ontologies. In: Meersman, R., Tari, Z., Herrero, P. (eds.) OTM 2006 Workshops. LNCS, vol. 4278, pp. 1012–1020. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  22. 22.
    Wang, H., Horridge, M., Rector, A.L., Drummond, N., Seidenberg, J.: Debugging OWL-DL Ontologies: A Heuristic Approach. In: Gil, Y., Motta, E., Benjamins, V.R., Musen, M.A. (eds.) ISWC 2005. LNCS, vol. 3729, pp. 745–757. Springer, Heidelberg (2005)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Eva Blomqvist
    • 1
    • 2
  • Azam Seil Sepour
    • 3
  • Valentina Presutti
    • 2
  1. 1.Linköping UniversitySweden
  2. 2.Semantic Technologies LabISTC-CNRItaly
  3. 3.Jönköping UniversitySweden

Personalised recommendations