Abstract
Ontologies are an essential component of semantic knowledge bases and applications, and nowadays they are used in a plethora of domains. Despite the maturity of ontology languages, support tools and engineering techniques, the testing and validation of ontologies is a field which still lacks consolidated approaches and tools. This paper attempts at partly bridging that gap, taking a first step towards the extension of some traditional software testing techniques to ontologies expressed in a widely-used format. Mutation testing and coverage testing, revisited in the light of the peculiar features of the ontology language and structure, can can assist in designing better test suites to validate them, and overall help in the engineering and refinement of ontologies and software based on them.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Quillian, M.R.: Word concepts: a theory and simulation of some basic semantic capabilities. Behav. Sci. 12, 410–430 (1967)
World Wide Web Consortium (W3C): RDF 1.1 concepts and abstract syntax (2014)
World Wide Web Consortium (W3C): OWL 2 Web Ontology Language document overview, 2nd edn. (2012)
Antoniou, G., van Harmelen, F.: Web Ontology Language: OWL. In: Staab, S., Studer, R. (eds.) Handbook on Ontologies. International Handbooks on Information Systems, pp. 67–92. Springer, Heidelberg (2004)
Horrocks, I.: DAML+OIL: a description logic for the semantic web. Bull. Tech. Committee Data Eng. 25, 4–9 (2002)
Horrocks, I.: What are ontologies good for? In: Küppers, B.O., Hahn, U., Artmann, S. (eds.) Evolution of Semantic Systems, pp. 175–188. Springer, Heidelberg (2013)
Rospocher, M., Serafini, L.: An ontological framework for decision support. In: Takeda, H., Qu, Y., Mizoguchi, R., Kitamura, Y. (eds.) JIST 2012. LNCS, vol. 7774, pp. 239–254. Springer, Heidelberg (2013). doi:10.1007/978-3-642-37996-3_16
Kershenbaum, A., Fokoue, A., Patel, C., Welty, C., Schonberg, E., Cimino, J., Ma, L., Srinivas, K., Schloss, R., Murdock, J.W.: A view of OWL from the field: use cases and experiences. In: Cuenca Grau, B., Hitzler, P., Shankey, C., Wallace, E. (eds.) Proceedings of the Second Workshop on OWL: Experiences and Directions (OWLED), vol. 216. CEUR Workshop Proceedings (2006)
Blomqvist, E., Seil Sepour, A., Presutti, V.: Ontology testing - methodology and tool. In: Teije, A., Völker, J., Handschuh, S., Stuckenschmidt, H., d’Acquin, M., Nikolov, A., Aussenac-Gilles, N., Hernandez, N. (eds.) EKAW 2012. LNCS, vol. 7603, pp. 216–226. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33876-2_20
World Wide Web Consortium (W3C): OWL Web Ontology Language test cases (2004)
Wang, H., Horridge, M., Rector, A., Drummond, N., Seidenberg, J.: Debugging OWL-DL ontologies: a heuristic approach. In: Gil, Y., Motta, E., Benjamins, V.R., Musen, M.A. (eds.) ISWC 2005. LNCS, vol. 3729, pp. 745–757. Springer, Heidelberg (2005). doi:10.1007/11574620_53
García-Ramos, S., Otero, A., Fernández-López, M.: OntologyTest: a tool to evaluate ontologies through tests defined by the user. In: Omatu, S., Rocha, M.P., Bravo, J., Fernández, F., Corchado, E., Bustillo, A., Corchado, J.M. (eds.) IWANN 2009. LNCS, vol. 5518, pp. 91–98. Springer, Heidelberg (2009). doi:10.1007/978-3-642-02481-8_13
McGuinness, D.L., Fikes, R., Rice, J., Wilder, S.: An environment for merging and testing large ontologies. In: Proceedings of the Seventh International Conference on Principles of Knowledge Representation and Reasoning (KR 2000), pp. 483–493 (2000)
Gangemi, A., Catenacci, C., Ciaramita, M., Lehmann, J.: Modelling ontology evaluation and validation. In: Sure, Y., Domingue, J. (eds.) ESWC 2006. LNCS, vol. 4011, pp. 140–154. Springer, Heidelberg (2006). doi:10.1007/11762256_13
Burton-Jones, A., Storey, V.C., Sugumaran, V., Ahluwalia, P.: A semiotic metrics suite for assessing the quality of ontologies. Data Knowl. Eng. 55, 84–102 (2005)
Ma, L., Yang, Y., Qiu, Z., Xie, G., Pan, Y., Liu, S.: Towards a complete OWL ontology benchmark. In: Sure, Y., Domingue, J. (eds.) ESWC 2006. LNCS, vol. 4011, pp. 125–139. Springer, Heidelberg (2006). doi:10.1007/11762256_12
Guarino, N.: An overview of ontoclean. In: Staab, S., Studer, R. (eds.) Handbook on Ontologies. International Handbooks on Information Systems, 2nd edn, pp. 201–220. Springer, Heidelberg (2009)
Poveda-Villalón, M., Suárez-Figueroa, M.C., Gómez-Pérez, A.: Validating ontologies with OOPS!. In: Teije, A., Völker, J., Handschuh, S., Stuckenschmidt, H., d’Acquin, M., Nikolov, A., Aussenac-Gilles, N., Hernandez, N. (eds.) EKAW 2012. LNCS, vol. 7603, pp. 267–281. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33876-2_24
Poveda, M., Suárez-Figueroa, M.C., Gómez-Pérez, A.: Common pitfalls in ontology development. In: Meseguer, P., Mandow, L., Gasca, R.M. (eds.) CAEPIA 2009. LNCS, vol. 5988, pp. 91–100. Springer, Heidelberg (2010). doi:10.1007/978-3-642-14264-2_10
Vrandečić, D., Gangemi, A.: Unit tests for ontologies. In: Meersman, R., Tari, Z., Herrero, P. (eds.) OTM 2006. LNCS, vol. 4278, pp. 1012–1020. Springer, Heidelberg (2006). doi:10.1007/11915072_2
Granitzer, M., Scharl, A., Weichselbraun, A., Neidhart, T., Juffinger, A., Wohlgenannt, G.: Automated ontology learning and validation using hypothesis testing. In: Wegrzyn-Wolska, K.M., Szczepaniak, P.S. (eds.) Advances in Intelligent Web Mastering. Advances in Soft Computing, vol. 43, pp. 130–135. Springer, Heidelberg (2007)
Lee, S., Bai, X., Chen, Y.: Automatic mutation testing and simulation on OWL-S specified web services. In: Proceedings of the 41st Annual Simulation Symposium (ANSS), pp. 149–156. IEEE (2008)
World Wide Web Consortium (W3C): OWL-S: Semantic markup for web services (2004)
Wang, Y., Bai, X., Li, J., Huang, R.: Ontology-based test case generation for testing web services. In: Proceedings of the 8th International Symposium on Autonomous Decentralized Systems (ISADS), pp. 43–50 (2007)
DeMillo, R.A., Lipton, R.J., Sayward, F.G.: Hints on test data selection: help for the practicing programmer. Computer 11, 34–41 (1978)
Hamlet, R.G.: Testing programs with the aid of a compiler. IEEE Trans. Softw. Eng. SE-3, 279–290 (1977)
Lipton, R.: Fault diagnosis of computer programs. Technical report. Carnegie Mellon University (1971)
Ammann, P., Offutt, A.J.: 5. In: Syntax-Based Testing, pp. 170–212. Cambridge University Press, Cambridge (2008)
Howden, W.E.: Weak mutation testing and completeness of test sets. IEEE Trans. Softw. Eng. SE-8, 371–379 (1982)
Jia, Y., Harman, M.: An analysis and survey of the development of mutation testing. IEEE Trans. Software Eng. 37, 649–678 (2011)
Offutt, A.J.: A practical system for mutation testing: help for the common programmer. In: Proceedings of the International Test Conference (ITC). IEEE Computer Society, pp. 824–830 (1994)
Offutt, A.J., Untch, R.H.: Mutation 2000: Uniting the orthogonal. In: Wong, W.E. (ed.) Mutation Testing for the New Century. The Springer International Series on Advances in Database Systems, vol. 24, pp. 34–44. Springer, US (2001)
Bartolini, C., Bertolino, A., Marchetti, E., Parissis, I.: Data flow-based validation of web services compositions: perspectives and examples. In: Lemos, R., Giandomenico, F., Gacek, C., Muccini, H., Vieira, M. (eds.) WADS 2007. LNCS, vol. 5135, pp. 298–325. Springer, Heidelberg (2008). doi:10.1007/978-3-540-85571-2_13
Ma, Y.S., Offutt, A.J., Kwong, Y.R.: Mujava: an automated class mutation system. Softw. Test. Verification Reliab. 15, 97–133 (2005)
Offutt, A.J., Lee, A., Rothermel, G., Untch, R.H., Zapf, C.: An experimental determination of sufficient mutant operators. ACM Trans. Softw. Eng. Methodol. (TOSEM) 5, 99–118 (1996)
Offutt, A.J., Hayes, J.H.: A semantic model of program faults. SIGSOFT Softw. Eng. Notes 21, 195–200 (1996)
Mottu, J.-M., Baudry, B., Traon, Y.: Mutation analysis testing for model transformations. In: Rensink, A., Warmer, J. (eds.) ECMDA-FA 2006. LNCS, vol. 4066, pp. 376–390. Springer, Heidelberg (2006). doi:10.1007/11787044_28
Clark, J.A., Dan, H., Hierons, R.M.: Semantic mutation testing. In: Proceedings of the 3rd IEEE International Conference on Software Testing, Verification, and Validation Workshops (ICSTW), pp. 100–109. IEEE (2010)
Horridge, M., Drummond, N., Goodwin, J., Rector, A., Stevens, R., Wang, H.H.: The manchester OWL syntax. In: OWL: Experiences and Directions Workshop (OWLED) (2006)
Zhu, H., Hall, P.A.V., May, J.H.R.: Software unit test coverage and adequacy. ACM Comput. Surv. 29, 366–427 (1997)
Yang, Q., Jenny Li, J., Weiss, D.M.: A survey of coverage-based testing tools. Comput. J. 52, 589–597 (2009)
Ledgard, H.F., Marcotty, M.: A genealogy of control structures. Commun. ACM 18, 629–639 (1975)
Huang, J.C.: An approach to program testing. ACM Comput. Surv. 7, 113–128 (1975)
Chow, T.S.: Testing software design modeled by finite-state machines. IEEE Trans. Software Eng. 4, 178–187 (1978)
Osterweil, L.J.: Data flow analysis as an aid in documentation, assertion, generation, validation, and error detection. Technical Report CU-CS-055-74, University of Colorado, Boulder, Colorado 80302 (1974)
Ammann, P., Offutt, A.J.: 2. In: Graph Coverage, pp. 27–103. Cambridge University Press, Cambridge (2008)
Tikir, M.M., Hollingsworth, J.K.: Efficient instrumentation for code coverage testing. In: Proceedings of the ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA), pp. 86–96 (2002)
Ammann, P., Offutt, A.J.: 8. In: Building Testing Tools, pp. 268–279. Cambridge University Press, Cambridge (2008)
Bartolini, C., Muthuri, R.: Reconciling data protection rights and obligations: an ontology of the forthcoming EU regulation. In: Proceedings of the Workshop on Language and Semantic Technology for Legal Domain (LST4LD), Recent Advances in Natural Language Processing (RANLP) (2015)
Bartolini, C., Muthuri, R., Santos, C.: Using ontologies to model data protection requirements in workflows. In: Proceedings of the Ninth International Workshop on Juris-informatics (JURISIN), pp. 27–40 (2015). Extended version to be published in LNAI book
Reding, V.: The upcoming data protection reform for the European Union. International Data Privacy Law (2010)
Rodríguez-Doncel, V., Santos, C., Casanovas, P.: A model of air transport passenger incidents and rights. In: Proceedings of the 27th International Conference on Legal Knowledge and Information Systems (JURIX), pp. 55–60. IOS Press (2014)
Rodríguez-Doncel, V., Santos, C., Casanovas, P.: Ontology-driven legal support-system in the air transport passenger domain. In: Proceedings of the International Workshop on Semantic Web for the Law (SW4Law) (2014)
World Wide Web Consortium (W3C): RDF 1.1 Turtle (2014)
World Wide Web Consortium (W3C): Sparql query language for rdf (2008)
Bartolini, C.: Mutating OWLs: semantic mutation testing for ontologies. In: Proceedings of the workshop on domAin specific Model-based AppRoaches to vErificaTion and validaTiOn (AMARETTO), pp. 43–53 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Bartolini, C. (2017). Software Testing Techniques Revisited for OWL Ontologies. In: Hammoudi, S., Pires, L., Selic, B., Desfray, P. (eds) Model-Driven Engineering and Software Development. MODELSWARD 2016. Communications in Computer and Information Science, vol 692. Springer, Cham. https://doi.org/10.1007/978-3-319-66302-9_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-66302-9_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-66301-2
Online ISBN: 978-3-319-66302-9
eBook Packages: Computer ScienceComputer Science (R0)