Advertisement

User Evaluation Study of a Tagging Approach to Semantic Mapping

  • Colm Conroy
  • Rob Brennan
  • Declan O’Sullivan
  • Dave Lewis
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5554)

Abstract

A key aspect of semantic interoperability is the semantic mapping process itself. Traditionally, semantic mapping processes conducted by knowledge engineers have been proposed to bridge this gap. However, knowledge engineers alone are unlikely to cope with the ever increasing amount of mapping work required, especially as mappings themselves begin to be specialised for different contexts. One solution is to develop new mapping processes that enable users to participate in the mapping process themselves. In this paper we present an evaluation study of our user-driven tagging approach to the semantic mapping process. In our approach, users actively participate in generating mappings by categorising automatically generated candidate matches presented in natural language over a long time period. In the evaluation study three groups of users generated mappings between their personal ontologies and a sports ontology describing sports news content from RSS feeds. The mapping process was embedded within the users’ work environment as a Firefox browser extension. The study is discussed, focusing on whether the mapping process is unintrusive, engaging and simplified for the user. The evaluation results were promising and indicate that people with various levels of expertise could become active in the semantic mapping process.

References

  1. 1.
    Dimitrova, V., Denaux, R., Hart, G., Dolbear, C., Holt, I., Cohn, A.G.: Involving Domain Experts in Authoring OWL Ontologies. In: Sheth, A., Staab, S., Dean, M., Paolucci, M., Maynard, D., Finin, T., Thirunarayan, K. (eds.) ISWC 2008. LNCS, vol. 5318, pp. 1–16. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  2. 2.
    Falconer, S.M., Storey, M.: A Cognitive Support Framework for Ontology Mapping. In: Aberer, K., Choi, K.-S., Noy, N., Allemang, D., Lee, K.-I., Nixon, L., Golbeck, J., Mika, P., Maynard, D., Mizoguchi, R., Schreiber, G., Cudré-Mauroux, P. (eds.) ASWC 2007 and ISWC 2007. LNCS, vol. 4825, pp. 114–127. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  3. 3.
    Noy, N.: Semantic Integration: A Survey of Ontology-Based Approaches. ACM SIGMOD Record 33(4), 65–70 (2004)CrossRefGoogle Scholar
  4. 4.
    Huhns, M., Stephens, L.: Personal Ontologies. IEEE Internet Computing 3(5), 85–87 (1999)CrossRefGoogle Scholar
  5. 5.
    Euzenat, J., Shvaiko, P.: Ontology Matching. Springer, Heidelberg (2007)zbMATHGoogle Scholar
  6. 6.
    Shvaiko, P., Euzenat, J.: Ten Challenges for Ontology Matching. In: Meersman, R., Tari, Z. (eds.) ODBASE 2008. LNCS, vol. 5332, pp. 1164–1182. Springer, Heidelberg (2008)Google Scholar
  7. 7.
    Jameson, A.: Usability and the Semantic Web. In: Sure, Y., Domingue, J. (eds.) ESWC 2006. LNCS, vol. 4011, p. 3. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  8. 8.
    Lambrix, P., Edberg, A.: Evaluation of ontology merging tools in bioinformatics. In: Pacific Symposium on Biocomputing 2003, pp. 589–600. World Scientific, Singapore (2003)Google Scholar
  9. 9.
    Robertson, G.G., Czerwinski, M.P., Churchill, J.E.: Visualization of mappings between schemas. In: CHI 2005: Proceedings of the SIGCHI conference on human factors in computing systems, pp. 431–439. ACM Press, New York (2005)Google Scholar
  10. 10.
    Bernstein, P.A., Melnik, S., Churchill, J.E.: Incremental Schema Matching. In: VLDB, pp. 1167–1170 (2006)Google Scholar
  11. 11.
    Mocan, A., Cimpian, E., Kerrigan, M.: Formal Model for Ontology Mapping Creation. In: Cruz, I., Decker, S., Allemang, D., Preist, C., Schwabe, D., Mika, P., Uschold, M., Aroyo, L.M. (eds.) ISWC 2006. LNCS, vol. 4273, pp. 459–472. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  12. 12.
    Shvaiko, P., Giunchiglia, F., da Silva, P.P., McGuinness, D.L.: Web Explanations for Semantic Heterogeneity Discovery. In: Gómez-Pérez, A., Euzenat, J. (eds.) ESWC 2005. LNCS, vol. 3532, pp. 303–317. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  13. 13.
    Kaufmann, E., Bernstein, A.: How Useful are Natural Language Interfaces to the Semantic Web for Casual End-users? In: Aberer, K., Choi, K.-S., Noy, N., Allemang, D., Lee, K.-I., Nixon, L., Golbeck, J., Mika, P., Maynard, D., Mizoguchi, R., Schreiber, G., Cudré-Mauroux, P. (eds.) ASWC 2007 and ISWC 2007. LNCS, vol. 4825, pp. 281–294. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  14. 14.
    Soantag, D.: Towards Dialogue-Based Interactive Semantic Mediation in the Medical Domain. In: 3rd International Workshop on Ontology Matching (OM 2008) at ISWC 2008 (2008)Google Scholar
  15. 15.
    Groza, T., Handschuh, S., Moeller, K., Grimnes, G., Sauermann, L., Minack, E., Mesnage, C., Jazayeri, M., Reif, G., Gudjonsdottir, R.: The NEPOMUK Project – On the way to the Social Semantic Desktop. In: Pellegrini, T., Schaffert, S. (eds.) Proceedings of I-Semantics 2007, JUCS, pp. 201–211 (2007)Google Scholar
  16. 16.
    Szonszor, M., Alani, H., Contador, I., O’Hara, K., Shadbolt, N.: Semantic Modelling of User Interest Based on Cross-Folksonomy Analysis. In: Sheth, A., Staab, S., Dean, M., Paolucci, M., Maynard, D., Finin, T., Thirunarayan, K. (eds.) ISWC 2008. LNCS, vol. 5318, pp. 632–648. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  17. 17.
    Golder, S.A., Huberman, B.A.: Usage patterns of collaborative tagging systems. J. Information Science 32, 198–208 (2006)CrossRefGoogle Scholar
  18. 18.
    Li, X., Guo, L., Zhao, Y.E.: Tag-based social interest discovery. In: Proc. 19th Int. World Wide Web Conf. (WWW), Beijing, China (2008)Google Scholar
  19. 19.
    Conroy, C., O’Sullivan, D., Lewis, D.: Ontology Mapping Through Tagging. In: International Workshop on Ontology Alignment and Visualisation, CISIS 2008, pp. 886–891 (2008) ISBN 0-7695-3109-1 Google Scholar
  20. 20.
    Conroy, C.: Towards Semantic Mapping for Casual Web Users. In: Sheth, A., Staab, S., Dean, M., Paolucci, M., Maynard, D., Finin, T., Thirunarayan, K. (eds.) ISWC 2008. LNCS, vol. 5318, pp. 907–913. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  21. 21.
    Euzenat, J.: An API for ontology alignment. In: McIlraith, S.A., Plexousakis, D., van Harmelen, F. (eds.) ISWC 2004. LNCS, vol. 3298, pp. 698–712. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  22. 22.
    Conroy, C., O’Sullivan, D., Lewis, D.: A Tagging Approach to Ontology Mapping. In: 2nd International Workshop on Ontology Mapping (OM 2007) at ISWC 2007 (2007)Google Scholar
  23. 23.
    Tullis, T.S., Stetson, J.N.: A comparison of questionnaires for assessing website usability. In: Usability Professionals’ Association Conference, Minneapolis, Minnesota (June 2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Colm Conroy
    • 1
  • Rob Brennan
    • 1
  • Declan O’Sullivan
    • 1
  • Dave Lewis
    • 1
  1. 1.Knowledge and Data Engineering GroupTrinity College DublinIreland

Personalised recommendations