Data Triangulation in a User Evaluation of the Sealife Semantic Web Browsers

  • Helen Oliver
  • Patty Kostkova
  • Ed de Quincey
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 27)


There is a need for greater attention to triangulation of data in user-centred evaluation of Semantic Web Browsers. This paper discusses triangulation of data gathered during development of a novel framework for user-centred evaluation of Semantic Web Browsers. The data was triangulated from three sources: quantitative data from web server logs and questionnaire results, and qualitative data from semi-structured interviews. This paper shows how triangulation was essential in validation and completeness of the results, and was indispensable in ensuring accurate interpretation of the results in determining user satisfaction.


Semantic Web Browsers User Evaluation Data Triangulation Healthcare Ontologies Sealife 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Berners-Lee, T., Hendler, T., Lassila, O.: The Semantic Web. Scientific American 284, 34–43 (2001)CrossRefGoogle Scholar
  2. 2.
    Schroeder, M., Burger, A., Kostkova, P., Stevens, R., Habermann, B., Dieng-Kuntz, R.: From a Service-based eScience Infrastructure to a Semantic Web for the Life Sciences: The SeaLife Project. In: Workshop on network tools and applications in biology, NETTAB 2006, Pula, Italy (2006)Google Scholar
  3. 3.
    Oliver, H., Diallo, G., de Quincey, E., Alexopoulou, D., Habermann, B., Kostkova, P., Schroeder, M., Jupp, S., Khelif, K., Stevens, R., Jawaheer, G., Madle, G.: A User-Centred Evaluation Framework For The Sealife Semantic Web Browsers. BMC Bioinformatics, Special Issue (in press, 2009)Google Scholar
  4. 4.
    Madle, G., Kostkova, P., Mani-Saada, J., Roy, A.: Lessons Learned From Evaluation of The Use of The National Electronic Library of Infection. Health Informatics Journal 12, 137–151 (2006)CrossRefPubMedGoogle Scholar
  5. 5.
    Machan, C., Ammenwerth, E., Schabetsberger, T.: Evaluation of the Electronic Transmission of Medical Findings from Hospitals to Practitioners by Triangulation. Methods of Information in Medicine 44, 225–233 (2005)Google Scholar
  6. 6.
    Ammenwerth, E., Iller, C., Mansmann, U.: Can evaluation studies benefit from triangulation? A case study. International Journal of Medical Informatics 70, 237–248 (2003)CrossRefPubMedGoogle Scholar
  7. 7.
    Ammenwerth, E., Gräber, S., Bürkle, T., Iller, C.: Evaluation of Health Information Systems: Challenges and Approaches. In: Spil, T.A.M., Schuring, R.W. (eds.) E-health systems diffusion and use, pp. 212–236. IGI (2005)Google Scholar
  8. 8.
    Reichert, M., Linckels, S., Meinel, C., Engel, T.: Student’s Perception of A Semantic Search Engine. In: Proceedings of the IADIS Cognition And Exploratory Learning In Digital Age (CELDA 2005), Porto, Portugal, pp. 139–147 (2005)Google Scholar
  9. 9.
    Uren, V., Motta, E., Dzbor, M., Cimiano, P.: Browsing For Information By Highlighting Automatically Generated Annotations: A User Study And Evaluation. In: K-CAP 2005: Proceedings of the 3rd International Conference on Knowledge Capture, pp. 75–82. ACM Press, New York (2005)Google Scholar
  10. 10.
    Hoeber, O., Yang, X.D.: User-Oriented Evaluation Methods for Interactive Web Search Interfaces. In: 2007 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology Workshops, pp. 239–243. IEEE CS Press, Los Alamitos (2007)CrossRefGoogle Scholar
  11. 11.
    Yesilada, Y., Bechhofer, S., Horan, B.: Dynamic Linking of Web Resources: Customisation and Personalisation. In: Wallace, M., Angelides, M.C., Mylonas, P. (eds.) Advances in Semantic Media Adaptation And Personalization. Springer Series on Studies in Computational Intelligence, vol. 93, pp. 1–24. Springer, Berlin (2008)CrossRefGoogle Scholar
  12. 12.
    Diallo, G., Khelif, K., Corby, O., Kostkova, P., Madle, G.: Semantic Browsing of a Domain Specific Resources: The Corese-NeLI Framework. In: IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent technology, WI-IAT 2008, pp. 50–54. IEEE, Sydney (2008)CrossRefGoogle Scholar
  13. 13.
    Doms, A., Schroeder, M.: GoPubMed: Exploring Pub. Med. with the Gene. Ontology. Nucleic Acids Research 33 (Web Server Issue), W783–W786 (2005)CrossRefGoogle Scholar
  14. 14.
    Diallo, G., Kostkova, P., Jawaheer, G., Jupp, S., Stevens, R.: Process of Building a Vocabulary for the Infection Domain. In: 21st IEEE International Symposium on Computer-Based Medical Systems, pp. 308–313. IEEE, Los Alamitos (2008)CrossRefGoogle Scholar
  15. 15.
  16. 16.
    Denzin, N.: Strategies of Multiple Triangulation. In: Denzin, N. (ed.) The Research Act. a theoretical introduction for sociological methods, pp. 297–331. Aldine, Chicago (1970)Google Scholar
  17. 17.
    Greene, J., McClintock, C.: Triangulation in Evaluation. Evaluation Review 9, 523–545 (2005)CrossRefGoogle Scholar
  18. 18.
    Brown, S., Ross, R., Gerrard, D., Greengrass, M., Bryson, J.: RePAH: A User Requirements Analysis for Portals in the Arts and Humanities - Final Report. Arts & Humanities Research Council, UK (2006)Google Scholar

Copyright information

© ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering 2010

Authors and Affiliations

  • Helen Oliver
    • 1
  • Patty Kostkova
    • 1
  • Ed de Quincey
    • 1
  1. 1.City eHealth Research Centre (CeRC)City University LondonLondonUK

Personalised recommendations