Indented Tree or Graph? A Usability Study of Ontology Visualization Techniques in the Context of Class Mapping Evaluation

  • Bo Fu
  • Natalya F. Noy
  • Margaret-Anne Storey
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8218)


Research effort in ontology visualization has largely focused on developing new visualization techniques. At the same time, researchers have paid less attention to investigating the usability of common visualization techniques that many practitioners regularly use to visualize ontological data. In this paper, we focus on two popular ontology visualization techniques: indented tree and graph. We conduct a controlled usability study with an emphasis on the effectiveness, efficiency, workload and satisfaction of these visualization techniques in the context of assisting users during evaluation of ontology mappings. Findings from this study have revealed both strengths and weaknesses of each visualization technique. In particular, while the indented tree visualization is more organized and familiar to novice users, subjects found the graph visualization to be more controllable and intuitive without visual redundancy, particularly for ontologies with multiple inheritance.


Ontology visualization indented tree graph usability study 


  1. 1.
    Stab, C., Nazemi, K., Breyer, M., Burkhardt, D., Kohlhammer, J.: Semantics Visualization for Fostering Search Result Comprehension. In: Simperl, E., Cimiano, P., Polleres, A., Corcho, O., Presutti, V. (eds.) ESWC 2012. LNCS, vol. 7295, pp. 633–646. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  2. 2.
    Dadzie, A.S., Rowe, M.: Approaches to Visualising Linked Data: A Survey. Semantic Web 2, 89–124 (2011)Google Scholar
  3. 3.
    Katifori, A., Halatsis, C., Lepouras, G., Vassilakis, C., Giannopoulou, E.: Ontology Visualization Methods - A Survey. ACM Computing Surveys 39(4), Article 10 (2007)Google Scholar
  4. 4.
    Sivakumar, R., Arivoli, P.V.: Ontology Visualization Protégé Tools – A Review. International Journal of Advanced Information Technology 1(4) (2011)Google Scholar
  5. 5.
    Noy, N.F., Shah, N.H., Whetzel, P.L., Dai, B., Dorf, M., Griffith, N., Jonquet, C., Rubin, D.L., Storey, M.-A., Chute, C.G., Musen, M.A.: BioPortal: Ontologies and Integrated Data Resources at the Click of A Mouse. Nucleic Acids Research 37(2), 170–173 (2009)CrossRefGoogle Scholar
  6. 6.
    Vercruysse, S., Venkatesan, A., Kuiper, M.: OLSVis: An Animated, Interactive Visual Browser for Bio-ontologies. BMC Bioinformatics 13(1), 116 (2012)CrossRefGoogle Scholar
  7. 7.
    Lanzenberger, M., Sampson, J., Rester, M.: Ontology Visualization: Tools and Techniques for Visual Representation of Semi-Structured Meta-Data. Journal of Universal Computer Science 16(7), 1036–1054 (2010)Google Scholar
  8. 8.
    Khattak, A.M., Latif, K., Khan, S., Ahmed, N.: Ontology Recovery and Visualization. In: The 4th International Conference on Next Generation Web Services Practices, pp. 90–96 (2008)Google Scholar
  9. 9.
    Brockmans, S., Volz, R., Eberhart, A., Löffler, P.: Visual Modeling of OWL DL Ontologies using UML. In: McIlraith, S.A., Plexousakis, D., van Harmelen, F. (eds.) ISWC 2004. LNCS, vol. 3298, pp. 198–213. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  10. 10.
    Tudorache, T., Nyulas, C., Noy, N.F., Musen, M.A.: WebProtege: A Collaborative Ontology Editor and Knowledge Acquisition Tool for the Web. Semantic Web Journal 4(1), 89–99 (2013)Google Scholar
  11. 11.
    Baehrecke, E.H., Dang, N., Babaria, K., Shneiderman, B.: Visualization and Analysis of Microarray and Gene Ontology Data with Treemaps. BMC Bioinformatics 5, 84 (2004)CrossRefGoogle Scholar
  12. 12.
    Plaisant, C., Grosjean, J., Bederson, B.B.: SpaceTree: Supporting Exploration in Large Node Link Tree, Design Evolution and Empirical Evaluation. In: The IEEE Symposium on Information Visualization, vol. 57 (2002)Google Scholar
  13. 13.
    Parsia, B., Wang, T., Goldbeck, J.: Visualizing Web Ontologies with CropCircles. In: The 4th International Semantic Web Conference. LNCS, vol. 3729, pp. 6–10 (2005)Google Scholar
  14. 14.
    Bosca, A., Bomino, D., Pellegrino, P.: OntoSphere: More than A 3D Ontology Visualization Tool. In: The 2nd Italian Semantic Web Workshop. CEUR-WS, vol. 166 (2005)Google Scholar
  15. 15.
    Motta, E., Mulholland, P., Peroni, S., d’Aquin, M., Gomez-Perez, J.M., Mendez, V., Zablith, F.: A Novel Approach to Visualizing and Navigating Ontologies. In: Aroyo, L., Welty, C., Alani, H., Taylor, J., Bernstein, A., Kagal, L., Noy, N., Blomqvist, E. (eds.) ISWC 2011, Part I. LNCS, vol. 7031, pp. 470–486. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  16. 16.
    Storey, M.-A., Musen, M., Silva, J., Best, C., Ernst, N., Fergerson, R., Noy, N.: Jambalaya: Interactive Visualization to enhance Ontology Authoring and Knowledge Acquisition in Protégé. In: Workshop on Interactive Tools for Knowledge Capture (2001)Google Scholar
  17. 17.
    Petrelli, D., Mazumdar, S., Dadzie, A.S., Ciravegna, F.: Multi Visualization and Dynamic Query for Effective Exploration of Semantic Data. In: Bernstein, A., Karger, D.R., Heath, T., Feigenbaum, L., Maynard, D., Motta, E., Thirunarayan, K. (eds.) ISWC 2009. LNCS, vol. 5823, pp. 505–520. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  18. 18.
    Kuhar, S., Podgorelec, V.: Ontology Visualization for Domain Experts: A New Solution. In: The 16th International Conference on Information Visualisation, pp. 363–369 (2012)Google Scholar
  19. 19.
    Alani, H.: TGVizTab: An Ontology Visualisation Extension for Protégé. In: Workshop on Visualization Information in Knowledge Engineering (2003)Google Scholar
  20. 20.
    Falconer, S.M., Callendar, C., Storey, M.-A.: A Visualization Service for the Semantic Web. In: Cimiano, P., Pinto, H.S. (eds.) EKAW 2010. LNCS, vol. 6317, pp. 554–564. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  21. 21.
    Fu, B., Grammel, L., Storey, M.-A.: BioMixer: A Web-based Collaborative Ontology Visualization Tool. In: The 3rd International Conference on Biomedical Ontology. CEUR-WS, vol. 897 (2012) ISSN 1613-0073Google Scholar
  22. 22.
    Herman, I., Melançon, G., Marshall, M.S.: Graph Visualization and Navigation in Information Visualization: A Survey. IEEE Transactions on Visualization and Computer Graphics 6(1), 24–43 (2000)CrossRefGoogle Scholar
  23. 23.
    Graham, M., Kennedy, J.: A Survey of Multiple Tree Visualisation. Information Visualization 9(4), 235–252 (2009)CrossRefGoogle Scholar
  24. 24.
    Lam, H., Bertini, E., Isenberg, P., Plaisant, C., Carpendale, S.: Seven Guiding Scenarios for Information Visualization Evaluation. Technical Report (2010)Google Scholar
  25. 25.
    Chen, C., Czerwinski, M.: Empirical Evaluation of Information Visualizations: An Introduction. International Journal on Human-Computer Studies 53, 631–635 (2000)CrossRefGoogle Scholar
  26. 26.
    Saraiya, P., North, C., Duca, K.: An Insight-Based Methodology for Evaluating Bioinformatics Visualization. IEEE Trans. on Visualization and Computer Graphics 11(4) (2005)Google Scholar
  27. 27.
    Akrivi, K., Elena, T., Constantin, H., Georgios, L., Costas, V.: A Comparative Study of Four Ontology Visualization Techniques in Protégé: Experiment Setup and Preliminary Results. In: The 10th International Conference on Information Visualization, pp. 417–423 (2006)Google Scholar
  28. 28.
    Swaminathan, V., Sivakumar, R.: A Comparative Study of Recent Ontology Visualization Tools with a Case of Diabetes Data. International Journal of Research in Computer Science 2(3), 31–36 (2012)CrossRefGoogle Scholar
  29. 29.
    Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Human Mental Workload. North Holland Press, Amsterdam (1988)Google Scholar
  30. 30.
    Brooke, J.: SUS: A Quick and Dirty Usability Scale. Usability Evaluation in Industry. Taylor & Francis, London (1996)Google Scholar
  31. 31.
    Lund, A.: Measuring Usability with the USE Questionnaire. Usability and User Experience Newsletter of the STC Usability SIG (2001)Google Scholar
  32. 32.
    Benedek, J., Miner, T.: Measuring Desirability: New Methods for Evaluating Desirability in a Usability Lab Setting. In: Usability Professionals Association Conference (2002)Google Scholar
  33. 33.
    Hart, S.G.: NASA-Task Load Index (NASA-TLX); 20 Years Later. In: The Human Factors and Ergonomics Society 50th Annual Meeting, pp. 904–908 (2006)Google Scholar
  34. 34.
    Likert, R.: A Technique for the Measurement of Attitudes. Archives of Psychology 140, 1–55 (1932)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Bo Fu
    • 1
  • Natalya F. Noy
    • 2
  • Margaret-Anne Storey
    • 1
  1. 1.Department of Computer ScienceUniversity of VictoriaCanada
  2. 2.Stanford Center for Biomedical Informatics ResearchStanford UniversityUSA

Personalised recommendations