Towards Quality Measures for Evaluating Thesauri

  • Daniel Kless
  • Simon Milton
Part of the Communications in Computer and Information Science book series (CCIS, volume 108)


Thesaurus evaluation has often focused on the task of retrieval or analyzed the information environment including factors such as the user, the user interface. Rarely ever has the quality of a thesaurus as an artefact itself been focus of attention. In particular, there are no measures, which provide a holistic description of its intrinsic characteristics as an artefact. This paper suggests a range of abstract measurement constructs based on quality notions in thesaurus literature and inference from other related literature. The suggested measurement constructs allow representing a thesaurus in evaluation approaches, which thereby becomes empirically testable.


Thesaurus evaluation thesaurus measures 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Nielsen, M.L.: A framework for work task based thesaurus design. Journal of Documentation 57, 774–797 (2001)CrossRefGoogle Scholar
  2. 2.
    Shiri, A., Revie, C.: Query expansion behavior within a thesaurus-enhanced search environment: A user-centered evaluation. Journal of the American Society for Information Science and Technology 57, 462–478 (2006)CrossRefGoogle Scholar
  3. 3.
    Blocks, D., Binding, C., Cunliffe, D., Tudhope, D.: Qualitative Evaluation of Thesaurus-Based Retrieval. In: Research and Advanced Technology for Digital Libraries, pp. 75–107 (2002)Google Scholar
  4. 4.
    Pizzato, L., de Lima, V.: Evaluation of a Thesaurus-Based Query Expansion Technique. In: Computational Processing of the Portuguese Language, p. 196 (2003)Google Scholar
  5. 5.
    BS 8723-2: Thesauri. BS 8723: Structured vocabularies for information retrieval. Guide. British Standards Institution (BSI), Committee IDT/2/2 (2005). Google Scholar
  6. 6.
    BS 8723-1: Definitions, symbols and abbreviations. BS 8723: Structured vocabularies for information retrieval. Guide. British Standards Institution (BSI), Committee IDT/2/2 (2005). Google Scholar
  7. 7.
    Broughton, V., Hansson, J., Hjørland, B., López-Huertas, M.J.: Knowledge Organization. In: European Curriculum Reflections on Library and Information Science Education, pp. 133–148. The Royal School of Library and Information Science (2005)Google Scholar
  8. 8.
    Hodge, G.: Systems of Knowledge Organization for Digital Libraries: Beyond Traditional Authority Files. The Digital Library Federation. Council on Library and Information Resources, Washington (2009)Google Scholar
  9. 9.
    Giunchiglia, F., Zaihrayeu, I.: Lightweight Ontologies. In: Encyclopedia of Database Systems. Springer, Heidelberg (2009)Google Scholar
  10. 10.
    Gangemi, A., Catenacci, C., Ciaramita, M., Lehmann, J.: Modelling Ontology Evaluation and Validation. In: Sure, Y., Domingue, J. (eds.) ESWC 2006. LNCS, vol. 4011, pp. 140–154. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  11. 11.
    Gangemi, A., Catenacci, C., Ciaramita, C., Lehmann, J.: Ontology evaluation and validation (2005)Google Scholar
  12. 12.
    Yao, H., Orme, A.M., Etzkorn, L.: Cohesion metrics for ontology design and application. Journal of Computer Science 1, 107–113 (2005)CrossRefGoogle Scholar
  13. 13.
    Park, J.: Metadata Quality in Digital Repositories: A Survey of the Current State of the Art. Cataloging & Classification Quarterly 47, 213–228 (2009)CrossRefGoogle Scholar
  14. 14.
    Stvilia, B., Gasser, L., Twidale, M.B., Smith, L.C.: A framework for information quality assessment. Journal of the American Society for Information Science and Technology 58, 1720–1733 (2007)CrossRefGoogle Scholar
  15. 15.
    Moen, W.E., Stewart, E.L., McClure, C.R.: The Role of Content Analysis in Evaluating Metadata for the U.S. Government Information Locator Service (GILS). IEEE, Los Alamitos (1997)Google Scholar
  16. 16.
    Bruce, T.R., Hillmann, D.I.: The Continuum of Metadata Quality: Defining, Expressing, Exploiting. In: Hillmann, D., Westbrooks, E. (eds.) Metadata in Practice, pp. 238–256. American Library Association Editions, Chicago (2004)Google Scholar
  17. 17.
    Soergel, D.: Indexing and retrieval performance: The logical evidence. Journal of the American Society for Information Science 45, 589–599 (1994)CrossRefGoogle Scholar
  18. 18.
    BS 8723 Data model: BS 8723 Data model,
  19. 19.
    ANSI/NISO Z39.19: Guidelines for the Construction, Format, and Management of Monolingual Controlled Vocabularies (2005)Google Scholar
  20. 20.
    Aitchison, J., Bawden, D., Gilchrist, A.: Thesaurus Construction and Use: A Practical Manual. Fitzroy Dearborn Publishers (2000)Google Scholar
  21. 21.
    Blocks, D., Cunliffe, D., Tudhope, D.: A reference model for user-system interaction in thesaurus-based searching. Journal of the American Society for Information Science and Technology 57, 1655–1665 (2006)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Daniel Kless
    • 1
  • Simon Milton
    • 1
  1. 1.University of MelbourneAustralia

Personalised recommendations