Ontology as a Search-Tool: A Study of Real Users’ Query Formulation With and Without Conceptual Support
This study examines 16 real users’ use of an ontology as a search tool. The users’ queries constructed with the help of a Concept-based Information Retrieval Interface (CIRI) were compared to queries created independently based on the same search task description. Also the effectiveness of the CIRI queries was compared to the users’ unaided queries. The simulated search task method was used to make the searching situations as close to real as possible. Due to CIRI’s query expansion feature the number of search terms was remarkably higher in ontology queries than in Direct interface queries. The search results were evaluated with generalised precision and generalised relative recall as well as precision based on personal assessments. The Direct interface queries performed better in all methods of comparison.
KeywordsSearch Task Test User Query Expansion Real User Query Formulation
Unable to display preview. Download preview PDF.
- 1.Airio, E., Järvelin, K., Suomela, S., Saatsi, P., Kekäläinen, J.: CIRI - An Ontology-based Query Interface for Text Retrieval. The Web Intelligence –symposium, Helsinki, Finland (2004), Available at, http://www.cs.helsinki.fi/group/seco/conference/step2004/material.html, [Cited October 26, 2004]
- 2.Allan, J., Callan, J., Croft, B., Ballesteros, L., Byrd, D., Swan, R., Xu, J.: INQUERY does battle with TREC-6 (1997), Available at, http://trec.nist.gov/pubs/trec6/papers/umass-trec97.ps, [Cited 26.10.2004]
- 4.Borlund, P.: Evaluation of interactive information retrieval systems. Doctoral dissertation. Åbo Akademi University Press, Åbo (2000)Google Scholar
- 5.Efthimiadis, E.N.: Query expansion. In: Williams, M.E. (ed.) Annual Review of Information Science and Technology, Medford, NJ. Information Today, vol. 31, pp. 121–187 (1996)Google Scholar
- 7.Guarino, N., Masolo, C., Vetere, G.: OntoSeek: Using large linguistic ontologies for gathering information resources from the Web. LADSEB-CNR Technical Report 01/98 (1998)Google Scholar
- 8.ISO International Standard 2788. Documentation - Guidelines for the establishment and development of monolingual thesauri. International Organization for Standardization (1986) Google Scholar
- 12.Järvelin, K., Kristensen, J., Niemi, T., Sormunen, E., Keskustalo, H.: A deductive data model for query expansion. In: Frei, H.-P., Harman, D., Schäuble, P., Wilkinson, R. (eds.) Proceedings of the 19th Annual International ACM–SIGIR Conference on Research and Development in Information Retrieval, pp. 235–249. ACM press, New York (1996)CrossRefGoogle Scholar
- 13.Kekäläinen, J.: The effects of query complexity, expansion and structure on retrieval performance in probabilistic text retrieval. PhD dissertation, Department of Information Studies, University of Tampere. Acta Universitatis Tamperensis 678 (1999)Google Scholar
- 16.Sihvonen, A., Vakkari, P.: Subject knowledge improves interactive query expansion assisted by a thesaurus. To appear in Journal of Documentation (2004)Google Scholar
- 19.Turtle, H.R.: Inference networks for document retrieval. Ph.D. dissertation. COINS Technical Report 90–92. Computer and information Science Department, University of Massachusetts (1990)Google Scholar