Abstract
The paper analyses searchers’ assessments of usefulness and specificity on different levels of granularity in XML-coded documents. Documents are assessed on 10 usefulness/specificity combinations and on the granularity levels of article, section, and subsection. Overlapping judgements show a remarkable lack of consistency between searchers. There is an inverse relationship between articles and sections both in the assessment of specificity and of usefulness, indicating that retrieval on different granularity levels are a useful feature of a retrieval system. Searchers find the full article more useful when they assess the same document both on the article and section level indicating that there is a need to provide context to the sections and subsections when presenting result list of XML-documents.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Borlund, P.: Evaluation of interactive information retrieval systems. Åbo Akademi University Press, Åbo (2000)
Finesilver, K., Reid, J.: User Behaviour in the Context of Structured Documents. In: Sebastiani, F. (ed.) ECIR 2003. LNCS, vol. 2633, pp. 104–119. Springer, Heidelberg (2003)
Kekäläinen, J., Järvelin, K.: Using graded relevance assessments in IR evaluation. Journal of the American Society for Information Science and Technology 53(13), 1120–1129 (2002)
Kazai, G., Lalmas, M., Fuhr, N., Gövert, N.: A report on the first year of the initiative for the evaluation of XML retrieval (INEX 2002). Journal of the American Society for Information Science and Technology 55(6), 551–556 (2004)
Kazai, G., Lalmas, M., de Vries, A.P.: The Overlap Problem in Content-Oriented XML Retrieval Evaluation. In: Järvelin, K., Allan, J., Bruza, P., Sanderson, M. (eds.) Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Sheffield, pp. 72–79 (2004)
Luk, R.W.P., et al.: A Survey in indexing and searching XML documents. Journal of the American Society for Information Science and Technology 53(6), 415–437 (2002)
Malik, S., Tombros, A., Larsen, B.: HyREX for INEX itrack (2004), Available http://inex.is.informatik.uni-duisburg.de:2004/tracks/int/internal/downloads/guide.pdf
Saracevic, T., Kantor, P., Chamis, A.Y., Trivison, D.: A Study of Information Seeking and Retrieving. I. Background and Methodology. Journal of the American Society for Information Science 39(3), 161–176 (1988)
Tombros, A., Larsen, B., Malik, S.: The Interactive track at INEX 2004. In: Fuhr, N., Lalmas, M., Malik, S., Szlávik, Z. (eds.) INEX 2004. LNCS, vol. 3493, pp. 410–423. Springer, Heidelberg (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pharo, N., Nordlie, R. (2005). Context Matters: An Analysis of Assessments of XML Documents. In: Crestani, F., Ruthven, I. (eds) Context: Nature, Impact, and Role. CoLIS 2005. Lecture Notes in Computer Science, vol 3507. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11495222_19
Download citation
DOI: https://doi.org/10.1007/11495222_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26178-0
Online ISBN: 978-3-540-32101-9
eBook Packages: Computer ScienceComputer Science (R0)