Abstract
This paper describes a study on diversity in image search results. One of the first test collections explicitly built to study diversity – the ImageCLEFPhoto 2008 collection – was used in an evaluation exercise in the summer of 2008. Analyzing 200 of the runs submitted by 24 research groups enabled the relationship between precision and result diversity to be studied. In addition, the level of diversity present in search results produced by retrieval systems built without explicit support for diversity was computed. The remaining potential to improve on diversity was calculated and finally, a significant preference by users for diverse search results was shown.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Spärck-Jones, K., Robertson, S.E., Sanderson, M.: Ambiguous requests: implications for retrieval tests, systems and theories. ACM SIGIR Forum 41(2), 8–17 (2007)
Sanderson, M.: Ambiguous queries: test collections need more sense. In: Proc. ACM SIGIR, pp. 499–506 (2008)
Carbonell, J., Goldstein, J.: The use of MMR, diversity-based reranking for reordering documents and producing summaries. In: Proc. ACM SIGIR, pp. 335–336 (1998)
Zhai, C.: Risk Minimization and Language Modeling in Text Retrieval, PhD thesis, Carnegie Mellon University (2002)
Chen, H., Karger, D.R.: Less is more: probabilistic models for retrieving fewer relevant documents. In: Proc. ACM SIGIR, pp. 429–436 (2006)
Hersh, W.R., Over, P.: Trec-8 interactive track report. In: Proc. of TREC-8 (1999)
Over, P.: TREC-5 Interactive Track Report. In: Proc. TREC-5, pp. 29–56 (1997)
Clarke, C.L., Kolla, M., Cormack, G.V., Vechtomova, O., Ashkan, A., Büttcher, S., MacKinnon, I.: Novelty and diversity in information retrieval evaluation. In: Proc. ACM SIGIR, pp. 659–666 (2008)
Arni, T., Clough, P., Sanderson, M., Grubinger, M.: Overview of the ImageCLEFPhoto 2008 Photographic Retrieval Task. In: CLEF 2008 Working Notes (2008)
Grubinger, M., Clough, P., Müller, H., Deselaers, T.: The IAPR TC-12 Benchmark: A New Evaluation Resource for Visual Information Systems. In: Proc. of International Workshop OntoImage 2006 Language Resources for Content-Based Image Retrieval, held in conjunction with LREC 2006, Genoa, Italy, pp. 13–23 (2006)
Clough, P., Grubinger, M., Deselaers, T., Hanbury, A., Müller, H.: Overview of the imageCLEF 2006 photographic retrieval and object annotation tasks. In: Peters, C., Clough, P., Gey, F.C., Karlgren, J., Magnini, B., Oard, D.W., de Rijke, M., Stempfhuber, M. (eds.) CLEF 2006. LNCS, vol. 4730, pp. 579–594. Springer, Heidelberg (2007)
Grubinger, M., Clough, P., Hanbury, A., Müller, H.: Overview of the ImageCLEFPhoto 2007 photographic retrieval task. In: Peters, C., Jijkoun, V., Mandl, T., Müller, H., Oard, D.W., Peñas, A., Petras, V., Santos, D. (eds.) CLEF 2007. LNCS, vol. 5152, Springer, Heidelberg (2008)
Zhai, C.X., Cohen, W.W., Lafferty, J.: Beyond independent relevance: methods and evaluation metrics for subtopic retrieval. In: Proc. ACM SIGIR, pp. 10–17 (2003)
Arni, T., Tang, J., Sanderson, M., Clough, P.: Creating a test collection to evaluate diversity in image retrieval. In: The Proceedings of the Workshop on Beyond Binary Relevance: Preferences, Diversity, and Set-Level Judgments, held at SIGIR 2008 (2008)
O’Hare, N., Wilkins, P., Gurrin, C., Newman, E., Jones, G., Smeaton, A.: DCU at ImageCLEFPhoto 2008. In: Working Notes of CLEF 2008 Workshop (2008)
Chang, Y., Chen, H.: Increasing Relevance and Diversity in Photo Retrieval by Result Fusion. In: Working Notes of CLEF 2008 Workshop (2008)
Song, K., Tian, Y., Gao, W., Huang, T.: Diversifying the image retrieval results. In: Proc. ACM Multimedia, pp. 707–710 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sanderson, M., Tang, J., Arni, T., Clough, P. (2009). What Else Is There? Search Diversity Examined. In: Boughanem, M., Berrut, C., Mothe, J., Soule-Dupuy, C. (eds) Advances in Information Retrieval. ECIR 2009. Lecture Notes in Computer Science, vol 5478. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-00958-7_51
Download citation
DOI: https://doi.org/10.1007/978-3-642-00958-7_51
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-00957-0
Online ISBN: 978-3-642-00958-7
eBook Packages: Computer ScienceComputer Science (R0)