Abstract
GeoCLEF was a new pilot track in CLEF 2005. GeoCLEF was to test and evaluate cross-language geographic information retrieval (GIR) of text. Geographic information retrieval is retrieval oriented toward the geographic specification in the description of the search topic and returns documents which satisfy this geographic information need. For GeoCLEF 2005, twenty-five search topics were defined for searching against the English and German ad-hoc document collections of CLEF. Topic languages were English, German, Portuguese and Spanish. Eleven groups submitted runs and about 25,000 documents (half English and half German) in the pooled runs were judged by the organizers. The groups used a variety of approaches, including geographic bounding boxes and external knowledge bases (geographic thesauri and ontologies and gazetteers). The results were encouraging but showed that additional work needs to be done to refine the task for GeoCLEF in 2006.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Clough, P.D., Sanderson, M.: A Proposal for Comparative Evaluation of Automatic Annotation for Geo-referenced Documents. In: Proceedings of Workshop on Geographic Information Retrieval, SIGIR (2004)
Clough, P.D.: Extracting Metadata for Spatially-Aware Information Retrieval on the Internet. In: Proceedings of GIR 2005 Workshop at CIKM 2005, Bremen, Germany, November 4, online (2005)
Cormack, G.V., Palmer, C.R., Clarke, C.L.A.: Efficient Construction of Large Test Collections. In: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 282–289 (1998)
Cunningham, H., Maynard, D., Bontcheva, K., Tablan, V.: GATE: A Framework and Graphical Development Environment for Robust NLP Tools and Applications. In: Proceedings of ACL 2002, Philadelphia (2002)
Kraaij, W., Smeaton, A.F., Over, P., Arlandis, J.: TRECVID 2004 - An Overview. In: TREC Video Retrieval Evaluation Online Proceedings (2004), http://www-nlpir.nist.gov/projects/tvpubs/tv.pubs.org.html
Sanderson, M., Joho, H.: Forming Test Collections with No System Pooling. In: Järvelin, K., Allan, J., Bruza, P., Sanderson, M. (eds.) Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Sheffield, UK, pp. 33–40 (2004)
Sanderson, M., Zobel, J.: Information Retrieval System Evaluation: Effort, Sensitivity, and Reliability. In: Proceedings of the 28th ACM SIGIR conference, Brazil, pp. 162–169 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gey, F., Larson, R., Sanderson, M., Joho, H., Clough, P., Petras, V. (2006). GeoCLEF: The CLEF 2005 Cross-Language Geographic Information Retrieval Track Overview. In: Peters, C., et al. Accessing Multilingual Information Repositories. CLEF 2005. Lecture Notes in Computer Science, vol 4022. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11878773_101
Download citation
DOI: https://doi.org/10.1007/11878773_101
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-45697-1
Online ISBN: 978-3-540-45700-8
eBook Packages: Computer ScienceComputer Science (R0)