GeoCLEF 2006: The CLEF 2006 Cross-Language Geographic Information Retrieval Track Overview

  • Fredric Gey
  • Ray Larson
  • Mark Sanderson
  • Kerstin Bischoff
  • Thomas Mandl
  • Christa Womser-Hacker
  • Diana Santos
  • Paulo Rocha
  • Giorgio M. Di Nunzio
  • Nicola Ferro
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4730)

Abstract

After being a pilot track in 2005, GeoCLEF advanced to be a regular track within CLEF 2006. The purpose of GeoCLEF is to test and evaluate cross-language geographic information retrieval (GIR): retrieval for topics with a geographic specification. For GeoCLEF 2006, twenty-five search topics were defined by the organizing groups for searching English, German, Portuguese and Spanish document collections. Topics were translated into English, German, Portuguese, Spanish and Japanese. Several topics in 2006 were significantly more geographically challenging than in 2005. Seventeen groups submitted 149 runs (up from eleven groups and 117 runs in GeoCLEF 2005). The groups used a variety of approaches, including geographic bounding boxes, named entity extraction and external knowledge bases (geographic thesauri and ontologies and gazetteers).

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Conover, W.J.: Practical Nonparametric Statistics. John Wiley and Sons, New York, USA (1971)Google Scholar
  2. 2.
    Eilders, C.: The role of news factors in media use. Technical report, Wissenschaftszentrum Berlin für Sozialforschung gGmbH (WZB). Forschungsschwerpunkt Sozialer Wandel, Institutionen und Vermittlungsprozesse des Wissenschaftszentrums Berlin für Sozialforschung. Berlin (1996)Google Scholar
  3. 3.
    Gey, F., Larson, R., Sanderson, M., Joho, H., Clough, P., Petras, V.: GeoCLEF: the CLEF 2005 cross-language geographic information retrieval track overview. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, Springer, Heidelberg (2006)CrossRefGoogle Scholar
  4. 4.
    Gey, F., et al.: Challenges to Evaluation of Multilingual Geographic Information Retrieval in GeoCLEF. In: Proceedings of the 1st International Workshop on Evaluation of Information Access, Tokyo Japan, May 15, 2007, pp. 74–77 (2007)Google Scholar
  5. 5.
    Hull, D.: Using statistical testing in the evaluation of retrieval experiments. In: Korfhage, R., Rasmussen, E., Willett, P. (eds.) Proceedings of the 16th Annual International ACM SIGIR Conference on Research and Development on Information Retrieval (SIGIR 1993), pp. 329–338. ACM Press, New York (1993)CrossRefGoogle Scholar
  6. 6.
    Judge, G.G., Hill, R.C., Griffiths, W.E., Lutkepohl, H., Lee, T.C.: Introduction to the Theory and Practice of Econometrics, 2nd edn. John Wiley and Sons, New York, USA (1988)MATHGoogle Scholar
  7. 7.
    Kluck, M., Womser-Hacker, C.: Inside the evaluation process of the cross-language evaluation forum (CLEF): Issues of multilingual topic creation and multilingual relevance assessment. In: Proceedings of the third International Conference on Language Resources and Evaluation, LREC 2002, Las Palmas, Spain, pp. 573–576 (2002)Google Scholar
  8. 8.
    Santos, D., Bick, E.: Providing internet access to portuguese corpora: the ac/dc project. In: Gavrilidou, M., Carayannis, G., Markantonatou, S., Piperidis, S., Stainhauer, G. (eds.) Proceedings of the Second International Conference on Language Resources and Evaluation, LREC 2000, Athens, 31 May-2 June 2000, pp. 205–210 (2000)Google Scholar
  9. 9.
    Santos, D., Cardoso, N.: Portuguese at CLEF 2005: Reflections and challenges. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, Springer, Heidelberg (2006)CrossRefGoogle Scholar
  10. 10.
    Santos, D., Chaves, M.: The place of place in geographical information retrieval. In: Jones, C., Purves, R. (eds.) Workshop on Geographic Information Retrieval (GIR 2006), SIGIR 2006, Seattle, August 10, 2006, pp. 5–8 (2006)Google Scholar
  11. 11.
    Tague-Sutcliffe, J.: The Pragmatics of Information Retrieval Experimentation, Revisited. In: Sparck, K., Willett, P. (eds.) Readings in Information Retrieval, pp. 205–216. Morgan Kaufmann Publishers, San Francisco, California (1997)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Fredric Gey
    • 1
  • Ray Larson
    • 1
  • Mark Sanderson
    • 2
  • Kerstin Bischoff
    • 3
  • Thomas Mandl
    • 3
  • Christa Womser-Hacker
    • 3
  • Diana Santos
    • 4
  • Paulo Rocha
    • 4
  • Giorgio M. Di Nunzio
    • 5
  • Nicola Ferro
    • 5
  1. 1.University of California, Berkeley, CAUSA
  2. 2.Department of Information Studies, University of Sheffield, SheffieldUK
  3. 3.Information Science, University of HildesheimGermany
  4. 4.Linguateca, SINTEF ICTNorway
  5. 5.Department of Information Engineering, University of PaduaItaly

Personalised recommendations