GeoCLEF 2007: The CLEF 2007 Cross-Language Geographic Information Retrieval Track Overview

  • Thomas Mandl
  • Fredric Gey
  • Giorgio Di Nunzio
  • Nicola Ferro
  • Ray Larson
  • Mark Sanderson
  • Diana Santos
  • Christa Womser-Hacker
  • Xing Xie
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5152)

Abstract

GeoCLEF ran as a regular track for the second time within the Cross Language Evaluation Forum (CLEF) 2007. The purpose of GeoCLEF is to test and evaluate cross-language geographic information retrieval (GIR): retrieval for topics with a geographic specification. GeoCLEF 2007 consisted of two sub tasks. A search task ran for the third time and a query classification task was organized for the first. For the GeoCLEF 2007 search task, twenty-five search topics were defined by the organizing groups for searching English, German, Portuguese and Spanish document collections. All topics were translated into English, Indonesian, Portuguese, Spanish and German. Several topics in 2007 were geographically challenging. Thirteen groups submitted 108 runs. The groups used a variety of approaches. For the classification task, a query log from a search engine was provided and the groups needed to identify the queries with a geographic scope and the geographic components within the local queries.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Braschler, M., Peters, C.: Cross-Language Evaluation Forum: Objectives, Results, Achievements. Information Retrieval 7(1-2), 7–31Google Scholar
  2. 2.
    Santos, D., Rocha, P.: The key to the first CLEF in Portuguese: Topics, questions and answers in CHAVE. In: Peters, C., Clough, P., Gonzalo, J., Jones, G.J.F., Kluck, M., Magnini, B. (eds.) CLEF 2004. LNCS, vol. 3491, pp. 821–832. Springer, Heidelberg (2005)Google Scholar
  3. 3.
    Di Nunzio, G.M., Ferro, N.: DIRECT: A System for Evaluating Information Access Components of Digital Libraries. In: Rauber, A., Christodoulakis, S., Tjoa, A.M. (eds.) ECDL 2005. LNCS, vol. 3652, pp. 483–484. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  4. 4.
    Kluck, M., Womser-Hacker, C.: Inside the evaluation process of the cross-language evaluation forum (CLEF): Issues of multilingual topic creation and multilingual relevance assessment. In: Proceedings of the third International Conference on Language Resources and Evaluation, LREC, 2002, Las Palmas, Spain, pp. 573–576 (2002)Google Scholar
  5. 5.
    Evert, S.: The CQP Query Language Tutorial (CWB version 2.2.b90) University of Stuttgart (July 10, 2005), http://www.ims.uni-stuttgart.de/projekte/CorpusWorkbench/CQPTutorial/html/
  6. 6.
    Santos, D., Eckhard, B.: Providing Internet access to Portuguese corpora: the AC/DC project. In: Gavriladou, M., Carayannis, G., Markantonatou, S., Piperidis, S., Stainhaouer, G. (eds.) Proceedings of the Second International Conference on Language Resources and Evaluation, LREC 2000, pp. 205–210 (2000)Google Scholar
  7. 7.
    Gey, F., Larson, R., Sanderson, M., Bishoff, K., Mandl, T., Womser-Hacker, C., Santos, D., Rocha, P., Di Nunzio, G., Ferro, N.: GeoCLEF 2006: the CLEF 2006 Cross-Language Geographic Information Retrieval Track Overview. In: Peters, C., Clough, P., Gey, F.C., Karlgren, J., Magnini, B., Oard, D.W., de Rijke, M., Stempfhuber, M. (eds.) CLEF 2006. LNCS, vol. 4730, pp. 852–876. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  8. 8.
    Gey, F., Larson, R., Sanderson, M., Joho, H., Clough, P., Petras, V.: GeoCLEF: the CLEF 2005 cross-language geographic information retrieval track overview. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, pp. 908–919. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  9. 9.
    Santos, D., Chaves, M.S.: The place of place in geographical IR. In: GIR 2006, the 3rd Workshop on Geographic Information Retrieval, SIGIR 2006, Seattle, 10 August 2006 (presentation at, 2006), http://www.linguateca.pt/Diana/download/acetSantosChavesGIR2006.pdf
  10. 10.
    Buckley, C., Voorhees, E.: Retrieval System Evaluation. In: TREC: Experiment and Evaluation in Information Retrieval, pp. 53–75. MIT Press, Cambridge (2005)Google Scholar
  11. 11.
    Sanderson, M., Zobel, J.: Information Retrieval System Evaluation: Effort, Sensitivity, and Reliability. In: 28th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR) 2005, pp. 162–169 (2005)Google Scholar
  12. 12.
    Zobel, J.: How Reliable are the Results of Large-Scale Information Retrieval Experiments? In: Proceedings of the 21st Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR 1998), Melbourne, Australia, pp. 307–314. ACM Press, New York (1998)CrossRefGoogle Scholar
  13. 13.
    Li, Z., Wang, C., Xing, X., Ma, W.-Y.: Query Parsing Task for GeoCLEF 2007 Report. In: Nardi, A., Peters, C. (eds.) Working Notes of the Cross Language Evaluation Forum (CLEF) (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Thomas Mandl
    • 1
  • Fredric Gey
    • 2
  • Giorgio Di Nunzio
    • 3
  • Nicola Ferro
    • 3
  • Ray Larson
    • 2
  • Mark Sanderson
    • 4
  • Diana Santos
    • 5
  • Christa Womser-Hacker
    • 1
  • Xing Xie
    • 6
  1. 1.Information ScienceUniversity of HildesheimGermany
  2. 2.University of CaliforniaBerkeleyUSA
  3. 3.Department of Information EngineeringUniversity of PaduaItaly
  4. 4.Department of Information StudiesUniversity of SheffieldSheffieldUK
  5. 5.Linguateca, SINTEF ICTNorway
  6. 6.Microsoft Research AsiaBeijingChina

Personalised recommendations