Advertisement

Domain-Specific Track CLEF 2005: Overview of Results and Approaches, Remarks on the Assessment Analysis

  • Michael Kluck
  • Maximilian Stempfhuber
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4022)

Abstract

The challenge of the CLEF domain-specific track is to map user queries in one language to documents in different languages adapting the systems used to the vocabulary and wording of the social science domain. In addition to a general overview of this track and its tasks, some details on the approaches of the participating groups and their results are reported. One of the outcomes is the considerable improvement in results if the retrieval systems make use of the thesauri provided or the intellectually assigned descriptors. Other findings for IR in a domain-specific context are also given. Finally, considerations on the topic creation and assessment processes are made on the basis of empirical data mainly from the GIRT corpus.

Keywords

Relevant Document Query Expansion Parallel Corpus Relevance Assessment English Topic 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Kluck, M., Gey, F.C.: The Domain-Specific Task of CLEF - Specific Evaluation Strategies in Cross-Language Information Retrieval. In: Peters, C. (ed.) CLEF 2000. LNCS, vol. 2069, pp. 48–56. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  2. 2.
    Kluck, M.: The GIRT Data in the Evaluation of CLIR Systems – from 1997 Until 2003. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds.) CLEF 2003. LNCS, vol. 3237, pp. 376–390. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  3. 3.
    Kluck, M.: The Domain-Specific Track in CLEF 2004: Overview of the Results and Remarks on the Assessment Process. In: Peters, C., Clough, P., Gonzalo, J., Jones, G.J.F., Kluck, M., Magnini, B. (eds.) CLEF 2004. LNCS, vol. 3491, pp. 260–270. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  4. 4.
    Aussenac-Gilles, N., Boughanem, M., Baziz, M.: Evaluating a Conceptual Indexing Method by Utilizing WordNet. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, pp. 238–246. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  5. 5.
    Ageev, M., Dobrov, B., Loukachevitch, N.: Socio-Political Thesaurus in Concept-Based Information Retrieval. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, pp. 141–150. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  6. 6.
    Petras, V., Gey, F., Larson, R.R.: Domain-Specific CLIR of English, German and Russian Using Fusion and Subject Metadata for Query Expansion. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, pp. 226–237. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  7. 7.
    Leveling, J.: A Baseline for NLP in Domain-Specific IR. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, pp. 222–225. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  8. 8.
    Hackl, R., Mandl, T.: Domain Specific Mono- and Bilingual English to German Retrieval Experiments with a Social Science Document Corpus. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, pp. 247–250. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  9. 9.
    Savoy, J., Berger, P.-Y.: Monolingual, Bilingual, and GIRT Information Retrieval at CLEF-2005. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, pp. 131–140. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  10. 10.
    Kluck, M.: Test Collection Report for the CLEF Campaign 2003: Deliverable 3.2.2, Bonn 2003, 10-11, http://www.clef-campaign.org/deliv_avail_to_public/Del322.pdf
  11. 11.
    Kluck, M., Winter, M.: Topic-Entwicklung und Relevanzbewertung bei GIRT: ein Werkstattbericht. In: Mandl, T., Womser-Hacker, C. (eds.) Effektive Information Retrieval Verfahren in der Praxis. Proceedings Vierter Hildesheimer Evaluierungs- und Retrievalworkshop (HIER 2005), UVK, Konstanz. Hildesheim, 20. Juli 2005. Schriften zur Informationswissenschaft, vol. 45 (to appear, 2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Michael Kluck
    • 1
  • Maximilian Stempfhuber
    • 2
  1. 1.Stiftung Wissenschaft und Politik (SWP), German Institute for International and Security AffairsBerlinGermany
  2. 2.Informationszentrum Sozialwissenschaften (IZ)BonnGermany

Personalised recommendations