Advertisement

Overview of the WiQA Task at CLEF 2006

  • Valentin Jijkoun
  • Maarten de Rijke
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4730)

Abstract

We describe WiQA 2006, a pilot task aimed at studying question answering using Wikipedia. Going beyond traditional factoid questions, the task considered at WiQA 2006 was to return—given an source page from Wikipedia—to identify snippets from other Wikipedia pages, possibly in languages different from the language of the source page, that add new and important information to the source page, and that do so without repetition.

A total of 7 teams took part, submitting 20 runs. Our main findings are two-fold: (i) while challenging, the tasks considered at WiQA are do-able as participants achieved impressive scores as measured in terms of yield, mean reciprocal rank, and precision, (ii) on the bilingual task, substantially higher scores were achieved than on the monolingual tasks.

Keywords

Question Answering Working Note Coreference Resolution Question Answering System Source Article 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [CLEF 2006 Working Notes(2006)]
    CLEF 2006 Working Notes. In: Working Notes for the CLEF 2006 Workshop (2006), http://www.clef-campaign.org/2006/working_notes/CLEF2006WN-Contents.html
  2. [Denoyer and Gallinari(2006)]
    Denoyer, L., Gallinari, P.: The Wikipedia XML Corpus. SIGIR Forum (2006)Google Scholar
  3. [Soboroff and Harman(2003)]
    Soboroff, I., Harman, D.: Overview of the TREC 2003 Novelty track. In: Proceedings of the Twelfth Text REtrieval Conference (TREC 2003), NIST, pp. 38–53 (2003)Google Scholar
  4. [WiQA(2006)]
    WiQA, Question Answering Using Wikipedia (2006), http://ilps.science.uva.nl/WiQA/

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Valentin Jijkoun
    • 1
  • Maarten de Rijke
    • 1
  1. 1.ISLA, University of Amsterdam 

Personalised recommendations