On the Evaluation of Snippet Selection for WebCLEF
- Cite this paper as:
- Overwijk A., Nguyen D., Hauff C., Trieschnigg D., Hiemstra D., de Jong F. (2009) On the Evaluation of Snippet Selection for WebCLEF. In: Peters C. et al. (eds) Evaluating Systems for Multilingual and Multimodal Information Access. CLEF 2008. Lecture Notes in Computer Science, vol 5706. Springer, Berlin, Heidelberg
WebCLEF is about supporting a user who is an expert in writing a survey article on a specific topic with a clear goal and audience by generating a ranked list with relevant snippets. This paper focuses on the evaluation methodology of WebCLEF. We show that the evaluation method and test set used for WebCLEF 2007 cannot be used to evaluate new systems and give recommendations how to improve the evaluation.
KeywordsMeasurement Performance Experimentation
Unable to display preview. Download preview PDF.