Abstract
Motivated by the hypothesis that the retrieval performance of a weighting model is independent of the language in which queries and collection are expressed, we compared the retrieval performance of three weighting models, i.e., Okapi, statistical language modeling (SLM), and deviation from randomness (DFR), on three monolingual test collections, i.e., French, Italian, and Spanish. The DFR model was found to consistently achieve better results than both Okapi and SLM, whose performance was comparable. We also evaluated whether the use of retrieval feedback improved retrieval performance; retrieval feedback was beneficial for DFR and Okapi and detrimental for SLM. Besides relative performance, DFR with retrieval feedback achieved excellent absolute results: best run for Italian and Spanish, third run for French.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Amati, G., Carpineto, C., Romano, G.: FUB at TREC-10 Web Track: A Probabilistic Framework for Topic Relevance Term Weighting. In: Proceedings of the 10th Text REtrieval Conference (TREC-10), pp. 182–191. NIST Special Publication 500-250, Gaithersburg (2001)
Amati, G., Carpineto, C., Romano, G.: Italian monolingual information retrieval with PROSIT. In: Peters, C., Braschler, M., Gonzalo, J. (eds.) CLEF 2002. LNCS, vol. 2785, pp. 257–264. Springer, Heidelberg (2003)
Amati, G., van Rijsbergen, C.J.: Probabilistic models of information retrieval based on measuring divergence from randomness. ACM Transactions on Information Systems 20(4), 357–389 (2002)
Amati, G., Carpineto, C., Romano, G.: Fondazione Ugo Bordoni at TREC 2003: Robust and Web track. In: Proceedings of TREC 2003, Gaithersburg, MD, USA, pp. 210–219 (2003)
Carpineto, C., De Mori, R., Romano, G., Bigi, B.: An Information Theoretic Approach to Automatic Query Expansion. ACM Transactions on Information Systems 19(1), 1–27 (2001)
Hiemstra, D., Kraaij, W.: Twenty-one at TREC-7: Ad hoc and cross-language track. In: Proceedings of the 7th Text REtrieval Conference (TREC-7), pp. 227–238. NIST Special Publication 500-242, Gaithersburg (1998)
Ponte, J., Croft, W.B.: A language modeling approach to information retrieval. In: Proceedings of the 21st Annual International ACM SIGIR Conference on Reasearch and Development in Information Retrieval, pp. 275–281 (1998)
Porter, M.F.: An algorithm for suffix stripping. Program 14, 130–137 (1980)
Robertson, S.E., Walker, S., Beaulieu, M.M.: Okapi at TREC-7: Automatic Ad Hoc, Filtering, VLC, and Interactive track. In: Proceedings of the 7th Text REtrieval Conference (TREC-7), pp. 253–264. NIST Special Publication 500-242, Gaithersburg (1998)
Savoy, J.: Reports on CLEF-2001 experiments. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds.) CLEF 2001. LNCS, vol. 2406, pp. 257–264. Springer, Heidelberg (2002)
Zhai, C., Lafferty, J.: A study of smoothing methods for language models applied to ad hoc information retrieval. In: Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 334–342 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Amati, G., Carpineto, C., Romano, G. (2004). Comparing Weighting Models for Monolingual Information Retrieval. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds) Comparative Evaluation of Multilingual Information Access Systems. CLEF 2003. Lecture Notes in Computer Science, vol 3237. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30222-3_29
Download citation
DOI: https://doi.org/10.1007/978-3-540-30222-3_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-24017-4
Online ISBN: 978-3-540-30222-3
eBook Packages: Springer Book Archive