Abstract
We introduce in this paper a new heuristic constraint for PRF models, referred to as the Document Frequency (DF) constraint, which is validated through a series of experiments with an oracle. We then analyze, from a theoretical point of view, state-of-the-art PRF models according to their relation with this constraint. This analysis reveals that the standard mixture model for PRF in the language modeling family does not satisfy the DF constraint on the contrary to several recently proposed models. Lastly, we perform tests, which further validate the constraint, with a simple family of tf-idf functions based on a parameter controlling the satisfaction of the DF constraint.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Amati, G., Carpineto, C., Romano, G., Bordoni, F.U.: Fondazione Ugo Bordoni at TREC 2003: robust and web track (2003)
Clinchant, S., Gaussier, E.: Information-based models for ad hoc IR. In: SIGIR 2010, Conference on Research and Development in Information Retrieval (2010)
Collins-Thompson, K.: Reducing the risk of query expansion via robust constrained optimization. In: CIKM 2009 Conference on Information and Knowledge Management (2009)
Collins-Thompson, K., Callan, J.: Estimation and use of uncertainty in pseudo-relevance feedback. In: SIGIR 2007 (2007)
Crabtree, D.W., Andreae, P., Gao, X.: Exploiting underrepresented query aspects for automatic query expansion. In: SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2007 (2007)
Dillon, J.V., Collins-Thompson, K.: A unified optimization framework for robust pseudo-relevance feedback algorithms. In: CIKM, pp. 1069–1078 (2010)
Fang, H., Tao, T., Zhai, C.: A formal study of information retrieval heuristics. In: SIGIR 2004: Conference on Research and Development in Information Retrieval (2004)
Lavrenko, V., Croft, W.B.: Relevance based language models. In: SIGIR 2001:Conference on Research and Development in Information Retrieval (2001)
Lee, K.S., Croft, W.B., Allan, J.: A cluster-based resampling method for pseudo-relevance feedback. In: SIGIR 2008, Conference on Research and Development in Information Retrieval (2008)
Lv, Y., Zhai, C.: Adaptive relevance feedback in information retrieval. In: Conference on Information and Knowledge Management, CIKM 2009 (2009)
Lv, Y., Zhai, C.: A comparative study of methods for estimating query language models with pseudo feedback. In: CIKM 2009: Conference on Information and Knowledge Management, pp. 1895–1898 (2009)
Lv, Y., Zhai, C.: Positional relevance model for pseudo-relevance feedback. In: SIGIR 2010, Conference on Research and Development in Information Retrieval (2010)
Seo, J., Croft, W.B.: Geometric representations for multiple documents. In: SIGIR 2010: Conference on Research and Development in Information Retrieval (2010)
Xu, Z., Akella, R.: A new probabilistic retrieval model based on the dirichlet compound multinomial distribution. In: SIGIR 2008: Conference on Research and Development in Information Retrieval (2008)
Zhai, C., Lafferty, J.: Model-based feedback in the language modeling approach to information retrieval. In: CIKM 2001 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Clinchant, S., Gaussier, E. (2011). Is Document Frequency Important for PRF?. In: Amati, G., Crestani, F. (eds) Advances in Information Retrieval Theory. ICTIR 2011. Lecture Notes in Computer Science, vol 6931. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23318-0_10
Download citation
DOI: https://doi.org/10.1007/978-3-642-23318-0_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23317-3
Online ISBN: 978-3-642-23318-0
eBook Packages: Computer ScienceComputer Science (R0)