Abstract
Prior efforts have shown that data fusion techniques can be used to improve retrieval effectiveness under certain situations. Although the precise conditions necessary for fusion to improve retrieval have not been identified, it is widely believed that as long as component result sets used in fusion have higher relevant overlap than non-relevant overlap, improvements due to fusion can be observed. We show that this is not the case when systemic differences are held constant and different highly effective document retrieval strategies are fused within the same information retrieval system. Furthermore, our experiments have shown that the ratio of relevant to non-relevant overlap is a poor indicator of the likelihood of fusion’s effectiveness, and we propose an alternate hypothesis of what needs to happen in order for fusion to improve retrieval when standard voting/merging algorithms such as CombMNZ are employed.
The authors would like to note that a greatly expanded version of this work was published in the 2003 ACM Symposium on Applied Computing (ACM-SAC). Interested readers are invited to refer to [Beit03] for further details
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bartell, B.T., Cottrell, G.W., Belew, R.K.: Automatic Combination of multiple ranked retrieval systems. In: Proceedings of the 17th Annual ACM-SIGIR, pp. 173–181 (1994)
Beitzel, S.M., Jensen, E.C., Chowdhury, A., Grossman, D., Frieder, O., Goharian, N.: Disproving the Fusion Hypothesis: An Analysis of Data Fusion via Effective Information Retrieval Strategies. In: Proceedings of the 2003 ACM Symposium on Applied Computing (ACM-SAC), Melbourne, FL (March 2003)
Belkin, N.J., Cool, C., Croft, W.B., Callan, J.P.: The effect of multiple query representations on information retrieval performance. In: Proceedings of the 16th Annual ACM-SIGIR, pp. 339–346 (1993)
Belkin, N.J., Kantor, P., Fox, E.A., Shaw, J.A.: Combining evidence of multiple query representation for information retrieval. Information Processing & Management 31(3), 431–448 (1995)
Chowdhury, A., et al.: Improved query precision using a unified fusion model. In: Proceedings of the 9th Text Retrieval Conference, TREC-9 (2000)
Fox, E.A., Shaw, J.A.: Combination of Multiple Searches. In: Proceedings of the 2nd Text Retrieval Conference (TREC-2), pp. 243–252. NIST Special Publication 500-215 (1994)
Kwok, K., et al.: TREC-7 Ad-Hoc, High precision and filtering experiments using PIRCS. In: Proceedings of the 7th Text Retrieval Conference, TREC-7 (1998)
Lee, J.H.: Combining Multiple Evidence from Different Properties of Weighting Schemes. In: Proceedings of the 18th Annual ACM-SIGIR, pp. 180–188 (1995)
Lee, J.H.: Analyses of Multiple Evidence Combination. In: Proceedings of the 20th Annual ACM-SIGIR, pp. 267–276 (1995)
Robertson, S., et al.: Okapi at TREC-4. In: Proceedings of the 4th Text Retrieval Conference, TREC-4 (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Beitzel, S.M., Jensen, E.C., Chowdhury, A., Grossman, D., Goharian, N., Frieder, O. (2004). Recent Results on Fusion of Effective Retrieval Strategies in the Same Information Retrieval System. In: Callan, J., Crestani, F., Sanderson, M. (eds) Distributed Multimedia Information Retrieval. DIR 2003. Lecture Notes in Computer Science, vol 2924. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24610-7_8
Download citation
DOI: https://doi.org/10.1007/978-3-540-24610-7_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20875-4
Online ISBN: 978-3-540-24610-7
eBook Packages: Springer Book Archive