SIGIR ’94 pp 292-300 | Cite as

The Effect of Adding Relevance Information in a Relevance Feedback Environment

  • Chris Buckley
  • Gerard Salton
  • James Allan
Conference paper

Abstract

The effects of adding information from relevant documents are examined in the TREC routing environment. A modified Rocchio relevance feedback approach is used, with a varying number of relevant documents retrieved by an initial SMART search, and a varying number of terms from those relevant documents used to expand the initial query. Recall-precision evaluation reveals that as the amount of expansion of the query due to adding terms from relevant documents increases, so does the effectiveness. There appears to be a linear relationship between the log of the number of terms added and the recall-precision effectiveness. There also appears to be a linear relationship between the log of the number of known relevant documents and the recall-precision effectiveness.

Keywords

Harman 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Gerard Salton. Automatic Text Processing—the Transformation, Analysis and Retrieval of Information by Computer. Addison-Wesley Publishing Co., Reading, MA, 1989.Google Scholar
  2. 2.
    Gerard Salton and Chris Buckley. Improving retrieval performance by relevance feedback. Journal of the American Society for Information Science, 41 (4): 288–297, 1990.CrossRefGoogle Scholar
  3. 3.
    David Haines and W. Bruce Croft. Relevance feedback and inference networks. In Robert Korfhage, Edie Rasmussen, and Peter Willett, editors, Proceedings of the Sixteenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 2–11, New York, 1993. Association for Computer Machinery.Google Scholar
  4. 4.
    D. K. Harman. Overview of the first Text REtrieval Conference (TREC-1). In D. K. Harman, editor, Proceedings of the First Text REtrieval Conference (TREC-1), pages 1–20. NIST Special Publication 500–207, March 1993.Google Scholar
  5. 5.
    D. K. Harman. Overview of the second Text REtrieval Conference (TREC-2). In D. K. Harman, editor, Proceedings of the Second Text REtrieval Conference (TREC-2). NIST Special Publication (in preparation).Google Scholar
  6. 6.
    Chris Buckley, Gerard Salton, and James Allan. Automatic retrieval with locality information using SMART. In D. K. Harman, editor, Proceedings of the First Text REtrieval Conference (TREC-1), pages 59–72. NIST Special Publication 500–207, March 1993.Google Scholar
  7. 7.
    Chris Buckley, Jaynes Allan, and Gerard Salton. Automatic routing and ad-hoc retrieval using SMART: TREC 2. In D. K. Harman, editor, Proceedings of the Second Text REtrieval Conference (TREC-2). NIST Special Publication (in preparation).Google Scholar
  8. 8.
    J.J. Rocchio. Relevance feedback in information retrieval. In Gerard Salton, editor, The SMART Retrieval System-Experiments in Automatic Document Processing, pages 313–323. Prentice Hall, Englewood Cliffs, NJ, 1971.Google Scholar
  9. 9.
    S.E. Robertson and K. Sparck Jones. Relevance weighting of search terms. Journal of the American Society for Information Science, 27 (3): 129–146, May-June 1976.Google Scholar
  10. 10.
    S.E. Robertson, C.J. van Rijsbergen, and M.F. Porter. Probabilistic models of indexing and searching. In R.N. Oddy, S.E. Robertson, C.J. van Rijsbergen, and P.W. Williams, editors, Information Retrieval Research. Butterworths, London, 1981.Google Scholar
  11. 11.
    Y.K. Chang, C. Cirillo, and J. Razon. Evaluation of feedback retrieval using modified freezing, residual collection, and test and control groups. In Gerard Salton, editor, The SMART Retrieval System—Experiments in Automatic Document Processing, chapter 17, pages 355–370. Prentice Hall, Englewood Cliffs, NJ, 1971.Google Scholar

Copyright information

© Springer-Verlag London Limited 1994

Authors and Affiliations

  • Chris Buckley
    • 1
  • Gerard Salton
    • 1
  • James Allan
    • 1
  1. 1.Department of Computer Science Upson HallCornell UniversityIthacaUSA

Personalised recommendations