Skip to main content

Fully Utilize Feedbacks: Language Model Based Relevance Feedback in Information Retrieval

  • Conference paper
  • 943 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 7120))

Abstract

Relevance feedback algorithm is proposed to be an effective way to improve the precision of information retrieval. However, most researches about relevance feedback are based on vector space model, which can’t be used in other more complicated and powerful models, such as language model and logic model. Meanwhile, other researches are conceptually restricted to the view of a query as a set of terms, and so cannot be naturally applied to more general case when the query is considered as a sequence of terms and the frequency information of a query tern is considered. In this paper, we mainly focuses on relevant feedback Algorithm based on language model. We use a mixture model to describe the process of generating document and use EM to solve model’s parameters. Our research also employs semi-supervised learning to calculate collection model and proposes an effective way to obtain feedback from irrelevant documents to improve our algorithm.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. van Rijsbergen, C.J.: Information retrieval, 2nd edn. Butterworths (1979)

    Google Scholar 

  2. Crestani, F., Ruthven, I., Sanderson, M., van Rijsbergen, C.J.: The troubles with using a logical model of IR on a large collection of documents. In: Harman, D.K. (ed.) Proceedings of the Fourth Text Retrieval Conference (TREC-4), pp. 509–525. NIST special publication (1995)

    Google Scholar 

  3. Ponte, J., Croft, W.B.: A language modeling approach to information retrieval. In: Proceedings of the ACM SIGIR 1988, pp. 275–281 (1988)

    Google Scholar 

  4. Lafferty, J., Zhai, C.: Docunment language models, query models, and risk minimization for information retrieval. In: Proceedings of SIGIR 2001 (2001)

    Google Scholar 

  5. Lafferty, J., Zhai, C.: A study of smoothing methods for language models applied to ad hoc information retrieval. In: Proceedings of SIGIR 2001 (2001)

    Google Scholar 

  6. Rocchio, J.J.: Relevance feedback in information retrieval. In: Salton, G. (ed.) The SMART Retrieval System Experiments in Automatic Document Processing, ch. 14, pp. 313–323 (1971)

    Google Scholar 

  7. Ide, E., Salton, G.: Interactive search strategies and dynamic file organization in information retrieval. In: Salton, G. (ed.) The SMART Retrieval System - Experiments in Automatic Document Processing, ch. 18, pp. 373–393 (1971)

    Google Scholar 

  8. Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. Journal of Royal Statist. Soc. B 39, 1–38 (1977)

    MathSciNet  MATH  Google Scholar 

  9. Salton, G., Buckley, C.: Improving retrieval performance by relevance feedback. Journal of the American Society for Information Science 41(4), 288–297 (1990)

    Article  Google Scholar 

  10. Zhai, C., Lafferty, J.: Model-based feedback in the language modeling approach to information retrieval. In: Proceedings of CIKM 2001 (2001)

    Google Scholar 

  11. Robertson, S.E.: The Probability Ranking Principle in IR, pp. 281–286. Morgan Kaufmann Publishers, Inc., San Francisco (1997)

    Google Scholar 

  12. Lavrenko, V., Croft, B.: Relevance-based language models. In: Proceedings of SIGIR 2001 (2001)

    Google Scholar 

  13. Lv, Y., Zhai, C.: Adaptive relevance feedback in informationretrieval. In: Proceedings of CIKM 2009 (2009)

    Google Scholar 

  14. Tan, B., Velivelli, A., Fang, H., Zhai, C.: Termfeedback for information retrieval with languagemodels. In: Proceedings of SIGIR 2007 (2007)

    Google Scholar 

  15. Bai, J., Song, D., Bruza, P., Nie, J.-Y., Cao, G.: Queryexpansion using term relationships in language models forinformation retrieval. In: Proceedings of CIKM 2005 (2005)

    Google Scholar 

  16. Bennett, G., Scholer, F., Uitdenbogerd, A.: A comparative study of probabilistic andlanguage models for information retrieval. In: Nineteenth Australasian Database Conference (ADC). CRPIT, ACS, vol. 75, pp. 65–74 (2008)

    Google Scholar 

  17. Xu, Z., Akella, R.: A bayesian logisticregression model for active relevance feedback. In: Proceedings of SIGIR 2008 (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Lv, SL., Deng, ZH., Yu, H., Gao, N., Jiang, JJ. (2011). Fully Utilize Feedbacks: Language Model Based Relevance Feedback in Information Retrieval. In: Tang, J., King, I., Chen, L., Wang, J. (eds) Advanced Data Mining and Applications. ADMA 2011. Lecture Notes in Computer Science(), vol 7120. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25853-4_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-25853-4_30

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-25852-7

  • Online ISBN: 978-3-642-25853-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics