Skip to main content
SpringerLink
Log in

Information Theoretic Approach to Information Extraction

  • Conference paper
Flexible Query Answering Systems (FQAS 2006)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4027))

Included in the following conference series:

Abstract

We use the hypergeometric distribution to extract relevant information from documents. The hypergeometric distribution gives the probability estimate of observing a given term frequency with respect to a prior. The lower the probability the higher the amount of information is carried by the term. Given a subset of documents, the information items are weighted by using the inversely related function of of the hypergeometric distribution. We here provide an exemplifying introduction to a topic-driven information extraction from a document collection based on the hypergeometric distribution.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Amati, G.: Frequentist and Bayesian Approach to Information Retrieval. In: Lalmas, M., MacFarlane, A., Rüger, S.M., Tombros, A., Tsikrika, T., Yavlinsky, A. (eds.) ECIR 2006. LNCS, vol. 3936, pp. 13–24. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  2. Attar, R., Fraenkel, A.S.: Local feedback in full-text retrieval systems. Journal of the ACM (JACM) 24(3), 397–417 (1977)

    Article  MATH  Google Scholar 

  3. Cai, D., Van Rijsbergen, C.J., Jose, J.M.: Automatic query expansion based on divergence. In: Paques, H., Liu, L., Grossman, D. (eds.) Proceedings of the Tenth International Conference on Information and Knowledge Management (CIKM-2001), Novmber 5–10, pp. 419–426. ACM Press, New York (2001)

    Chapter  Google Scholar 

  4. Carpineto, C., De Mori, R., Romano, G., Bigi, B.: An information theoretic approach to automatic query expansion. ACM Transactions on Information Systems 19(1), 1–27 (2001)

    Article  Google Scholar 

  5. Croft, W.: Relevance feedback and inference networks. In: Proceedings of the 16th Annual International ACM SIGIR Conference, pp. 2–11 (1993)

    Google Scholar 

  6. Croft, W., Harper, D.: Using probabilistic models of document retrieval without relevance information. Journal of Documentation 35, 285–295 (1979)

    Article  Google Scholar 

  7. Haines, D., Croft, W.B.: Relevance feedback and inference networks. In: Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, pp. 2–11. ACM Press, New York (1993)

    Chapter  Google Scholar 

  8. Harman, D.: Relevance feedback revisited. In: Proceedings of ACM SIGIR, Copenhagen, Denmark, June 1992, pp. 1–10 (1992)

    Google Scholar 

  9. Ide, E.: New experiments in relevance feedback. In: Salton (ed.) The SMART Retrieval System, pp. 337–354. Prentice-Hall, Englewood Cliffs (1971)

    Google Scholar 

  10. Kwok, K.L.: A new method of weighting query terms for ad-hoc retrieval. In: Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, pp. 187–195. ACM Press, New York (1996)

    Chapter  Google Scholar 

  11. Lafferty, J., McCallum, A., Pereira, F.: Conditional Random Fields: Probabilistic models for segmenting and labeling sequence data. In: Brodley, C.E., Danyluk, A.P. (eds.) ICML, pp. 282–289. Morgan Kaufmann, San Francisco (2001)

    Google Scholar 

  12. Lafferty, J., Zhai, C.: Document Language Models, Query Models, and Risk Minimization for Information Retrieval. In: Proceedings of ACM SIGIR, New Orleans, Louisiana, USA, September 9-12, pp. 111–119. ACM Press, New York (2001)

    Google Scholar 

  13. Robertson, S.: On relevance weight estimation and query expansion. Journal of Documentation 42(3), 288–297 (1986)

    Article  Google Scholar 

  14. Robertson, S.E., Sparck-Jones, K.: Relevance weighting of search terms. Journal of the American Society for Information Science 27, 129–146 (1976)

    Article  Google Scholar 

  15. Rocchio, J.: Relevance feedback in information retrieval. In: Salton (ed.) The SMART Retrieval System, pp. 313–323. Prentice-Hall, Englewood Cliffs (1971)

    Google Scholar 

  16. Salton, G., Buckley, C.: Improving Retrieval Performance by Relevance Feedback. Journal of the American Society for Information Science 41(4), 182–188 (1990)

    Article  Google Scholar 

  17. Voorhees, E.M.: Query expansion using lexical-semantic relations. In: Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, pp. 61–69. Springer, New York (1994)

    Google Scholar 

  18. Wellner, B., McCallum, A., Peng, F., Hay, M.: An integrated, conditional model of information extraction and coreference with application to citation matching. In: Conference on Uncertainty in Artificial Intelligence (UAI) (2004)

    Google Scholar 

  19. Xu, J., Croft, W.: Query expansion using local and global document analysis. In: Proceedings of ACM SIGIR, Zurich, Switzerland, August 1996, pp. 4–11 (1996)

    Google Scholar 

  20. Xu, J., Croft, W.B.: Improving the effectiveness of information retrieval with local context analysis. ACM Transactions on Information Systems (TOIS) 18(1), 79–112 (2000)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Fondazione Ugo Bordoni, Rome, Italy

    Giambattista Amati

Authors
  1. Giambattista Amati
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. The European Center for Counterterrorism Research and Studies Department of Computer Science and Engineering, Aalborg University, DK-6700, Esbjerg, Denmark

    Henrik Legind Larsen

  2. DISCO, University Milano-Bicocca, Milano, Italy

    Gabriella Pasi

  3. Computer Science Department, Aalborg University Esbjerg, Niels Bohrs Vej 8, 6700, Esbjerg, Denmark

    Daniel Ortiz-Arroyo

  4. Department of Computer Science, Roskilde University, P.O. Box 260, DK-4000, Roskilde, Denmark

    Troels Andreasen

  5. Research group PLIS: Programming, Logic and Intelligent Systems, Department of Communication, Business and Information Technologies, Roskilde University, P.O. Box 260, DK-4000, Roskilde, Denmark

    Henning Christiansen

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Amati, G. (2006). Information Theoretic Approach to Information Extraction. In: Larsen, H.L., Pasi, G., Ortiz-Arroyo, D., Andreasen, T., Christiansen, H. (eds) Flexible Query Answering Systems. FQAS 2006. Lecture Notes in Computer Science(), vol 4027. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11766254_44

Download citation

  • DOI: https://doi.org/10.1007/11766254_44

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-34638-8

  • Online ISBN: 978-3-540-34639-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation