Advertisement

NLP-Driven Constructive Learning for Filtering an IR Document Stream

  • João Marcelo Azevedo Arcoverde
  • Maria das Graças Volpe Nunes
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4730)

Abstract

Feature engineering is known as one of the most important challenges for knowledge acquisition, since any inductive learning system depends upon an efficient representation model to find good solutions to a given problem. We present an NLP-driven constructive learning method for building features based upon noun phrases structures, which are supposed to carry the highest discriminatory information. The method was test at the CLEF 2006 Ad-Hoc, monolingual (Portuguese) IR track. A classification model was obtained using this representation scheme over a small subset of the relevance judgments to filter false-positives documents returned by the IR-system. The goal was to increase the overall precision. The experiment achieved a MAP gain of 41.3%, in average, over three selected topics. The best F1-measure for the text classification task over the proposed text representation model was 77.1%. The results suggest that relevant linguistic features can be exploited by NLP techniques in a domain specific application, and can be used suscesfully in text categorization, which can act as an important coadjuvant process for other high-level IR tasks.

Keywords

Information Retrieval Noun Phrase Average Precision Query Expansion Relevance Judgment 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Arcoverde, J.M.A., Nunes, M.d.G.V., Scardua, W.: Using noun phrases for local analysis in automatic query expansion. In: CLEF working notes for ad-hoc, monolingue, Portuguese track (2006)Google Scholar
  2. 2.
    Apté, C., Damerau, F., Weiss, S.M.: Towards language independent automated learning of text categorisation models. In: Research and Development in Information Retrieval, pp. 23–30 (1994)Google Scholar
  3. 3.
    Sebastiani, F.: Machine learning in automated text categorization. ACM Computing Surveys 34(1), 1–47 (2002)CrossRefGoogle Scholar
  4. 4.
    Turtle, H.R.: Inference Networks for Document Retrieval. PhD thesis (1991)Google Scholar
  5. 5.
    Ratnaparkhi, A.: A maximum entropy part-of-speech tagger, University of Pennsylvania, USA (1996)Google Scholar
  6. 6.
    Brill, E.: Transformation-based error-driven learning and natural language processing: A case study in part-of-speech tagging. Computational Linguistics 21(4), 543–565 (1995)Google Scholar
  7. 7.
    Michalski, R.S.: Pattern recognition as knowledge-guided computer induction, Tech. Report 927 (1978)Google Scholar
  8. 8.
    Bloedorn, E., Michalski, R.S.: Data-driven constructive induction. IEEE Intelligent Systems 13(2), 30–37 (1998)CrossRefGoogle Scholar
  9. 9.
    Chawla, N.V., Japkowicz, N., Kotcz, A.: Editorial: special issue on learning from imbalanced data sets. SIGKDD Explorations 6(1), 1–6 (2004)CrossRefGoogle Scholar
  10. 10.
    Raskutti, B., Kowalczyk, A.: Extreme rebalancing for svms: a case study. SIGKDD Explorations 6(1), 60–69 (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • João Marcelo Azevedo Arcoverde
    • 1
  • Maria das Graças Volpe Nunes
    • 1
  1. 1.Departamento de Ciências de Computação, Instituto de Ciências Matemáticas e de Computação, Universidade de Sã Paulo - Campus de São Carlos, Caixa Postal 668, 13560-970 - São Carlos, SPBrasil

Personalised recommendations