Naïve Algorithms for Keyphrase Extraction and Text Summarization from a Single Document Inspired by the Protein Biosynthesis Process

  • Daniel Gayo-Avello
  • Darío Álvarez-Gutiérrez
  • José Gayo-Avello
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3141)

Abstract

Keywords are a simple way of describing a document, giving the reader some clues about its contents. However, sometimes they only categorize the text into a topic being more useful a summary. Keywords and abstracts are common in scientific and technical literature but most of the documents available (e.g., web pages) lack such help, so automatic keyword extraction and summarization tools are fundamental to fight against the “information overload” and improve the users’ experience. Therefore, this paper describes a new technique to obtain keyphrases and summaries from a single document. With this technique, inspired by the process of protein biosynthesis, a sort of “document DNA” can be extracted and translated into a “significance protein” which both produces a set of keyphrases and acts on the document highlighting the most relevant passages. These ideas have been implemented into a prototype, publicly available in the Web, which has obtained really promising results.

References

  1. 1.
    Dunning, T.: Statistical identification of language. Computing Research Laboratory, New Mexico State University (1994)Google Scholar
  2. 2.
    Sibun, P., Reynar, J.C.: Language Identification: Examining the Issues. In: Proc. of 5th Symposium on Document Analysis and Information Retrieval, Las Vegas, USA (1996)Google Scholar
  3. 3.
    Cavnar, W.B., Trenkle, J.M.: N-Gram-Based Text Categorization. In: Proc. of 3rd Annual Symposium on Document Analysis and Information Retrieval, Las Vegas, USA (1994)Google Scholar
  4. 4.
    Slonim, N., Tishby, N.: Document clustering using word clusters via the information bottleneck method. In: Proc. of 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Athens, Greece, pp. 208–215 (2000)Google Scholar
  5. 5.
    Hulth, A.: Improved Automatic Keyword Extraction Given More Linguistic Knowledge. In: Proc. of the 2003 Conference on Empirical Methods in NLP, Sapporo, Japan (2003)Google Scholar
  6. 6.
    Matsuo, Y., Ishizuka, M.: Keyword Extraction from a Single Document using Word Co-occurrence Statistical Information. In: Proc. of the Sixteenth International FLAIRS Conference, St. Augustine, FL, USA, pp. 392–396 (2003)Google Scholar
  7. 7.
    Hovy, E., Lin, C.: Automated text summarization in SUMMARIST. In: Mani, I., Maybury, M. (eds.) Advances in Automated Text Summarization, MIT Press, Cambridge (1999)Google Scholar
  8. 8.
    Srinivasan, R., Rose, G.D.: Ab initio prediction of protein structure using LINUS. Proteins: Structure, Function, and Genetics 47(4), 489–495 (2002)CrossRefGoogle Scholar
  9. 9.
    Larson, S.M., et al.: Folding@Home and Genome@Home: Using distributed computing to tackle previously intractable problems in computational biology. In: Grant, R. (ed.) Computational Genomics, Horizon Press (2003)Google Scholar
  10. 10.
    Ferreira da Silva, J., Pereira Lopes, G.: Extracting Multiword Terms from Document Collections. In: Proc. of VExTAL, Venice, Italy (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Daniel Gayo-Avello
    • 1
  • Darío Álvarez-Gutiérrez
    • 1
  • José Gayo-Avello
    • 1
  1. 1.Department of InformaticsUniversity of OviedoOviedoSPAIN

Personalised recommendations