Text Compression by Syntactic Pruning

  • Michel Gagnon
  • Lyne Da Sylva
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4013)

Abstract

We present a method for text compression, which relies on pruning of a syntactic tree. The syntactic pruning applies to a complete analysis of sentences, performed by a French dependency grammar. Sub-trees in the syntactic analysis are pruned when they are labelled with targeted relations. Evaluation is performed on a corpus of sentences which have been manually compressed. The reduction ratio of extracted sentences averages around 70%, while retaining grammaticality or readability in a proportion of over 74%. Given these results on a limited set of syntactic relations, this shows promise for any application which requires compression of texts, including text summarization.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Abeillé, A., Clément, L., Toussenel, F.: Building a treebank for french. In: Abeillé, A. (ed.) Treebanks: Building and Using Parsed Corpora, pp. 165–188. Kluwer Academic Publishers, Dordrecht (2003)Google Scholar
  2. 2.
    Barzilay, R., McKeown, K., Elhadad, M.: Information fusion in the context of multi-document summarization. In: Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics, New Brunswick, NJ, pp. 550–557. Association for Computational Linguistics (1999)Google Scholar
  3. 3.
    Blache, P., Morin, J.-Y.: Une grille d’évaluation pour les analyseurs syntaxiques. In: TALN 2003, Batz-sur-mer, juin 11-14, 2003, pp. 77–86 (2003)Google Scholar
  4. 4.
    Coulombe, C., Doll, F., Drouin, P.: Intégration d’un analyseur syntaxique à large couverture dans un outil de langage contrôlé en français. Lingvisticae Investigationes (Machine Translation, Controlled Languages and Specialised Languages) 28(1) (2005)Google Scholar
  5. 5.
    Fiszman, M., Rindflesch, T.C., Kilicoglu, H.: Abstraction summarization for managing the biomedical research literature. In: Proceedings of the Computational Lexical Semantics Workshop, HLT-NAACL 2004, Boston, Massachussetts, USA, May 2-7, 2004, pp. 76–83 (2004)Google Scholar
  6. 6.
    Gagnon, M., Da Sylva, L.: Text summarization by sentence extraction and syntactic pruning. In: Computational Linguistics in the North-East (CLiNE), Gatineau (2005)Google Scholar
  7. 7.
    Goulet, M.-J., Bourgeoys, J.: Le projet gÉraf: guide pour l’évaluation des résumés automatiques français. In: TALN 2004, avril 19-21, 2004, pp. 19–21 (2004)Google Scholar
  8. 8.
    Grefenstette, G.: Producing intelligent telegraphic text reduction to provide an audio scanning service for the blind. In: Working Notes of the Workshop on Intelligent Text Summarization, Menlo Park, CA. American Association for Artificial Intelligence Spring Symposium Series, pp. 111–117 (1998)Google Scholar
  9. 9.
    Grefenstette, G.: Light parsing as finite-state filtering. In: Proceedings ECAI 1996 Workshop on Extended Finite State Models of Language, August 11-12 (1996)Google Scholar
  10. 10.
    Inderjeet, M., Maybury, M.T.: Advances in Automatic Text Summarization. MIT Press, Cambridge (1999)Google Scholar
  11. 11.
    Jing, H., McKeown, K.: The decomposition of human-written summary sentences. In: Proceedings of the 22nd International Conference on Research and Development in Information Retrieval (SIGIR 1999), New York, pp. 129–136. Association for Computing Machinery (1999)Google Scholar
  12. 12.
    Knight, K., Marcu, D.: Summarization beyond sentence extraction: A probabilistic approach to sentence compression. Artificial Intelligence 139, 91–107 (2002)MATHCrossRefGoogle Scholar
  13. 13.
    Lin, C.-Y.: Improving summarization performance by sentence compression - a pilot study. In: Proceedings of the Sixth International Workshop on Information Retrieval with Asian Languages (IRAL 2003), Sapporo, Japan (July 7, 2003)Google Scholar
  14. 14.
    Mani, I.: Automatic Summarization. John Benjamins, Amsterdam, Philadelphia (2001)MATHGoogle Scholar
  15. 15.
    Minel, J.-L.: Résumé automatique de textes. Traitement automatique des langues 45(1) (2004)Google Scholar
  16. 16.
    NIST. Document understanding conference - introduction. Technical report, http://www-nlpir.nist.gov/projects/duc/intro.html
  17. 17.
    Saggion, H., Lapalme, G.: Selective analysis for the automatic generation of summaries. In: Beghtol, C., Howarth, L., Williamson, N. (eds.) Dynamism and Stability in Knowledge Organization – Proceedings of the Sixth International ISKO Conference, Toronto, july 2000, pp. 176–181. International Society of Knowledge Organization, Ergon Verlag (2000)Google Scholar
  18. 18.
    Thione, G.L., van den Berg, M.H., Polanyi, L., Culy, C.: Hybrid text summarization: Combining external relevance measures with structural analysis. In: Proceedings of the ACL2004 Workshop Text Summarization Branches Out, Barcelona, Spain, July 25-26 (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Michel Gagnon
    • 1
  • Lyne Da Sylva
    • 2
  1. 1.Département de génie informatiqueÉcole Polytechnique de MontréalCanada
  2. 2.École de bibliothéconomie et des sciences de l’informationUniversité de MontréalCanada

Personalised recommendations