Advertisement

Capturing Document Semantics for Ontology Generation and Document Summarization

  • David Baxter
  • Bryan Klimt
  • Marko Grobelnik
  • David Schneider
  • Michael WitbrockEmail author
  • Dunja Mladenić

When dealing with a document collection, it is important to identify repeated information. In multi-document summarization, for example, it is important to retain widely repeated content, even if the wording is not exactly the same. Simplistic approaches simply look for the same strings, or the same syntactic structures (including words), across documents. Here we investigate semantic matching, applying background knowledge from a large, general knowledge base (KB) to identify such repeated information in texts.

Automatic document summarization is the problem of creating a surrogate for a document that adequately represents its full content. Automatic ontology generation requires information about candidate types, roles and relationships gathered from across a document or document collection. We aim at a summarization system that can replicate the quality of summaries created by humans and ontology creation systems that significantly reduce the human effort required for construction. Both applications depend for their success on extracting the essence of a collection of text. The work reported here demonstrates the utility of using deep knowledge from Cyc for effectively identifying redundant information in texts by using both semantic and syntactic information.

Keywords

Ontology Generation Lexical Information Semantic Graph Summarization System Document Summarization 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Fellbaum C (Ed.) (1998) WordNet: An electronic lexical database. Cambridge, MA: MIT Press. ISBN-13 978-0-262-06197-1zbMATHGoogle Scholar
  2. Fortuna B, Mladenić D, Grobelnik M (2006) Semi-automatic construction of topic ontologies. In: Ackermann, Berendt, Grobelnik, Mladenić (Eds.). Semantics, web and mining: joint international workshops, EWMF 2005 and KDO 2005, Porto, Portugal, October 3 and 7, 2005: revised selected papers (Lecture Notes in Computer Science, Lecture Notes in artificial Intelligence, Vol. 4289). Berlin; Heidelberg; New York: Springer, 121–131Google Scholar
  3. Fortuna B, Mladenić D, Grobelnik M (2005) Visualization of Text Document Corpus. Informatica Journal, vol. 29, no. 4: 497–502Google Scholar
  4. Grinberg D, Lafferty J, Sleator D (1995) A robust parsing algorithm for link grammars. Carnegie Mellon University Computer Science Technical Report CMU-CS-95-125, and Proceedings of the Fourth International Workshop on Parsing Technologies, Prague, SeptemberGoogle Scholar
  5. Grobelnik M, Mladenić D (2005) Automated Knowledge Discovery in Advanced Knowledge Management. Journal of Knowledge Management, Vol. 9, 132–146CrossRefGoogle Scholar
  6. Krishnan V, Manning C D (2006) An Effective Two-Stage Model for Exploiting Non-Local Dependencies in Named Entity Recognition. Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, 1121–1128Google Scholar
  7. Lenat D B (1995, November) Cyc: A Large-Scale Investment in Knowledge Infrastructure. Communications of the ACM vol. 38, no. 11Google Scholar
  8. Leskovec J, Grobelnik M, Milic-Frayling N (2004) Learning Sub-structures of Document Semantic Graphs for Document Summarization. In Workshop on Link Analysis and Group Detection (LinkKDD2004). The Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data MiningGoogle Scholar
  9. Leskovec J, Milic-Frayling N, Grobelnik M (2005) Impact of Linguistic Analysis on the Semantic Graph Coverage and Learning of Document Extracts. National Conference on Artificial Intelligence AAAI-2005, Pittsburgh, PAGoogle Scholar
  10. Matuszek C, Cabral J, Witbrock M, DeOliveira J (2006) An Introduction to the Syntax and Content of Cyc. In Proceedings of the 2006 AAAI Spring Symposium on Formalizing and Compiling Background Knowledge and Its Applications to Knowledge Representation and Question Answering, Stanford, CA, March 2006Google Scholar
  11. Panton K, Miraglia P, Salay N et al. (2002) Knowledge Formation and Dialogue Using the KRAKEN Toolset. In Proceedings of the Fourteenth National Conference on Innovative Applications of Artificial Intelligence, 900–905. Edmonton, CanadaGoogle Scholar
  12. Shah P, Schneider D, Matuszek C, Kahlert R C, Aldag B, Baxter D, Cabral J, Witbrock M, Curtis J (2006) Automated Population of Cyc: Extracting Information about Named-entities from the Web. In Proceedings of the Nineteenth International FLAIRS Conference, 153–158, Melbourne Beach, FL, May 2006Google Scholar
  13. Sleator D and Temperley D (1991) Parsing English with a Link Grammar. Carnegie Mellon University Computer Science Technical Report CMU-CS-91-196, October 1991Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • David Baxter
    • 1
  • Bryan Klimt
    • 1
  • Marko Grobelnik
    • 2
  • David Schneider
    • 1
  • Michael Witbrock
    • 1
    Email author
  • Dunja Mladenić
    • 2
  1. 1.Cycorp, Inc.Austin
  2. 2.Jozef Stefan InstituteLjubljanaSlovenia

Personalised recommendations