, 43:27 | Cite as

Enhancing multi-document summarization using concepts

  • Pattabhi R K Rao
  • S Lalitha Devi


In this paper we propose a methodology to mine concepts from documents and use these concepts to generate an objective summary of all relevant documents. We use the conceptual graph (CG) formalism as proposed by Sowa to represent the concepts and their relationships in the documents. In the present work we have modified and extended the definition of the concept given by Sowa. The modified and extended definition is discussed in detail in section 2 of this paper. A CG of a set of relevant documents can be considered as a semantic network. The semantic network is generated by automatically extracting CG for each document and merging them into one. We discuss (i) generation of semantic network using CGs and (ii) generation of multi-document summary. Here we use restricted Boltzmann machines, a deep learning technique, for automatically extracting CGs. We have tested our methodology using MultiLing 2015 corpus. We have obtained encouraging results, which are comparable to those from the state of the art systems.


Concept mining text mining multi-document summarization machine learning restricted Boltzmann machines MultiLing 2015 dataset 


  1. 1.
    Mani I 2001 Summarization evaluation: an overview. In: Proceedings of NTCIR Google Scholar
  2. 2.
    Luhn H P 1958 The automatic creation of literature abstracts. IBM J. Res. Dev.  2(2): 159–165MathSciNetCrossRefGoogle Scholar
  3. 3.
    Lin C Y and Hovy E H 2002 From single to multi-document summarization: a prototype system and its evaluation. In: Proceedings of ACL-2002, pp. 457–464Google Scholar
  4. 4.
    Radev D, Jing H, Stys M and Tam D 2004 Centroid-based summarization of multiple documents. Inf. Process. Manage.  40: 919–938CrossRefzbMATHGoogle Scholar
  5. 5.
    Kleinberg 1999 Authoritative sources in a hyperlinked environment. J. ACM  46(5): 604–632MathSciNetCrossRefzbMATHGoogle Scholar
  6. 6.
    Brin S and Page L 1998 The anatomy of a large scale hypertextual Web search engine. Comput. Netw. ISDN Syst.  30: 1–7CrossRefGoogle Scholar
  7. 7.
    Erkan G and Radev D 2004 Lexpagerank: prestige in multi-document text summarization. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, Barcelona, Spain, JulyGoogle Scholar
  8. 8.
    Mihalcea R Graph-based ranking algorithms for sentence extraction, applied to text summarization. In: Proceedings of ACL 2004 on Interactive Poster and Demonstration Sessions (ACLdemo 2004), Barcelona, SpainGoogle Scholar
  9. 9.
    Mihalcea R and Tarau P 2004 TextRank – bringing order into texts. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2004), Barcelona, SpainGoogle Scholar
  10. 10.
    Mihalcea R, Tarau P and Figa E 2004 PageRank on semantic networks, with application to word sense disambiguation. In: Proceedings of the 20th International Conference on Computational Linguistics (COLING 2004), Geneva, SwitzerlandGoogle Scholar
  11. 11.
    McKeownand K and Radev D 1995 Generating summaries of multiple news articles. In: Proceedings of the 18th Annual International ACM, Seattle, WA, pp. 74–82Google Scholar
  12. 12.
    Virendra G and Tanveer J S 2012 Multi-document summarization using sentence clustering. In: IEEE Proceedings of the 4th International Conference on Intelligent Human–Computer Interaction, Kharagpur, India, pp. 314–318Google Scholar
  13. 13.
    Sowa J F 1984 Conceptual structures, information processing in mind and machine. Addison Wesley, Boston, MA, USAzbMATHGoogle Scholar
  14. 14.
    Edward E S and Douglas L M 1981 Categories and concepts Cambridge, Massachusetts–London, England: Harvard University PressGoogle Scholar
  15. 15.
    Sowa J F 1976 Conceptual graphs for a data base interface. IBM J. Res. Dev.  20(4): 336–357MathSciNetCrossRefzbMATHGoogle Scholar
  16. 16.
    Ivan A S, Baldwin T, Bond F, Copestake A and Flickinger D 2002 Multiword expressions: a pain in the neck for NLP. In: Proceedings of the 3rd International Conference on Intelligent Text Processing and Computational Linguistics (CICLing-2002), Mexico City, Mexico, pp. 1–15Google Scholar
  17. 17.
    Brill E 1994 Some advances in transformation based part of speech tagging. In: Proceedings of the Twelfth International Conference on Artificial Intelligence (AAAI-94), Seattle, WA, pp. 722–727Google Scholar
  18. 18.
    Ngai G and Florian R Transformation-based learning in the fast lane. In: Proceedings of NAACL’2001, Pittsburgh, PA, pp. 40–47Google Scholar
  19. 19.
    Lafferty J, McCallum A and Pereira F 2001 Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the 18th International Conference on Machine Learning (ICML-2001), pp. 282–289Google Scholar
  20. 20.
    Hinton G and Salakhutdinov R 2006 Reducing the dimensionality of data with neural networks. Science  313(5786): 504–507MathSciNetCrossRefzbMATHGoogle Scholar
  21. 21.
    Srivastava N, Salakhutdinov R R and Hinton G E 2013 Modeling documents with a deep Boltzmann machine. In: Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI) Google Scholar
  22. 22.
    Rao P R K and Lalitha Devi S 2015 Automatic identification of conceptual structures using deep Boltzmann machines. In: Proceedings of the Forum for Information Reterival and Evaluation, ACM DL, Gandhinagar, India, pp. 16–80Google Scholar
  23. 23.
    Mikolov T, Chen K, Corrado G and Dean J 2013 Efficient estimation of word representations in vector space. In: Proceedings of the Workshop at ICLR Google Scholar
  24. 24.
    Blum N 2001 A simplified realization of the Hopcroft–Karp approach to maximum matching in general graphs. Tech. Rep. 895549-CS, Computer Science Department, University of BonnGoogle Scholar
  25. 25.
    Hopcroft J E and Karp R M 1973 An n5/2 algorithm for maximum matchings in bipartite graphs. SIAM J. Comput.  2(4): 225–231, MathSciNetCrossRefzbMATHGoogle Scholar
  26. 26.
    Giannakopoulos G, Kubina J, John M C, Steinberger J, Favre B, Kabadjov M, Kruschwitz U and Poesio M 2015 Multiling 2015: multilingual summarization of single and multi-documents, on-line fora, and call-center conversations. In: Proceedings of SIGDIAL, Prague, pp. 270–274Google Scholar
  27. 27.
    Yang S Y and Soo V W 2012 Extract conceptual graphs from plain texts in patent claims. J. Eng. Appl. Artif. Intell.  25(4): 874–887CrossRefGoogle Scholar
  28. 28.
    Rao P R K, Lalitha Devi S and Rosso P 2013 Automatic identification of concepts and conceptual relations from patents using machine learning methods. In: Proceedings of the 10th International Conference on Natural Language Processing (ICON 2013), Noida, IndiaGoogle Scholar
  29. 29.
    Lin C Y 2004 ROUGE: a package for automatic evaluation of summaries. In: Proceedings of the Workshop on Text Summarization Branches Out, Barcelona, SpainGoogle Scholar
  30. 30.
    Lin C Y and Hovy E 2003 Automatic evaluation of summaries using n-gram co-occurrence. In: Proceedings of the 2003 Language Technology Conference (HLT-NAACL 2003), Edmonton, Canada, pp. 71–78Google Scholar

Copyright information

© Indian Academy of Sciences 2018

Authors and Affiliations

  1. 1.AU-KBC Research CentreMIT Campus of Anna UniversityChennaiIndia

Personalised recommendations