Skip to main content
SpringerLink
Log in

Extractive text summarization of arabic multi-document using fuzzy C-means and Latent Dirichlet Allocation

  • Original Article
  • Published:
International Journal of System Assurance Engineering and Management Aims and scope Submit manuscript

Abstract

In this research, we investigated the performance of the combination of fuzzy c-means and latent Dirichlet allocation algorithms for Arabic multi-document summarization. The summary should include the most essential sentences from multi-documents with the same topic. The TAC-2011 corpus is used for experiments, first, the documents in the corpus are clustered using fuzzy c-means algorithm. The aim of the clustering process here is to classify the documents according to their topics, e.g., economic, politic, sport, etc. The results are compared against some recent Arabic summarization approaches that used ant colony and discriminant analysis algorithms. The proposed approach has obtained competitive results compared to those recent approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Abdulateef S, Khan NA, Chen B, Shang X (2020) Multi-document Arabic Text Summarization Based on Clustering and Word2Vec to Reduce Redundancy. Information 11:59. https://doi.org/10.3390/info11020059. )

    Article  Google Scholar 

  • Afsharizadeh M. (2022). A Survey on Multi-document Summarization and Domain-Oriented Approaches. Journal of Information Systems and Telecommunication (JIST), 37, pp. 68–78

  • Al-Dhelaan M (2015) StarSum: A Simple Star Graph for Multi-document Summarization. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 715–718

  • Alqaisi R, Ghanem W, Qaroush A (2020) Extractive Multi-Document Arabic Text Summarization Using Evolutionary Multi-Objective Optimization With K-Medoid Clustering. IEEE Access 8:228206–228224. https://doi.org/10.1109/ACCESS.2020.3046494. )

    Article  Google Scholar 

  • Al-Saleh AB, Menai ME (2018) Ant Colony System for Multi-Document Summarization. Claiming a place: Proceedings of the27th International Conference on Computational Linguistics, New Mexico, USA, 20–26 August 2018, pp.734–744

  • Al-Taani AT, Al-Sayadi SH (2020) Classification of Arabic Text Using Singular Value Decomposition and Fuzzy C-Means Algorithms. In: Johri P, Verma J, Paul S (eds) Applications of Machine Learning. Algorithms for Intelligent Systems. Springer, Singapore. https://doi.org/10.1007/978-981-15-3357-0_8.)

    Chapter  Google Scholar 

  • Al-Taani AT, Msallam MM, Wedian SA (2012) A top-down chart parser for analyzing Arabic sentences. Int Arabic J Inform Technol 9(2):109–116

    Google Scholar 

  • Al-Taani AT (2017) (). Automatic text summarization approaches, paper presented at the International Conference on Infocom Technologies and Unmanned Systems (Trends and Future Directions) (ICTUS), Amity University Dubai, Dubai International Academic City, 18–20 December 2017, pp. 93–94

  • Al-Taani AT (2021) ). Recent Advances in Arabic Automatic Text Summarization. Int J Adv Soft Comput its Appl 13(3):59–71. https://doi.org/10.15849/IJASCA.211128.05. (

    Article  Google Scholar 

  • Ali ZH (2019) Multilingual Text Summarization based on LDA and Modified PageRank,(Master Thesis), University of Baghdad, Iraq

  • Aliguliyev RM (2009) A new sentence similarity measure and sentence based extractive technique for automatic text summarization. Expert Syst Application J 36(4):7764–7772

    Article  Google Scholar 

  • Amato F, Moscato V, Picariello A, Sperlí G (2017) D’Acierno, A., Penta, A. Semantic summarization of web news. Encyclopedia with Semantic Computing Robotic Intelligence, 01(01), pp.1–6

  • Ba-Alwi F, Gaphari G, Al-Duqaimi F (2015) Arabic Text Summarization Using Latent Semantic Analysis. Br J Appl Sci Technol 10(2):1–14

    Article  Google Scholar 

  • Banerjee S, Mitra P, Sugiyama K (2015) Multi-document abstractive summarization using ILP based multi-sentence compression. paper presented at Twenty-Fourth international Joint Conference Artificial Intelligence (IJCAI), 2015-January, pp.1208–1214

  • Blei MD, Ng AY, Jordan MI (2003) Latent Dirichlet Allocation.Journal of machine learning research, pp.993–1022

  • Cai X, Li W (2013) Ranking Through Clustering: An Integrated Approach to Multi- Document Summarization. IEEE Trans Audio Speech Lang Process 21(7):1424–1433

    Article  Google Scholar 

  • Conroy J, Schlesinger J (2011) CLASSY 2011 at TAC: Guided and multi-lingual summaries and evaluation metrics. paper presented at Text Analysis Conference pp.1–8

  • Cui P, Hu L (2021) (). Topic-Guided Abstractive Multi-Document Summarization. In: Findings of the Association for Computational Linguistics: EMNLP 2021, pp.1463–1472. https://doi.org/10.18653/v1/2021.findings-emnlp.126

  • Das P, Shihari RK (2011) Global and Local Models for Multi-Document Summarization. paper presented at Text Analysis Conference.

  • Dunn JC (1973) A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters. J Cybernetics 3(3):32–57

    Article  MathSciNet  Google Scholar 

  • El-haj M, Kruschwitz U, Fox C (2011) University of Essex at the TAC 2011 Multilingual Summarisation Pilot. paper presented at Text Analysis Conference.

  • El-Haj M, Rayson P (2013) Using a keyness metric for single and multi-document summarization. Claiming a place: Proceedings of the Multi-Ling 2013 Workshop on Multilingual Multi-document Summarization, Sofia, Bulgaria, 9th August 2013

  • El-khair IA (2006) Effects of stop words elimination for Arabic information retrieval: comparative study. Int J Comput Inform Sci 4(1):119–133

    Google Scholar 

  • Fang H, Lu W, Wu F, Zhang Y, Shang X, Shao J, Zhuang Y (2015) Topic aspect- oriented summarization via group selection”. Neurocomputing 149(1):1613–1619

    Article  Google Scholar 

  • Fejer HN, Omar N (2015) Automatic Multi-Document Arabic Text Summarization Using Clustering and Keyphrase Extraction. J Artif Intell 8(1):1–9

    Article  Google Scholar 

  • Gambhir M, Gupta V (2016) Recent automatic text summarization techniques: a survey. Artif Intell Rev 47(1):1–66

    Article  Google Scholar 

  • Garbhapu VK, Bodapati P (2022) Extractive Summarization of Bible Data using Topic Modeling. Int J Eng Trends Technol 70(6):79–89. https://doi.org/10.14445/22315381/IJETT-V70I6P210

    Article  Google Scholar 

  • Giannakopoulos G, El-Haj M, Steinberger J, Favre B, Litvak M, Varma V (2011) TAC 2011 MultiLing Pilot Overview. paper presented at TAC 2011 Work. Maryl. MD, USA, Novemb

  • Giannakopoulos G, Karkaletsis V (2010) Summarization system evaluation variations based on n-gram graphs. paper presented at Text Analysis Conference (TAC)

  • Golub GH, Reinsch C (1970) Singular value decomposition and least squares solutions. Numer Math 14:403–420

    Article  MathSciNet  Google Scholar 

  • Hernández-Castañeda A, García-Hernández RA, Ledeneva Y, Millán-Hernández (2020) C. E. Extractive Automatic Text Summarization Based on Lexical-Semantic Keywords, IEEE Access, 8, pp. 49896–49907, doi: https://doi.org/10.1109/ACCESS.2020.2980226

  • Hmida F, Favre B (2011) LIF at TAC multiling: towards a truly language independent summarizer. paper presented at Text Analysis Conference (TAC 2011)

  • Hofmann T (1999) Probabilistic latent semantic indexing. Claiming a place: Proceedings of the Fifteenth conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann, Berkeley, pp.289–296

  • Jain A. (2022). Automatic Text Summarization for Hindi Using Real Coded Genetic Algorithm.Applied Sciences, 12,6584. https://doi.org/10.3390/app12136584

  • Khan A, Salim N (2016) and Farman., H. Clustered genetic semantic graph approach for multi-document abstractive summarization. paper presented at In 2016 International Conference on Intelligent Systems Engineering (ICISE). pp. 63–70

  • Koulali R, El-Haj M (2013) Arabic Topic Detection using Automatic Text Summarization. paper presented the ACS International Conference on Computer System and Application (AICCSA), Lancaster university, UK, May 2013

  • Li P, Wang Z, Lam W, Ren Z, Bing L (2017) Salience Estimation via Variational Auto-Encoders for Multi-Document Summarization. paper presented at Thirty-First AAAI Conference Artificial. Intelligence, pp.3497–3503

  • Lin C (2004) Rouge: A package for automatic evolution of summaries. Text Summarization Branches Out: proceeding of the ACL-04 Workshop

  • Liu H, Liu P, Heng W, Li L (2011) The CIST Summarization System at TAC 2011. paper presented at Text Analysis Conference (TAC 2011)

  • Merniz A, Chaibi AH, Ben Ghezala HH (2021) (). Multi-document Arabic Text Summarization based on Thematic Annotation. In: Proceedings of the 16th International Conference on Software Technologies (ICSOFT 2021), pages 639–644. https://doi.org/10.5220/0010557906390644

  • Mohamed M, Oussalah M (2016) An Iterative Graph-Based Generic Single and Multi Document Summarization Approach Using Semantic Role Labeling and Wikipedia Concepts. in: Proceedings – 2016 IEEE 2nd International Conference on Big Data Computing Service and Applications, BigDataService 2016, pp. 117–120

  • Na L, Ying L (2016) Xiao-jun, T., Hai-wen, W., Peng, X. and Ming-xia, L. Multi-document Summarization Algorithm based on Significance Sentences. paper presented at the Control and Decision Conference (CCDC), Yinchuan, China, May 2016

  • Nagwani NK (2015) Summarizing large text collection using topic modeling and clustering based on MapReduce framework. J Big Data 2(1):1–18

    Article  Google Scholar 

  • Nguyen MT, Nguyen THN, Nguyen HD, Nguyen VH (2018) Learning to Estimate the Importance of Sentences for Multi-Document Summarization. paper presented at. 2018 10th International Conference Knowledge System Engineering (KSE), 2018, pp.31–36

  • Ouatik S, Alaoui E (2016) An Efficient Method based on Deep Learning Approach for Arabic Text Categorization. paper presented at International Arab Conference on Information Technology, 6 Dec 2016

  • Oufaida H, Nouali O, Blache P (2014) Minimum redundancy and maximum relevance for single and multi-document Arabic text summarization. J King Saud Univ - Comput Inform Sci 26(4):450–461

    Google Scholar 

  • Radev DR, Jing H, Styś M, Tam D (2004) Centroid-based summarization of multiple documents. Inform Process Manage 40:919–938

    Article  Google Scholar 

  • Rainarli E, Dewi KE (2018) Relevance Vector Machine for Summarization. paper presented at IOP Conference Series Mater Science Engineering, 407(1)

  • Roubens M (1978) Pattern classification problems and fuzzy sets. Fuzzy Sets System 1(4):239–253

    Article  MathSciNet  Google Scholar 

  • Saggion H (2011) Using SUMMA for Language Independent Summarization at TAC 2011. paper presented at Text Analysis Conference.

  • Salton G, Buckley C (1988) The types of Flatidae (Homoptera) in the Stockholm Museum described by Stål, Melichar, Jacobi and Walker. Insect Syst Evoluation 17(3):323–337

    Google Scholar 

  • Sanchez-Gomez JM, Vega-Rodríguez MA, Pérez CJ (2018) Extractive multi-document text summarization using a multi-objective artificial bee colony optimization approach. Knowledge-Based Syst 159:1–8

    Article  Google Scholar 

  • Silvia, Rukmana P, Aprilia VR, Suhartono D, Meiliana RW (2014) Summarizing Text for Indonesian Language by Using Latent Dirichlet Allocation and Genetic Algorithm. Claiming a place: Proceeding of International Conference on Electrical Engineering, Computer Science and Informatics, Yogyakarta, Indonesia, pp. 148–153

  • Steinberger J, Kabadjov M, Steinberger R, Tanev H, Turchi M, Zavarella V (2011) JRC’s Participation at TAC 2011: Guided and Multilingual Summarization Tasks’ Proc. Text Analysis Conference.

  • Suneetha S, Reddy AV (2018) BHLM: Bayesian theory-based hybrid learning model for multi-document summarization”,International Journal Modelling, Simulation, Science Computing, 9(2)

  • Taghva K, Elkhoury R, Coombs JS (2005) Arabic Stemming Without A Root Dictionary. paper presented at the International Treatment Center’s Cooperative (ITCC) Conference, University of Nevada, Las Vegas, pp.152–157

  • Twinandilla S, Adhy S, Surarso B, Kusumaningrum R (2018) Multi-Document Summarization Using K-Means and Latent Dirichlet Allocation (LDA) – Significance Sentences. paper presented at 3rd International Conference on Computer Science and Computational Intelligence, Universities Diponegoro, Yogyakarta, Indonesia, Vol. 135, pp. 663–670

  • Waheeb SA, Husni H (2014) Multi-document Arabic summarization using text clustering to reduce redundancy. Int J Adv Sci Technol 2(1):194–199

    Google Scholar 

  • Wu Z, Lei L, Li G, Huang H, Zheng C, Chen E, Xn G (2017) A Topic Modeling based Approach to Novel Document Automatic Summarization. Expert Syst Appl 48:12–23

    Article  Google Scholar 

  • Yang G, Wen D, Kinshuk, Chen N, Sutinen E (2015) A novel contextual topic model for multi-document summarization. Expert Syst Appl 42(3):1340–1352

    Article  Google Scholar 

  • Yang L, Cai X, Zhang Y, Shim P (2014) Enhancing sentence-level clustering with ranking-based clustering framework for theme-based summarization. Inf Sci 206(1):37–50

    Article  Google Scholar 

  • Zhong SH, Liu Y, Li B, Long J (2015) Query-oriented unsupervised multi-document summarization via deep learning model. Expert Syst Applactions 42(21):8146–8155

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Yarmouk University, Irbid, Jordan

    Ahmad T. Al-Taani & Sami H. Al-Sayadi

Authors
  1. Ahmad T. Al-Taani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sami H. Al-Sayadi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ahmad T. Al-Taani.

Ethics declarations

Disclosure of potential conflicts of interest

we certify that there is no actual or potential conflict of interest in relation to this article.

Research involving Human Participants and/or Animals

this article doesn’t involve human participants and/or animals.

Informed consent

We give our consent for the publication of identifiable details, which can include figures and/or tables and/or details within the text (“Material”) to be published in the Journal. We confirm that we have seen and been given the opportunity to read both the Material and the Article to be published by Springer Nature.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Al-Taani, A.T., Al-Sayadi, S.H. Extractive text summarization of arabic multi-document using fuzzy C-means and Latent Dirichlet Allocation. Int J Syst Assur Eng Manag 15, 713–726 (2024). https://doi.org/10.1007/s13198-022-01783-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13198-022-01783-2

Keywords

Search

Navigation