Abstract
Large texts are not always entirely meaningful: they might include repetitions and useless details, and might not be easy to interpret by humans. Automatic text summarization aims to simplify text by making it shorter and (possibly) more informative. This paper describes a new solution for extractive text summarization, designed to efficiently process flat (unstructured) text. It performs unsupervised frequency-based document processing to identify the candidate sentences having the highest potential to represent informative content in the document. It introduces a dedicated feature vector representation for sentences to evaluate the relative impact of different sentence terms. The sentence feature vectors are run through a partitional k-means clustering process, to build the extractive summary based on the cluster representatives. Experimental results highlight the quality and efficiency of our approach.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
We use the Porter Stemmer in our approach since it is one the most effective in the literature.
- 2.
We use the WordNet lexical dictionary [3] to perform lemmatization, due to its common usage in the literature.
- 3.
With respect to.
- 4.
Available online: https://bit.ly/3FiaMLu.
References
Khan, A., Salim, N.: A review on abstractive summarization methods. J. Theor. Appl. Inf. Technol. 59(1), 64–72 (2014)
Tanaka, H., et al.: Syntax-driven sentence revision for broadcast news summarization. In: Workshop on Language Generation and Summarization, pp. 39–47 (2009)
Miller, G., Fellbaum, C.: WordNet then and now. Lang. Resour. Eval. 41(2), 209–214 (2007)
Getahun, F., Tekli, J., Chbeir, R., Viviani, M., Yetongnon, K.: Relating RSS news/items. In: Gaedke, M., Grossniklaus, M., DÃaz, O. (eds.) ICWE 2009. LNCS, vol. 5648, pp. 442–452. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-02818-2_36
Genest, P., Lapalme, G.: Fully abstractive approach to guided summarization. In: Annual Meeting of the Association for Computational Linguistics (ACL), pp. 354–358 (2012)
Lau, R., et al.: Toward a fuzzy domain ontology extraction method for adaptive e-learning. IEEE Trans. Knowl. Data Eng. 21(6), 800–813 (2009)
Özates S., et al.: Sentence similarity based on dependency tree kernels for multi-document summarization. In: International Conference on Language Resources and Evaluation (LREC) (2016)
Abdel-Salam, S., Rafea, A.: Performance study on extractive text summarization using BERT models. Information 13(2), 67 (2022)
Cao, S., Yang, Y.: DP-BERT: dynamic programming BERT for text summarization. In: Fang, Lu., Chen, Y., Zhai, G., Wang, J., Wang, R., Dong, W. (eds.) Artificial Intelligence: First CAAI International Conference, CICAI 2021, Hangzhou, China, June 5–6, 2021, Proceedings, Part II, pp. 285–296. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-93049-3_24
Aaditya M., et al.: Layer freezing for regulating fine-tuning in BERT for extractive text summarization. In: Pacific Asia Conference on Information Systems (PACIS), p. 182 (2021)
Haraty, R., Nasrallah, R.: Indexing Arabic texts using association rule data mining. Librar. Hi Tech 37(1), 101–117 (2019)
Mansour, N., et al.: An auto-indexing method for Arabic text. Inf. Process. Manage. J. 44(4), 1538–1545 (2008)
Mojrian, M., Mirroshandel, S.A.: A novel extractive multi-document text summarization system using quantum-inspired genetic algorithm: MTSQIGA. Exp. Syst. Appl. 171, 114555 (2021)
Srivastava, A.K., Pandey, D., Agarwal, A.: Extractive multi-document text summarization using dolphin swarm optimization approach. Multimedia Tools Appl. 80(7), 11273–11290 (2021)
Popescu, M., et al.: A highly scalable method for extractive text summarization using convex optimization. Symmetry 13(10), 1824 (2021)
Kruengkrai, C., Jaruskulchai, C.: Generic text summarization using local and global properties of sentences. In: Web Intelligence, pp. 201–206 (2003)
Rani, R., Lobiyal, D.: An extractive text summarization approach using tagged-LDA based topic modeling. Multim. Tools Appl. 80(3), 3275–3305 (2021)
Tekli, J.: An overview of cluster-based image search result organization: background, techniques, and ongoing challenges. Knowl. Inf. Syst. 64(3), 589–642 (2022)
Haraty, R.A., Dimishkieh, M., Masud, M.: An enhanced k-means clustering algorithm for pattern discovery in healthcare data. Int. J. Distrib. Sensor Netw. 11(6), 615740:1-615740:11 (2015)
Lloyd, S.: Least squares quantization in PCM. IEEE Trans. Info. Theor. 28(2), 129–137 (1982)
Haraty, R., Hamdoun, M.: Iterative querying in web-based database applications. In: ACM Symposium on Applied Computing (SAC), pp. 458–462 (2002)
Mridha, M., et al.: A survey of automatic text summarization: progress, process and challenges. IEEE Access 2021(9), 156043–156070 (2021)
Tekli, J., Chbeir, R., Yetongnon, K.: Structural similarity evaluation between XML documents and DTDs. In: Benatallah, B., Casati, F., Georgakopoulos, D., Bartolini, C., Sadiq, W., Godart, C. (eds.) WISE 2007. LNCS, vol. 4831, pp. 196–211. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-76993-4_17
Mogren, O., et al.: Extractive summarization by aggregating multiple similarities. In: Recent Advances in Natural Language Processing (RANLP), pp. 451–457 (2015)
Kågebäck, M., et al.: Extractive summarization using continuous vector space models. In: Workshop on Continuous Vector Space Models and their Compositionality (CVSC), pp. 31–39 (2014)
Tekli, J., Al Bouna, B., Bou Issa, Y., Kamradt, M., Haraty, R.: (k, l)-clustering for transactional data streams anonymization. In: Su, C., Kikuchi, H. (eds.) ISPEC 2018. LNCS, vol. 11125, pp. 544–556. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-99807-7_35
Maziad, H., Rammouz, J.-A., Asmar, B.E., Tekli, J.: Preprocessing techniques for end-to-end trainable RNN-based conversational system. In: Brambilla, M., Chbeir, R., Frasincar, F., Manolescu, I. (eds.) ICWE 2021. LNCS, vol. 12706, pp. 255–270. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-74296-6_20
Chakar, J., Sobbahi, R.A., Tekli, J.: Depthwise separable convolutions and variational dropout within the context of YOLOv3. In: Bebis, G., et al. (eds.) ISVC 2020. LNCS, vol. 12509, pp. 107–120. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-64556-4_9
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Hajjar, A., Tekli, J. (2022). Unsupervised Extractive Text Summarization Using Frequency-Based Sentence Clustering. In: Chiusano, S., et al. New Trends in Database and Information Systems. ADBIS 2022. Communications in Computer and Information Science, vol 1652. Springer, Cham. https://doi.org/10.1007/978-3-031-15743-1_23
Download citation
DOI: https://doi.org/10.1007/978-3-031-15743-1_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-15742-4
Online ISBN: 978-3-031-15743-1
eBook Packages: Computer ScienceComputer Science (R0)