Abstract
Text classification is a strategy where the document categories are decided. Report classification is the assignment of relegating archives to a predefined space category. In this paper, a new method has classified Bangla text documents which consist of two deep learning models in terms of Bangla text categorization. The main purpose of this research is to text classification from Bangla text documents. This system can easily categorize from a large number of text documents. Firstly, the collected data was processed for the Bangla text document. Secondly, by designing the model architecture training data it was fitted out into the model. Finally, by calculating the accuracy and F1-score on the testing dataset, the model performance was evaluated. The deep learning recurrent neural network attention layer and recurrent neural network with BiLSTM attained 97.72% and 86.56% accuracy, respectively, which is compared to the other well-known classification algorithms in Bangla text classification.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Krendzelak M, Jakab F (1990) Text categorization with Machine Learning and Hierarchical Structure In: The Technical University of Kosice, pp 396–402. https://www.researchgate.net/publication/307854016 Text categorization with machine learning and hierarchical structures (Book download)
McCallum A (1999) Multi-label text classification with a mixture model trained by them. In: AAAI workshop on text learning, pp 1–7
Lewis DD, Ringuette M (1994) A comparison of two learning algorithms for text categorization. In Third annual symposium on document analysis and information retrieval, vol 33, pp 81–93
Kim Y (2014) Convolutional neural networks for sentence classification. In: Conference on empirical methods in natural language processing
Kalchbrenner N, Grefenstette E, Blunsom P (2014) A convolutional neural network for modelling sentences. In: Proceedings of the 52nd annual meeting of the association for computational linguistics, pp 655–665
Lilleberg J, Zhu Y, Zhang Y (2015) Support vector machines and word2vec for text classification with semantic features. In: ICCI*CC, Ge N, Lu J, Wang Y, Howard N, Chen P, Tao X, Zhang B, Zadeh LA (eds) IEEE computer society, pp 136–140
Trstenjak B, Mikac S, Donko D (2014) KNN with TF-IDF based framework for text categorization. Proc Eng 69:1356–1364
Du C, Huang L (2018) A deep attention-based recurrent neural networks. Int J Comput Commun Control (IJCCC)
Mansur M (2006) Analysis of n-gram based text categorization for Bangla in a newspaper corpus. In: Proceedings of international conference on computer and information technology
Islam M, Jubayer FEMS, Ahmed I (2017) A comparative study on different types of approaches to Bengali document categorization. In: Proceedings of the international conference on engineering research, innovation and education 2017
Kaur J, Saini JR (2015) A study of text classification natural language processing algorithms for Indian languages. VNSGU J Sci Technol 162–167
Hossain MR, Hoque MM (2019) Automatic Bengali document categorization based on deep convolution nets. In: Emerging research in computing, information, communication, and applications. Springer, Berlin, pp 513–525
Rahman S, Chakraborty P (2020) Bangla document classification using deep recurrent neural network with BiLSTM. In: Proceedings of international conference on machine intelligence and data science applications
Rahman MM, Pramanik MA, Sadik R, Roy M, Chakraborty P (2002) Bangla documents classification using transformer based deep learning models. In: 2nd international conference on Sustainable Technologies for Industry 4.0 (STI), 19–20 December, Dhaka, Bangladesh
Ahammad K, Shawon JAB, Chakraborty P, Islam MJ, Islam S (2021) Recognizing Bengali sign language gestures for digits in real time using convolutional neural network. Int J Comput Sci Information Security (IJCSIS) 19(1) September
Gulia S, Choudhury T (2016) An efficient automated design to generate UML diagram from natural language specifications. In: 6th international conference-cloud system and big data engineering (confluence), pp 641–648
Chakraborty P, Ahmed S, Yousuf MA, Azad A, Alyami SA, Moni MA (2021) A Human-Robot interaction system calculating visual focus of Human’s attention Level. IEEE Access 9:93409–93421
Singh N, Sharma T, Thakral A, Choudhury T (2018) Detection of fake profile in online social networks using machine learning. In: International Conference on Advances in Computing and Communication Engineering (ICACCE), pp 231–234
Zakir Hossan M (2018) 40k Bangla Newspaper Article. September 2018. https://www.kaggle.com/zshujon/40k-bangla-newspaper-article
Gupta M. Tokenization algorithms in Natural Language Processing (NLP). https://medium.com/data-science-in-your-pocket/tokenization-algorithms-in-natural-language-processing-NLP-1fceab8454af
Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. In: 3rd international conference for learning representations
Faruque MA, Rahman S, Chakraborty P, Choudhury T, Um JS, Singh TP (2021) Ascertaining polarity of public opinions on Bangladesh cricket using machine learning techniques. Spatial Information Research
Alam MT, Islam MM (2018) BARD: Bangla article classification using a new comprehensive dataset. In: International conference on bangla speech and language processing, August 2018
Mandal AK, Sen R (2014) Supervised learning methods for Bangla web document categorization. Int J Artif Intelligence Appl (IJAIA) 5(5), September 2014
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Ahmed, M., Chakraborty, P., Choudhury, T. (2022). Bangla Document Categorization Using Deep RNN Model with Attention Mechanism. In: Tavares, J.M.R.S., Dutta, P., Dutta, S., Samanta, D. (eds) Cyber Intelligence and Information Retrieval. Lecture Notes in Networks and Systems, vol 291. Springer, Singapore. https://doi.org/10.1007/978-981-16-4284-5_13
Download citation
DOI: https://doi.org/10.1007/978-981-16-4284-5_13
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-4283-8
Online ISBN: 978-981-16-4284-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)