Abstract
In this paper, we conduct a comparative study about the impact of stemming algorithms, as feature extraction systems, on the task of classification of Arabic text documents. Stemming is forceful and fierce as in reducing words to their three-letters roots. Which may influence the semantics, as various words with divers implications may share the same root. Light stemming, by examination, expels oftentimes utilized prefixes and suffixes in Arabic words. Light stemming doesn’t extract the root and thus doesn’t influence the semantics of words. However, the result of the light stemming is not necessarily a word. For the evaluation, we used corpus contains 5,070 records that fall into six classes. A several tests were done utilizing two separate illustrations of the same corpus. The K-Nearest Neighbors (KNN) classifier was utilized for the classification task. The recall measure is used to evaluate the performance of these methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Al-Arabizi: Why do Google fight it more than Arabic? http://www.bbc.com/arabic/mobile/scienceandtech/2012/12/121220_arabic_language_internet_arab_days.shtml. Accessed 20 Mar 2017
Sorting the languages of the world in terms of proliferation.
. Accessed 20 Mar 2017List of languages by total number of speakers.
. Accessed 20 Mar 2017Correa, R.F., Ludermir, T.B.: Automatic text categorization: case study. In: the 7th Brazilian Symposium on Neural Networks, Pernambuco, Brazil, November 2002
Eyheramendy, S., Lewis, D., Madiagn, D.: On the naive Bayes model for text categorization. In: The Artificial Intelligence and Statistics Conference, Key West, Florida, January 2003
Peter, B.: Active learning of SVM and Decision tree classifiers for text categorization. In: The 4th Slovakian-Hungarian Joint Symposium on Applied Machine Intelligence, Herlany, Slovakia, January 2006
Wang, P., et al.: Semantic Clustering and convolutional neural network for short text categorization. In: 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, China, pp. 352–357, 26–31 July 2015
Gongde, G., et al.: An kNN model-based approach and its application in text categorization. In: The International Conference on Computational Linguistics and Intelligent Text Processing (CICLing), Seoul, Korea, February 2004
Basu, A., Walters, C., Shepherd, M.: Support vector machines for text categorization. In: 36th Annual Hawaii International Conference, Los Alamitos, California, USA, January 2003
Jun, Y., et al.: OCFS: optimal orthogonal centroid feature selection for text categorization. In: 28th Annual International ACM SIGIR Conference, Salvador, Brazil, August 2005
Seo, Y., Ankolekar, A., Sycara, K.: Feature selection for extracting semantically rich words. Technical report CMU-RI-TR-04-18, Robotics Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, March 2004
Yang, Y., Pedersen, J.: A comparative study on feature selection in text categorization. In: 40th International Conference on Machine Learning, Nashville, Tennessee, USA, July 1997
Tuerlinckx, L.: La lemmatisation de l’arabe non classique. In: 7th International Days of Textual Data Statistical Analysis (JADT), Louvainla- Neuve, Belgium (2004)
Anjali, G.J., et al.: A comparative study of stemming algorithms. Int. J. Comput. Technol. Appl. (IJCTA) 2(6), 1930–1938 (2011)
Khoja, S., Garside, R.: Stemming arabic text. Computer Science Department, Lancaster University, Lancaster, UK (1999)
Al-Shalabi, R., Kanaan, G., Al-Serhan, H.: New approach for extracting Arabic roots. In: The International Arab Conference on Information Technology, Alexandria, Egypt, pp. 42–59 (2003)
Evens, M.: A computational morphology system for Arabic. In: The Workshop on Computational Approaches to Semitic Languages, Montreal, Quebec, Canada, August 1998
Sawalha, M., Atwell, E.: Comparative evaluation of arabic language morphological analysers and stemmers. COLING: companion volume – Posters and Demonstrations, Manchester, UK, pp. 107–110 (2008)
Connell, M.: Improving stemming for arabic information retrieval: light stemming and cooccurrence analysis. In: 25th Annual International Conference on Research and Development in Information Retrieval, Tampere, Finland, pp. 275–282, August 2002
Joachims, T.: A statistical learning model of text classification for support vector machines. In: 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, New Orleans, Louisiana, USA (2001)
Moh’d, A., Mesleh, A.: Chi square feature extraction based svms arabic language text categorization system. J. Comput. Sci. 3, 6 (2007)
Al-Harbi, S., Almuhareb, A., Al-Thubaity, A., Khorsheed, M.S., Al-Rajeh, A.: Automatic Arabic text classification. In: 9th International Conference on the Statistical Analysis of Textual Data, Lyon, France, 12 –14 March 2008
Kourdi, M.E., Bensaid, A., Rachidi, T.: Automatic Arabic document categorization based on the Naive Bayes algorithm. In: The Workshop on Computational Approaches to Arabic Script-based Languages, Geneva, Switzerland (2004)
Majed, F.O., Hussien, I.: AL-dwan, M., Shamsan, A.: Arabic text classification using smo, Naïve Bayesian, J48 Algorithms. Int. J. Res. Rev. Appl. Sci. 9, 10 (2011)
. Accessed 20 Mar 2017
. Accessed 20 Mar 2017Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Boukil, S., El Adnani, F., El Moutaouakkil, A.E., Cherrat, L., Ezziyyani, M. (2018). Arabic Stemming Techniques as Feature Extraction Applied in Arabic Text Classification. In: Ezziyyani, M., Bahaj, M., Khoukhi, F. (eds) Advanced Information Technology, Services and Systems. AIT2S 2017. Lecture Notes in Networks and Systems, vol 25. Springer, Cham. https://doi.org/10.1007/978-3-319-69137-4_31
Download citation
DOI: https://doi.org/10.1007/978-3-319-69137-4_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-69136-7
Online ISBN: 978-3-319-69137-4
eBook Packages: EngineeringEngineering (R0)