Abstract
This paper aims at applying Recurrent Neural Networks (RNN) to Natural Language Processing using old texts such as sacred books. The objective of this work is to generate a text that follows the same structure and semantic of the studied corpus written in Arabic. This is done through various networks such as vanilla RNN, LSTM (Long Short Term Memory) and GRU (Gated Recurrent Unit). After training, the quality of the generated text is measured using BLEU scores. Besides, an exploratory analysis of the corpus is presented to exhibit some interesting findings at the words and chapters level.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositionality. In: NIPS (2013)
Pearson, K.: On lines and planes of closest fit to systems of points in space. Philios. Mag. 2, 559–572 (1901)
van der Maaten, L.J.P., Hinton, G.E.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9, 2431–2456 (2008)
Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to sequence learning with neural networks. In: NIPS, p. 31043112 (2014)
Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. arXiv:1409.0473 (2014)
Farhadi, A., Hejrati, M., Sadeghi, M.A., Young, P., Rashtchian, C., Hockenmaier, J., Forsyth, D.: Every picture tells a story: generating sentences from images. In: ECCV (2010)
Mutiwokuziva, M.T., Chanda, M.W., Kadebu, P., Mukwazvure, A., Gotora, T.T.: A neural-network based chat bot. In: 2017 2nd International Conference on Communication and Electronics Systems (ICCES), Coimbatore, pp. 212–217 (2017)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8),17351780 (1997)
Cho, K., van Merrienboer, B., Bahdanau, D., Bengio, Y.: On the properties of neural machine translation: encoder-decoder approaches. arXiv preprint arXiv:1409.1259 (2014)
Lipton, Z.C., Berkowitz, J., Elkan, C.: A critical review of recurrent neural networks for sequence learning. arXiv:1506.00019 (2015)
Papineni, K., Roukos, S., Ward, T., Zhu, W.J.: BLEU: a method for automatic evaluation of machine translation. In: ACL (2002)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv:1412.6980 [cs.LG] (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
El Mokhtari, K., Azmani, M., Astito, A. (2020). Predictive Natural Language Processing Analysis Applied to Arabic. In: Ezziyyani, M. (eds) Advanced Intelligent Systems for Sustainable Development (AI2SD’2019). AI2SD 2019. Advances in Intelligent Systems and Computing, vol 1102. Springer, Cham. https://doi.org/10.1007/978-3-030-36653-7_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-36653-7_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-36652-0
Online ISBN: 978-3-030-36653-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)