Abstract
In the past few years, the growth of e-commerce and digital marketing in Vietnam has generated a huge volume of opinionated data. Analyzing those data would provide enterprises with insight for better business decisions. In this work, as part of the Advosights project, we study sentiment analysis of product reviews in Vietnamese. The final solution is based on Self-attention neural networks, a flexible architecture for text classification task with about \(90.16\%\) of accuracy in 0.0124 second, a very fast inference time.
Supported by Kyanon Digital.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Schuster, M., Paliwal, K.K.: Bidirectional recurrent neural networks. IEEE Trans. Sig. Process. 45(11), 2673–2681 (1997)
Schneider, W.X.: An Introduction to “Mechanisms of Visual Attention: A Cognitive Neuroscience Perspective” (1998) https://pdfs.semanticscholar.org/b719/918bdf2e71571a3cbb2a6aaaec3f1b6af9e6.pdf
Esuli, A., Sebastiani, F.: Senti-wordnet: a publicly available lexical resource for opinion mining. In: Proceedings of LREC, vol. 6, pp. 417–422 (2006)
Baccianella, S., Esuli, A., Sebastiani, F.: Sentiwordnet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Proceedings of LREC, vol. 10, pp. 2200–2204 (2010)
Mohammad, S.M., Kiritchenko, S., Zhu, X.: NRC-canada: building the state-of-the-art in sentiment analysis of tweets. In: Proceedings of SemEval-2013 (2013)
Mnih, V., et al.: Recurrent models of visual attention. In: Neural Information Processing Systems Conference (NIPS) (2014). arXiv preprint arXiv:1406.6247
Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. accepted in International Conference on Learning Representations (ICLR) (2015). arXiv preprint arXiv:1409.0473, 2014
Chung, J., Gulcehre, C., Cho, K., Bengio, Y.: Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling. arXiv preprint arXiv:1412.3555 (2014)
Cheng, J., Dong, L., Lapata, M.: Long short-term memory-networks for machine reading. Computing Research Repository (CoRR) (2016). arXiv preprint arXiv:1601.06733
Lu, J., Yang, J., Batra, D., Parikh, D.: Hierarchical question-image co-attention for visual question answering. In: Advances in Neural Information Processing Systems 29, pp. 289–297. Curran Associates Inc. (2016)
Vo, D.T., Zhang, Y.: Don’ t Count, Predict! An Automatic Approach to Learning Sentiment Lexicons for Short Text (2016). https://www.aclweb.org/anthology/P16-2036
Bojanowski, P., Grave, E., Joulin, A., Mikolov, T.: Enriching Word Vectors with Subword Information. arXiv preprint arXiv:1607.04606 (2016)
Kokkinos, F., Potamianos, A.: Structural attention neural networks for improved sentiment analysis. arXiv preprint arXiv:1701.01811 (2017)
Daniluk, M., Rocktaschel, T., Welbl, J., Riedel, S.: Frustratingly short attention spans in neural language modeling. arXiv preprint arXiv:1702.04521 (2017)
Vaswani, A., et al.: Attention is all you need. In: Guyon, I., et al. (eds.) Advances in Neural Information Processing Systems 30, pp. 5998–6008. Curran Associates Inc. (2017). arXiv preprint arXiv:1706.03762 (2017). http://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf
Gehring, J., Auli, M., Grangier, D., Yarats, D., Dauphin, Y.N.: Convolutional sequence to sequence learning. arXiv preprint arXiv:1705.03122 (2017)
Hu, J., Shen, L., Albanie, S., Sun, G., Wu, E.: Squeeze-and-Excitation Networks. arXiv preprint arXiv:1709.01507 (2017)
Zhou, Y., Zhou, J., Liu, L., Feng, J., Peng, H., Zheng, X.: RNN-based sequence-preserved attention for dependency parsing (2018). https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/view/17176
Anh, V., et al.: Underthesea. https://github.com/undertheseanlp/underthesea
Natural Language Toolkit. https://www.nltk.org/
Acknowledgment
We thank our teammates, Tran A. Sang, Cao T. Thanh, and Ha H. Huy for helpful discussions and supports.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Hoang, S.N., Nguyen, L.V., Huynh, T., Pham, V.T. (2019). An Efficient Model for Sentiment Analysis of Electronic Product Reviews in Vietnamese. In: Dang, T., Küng, J., Takizawa, M., Bui, S. (eds) Future Data and Security Engineering. FDSE 2019. Lecture Notes in Computer Science(), vol 11814. Springer, Cham. https://doi.org/10.1007/978-3-030-35653-8_10
Download citation
DOI: https://doi.org/10.1007/978-3-030-35653-8_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-35652-1
Online ISBN: 978-3-030-35653-8
eBook Packages: Computer ScienceComputer Science (R0)