Advertisement

The Comparison of Pooling Functions in Convolutional Neural Network for Sentiment Analysis Task

  • Nurul Ashikin SamatEmail author
  • Mohd Najib Mohd Salleh
  • Haseeb Ali
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 978)

Abstract

Convolutional Neural Network (CNN) has gained considerable attention in many Natural Language Processing applications including sentiment analysis task. A typical CNN model usually is made up of several convolutional and pooling layers. In this paper, our aim is to acquire detailed understanding into different type of pooling function by directly differentiate them on a same architecture layers for sentiment analysis tasks. These insights should prove useful for future development of pooling function in CNN models for sentiment analysis task.

Keywords

Pooling function Convolutional neural network Natural language processing Sentiment analysis 

References

  1. 1.
    Sun S, Luo C, Chen J (2017) A review of natural language processing techniques for opinion mining systems. Inf Fusion 36:10–25CrossRefGoogle Scholar
  2. 2.
    Wu Z, Dai X-Y, Yin C, Huang S, Chen J (2018) Improving review representations with user attention and product attention for sentiment classification. In: Thirty-second AAAI conference on artificial intelligenceGoogle Scholar
  3. 3.
    Yaqub U, Chun S, Atluri V, Vaidya J (2017) Sentiment based analysis of tweets during the us presidential elections. In: Proceedings of the 18th annual international conference on digital government research. ACM, pp 1–10Google Scholar
  4. 4.
    Anandarajan M, Hill C, Nolan T (2019) Sentiment analysis of movie reviews using R. In: Practical text analytics. Springer, pp 193–220Google Scholar
  5. 5.
    Ramanathan V, Meyyappan T (2019) Twitter text mining for sentiment analysis on people’s feedback about oman tourism. In: 2019 4th MEC international conference on big data and smart city (ICBDSC). IEEE, pp 1–5Google Scholar
  6. 6.
    Serrano-Guerrero J, Olivas JA, Romero FP, Herrera-Viedma E (2015) Sentiment analysis: a review and comparative analysis of web services. Inf Sci 311:18–38CrossRefGoogle Scholar
  7. 7.
    Goswami S, Nandi S, Chatterjee S (2019) Sentiment analysis based potential customer base identification in social media. In: Contemporary advances in innovative and applicable information technology. Springer, pp 237–243Google Scholar
  8. 8.
    Rodríguez A, Argueta C, Chen Y-L (2019) Automatic detection of hate speech on facebook using sentiment and emotion analysis. In: 2019 international conference on artificial intelligence in information and communication (ICAIIC). IEEE, pp 169–174Google Scholar
  9. 9.
    Zhang Y-D, Dong Z, Chen X, Jia W, Du S, Muhammad K, Wang S-H (2019) Image based fruit category classification by 13-layer deep convolutional neural network and data augmentation. Multimed Tools Appl 78:3613–3632CrossRefGoogle Scholar
  10. 10.
    Geetharamani G, Pandian A (2019) Identification of plant leaf diseases using a nine-layer deep convolutional neural network. Comput Electr Eng 76:323–338CrossRefGoogle Scholar
  11. 11.
    Akiyama T, Kobayashi Y, Kishigami J, Muto K (2018) CNN-based boat detection model for alert system using surveillance video camera. In: 2018 IEEE 7th global conference on consumer electronics (GCCE). IEEE, pp 669–670Google Scholar
  12. 12.
    Kim H, Kim Y, Kim SJ, Lee I (2018) Building emotional machines: recognizing image emotions through deep neural networks. IEEE Trans Multimedia 20:2980–2992CrossRefGoogle Scholar
  13. 13.
    Dhall A, Kaur A, Goecke R, Gedeon T (2018) Emotiw 2018: audio-video, student engagement and group-level affect prediction. In: Proceedings of the 2018 on international conference on multimodal interaction. ACM, pp 653–656Google Scholar
  14. 14.
    Ceruti C, Cuculo V, D’Amelio A, Grossi G, Lanzarotti R (2017) Taking the hidden route: deep mapping of affect via 3D neural networks. In: International conference on image analysis and processing. Springer, pp 189–196Google Scholar
  15. 15.
    Young T, Hazarika D, Poria S, Cambria E (2018) Recent trends in deep learning based natural language processing. ieee Comput Intell Mag 13:55–75CrossRefGoogle Scholar
  16. 16.
    Lai S, Xu L, Liu K, Zhao J (2015) Recurrent convolutional neural networks for text classification. In: Twenty-ninth AAAI conference on artificial intelligenceGoogle Scholar
  17. 17.
    Kim Y (2014) Convolutional neural networks for sentence classification. arXiv:1408.5882
  18. 18.
    Kalchbrenner N, Grefenstette E, Blunsom P (2014) A convolutional neural network for modelling sentences. arXiv:1404.2188
  19. 19.
    Dos Santos C, Gatti M (2014) Deep convolutional neural networks for sentiment analysis of short texts. In: Proceedings of COLING 2014, the 25th international conference on computational linguistics: technical papers, pp 69–78Google Scholar
  20. 20.
    Xu F, Zhang X, Xin Z, Yang A (2019) Investigation on the Chinese text sentiment analysis based on convolutional neural networks in deep learning. Comput Mater Contin 58(3):697–709CrossRefGoogle Scholar
  21. 21.
    Liao S, Wang J, Yu R, Sato K, Cheng Z (2017) CNN for situations understanding based on sentiment analysis of twitter data. Procedia Comput Sci 111:376–381CrossRefGoogle Scholar
  22. 22.
    Li Q, Jin Z, Wang C, Zeng DD (2016) Mining opinion summarizations using convolutional neural networks in Chinese microblogging systems. Knowl-Based Syst 107:289–300CrossRefGoogle Scholar
  23. 23.
    Abid F, Alam M, Yasir M, Li C (2019) Sentiment analysis through recurrent variants latterly on convolutional neural network of Twitter. Futur Gener Comput Syst 95:292–308CrossRefGoogle Scholar
  24. 24.
    Scherer D, Müller A, Behnke S (2010) Evaluation of pooling operations in convolutional architectures for object recognition. In: International conference on artificial neural networks. Springer, pp. 92–101Google Scholar
  25. 25.
    Wang Y, Li J, Metze F (2019) A comparison of five multiple instance learning pooling functions for sound event detection with weak labeling. In: ICASSP 2019-2019 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, pp 31–35Google Scholar
  26. 26.
    Wang X, Wang L, Qiao Y (2012) A comparative study of encoding, pooling and normalization methods for action recognition. In: Asian conference on computer vision. Springer, pp 572–585Google Scholar
  27. 27.
    Gu J, Wang Z, Kuen J, Ma L, Shahroudy A, Shuai B, Liu T, Wang X, Wang G, Cai J (2018) Recent advances in convolutional neural networks. Pattern Recogn 77:354–377CrossRefGoogle Scholar
  28. 28.
    Severyn A, Moschitti A (2015) Learning to rank short text pairs with convolutional deep neural networks. In: Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval. ACM, pp 373–382Google Scholar
  29. 29.
    Williams T, Li R (2018) Wavelet pooling for convolutional neural networksGoogle Scholar
  30. 30.
    Zeiler MD, Fergus R (2013) Stochastic pooling for regularization of deep convolutional neural networks. arXiv:1301.3557
  31. 31.
  32. 32.
    Carneiro T, Da Nóbrega RVM, Nepomuceno T, Bian G-B, De Albuquerque VHC, Reboucas Filho PP (2018) Performance analysis of google colaboratory as a tool for accelerating deep learning applications. IEEE Access 6:61677–61685CrossRefGoogle Scholar
  33. 33.
    Maas AL, Daly RE, Pham PT, Huang D, Ng AY, Potts C (2011) Learning word vectors for sentiment analysis. In: Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies, vol 1. Association for Computational Linguistics, pp 142–150Google Scholar
  34. 34.

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Nurul Ashikin Samat
    • 1
    Email author
  • Mohd Najib Mohd Salleh
    • 2
  • Haseeb Ali
    • 1
  1. 1.Faculty of Computer Science and Information TechnologyUniversiti Tun Hussein Onn Malaysia (UTHM)Parit RajaMalaysia
  2. 2.Department of Software Engineering, Faculty of Computer Science and Information TechnologyUniversiti Tun Hussein Onn Malaysia (UTHM)Parit RajaMalaysia

Personalised recommendations