Abstract
Not every trending tweet commands your attention! Overflow of social media data will soon require mechanisms to identify the severity of a situation to evaluate if a tweet must be given ample attention. News about bomb blasts, flood, epidemic outbreak affects several sectors and impacts the local economy. Such news is covered by media and government sources which forms meta-information with tweets. Most of the algorithms, both traditional and deep learning can decipher if the opinion is positive, negative, or neutral, they cannot allocate attention to the opinion. Compared to the binary classification of positive and negative sentiments, this article proposes a glove-text-CNN algorithm and attaches meta-information to predict the attention accuracy of sentence-level data. Correlation is being established among the various parameters of a trending hashtag and the most important parameter is being reported. The primary contribution is a modified neural algorithm to define an Attention Arousal Space that is designed to capture five major insights of sentence-level documents by attaching meta-information, to include media score, time decay, retweet, favorite scores and government source to modify original algorithm. The sentiment classification algorithm used for this research is Text-CNN with glove word embeddings, which was trained on 2,000,000 sentiment marked tweets from SemEval datasets. Sentiment classification training accuracy was 98.6% and validation set accuracy was 87.13%. Our experiments show accuracy over Hierarchical Attention Networks (HAN) which proves the effectiveness of this modified algorithm with meta-information for capturing attention.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Akhtar M, Kumar A, Ghosal D, Ekbal A, Bhattacharyya P (2017) A multilayer perceptron based ensemble technique for fine-grained financial sentiment analysis. In: Proceedings of the 2017 conference on empirical methods in natural language processing, pp 540–546
Cho K, Merrienboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using rnn encoder-decoder for statistical machine translation pages. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). Association for Computational Linguistics, Doha, Qatar, pp 1724–1734
Conneau A, Schwenk H, Barrault L, Lecun Y (2017) Very deep convolutional networks for text classification. In: ACL-EACL, pp 1107–1116
Dos Santos CN, Gatti M (2014) Deep convolutional neural networks for sentiment analysis of short texts. In: COLING, pp 69–78
Gao S, Ramanathan A, Tourassi G (2018) Hierarchical convolutional attention networks for text classification. In: Proceedings of the 3rd workshop on representation learning for NLP. Association for Computational Linguistics, Melbourne, Australia, pp 11–23
Guan Z, Chen L, Zhao W, Zheng Y, Tan S, Cai D (2016) Weakly-supervised deep learning for customer review sentiment classification. In: Proceedings of the twenty-fifth international joint conference on artificial intelligence
Guggilla C, Miller T, Gurevych I (2016) CNN- and LSTM-based claim classification in online user comments. In: Proceedings of COLING 2016, the 26th international conference on computational linguistics: technical papers, pp 2740–2751
Huang M, Qian Q, Zhu X (2017) Encoding syntactic knowledge in neural networks for sentiment classification. ACM Trans Inf Syst (TOIS) 35(3)
Irsoy O, Cardie C (2014) Opinion mining with deep recurrent neural networks. In: EMNLP, pp 720–728
Kalchbrenner N, Grefenstette E, Blunsom P (2014) A convolutional neural network for modelling sentences. In: Annual meeting of the association for computational linguistics. Maryland
Kim Y (2014) Convolutional neural networks for sentence classification. Retrieved from https://arxiv.org/abs/1408.5882
Liu P, Qui X, Huang X (2016) Recurrent neural network for text classification with multi-task learning. In: IJCAI, pp 2873–2879
McCormick TH, Lee H, Cesare N, Shojaie A, Spiro ES (2015) Using twitter for demographic and social science research: tools for data collection and processing. Sage
Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: Advances in neural information processing systems 26 (NIPS 2013)
Moraes R, Valiati JF, Neto WG (2013) Document-level sentiment classification: An empirical comparison between SVM and ANN. Expert Syst Appl 40(2):621–633
Peirson VAL, Tolunay EM (2018) Dank learning: generating memes using deep neural networks. Retrieved from https://arxiv.org/pdf/1806.04510.pdf
Qian Q, Huang M, Lei J, Zhu X (2017) Linguistically regularized LSTMs for sentiment classification. Retrieved from https://arxiv.org/abs/1611.03949
Rajput D, Madhukar M, Verma S, Manisha (2015) Sentiment analysis on big data using machine learning for holiday destinations 2015. In: IEEE European modelling symposium. Madrid
Santos CN, Gatti M (2014) Deep convolutional neural networks for sentiment analysis of short texts. In: Proceedings of COLING 2014, the 25th international conference on computational linguistics: Technical Papers, pp 69–78
Sukhbaatar S, Szlam A, Weston J, Fergus R (2015) End-to-end memory networks. In: Advances in neural information processing systems 28 (NIPS 2015)
Tai KS, Socher R, Manning CD (2015) Improved semantic representations from tree-structured long short-term memory networks. In: Annual meeting of the association for computational linguistics
Tian Q, Zhang P, Li B (2013) Towards predicting the best answers in community-based question-answering services. In: International AAAI conference on web and social media. AAAI
Van VD, Tahi T, Nghiem M-Q (2017) Combining convolution and recursive neural networks for sentiment analysis. In: SoICT ’17. Vietnam
Wang D, Nyberg E (2015) A long short-term memory model for answer sentence selection in question answering. In: Proceedings of the 53rd annual meeting of the association for computational linguistics 7th international joint conference on natural language processing (Short Papers). Beijing, pp 707–712
Wang T, Wu DJ, Coates A, Ng AY (2012) End-to-end text recognition with convolutional neural networks. In: ICPR. IEEE, New York, pp 3304–3308
Wang X, Jiang W, Luo Z (2016) Combination of convolutional and recurrent neural network for sentiment analysis of short texts. In: Proceedings of COLING 2016, the 26th international conference on computational linguistics: technical papers, pp 2428–2437
Weston J, Chopra S, Bordes A (2015) Memory networks. In: ICLR
Wu Z, Valentini-Botinhao C, Watts O, King S (2015) Deep neural networks employing multi-task learning and stacked bottleneck features for speech synthesis. In: 2015 IEEE international conference on acoustics, speech and signal processing. IEEE Explore, Brisbane, Australia
Yang D, Yang DC, He X, Smola A, Hovy E (2015) Hierarchical attention networks for document classification. Retrieved from https://www.cs.cmu.edu/~hovy/papers/16HLT-hierarchical-attention-networks.pdf
You Q, Luo J, Jin H, Yang J (2009) Robust image sentiment analysis using progressively trained and domain transferred deep networks. In: Twenty-Ninth AAAI conference on artificial intelligence
Yu J, Jiang J (2016) Learning sentence embeddings with auxiliary tasks for cross-domain sentiment classification. In: Proceedings of the 2016 conference on empirical methods in natural language processing. Austin, pp 236–246
Zeng D, Liu K, Lai S, Zhou G, Zhao J (2014) Relation classification via convolutional deep neural network. In: COLING, pp 2335–2344
Zhang L, Wang S, Liu B (2018) Deep learning for sentiment analysis: a survey. Wires Data Mining Knowl Discovery 8(4)
Zhao Z, Lu H, Cai D, He X, Zhuang Y (2017) Microblog sentiment classification via recurrent random walk network learning. In: Proceedings of the twenty-sixth international joint conference on artificial intelligence
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Rajput, D., Verma, S. (2021). An Attention Arousal Space for Mapping Twitter Data. In: Favorskaya, M.N., Mekhilef, S., Pandey, R.K., Singh, N. (eds) Innovations in Electrical and Electronic Engineering. Lecture Notes in Electrical Engineering, vol 661. Springer, Singapore. https://doi.org/10.1007/978-981-15-4692-1_29
Download citation
DOI: https://doi.org/10.1007/978-981-15-4692-1_29
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-4691-4
Online ISBN: 978-981-15-4692-1
eBook Packages: EnergyEnergy (R0)