Abstract
To steer impactful data-driven possibilities, Social Internet of Things (SIoT) comes with the collaboration of IoT and social networking and finds deeper insights into consumer behavior for better user experiences. Social networks can permeate intelligence to aid autonomous decision making by enhancing the service needs and communication among object peers in a SIoT. But the user-generated data has multiple layers of meaning which necessitate AI-driven solutions such as sentiment analysis to handle the dynamics. As people express opinions in complex ways and use rhetorical devices like sarcasm, irony, and implication etc., considering only the lexical content can be misleading. Moreover, intra-textual and sub-sentential reversals, topic drift, negation can further misrepresent sentiment, fostering the need to recognize and incorporate contextual semantics for increasing the sentiment classification accuracy. This research evaluates the use of hierarchical attention network (HAN) to classify sentiments in real-time Twitter data, including the multiple sentence tweets and multi-tweet threads. HAN allows differential contribution of various parts of tweet (tweet-sentence-word) to its essential meaning as it introduces two attentive mechanisms and the context-dependent importance of the parts of tweet are considered when constructing the representation of the document. The model is evaluated on two benchmark datasets and compares favorably to state-of-the-art approaches giving an effective solution to tweet-level analysis of sentiments in SIoT.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Baccianella S, Esuli A, Sebastiani F (2010) Sentiwordnet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Lrec, vol 10, no 2010, pp 2200–2204
Baziotis C, Pelekis N, Doulkeridis C (2017) DataStories at SemEval-2017 Task 4: deep LSTM with attention for message-level and topic-based sentiment analysis. In: Proceedings of the 11th international workshop on semantic evaluations, pp 747–754
Cliché M (2017) BB twtr at SemEval-2017 Task 4: Twitter Sentiment Analysis with CNNs and LSTMs. SemEval-2017: 573–580
Dang NC, Moreno-García MN, De la Prieta F (2020) Sentiment analysis based on deep learning: a comparative study. Electronics 9(3):483
Gu J, Wang Z, Kuen J, Ma L, Shahroudy A, Shuai B, Liu T, Wang X, Wang G, Cai J, Chen T (2018) Recent advances in convolutional neural networks. Pattern Recogn 1(77):354–377
Islam J, Mercer RE, Xiao L (2019) Multi-channel convolutional neural network for twitter emotion and sentiment recognition. In: Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, volume 1 (long and short papers), pp 1355–1365
Jiang N, Tian F, Li J, Yuan X, Zheng J (2020) MAN: mutual attention neural networks model for aspect-level sentiment classification in SIoT. IEEE Internet Things J 7(4):2901–2913
Jianqiang Z, Xiaolin G, Xuejun Z (2018) Deep convolution neural networks for twitter sentiment analysis. IEEE Access 6:23253–23260
Jin Y, Zhang H, Du D (2016) Improving deep belief networks via delta rule for sentiment classification. In: 2016 IEEE 28th international conference on tools with artificial intelligence (ICTAI). IEEE, pp 410–414
Kumar A (2021) Leveraging crowd knowledge to curate documentation for agile software industry using deep learning and expert ranking. Multimed Syst. https://doi.org/10.1007/s00530-020-00741-x
Kumar A, Garg G (2019) Sentiment analysis of multimodal twitter data. Multimed Tools Appl 78(17):24103–24119
Kumar A, Jaiswal A (2017) Empirical study of twitter and tumblr for sentiment analysis using soft computing techniques. In: Proceedings of the world congress on engineering and computer science, vol 1, pp 1–5
Kumar A, Jaiswal A (2019) Swarm intelligence based optimal feature selection for enhanced predictive sentiment accuracy on twitter. Multimed Tools Appl 78(20):29529–29553
Kumar A, Jaiswal A (2020) A deep swarm-optimized model for leveraging industrial data analytics in cognitive manufacturing. IEEE Trans Ind Inform. https://doi.org/10.1109/TII.2020.3005532
Kumar A, Jaiswal A (2020) Systematic literature review of sentiment analysis on Twitter using soft computing techniques. Concurr Comput: Pract Exp 32(1):e5107
Kumar A, Sachdeva N (2021) Multimodal cyberbullying detection using capsule network with dynamic routing and deep convolutional neural network. Multimed Syst. https://doi.org/10.1007/s00530-020-00747-5
Kumar A, Sebastian TM (2012) Sentiment analysis: a perspective on its past, present and future. Int J Intell Syst Appl 4(10):1–14
Kumar A, Sebastian TM (2012) Sentiment analysis on twitter. Int J Comput Sci Issues 9(4):372
Kumar A, Srinivasan K, Cheng WH, Zomaya AY (2020) Hybrid context enriched deep learning model for fine-grained sentiment analysis in textual and visual semiotic modality social data. Inf Process Manag 57(1):102141
Nguyen DQ, Vu T, Nguyen AT (2020) BERTweet: a pre-trained language model for English Tweets. arXiv preprint arXiv:2005.10200
Otter DW, Medina JR, Kalita JK (2020) A survey of the usages of deep learning for natural language processing. IEEE Trans Neural Netw Learn Syst 32:604–624
Peters ME, Neumann M, Iyyer M, Gardner M, Clark C, Lee K, Zettlemoyer L (2018) Deep contextualized word representations. arXiv preprint arXiv:1802.05365
Roopa MS, Pattar S, Buyya R, Venugopal KR, Iyengar SS, Patnaik LM (2019) Social Internet of Things (SIoT): foundations, thrust areas, systematic review and future directions. Comput Commun 139:32–57
Rosenthal S, Farra N, Nakov P (2017) SemEval-2017 task 4: sentiment analysis in Twitter. In: Proceedings of the 11th international workshop on semantic evaluation (SemEval-2017), pp 502–518
Saif H, Fernandez M, He Y, Alani H (2013) Evaluation datasets for Twitter sentiment analysis: a survey and a new dataset, the STS-Gold
Saif H, Fernandez M, He Y, Alani H (2014) Senticircles for contextual and conceptual semantic sentiment analysis of twitter. In: European semantic web conference. Springer, Cham, pp. 83–98
Saif H, He Y, Fernandez M, Alani H (2016) Contextual semantics for sentiment analysis of Twitter. Inf Process Manag 52(1):5–19
Scherer K, Dan E, Flykt A (2006) What determines a feeling’s position in affective space? A case for appraisal. Cogn Emot 20(1):92–113
Thelwall M, Buckley K, Paltoglou G (2012) Sentiment strength detection for the social web. J Am Soc Inform Sci Technol 63(1):163–173
Thelwall M, Buckley K, Paltoglou G, Cai D, Kappas A (2010) Sentiment strength detection in short informal text. J Am Soc Inform Sci Technol 61(12):2544–2558
Wilson T, Wiebe J, Hoffmann P (2005) Recognizing contextual polarity in phrase-level sentiment analysis. In: Proceedings of human language technology conference and conference on empirical methods in natural language processing, pp 347–354
Yang Z, Yang D, Dyer C, He X, Smola A, Hovy E (2016) Hierarchical attention networks for document classification. In: Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies, pp 1480–1489
Young T, Hazarika D, Poria S, Cambria E (2018) Recent trends in deep learning based natural language processing. IEEE Comput Intell Mag 13(3):55–75
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Kumar, A. Contextual semantics using hierarchical attention network for sentiment classification in social internet-of-things. Multimed Tools Appl 81, 36967–36982 (2022). https://doi.org/10.1007/s11042-021-11262-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-021-11262-8