Skip to main content
Log in

Contextual semantics using hierarchical attention network for sentiment classification in social internet-of-things

  • 1211: AIoT Support and Applications with Multimedia
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

    We’re sorry, something doesn't seem to be working properly.

    Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Abstract

To steer impactful data-driven possibilities, Social Internet of Things (SIoT) comes with the collaboration of IoT and social networking and finds deeper insights into consumer behavior for better user experiences. Social networks can permeate intelligence to aid autonomous decision making by enhancing the service needs and communication among object peers in a SIoT. But the user-generated data has multiple layers of meaning which necessitate AI-driven solutions such as sentiment analysis to handle the dynamics. As people express opinions in complex ways and use rhetorical devices like sarcasm, irony, and implication etc., considering only the lexical content can be misleading. Moreover, intra-textual and sub-sentential reversals, topic drift, negation can further misrepresent sentiment, fostering the need to recognize and incorporate contextual semantics for increasing the sentiment classification accuracy. This research evaluates the use of hierarchical attention network (HAN) to classify sentiments in real-time Twitter data, including the multiple sentence tweets and multi-tweet threads. HAN allows differential contribution of various parts of tweet (tweet-sentence-word) to its essential meaning as it introduces two attentive mechanisms and the context-dependent importance of the parts of tweet are considered when constructing the representation of the document. The model is evaluated on two benchmark datasets and compares favorably to state-of-the-art approaches giving an effective solution to tweet-level analysis of sentiments in SIoT.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Baccianella S, Esuli A, Sebastiani F (2010) Sentiwordnet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Lrec, vol 10, no 2010, pp 2200–2204

  2. Baziotis C, Pelekis N, Doulkeridis C (2017) DataStories at SemEval-2017 Task 4: deep LSTM with attention for message-level and topic-based sentiment analysis. In: Proceedings of the 11th international workshop on semantic evaluations, pp 747–754

  3. Cliché M (2017) BB twtr at SemEval-2017 Task 4: Twitter Sentiment Analysis with CNNs and LSTMs. SemEval-2017: 573–580

  4. Dang NC, Moreno-García MN, De la Prieta F (2020) Sentiment analysis based on deep learning: a comparative study. Electronics 9(3):483

    Article  Google Scholar 

  5. Gu J, Wang Z, Kuen J, Ma L, Shahroudy A, Shuai B, Liu T, Wang X, Wang G, Cai J, Chen T (2018) Recent advances in convolutional neural networks. Pattern Recogn 1(77):354–377

    Article  Google Scholar 

  6. Islam J, Mercer RE, Xiao L (2019) Multi-channel convolutional neural network for twitter emotion and sentiment recognition. In: Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, volume 1 (long and short papers), pp 1355–1365

  7. Jiang N, Tian F, Li J, Yuan X, Zheng J (2020) MAN: mutual attention neural networks model for aspect-level sentiment classification in SIoT. IEEE Internet Things J 7(4):2901–2913

    Article  Google Scholar 

  8. Jianqiang Z, Xiaolin G, Xuejun Z (2018) Deep convolution neural networks for twitter sentiment analysis. IEEE Access 6:23253–23260

    Article  Google Scholar 

  9. Jin Y, Zhang H, Du D (2016) Improving deep belief networks via delta rule for sentiment classification. In: 2016 IEEE 28th international conference on tools with artificial intelligence (ICTAI). IEEE, pp 410–414

  10. Kumar A (2021) Leveraging crowd knowledge to curate documentation for agile software industry using deep learning and expert ranking. Multimed Syst. https://doi.org/10.1007/s00530-020-00741-x

    Article  Google Scholar 

  11. Kumar A, Garg G (2019) Sentiment analysis of multimodal twitter data. Multimed Tools Appl 78(17):24103–24119

    Article  Google Scholar 

  12. Kumar A, Jaiswal A (2017) Empirical study of twitter and tumblr for sentiment analysis using soft computing techniques. In: Proceedings of the world congress on engineering and computer science, vol 1, pp 1–5

  13. Kumar A, Jaiswal A (2019) Swarm intelligence based optimal feature selection for enhanced predictive sentiment accuracy on twitter. Multimed Tools Appl 78(20):29529–29553

    Article  Google Scholar 

  14. Kumar A, Jaiswal A (2020) A deep swarm-optimized model for leveraging industrial data analytics in cognitive manufacturing. IEEE Trans Ind Inform. https://doi.org/10.1109/TII.2020.3005532

    Article  Google Scholar 

  15. Kumar A, Jaiswal A (2020) Systematic literature review of sentiment analysis on Twitter using soft computing techniques. Concurr Comput: Pract Exp 32(1):e5107

    Article  MathSciNet  Google Scholar 

  16. Kumar A, Sachdeva N (2021) Multimodal cyberbullying detection using capsule network with dynamic routing and deep convolutional neural network. Multimed Syst. https://doi.org/10.1007/s00530-020-00747-5

    Article  Google Scholar 

  17. Kumar A, Sebastian TM (2012) Sentiment analysis: a perspective on its past, present and future. Int J Intell Syst Appl 4(10):1–14

    Google Scholar 

  18. Kumar A, Sebastian TM (2012) Sentiment analysis on twitter. Int J Comput Sci Issues 9(4):372

    Google Scholar 

  19. Kumar A, Srinivasan K, Cheng WH, Zomaya AY (2020) Hybrid context enriched deep learning model for fine-grained sentiment analysis in textual and visual semiotic modality social data. Inf Process Manag 57(1):102141

    Article  Google Scholar 

  20. Nguyen DQ, Vu T, Nguyen AT (2020) BERTweet: a pre-trained language model for English Tweets. arXiv preprint arXiv:2005.10200

  21. Otter DW, Medina JR, Kalita JK (2020) A survey of the usages of deep learning for natural language processing. IEEE Trans Neural Netw Learn Syst 32:604–624

    Article  MathSciNet  Google Scholar 

  22. Peters ME, Neumann M, Iyyer M, Gardner M, Clark C, Lee K, Zettlemoyer L (2018) Deep contextualized word representations. arXiv preprint arXiv:1802.05365

  23. Roopa MS, Pattar S, Buyya R, Venugopal KR, Iyengar SS, Patnaik LM (2019) Social Internet of Things (SIoT): foundations, thrust areas, systematic review and future directions. Comput Commun 139:32–57

    Article  Google Scholar 

  24. Rosenthal S, Farra N, Nakov P (2017) SemEval-2017 task 4: sentiment analysis in Twitter. In: Proceedings of the 11th international workshop on semantic evaluation (SemEval-2017), pp 502–518

  25. Saif H, Fernandez M, He Y, Alani H (2013) Evaluation datasets for Twitter sentiment analysis: a survey and a new dataset, the STS-Gold

  26. Saif H, Fernandez M, He Y, Alani H (2014) Senticircles for contextual and conceptual semantic sentiment analysis of twitter. In: European semantic web conference. Springer, Cham, pp. 83–98

  27. Saif H, He Y, Fernandez M, Alani H (2016) Contextual semantics for sentiment analysis of Twitter. Inf Process Manag 52(1):5–19

    Article  Google Scholar 

  28. Scherer K, Dan E, Flykt A (2006) What determines a feeling’s position in affective space? A case for appraisal. Cogn Emot 20(1):92–113

    Article  Google Scholar 

  29. Thelwall M, Buckley K, Paltoglou G (2012) Sentiment strength detection for the social web. J Am Soc Inform Sci Technol 63(1):163–173

    Article  Google Scholar 

  30. Thelwall M, Buckley K, Paltoglou G, Cai D, Kappas A (2010) Sentiment strength detection in short informal text. J Am Soc Inform Sci Technol 61(12):2544–2558

    Article  Google Scholar 

  31. Wilson T, Wiebe J, Hoffmann P (2005) Recognizing contextual polarity in phrase-level sentiment analysis. In: Proceedings of human language technology conference and conference on empirical methods in natural language processing, pp 347–354

  32. Yang Z, Yang D, Dyer C, He X, Smola A, Hovy E (2016) Hierarchical attention networks for document classification. In: Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies, pp 1480–1489

  33. Young T, Hazarika D, Poria S, Cambria E (2018) Recent trends in deep learning based natural language processing. IEEE Comput Intell Mag 13(3):55–75

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Akshi Kumar.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kumar, A. Contextual semantics using hierarchical attention network for sentiment classification in social internet-of-things. Multimed Tools Appl 81, 36967–36982 (2022). https://doi.org/10.1007/s11042-021-11262-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11262-8

Keywords

Navigation