Skip to main content
Log in

Context-aware sentiment propagation using LDA topic modeling on Chinese ConceptNet

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

A sentiment dictionary is a valuable resource in sentiment analysis research. Previous work has propagated sentiment values from existing dictionaries via semantic networks to build wide-coverage dictionaries efficiently. Unfortunately, this blind propagation method tends to incorrectly estimate sentiment values the further along the chain it goes from the seed word because it does not consider word senses in context. In this work, we propose a context-aware propagation method on Chinese ConceptNet to help resolve this issue. In our approach, we represent contexts using LDA topic modeling by generating a topic for each context. We can then assign concepts different sentiment values for different topics when propagating sentiments on Chinese ConceptNet. Our experiments on both microblog posts and drama dialogue subtitles show that our context-aware approach improves the accuracy of sentiment polarity prediction.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Notes

  1. http://tcci.ccf.org.cn/conference/2013/pages/page04_dg.html.

  2. https://pypi.python.org/pypi/jieba/0.37.

  3. http://tcci.ccf.org.cn/conference/2013/pages/page04_dg.html.

References

  • Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J Mach Learn Res 3:993–1022. http://dl.acm.org/citation.cfm?id=944919.944937

  • Boia M, Musat C, Faltings B (2014) Acquiring commonsense knowledge for sentiment analysis through human computation. In: Proceedings of the twenty-eighth AAAI conference on artificial intelligence, AAAI14, pp 901–907. http://www.aaai.org/ocs/index.php/AAAI/AAAI14/paper/view/8244

  • Bradley M, Lang PJ (1999) Affective norms for english words (anew): instruction manual and affective ratings. University of Florida, The Center for Research in Psychophysiology

  • Cambria E, Speer R, Havasi C, Hussain A (2010) Senticnet: a publicly available semantic resource for opinion mining. In: AAAI fall symposium: commonsense knowledge, AAAI10, vol 10, pp 14–18. https://www.aaai.org/ocs/index.php/FSS/FSS10/paper/view/2216

  • Esuli A, Sebastiani F (2006) Sentiwordnet: a publicly available lexical resource for opinion mining. In: In proceedings of the 5th conference on language resources and evaluation, LREC06, vol 6, pp 417–422

  • Hassan A, Radev D (2010) Identifying text polarity using random walks. In: Proceedings of the 48th annual meeting of the association for computational linguistics, association for computational linguistics, Stroudsburg, PA, USA, ACL10, pp 395–40. http://dl.acm.org/citation.cfm?id=1858681.1858722

  • Havasi C, Speer R, Alonso J (2007) Conceptnet 3: a flexible, multilingual semantic network for common sense knowledge. In: Recent advances in natural language processing, Borovets, Bulgaria, RANLP07

  • Kuo YL, Chiang KY, Chan CW, Lee JC, Wang R, Shan E, Hsu JYJ (2009) Community-based game design: experiments on social games for commonsense data collection. In: KDD-09 Workshop on human computation, ACM, New York, NY, USA, HCOMP09, pp 15–22. doi:10.1145/1600150.1600154

  • Lang PJ (1980) Behavioral treatment and bio-behavioral assessment: computer applications. In: Sidowski JB, Johnson JH, Williams TH (eds) Technology in Mental Health Care Delivery Systems. Ablex, pp 119–137

  • Lee HY, ePulze Sdn Bhd C, Block C, Renganathan H (2011) Chinese sentiment analysis using maximum entropy. In: Sentiment analysis where AI meets psychology (SAAIP), pp 89–93

  • Liu H, Lieberman H, Selker T (2003) A model of textual affect sensing using real-world knowledge. In: Proceedings of the 8th international conference on intelligent user interfaces, ACM, New York, NY, USA, IUI03, pp 125–132. doi:10.1145/604045.604067

  • Lu Y, Castellanos M, Dayal U, Zhai C (2011) Automatic construction of a context-aware sentiment lexicon: an optimization approach. In: Proceedings of the 20th international conference on world wide web, ACM, New York, NY, USA, WWW11, pp 347–356. doi:10.1145/1963405.1963456

  • Miller GA (1995) Wordnet: a lexical database for english. Commun ACM 38(11):39–41. doi:10.1145/219717.219748

  • Rao Y, Lei J, Liu W, Li Q, Chen M (2014) Building emotional dictionary for sentiment analysis of online news. In: World Wide Web 2014, Springer, WWW14, pp 723–742. doi:10.1007/s11280-013-0221-9

  • Speer R, Havasi C (2012) Representing general relational knowledge in conceptnet 5. In: Proceedings of the eight international conference on language resources and evaluation, European Language Resources Association (ELRA), Istanbul, Turkey, LREC12. http://www.lrec-conf.org/proceedings/lrec2012/pdf/1072_Paper.pdf

  • Strapparava C, Valitutti A (2004) Wordnet-affect: an affective extension of wordnet. In: Proceedings of the 4th international conference on language resources and evaluation, IREC04, pp 1083–1086

  • Taboada M, Brooke J, Tofiloski M, Voll K, Stede M (2011) Lexicon-based methods for sentiment analysis. Comput Linguist 37(2):267–307. doi:10.1162/COLI_a_00049

    Article  Google Scholar 

  • Tsai ACR, Wu CE, Tsai RTH, Hsu JYJ (2013) Building a concept-level sentiment dictionary based on commonsense knowledge. IEEE Intell Syst IEEE13 28:22–30. doi:10.1109/MIS.2013.25. http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6461369

  • Wen S, Wan X (2014) Emotion classification in microblog texts using class sequential rules. In: AAAI conference on artificial intelligence 2014 AAAI14. http://www.aaai.org/ocs/index.php/AAAI/AAAI14/paper/view/8209

  • Wu CE, Tsai RTH (2014) Using relation selection to improve value propagation in a conceptnet-based sentiment dictionary. Knowl Based Syst 69:100–107. http://www.sciencedirect.com/science/article/pii/S0950705114001737

  • Xu G, Meng X, Wang H (2010a) Build chinese emotion lexicons using a graph-based algorithm and multiple resources. In: Proceedings of the 23rd international conference on computational linguistics, Association for Computational Linguistics, Stroudsburg, PA, USA, COLING’10, pp 1209–1217. http://dl.acm.org/citation.cfm?id=1873781.1873917

  • Xu H, Zhao K, Qiu L, Hu C (2010b) Expanding chinese sentiment dictionaries from large scale unlabeled corpus. In: PACLIC 24 proceedings, ACL, PACLIC10, vol 24, pp 301–310. http://www.aclweb.org/anthology/Y10-1034

  • Wu H-H, Tsai AC-R, Tsai RT-H, Hsu JYJ (2013) Building a graded chinese sentiment dictionary based on commonsense knowledge for sentiment analysis of song lyrics. J Inf Sci Eng 29(4): 647–662

Download references

Acknowledgments

This study was funded by the Ministry of Science and Technology, National Taiwan University, and Intel Corporation under Grants MOST 102-2627-E-002-001, 103-3113-E-002-008-, 103-2911-I-002-001, 104-2119-M-008-025, 104-2221-E-008 -034 -MY3, NTU-ICRP-104R7501, NTU-ICRP-104R7501-1, and 104R890861.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Richard Tzong-Han Tsai or Jane Yung-jen Hsu.

Ethics declarations

Conflict of interest

Po-Hao Chou declares that he has no conflict of interest. Richard Tzong-Han Tsai declares that he has no conflict of interest. Jane Yung-jen Hsu declares that she has no conflict of interest.

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. This article does not contain any studies with animals performed by any of the authors.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Additional information

Communicated by C.-H. Chen.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chou, PH., Tsai, R.TH. & Hsu, J.Yj. Context-aware sentiment propagation using LDA topic modeling on Chinese ConceptNet. Soft Comput 21, 2911–2921 (2017). https://doi.org/10.1007/s00500-016-2273-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-016-2273-0

Keywords

Navigation