An Intelligent Logistic Regression Approach for Verb Expression’s Sentiment Analysis

  • Daoning Jiang
  • Qian TaoEmail author
  • Zhenyu Wang
  • Lixia Dong
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 752)


Sentiment analysis of text has tremendous value in many fields. But verb expression is absent, while lots of researchers concentrate on identifying opinions from adjective, adverb, and noun expressions in recent years. In this paper, we find that verb expressions in a sentence can be more important because verb expressions not only imply opinions but also give a direct way for enterprise to improve their products. It is meaningful that the verb expressions are extracted and analyzed. In order to deal with this problem, we propose a new method of linear regression optimized by particle swarm optimization to analyze verb expression extracted from reviews. Since our training data is obtained from titles of reviews whose labels are automatically inferred from review ratings, our method is able to work without manual involvement. Experimental results demonstrate our approach has great performance in terms of both precision and efficiency.


Verb expression Sentiment analysis Particle swarm optimization Multiple linear regression Features engineering 



This work is supported in part by 2017 Central Universities Fundamental Research Project (General Program ID:56),in part by the Guangdong Province Natural Science Foundation under Grant No. 2015A030310194, in part by the Guangdong Province Science and Technology Project under Grant No. 2015A080804019 and No. 2015B010131003, in part by the Guangzhou Municipal Science and Technology Project under Grant No. 2015SX017 and No. 2015SX022, in part by the Guangdong Province Colleges Major Projects under Grant No. 2014KTSCX194, in part by the surface project of Wuxi health and family planning No. MS201716, in part by the Wuxi Science and Technology Development Guiding Project No. CSZ0N1617, and in part by 2016 NSFC-Guangdong Joint Fund of Scientific: Supercomputing Application Research Projects.


  1. 1.
    Beaudouin, Valérie. Note de lecture: Bing Liu. Sentiment Analysis and Opinion Mining, Morgan & Claypool publishers, 2012. 2012. Google Scholar
  2. 2.
    Chen, Zhiyuan, A. Mukherjee, and B. Liu. “Aspect Extraction with Automated Prior Knowledge Learning.” ACL 2014.Google Scholar
  3. 3.
    Subrahmanian, V. S., and D. Reforgiato. “AVA: Adjective-Verb-Adverb Combinations for Sentiment Analysis.” IEEE Intelligent Systems 23.4(2008):43–50.Google Scholar
  4. 4.
    Chunping, Ouyang, et al. “Features-level Sentiment Analysis of Movie reviews.” (2015).Google Scholar
  5. 5.
    Mikolov, Tomas, et al. “Neural network based language models for highly inflective languages.” IEEE International Conference on Acoustics, Speech and Signal Processing IEEE, 2009:4725–4728.Google Scholar
  6. 6.
    Bollegala, Danushka, D. Weir, and J. Carroll. “Cross-Domain Sentiment Classification Using a Sentiment Sensitive Thesaurus.” IEEE Transactions on Knowledge & Data Engineering 25.8(2013):1719–1731.Google Scholar
  7. 7.
    Karamibekr, Mostafa, and A. A. Ghorbani. “Verb Oriented Sentiment Classification.” Ieee/wic/acm International Joint Conferences on Web Intelligence and Intelligent Agent Technology IEEE Computer Society, 2012:327–331.Google Scholar
  8. 8.
    Li, Huayi, et al. “Extracting Verb Expressions Implying Negative Opinions.” AAAI 2015.Google Scholar
  9. 9.
    Pennington, Jeffrey, R. Socher, and C. Manning. “Glove: Global Vectors for Word Representation.” Conference on Empirical Methods in Natural Language Processing 2014:1532–1543.Google Scholar
  10. 10.
    Mikolov, Tomas, et al. “Efficient Estimation of Word Representations in Vector Space.” Computer Science (2013).Google Scholar
  11. 11.
    Mikolov, Tomas, et al. “Distributed Representations of Words and Phrases and their Compositionality.” Advances in Neural Information Processing Systems 26(2013):3111–3119.Google Scholar
  12. 12.
    Kübler, Sandra, R. Mcdonald, and J. Nivre. “Synthesis lectures on human language technologies.” (2009).Google Scholar
  13. 13.
    Turney, Peter D. “Thumbs up or thumbs down: semantic orientation applied to unsupervised classification of reviews.” Meeting on Association for Computational Linguistics Association for Computational Linguistics, 2002:417–424.Google Scholar
  14. 14.
    Taboada, Maite, et al. “Lexicon-based methods for sentiment analysis.” Computational Linguistics 37.2(2011):267–307.Google Scholar
  15. 15.
    Goldberg, Yoav, and O. Levy. “word2vec Explained: deriving Mikolov et al.’s negative-sampling word-embedding method.” Eprint Arxiv (2014).Google Scholar
  16. 16.
    Eberhart, R C. A modified particle swarm optimizer. Advances in Natural Computation. Springer Berlin Heidelberg, 1998:439–439.Google Scholar
  17. 17.
    Kavitha, S, S. Varuna, and R. Ramya. “A comparative analysis on linear regression and support vector regression.” Online International Conference on Green Engineering and Technologies IEEE, 2017.Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  • Daoning Jiang
    • 1
  • Qian Tao
    • 1
    Email author
  • Zhenyu Wang
    • 1
  • Lixia Dong
    • 2
  1. 1.School of Software EngineeringSouth China University of TechnologyGuangzhouChina
  2. 2.Wuxi Mental Health CenterNanjing Medical UniversityWuxiChina

Personalised recommendations