Social Media and News Sentiment Analysis for Advanced Investment Strategies

  • Steve Y. YangEmail author
  • Sheung Yin Kevin Mo
Part of the Studies in Computational Intelligence book series (SCI, volume 639)


The motivation of this chapter hinges on the growing popularity in the use of news and social media information and their increasing influence on the financial investment community . This chapter investigates the interplay between news/social sentiment and financial market movement in the form of empirical impact. The underlying belief is that news and social media influence investor sentiment, which in turn drives financial decisions and predicates the upward or downward movement of the financial markets. This book chapter contributes to the existing literature of sentiment analysis in the following three areas: (a) It provides a review of existing findings about influence of social media and news sentiment to asset prices and documents the persistent correlation between media sentiment and market movement. (b) It shows that abnormal news sentiment can be a predictive proxy for financial market returns and volatility, based on the intuition that extreme investor sentiment changes tend to have long and last effects to market movement. (c) It presents a number of approaches to formulate investment strategies based on the sentiment trend, shocks and feedback strength. The results show that the sentiment-based strategies yield superior risk-adjusted returns over other benchmark strategies. Altogether, this chapter provides a framework of existing empirical knowledge on the impact of sentiment on financial markets and further prescribes advanced investment strategies based on sentiment analytics.


Sentiment analysis Financial investment community Genetic algorithms Investment strategies 



The authors would like to thank the Financial Engineering Division at Stevens Institute of Technology for providing a state-of-the-art research environment with data access and hardware support. They would also like to acknowledge the support from the Civil Group of Northrop Grumman Corporation.


  1. 1.
    Aboura, S., Chevallier, J.: Leverage vs. feedback: which effect drives the oil market? Finan. Res. Lett. 10(3), 131–141 (2013)Google Scholar
  2. 2.
    Antoniou, A., Koutmos, G., Pericli, A.: Index futures and positive feedback trading: evidence from major stock exchanges. J. Empirical Finan. 12(2), 219–238 (2005)Google Scholar
  3. 3.
    Antweiler, W., Frank, M.Z.: Is all that talk just noise? The information content of internet stock message boards. J. Finan. 59(3), 1259–1294 (2004). Google Scholar
  4. 4.
    Arnold, L.G., Brunner, S.: The economics of rational speculation in the presence of positive feedback trading. Q. Rev. Econ. Finan. (2014)Google Scholar
  5. 5.
    Baccianella, S., Esuli, A., Sebastiani, F.: SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Calzolari, N., Choukri, K., Maegaard, B., Mariani, J., Odijk, J., Piperidis, S., ... Tapias, D. (eds.) Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC’10), pp. 2200–2204. European Language Resources Association (ELRA) (2010)Google Scholar
  6. 6.
    Barber, B.M., Odean, T.: All that glitters: the effect of attention and news on the buying behavior of individual and institutional investors. Rev. Finan. Stud. 21(2), 785–818 (2007)Google Scholar
  7. 7.
    Barberis, N., Shleifer, A., Vishny, R.: A model of investor sentiment. J. Finan. Econ. 49, 307–343 (1998)Google Scholar
  8. 8.
    Borgatti, S.P., Everett, M.G.: A Graph-theoretic perspective on centrality. Soc. Netw. 28(4), 466–484 (2006)Google Scholar
  9. 9.
    Brown, G.W., Cliff, M.T.: Investor sentiment and the near-term stock market. J. Empirical Finan. 11(1), 1–27 (2004)Google Scholar
  10. 10.
    Chau, F., Deesomsak, R.: Business cycle variation in positive feedback trading: evidence from the G-7 economies. J. Int. Finan. Mark. Inst. Money (2014)Google Scholar
  11. 11.
    Chopra, N., Lakonishok, J., Ritter, J.R.: Measuring abnormal performance. J. Finan. Econ. 31, 235–268 (1992)Google Scholar
  12. 12.
    Cohen, G., Kudryavtsev, A.: Investor rationality and financial decisions. J. Behav. Finan. 13(1), 11–16 (2012)Google Scholar
  13. 13.
    Crone, S.F., Koeppel, C.: Predicting exchange rates with sentiment indicators: an empirical evaluation using text mining and multilayer perceptrons. In: 2014 IEEE Conference on Computational Intelligence for Financial Engineering and Economics (CIFEr), pp. 114–121 (2014)Google Scholar
  14. 14.
    Daniel, K.D., Hirshleifer, D., Subrahmanyam, A.: Overconfidence, arbitrage, and equilibrium asset pricing. J. Finan. LVI, 921–965 (2001)Google Scholar
  15. 15.
    Daniel, K., Hirshleifer, D., Subrahmanyam, A.: Investor psychology and security market under- and overreactions. J. Finan. 53, 1839–1885 (1998)Google Scholar
  16. 16.
    DiBartolomeo, D., Warrick, S.: Linear Factor Models in Finance. Elsevier (2005)Google Scholar
  17. 17.
    Hilton, D.J.: The psychology of financial decision-making: applications to trading, dealing, and investment analysis. J. Psychol. Finan. Mark. 2(1), 37–53 (2001)Google Scholar
  18. 18.
    Hirshleifer, D., Subrahmanyam, A., Titman, S.: Feedback and the success of irrational investors. J. Finan. Econ. 81(2), 311–338 (2006)Google Scholar
  19. 19.
    Holland, J.: Genetic algorithms. Sci. Am. 66–72 (1992)Google Scholar
  20. 20.
    Hou, Y., Li, S.: The impact of the CSI 300 stock index futures: positive feedback trading and autocorrelation of stock returns. Int. Rev. Econ. Finan. 33, 319–337 (2014)Google Scholar
  21. 21.
    Im, T.L., San, P.W., On, C.K., Alfred, R., Anthony, P.: Impact of financial news headline and content to market sentiment. Int. J. Mach. Learn. Comput. 4(3), 237–242 (2014)Google Scholar
  22. 22.
    İnkaya, A., Yolcu Okur, Y.: Analysis of volatility feedback and leverage effects on the ISE30 index using high frequency data. J. Comput. Appl. Math. 259, 377–384 (2014)Google Scholar
  23. 23.
    Johnson, B.: Algorithmic Trading & DMA: An Introduction to Direct Access Trading Strategies, p. 574. 4Myeloma Press (2010)Google Scholar
  24. 24.
    Kaya, M.: Stock price prediction using financial news articles. In: 2nd IEEE International Conference on Information and Financial Engineering ICIFE 2010, pp. 478–482 (2010)Google Scholar
  25. 25.
    Khanna, N., Sonti, R.: Value creating stock manipulation: feedback effect of stock prices on firm value. J. Finan. Mark. 7(3), 237–270 (2004)Google Scholar
  26. 26.
    Koza, J.R.: Evolution of a Subsumption Architecture that Performs a Wall Following Task for an Autonomous Mobile Robot via Genetic Programming, pp. 1–39 (1992)Google Scholar
  27. 27.
    La Porta, R., Lakonishok, J., Shleifer, A., Vishny, R.W.: Good news for value stocks: further evidence on market efficiency. J. Finan. 52, 859–874 (1997)Google Scholar
  28. 28.
    Laopodis, N.T.: Feedback trading and autocorrelation interactions in the foreign exchange market: further evidence. Econ. Modell. 22(5), 811–827 (2005)Google Scholar
  29. 29.
    Li, X., Xie, H., Chen, L., Wang, J., Deng, X.: News impact on stock price return via sentiment analysis. Knowl-Based Syst. 69, 14–23 (2014)Google Scholar
  30. 30.
    Medhat, W., Hassan, A., Korashy, H.: Sentiment analysis algorithms and applications: a survey. Ain Shams Eng. J. 5(4), 1093–1113 (2014)Google Scholar
  31. 31.
    Mitchell, M., Mulherin, H.: The impact of public information on the stock market. J. Finan. 49(3), 923–950 (1994)Google Scholar
  32. 32.
    Mitra, L., Mitra, G.: The Handbook of News Analytics in Finance. Wiley, Chichester, West Sussex, UK (2011)Google Scholar
  33. 33.
    Mo, S.Y.K., Liu, A., Yang, S.: News sentiment to market impact and its feedback. SSRN Working Paper (Submitted) (2015)Google Scholar
  34. 34.
    Moreo, A., Romero, M., Castro, J.L., Zurita, J.M.: Lexicon-based comments-oriented news sentiment analyzer system. Expert Syst. Appl. 39(10), 9166–9180 (2012)Google Scholar
  35. 35.
    Nofsinger, J.R.: Social mood and financial economics. J. Behav. Finan. 6(3), 144–160 (2005)Google Scholar
  36. 36.
    Salm, C.A., Schuppli, M.: Positive feedback trading in stock index futures: international evidence. Int. Rev. Finan. Anal. 19(5), 313–322 (2010)Google Scholar
  37. 37.
    Schumaker, R.P., Zhang, Y., Huang, C.-N., Chen, H.: Evaluating sentiment in financial news articles. Decis. Support Syst. 53(3), 458–464 (2012)Google Scholar
  38. 38.
    Scott, J., Stumpp, M., Xu, P.: News, not trading volume, builds momentum. Finan. Anal. J. 59(2), 45–54 (2003)Google Scholar
  39. 39.
    Smales, L.A.: Asymmetric volatility response to news sentiment in gold futures. J. Int. Finan. Mark. Inst. Money 34, 161–172 (2015)Google Scholar
  40. 40.
    Song, Q., Liu, A., Yang, S.Y., Datta, K., Deane, A.: An extreme firm-specific news sentiment asymmetry based trading strategy. In: 2015 IEEE Conference on Computational Intelligence for Financial Engineering and Economics (CIFEr 2015) (2015)Google Scholar
  41. 41.
    Tetlock:. Giving content to investor sentiment: the role of media in the stock market. J. Finan. 62(3), 1139–1168 (2007)Google Scholar
  42. 42.
    Tetlock, P.C., Saar-Tsechansky, M., MacSkassy, S.: More than words: quantifying language to measure firms’ fundamentals. J. Finan. 63, 1437–1467 (2008). Google Scholar
  43. 43.
    Thaler, R.H.: Advances in Behavioral Finance, vol. 2. Princeton University Press, Princeton, NJ (2005)Google Scholar
  44. 44.
    Xie, B., Wang, D., Passonneau, R.J.: Semantic feature representation to capture news impact. In: Twenty-Seventh International Florida Artificial Intelligence Research Society Conference (2014)Google Scholar
  45. 45.
    Yang, S., Mo, S.Y.K., Liu, A., Kirilenko, A.: Genetic programming optimization for a sentiment feedback strength based trading strategy. SSRN Working Paper (2015)Google Scholar
  46. 46.
    Yang, S.Y., Mo, S.Y.K., Liu, A.: Twitter financial community sentiment and its predictive relationship to stock market movement. Quant. Finan. 15(10), 1637–1656 (2015)MathSciNetCrossRefGoogle Scholar
  47. 47.
    Yang, S.Y., Song, Q., Yin, S., Mo, K., Datta, K., Deane, A.: The impact of abnormal news sentiment on financial markets. J. Bus. Econ. 6(10), 1682–1694 (2015)Google Scholar
  48. 48.
    Yu, L.-C., Wu, J.-L., Chang, P.-C., Chu, H.-S.: Using a contextual entropy model to expand emotion words and their intensity for the sentiment classification of stock market news. Knowl.-Based Syst. 41, 89–97 (2013)Google Scholar
  49. 49.
    Zhang, W., Skiena, S.: Trading Strategies To Exploit Blog and News Sentiment (2010). Chan (2003)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Faculty of Financial Engineering, School of Systems & EnterprisesStevens Institute of TechnologyHobokenUSA
  2. 2.Faculty of Financial EngineeringStevens Institute of TechnologyHobokenUSA

Personalised recommendations