Abstract
Nowadays, tremendous number of financial online articles are published every day. Numerous natural language processing (NLP) algorithms and methodologies have arose, not only for correct, but also for fast financial sentiment extraction. Currently, word and sentence encoders are popular topic in NLP field, due to their ability to represent them as dense vectors in a continuous real numbers space, referred to as embeddings. These low dimensional embedding vectors are appropriate for deep neural networks (DNN) inputs, and their invention boosted the performance of multiple of NLP tasks.
In this paper, we evaluate different word and sentence embeddings in combination with standard machine learning and deep-learning classifiers for financial texts sentiment extraction. Our evaluation shows the BiGRU+Attention architecture with word embedding as features, give the best score in overall evaluation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Scikit-learn, https://scikit-learn.org/stable/.
- 2.
Keras, https://keras.io/.
References
Antweiler, W., Frank, M.Z.: Is all that talk just noise? The information content of internet stock message boards. J. Finan. 59(3), 1259–1294 (2004)
Ba, J., Mnih, V., Kavukcuoglu, K.: Multiple object recognition with visual attention. arXiv preprint arXiv:1412.7755 (2014)
Baker, M., Wurgler, J.: Investor sentiment in the stock market. J. Econ. Perspect. 21(2), 129–152 (2007)
Bojanowski, P., Grave, E., Joulin, A., Mikolov, T.: Enriching word vectors with subword information. Trans. Assoc. Comput. Linguist. 5, 135–146 (2017)
Cambria, E., Poria, S., Gelbukh, A., Thelwall, M.: Sentiment analysis is a big suitcase. IEEE Intell. Syst. 32(6), 74–80 (2017)
Cer, D., et al.: Universal sentence encoder. arXiv preprint arXiv:1803.11175 (2018)
Chung, J., Gülçehre, Ç., Cho, K., Bengio, Y.: Empirical evaluation of gated recurrent neural networks on sequence modeling. CoRR abs/1412.3555 (2014). http://arxiv.org/abs/1412.3555
Chung, J., Gulcehre, C., Cho, K., Bengio, Y.: Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555 (2014)
Cortis, K., et al.: SemEval-2017 Task 5: fine-grained sentiment analysis on financial microblogs and news. In: Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), pp. 519–535 (2017)
Elman, J.L.: Finding structure in time. Cogn. Sci. 14(2), 179–211 (1990)
Hochreiter, S., Schmidhuber, J.: LSTM can solve hard long time lag problems. In: Advances in Neural Information Processing Systems, pp. 473–479 (1997)
Hutto, C.J., Gilbert, E.: Vader: a parsimonious rule-based model for sentiment analysis of social media text. In: Eighth International AAAI Conference On Weblogs and Social Media (2014)
Kar, S., Maharjan, S., Solorio, T.: RiTUAL-UH at SemEval-2017 Task 5: sentiment analysis on financial data using neural networks. In: Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), pp. 877–882 (2017)
Loughran, T., McDonald, B.: When is a liability not a liability? Textual analysis, dictionaries, and 10-Ks. J. Finan. 66(1), 35–65 (2011)
Malo, P., Sinha, A., Takala, P., Ahlgren, O., Lappalainen, I.: Learning the roles of directional expressions and domain concepts in financial news analysis. In: 13th International Conference on Data Mining Workshops, pp. 945–954. IEEE (2013)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013)
Mishkin, S., Eakins, G.: Financial Markets and Institutions. Prentice Hall, Boston (2012)
Pennington, J., Socher, R., Manning, C.: Glove: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014)
Sabherwal, S., Sarkar, S.K., Zhang, Y.: Do internet stock message boards influence trading? Evidence from heavily discussed stocks with no fundamental news. J. Bus. Finan. Account. 38(9–10), 1209–1237 (2011)
Schwenk, H., Douze, M.: Learning joint multilingual sentence representations with neural machine translation. arXiv preprint arXiv:1704.04154 (2017)
Trofimovich, J.: Comparison of neural network architectures for sentiment analysis of Russian Tweets. In: Computational Linguistics and Intellectual Technologies: Proceedings of the International Conference Dialogue (2016)
Xie, Q., Dai, Z., Hovy, E., Luong, M.T., Le, Q.V.: Unsupervised data augmentation. arXiv preprint arXiv:1904.12848 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Mishev, K. et al. (2019). Performance Evaluation of Word and Sentence Embeddings for Finance Headlines Sentiment Analysis. In: Gievska, S., Madjarov, G. (eds) ICT Innovations 2019. Big Data Processing and Mining. ICT Innovations 2019. Communications in Computer and Information Science, vol 1110. Springer, Cham. https://doi.org/10.1007/978-3-030-33110-8_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-33110-8_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-33109-2
Online ISBN: 978-3-030-33110-8
eBook Packages: Computer ScienceComputer Science (R0)