Skip to main content
Log in

Do we Benefit from the Categorization of the News Flow in the Stock Price Prediction Problem?

  • Published:
Doklady Mathematics Aims and scope Submit manuscript

Abstract

The power of machine learning is widely leveraged in the task of company stock price prediction. It is essential to incorporate historical stock prices and relevant external world information for constructing a more accurate predictive model. The sentiments of the financial news connected with the company can become such valuable knowledge. However, financial news has different topics, such as Macro, Markets, or Product news. The adoption of such categorization is usually out of scope in a market research. In this work, we aim to close this gap and explore the effect of capturing the news topic differentiation in the stock price prediction problem. Initially, we classify the financial news stream into 20 pre-defined topics with the pre-trained model. Then, we get sentiments and explore the topic of news group sentiment labeling. Moreover, we conduct the experiments with the several well-proved models for time series forecasting, including the Temporal Convolutional Network (TCN), the D-Linear, the Transformer, and the Temporal Fusion Transformer (TFT). In the results of our research, utilizing the information from separate topic groups contributes to a better performance of deep learning models compared to the approach when we consider all news sentiments without any division.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1.
Fig. 2.

REFERENCES

  1. S. Budennyy, A. Kazakov, E. Kovtun, and L. Zhukov, “New drugs and stock market: A machine learning framework for predicting pharma market reaction to clinical trial announcements,” Sci. Rep. 13 (1), 12817 (2023).

    Article  Google Scholar 

  2. M. Nikou, G. Mansourfar, and J. Bagherzadeh, “Stock price prediction using deep learning algorithm and its comparison with machine learning algorithms,” Intell. Syst. Acc. Finance Manage. 26 (4), 164–174 (2019).

    Article  Google Scholar 

  3. W. Khan, M. A. Ghazanfar, M. A. Azam, A. Karami, K. H. Alyoubi, and A. S. Alfakeeh, “Stock market prediction using machine learning classifiers and social media, news,” J. Ambient Intell. Human. Comput. 13, 3433–3456 (2020).

    Article  Google Scholar 

  4. V. Patel and A. Patel, “Clustering news articles for topic detection,” Iconic Res. Eng. J. 1 (11), 57–61 (2018).

    Google Scholar 

  5. S. Kelly and K. Ahmad, “Estimating the impact of domain-specific news sentiment on financial assets,” Knowl.-Based Syst. 150, 116–126 (2018).

    Article  Google Scholar 

  6. G. Mu, N. Gao, Y. Wang, and L. Dai, “A stock price prediction model based on investor sentiment and optimized deep learning,” IEEE Access 11, 51353–51367 (2023). https://doi.org/10.1109/ACCESS.2023.3278790

    Article  Google Scholar 

  7. Z. Wang, Z. Hu, F. Li, and S.-B. Ho, “Learning-based stock market trending analysis by incorporating social media sentiment analysis” (2021). https://api.semanticscholar.org/CorpusID:235526511

  8. J.-X. Liu, J.-S. Leu, and S. Holst, “Stock price movement prediction based on Stocktwits investor sentiment using FinBERT and ensemble SVM,” PeerJ Comput. Sci. 9, 1403 (2023). https://doi.org/10.7717/peerj-cs.1403

    Article  Google Scholar 

  9. Z. Ji, P. Wu, C. Ling, and P. Zhu, “Exploring the impact of investor’s sentiment tendency in varying input window length for stock price prediction,” Multimedia Tools Appl. 82, 27415–27449 (2023). https://doi.org/10.1007/s11042-023-14587-8

    Article  Google Scholar 

  10. zeroshot/twitter-financial-news-topic. https://huggingface.co/datasets/zeroshot/twitter-financial-news-topic. Accessed May 17, 2023.

  11. finbert-tone-finetuned-finance-topic-classification. https://huggingface.co/nickmuchi/finbert-tone-finetuned-finance-topic-classification. Accessed May 17, 2023.

  12. finbert-tone. https://huggingface.co/yiyanghkust/finbert-tone. Accessed May 17, 2023.

  13. C. Lea, M. Flynn, R. Vidal, A. Reiter, and G. Hager, “Temporal convolutional networks for action segmentation and detection” (2016).

  14. A. Zeng, M. Chen, L. Zhang, and Q. Xu, “Are transformers effective for time series forecasting?” (2022). https://doi.org/10.48550/arXiv.2205.13504

  15. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in Neural Information Processing Systems (2017), Vol. 30. https://arxiv.org/abs/1706.03762

    Google Scholar 

  16. B. Lim, S. Ö. Arik, N. Loeff, and T. Pfister, “Temporal fusion transformers for interpretable multi-horizon time series forecasting,” Int. J. Forecast. 37, 1748–1764 (2021). https://doi.org/10.1016/j.ijforecast.2021.03.012

    Article  Google Scholar 

  17. Temporal Fusion Transformer. https://unit8co.github.io/darts/generated_api/darts.models.forecasting.tft_model.html. Accessed May 17, 2023.

  18. Historical financial news archive. www.kaggle.com/gennadiyr/us-equities-news-data/tasks. Accessed May 17, 2023.

Download references

Funding

This work was supported by ongoing institutional funding. No additional grants to carry out or direct this particular research were obtained.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to E. Yu. Kovtun.

Ethics declarations

The authors of this work declare that they have no conflicts of interest.

Additional information

Publisher’s Note.

Pleiades Publishing remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kulikova, T.D., Kovtun, E.Y. & Budennyy, S.A. Do we Benefit from the Categorization of the News Flow in the Stock Price Prediction Problem?. Dokl. Math. 108 (Suppl 2), S503–S510 (2023). https://doi.org/10.1134/S1064562423701648

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S1064562423701648

Keywords:

Navigation