Stock Prices Prediction from Financial News Articles Using LSTM and XAI

Abstract

The stock market is very complex and volatile. It is impacted by positive and negative sentiments which are based on media releases. The scope of the stock price analysis relies upon the ability to recognize the stock movements. It is based on technical fundamentals and understanding the hidden trends which the market follows. Stock price prediction (Vachhani et al in Mach Learn-Based Stock Market Anal Short Surv (2020) [1]) has consistently been an extremely dynamic field of exploration and research work. However, arriving at the ideal degree of precision is still an enticing challenge. In this paper, we are proposing a combined effort of using efficient machine learning techniques coupled with a deep learning technique—long short-term memory (LSTM) to use them to predict the stock prices with a high level of accuracy. Sentiments derived by users from news headlines have a tremendous effect on the buying and selling patterns of the traders as they easily get influenced by what they read. Hence, fusing one more dimension of sentiments along with technical analysis should improve the prediction accuracy. LSTM networks have proved to be a very useful tool to learn and predict temporal data having long-term dependencies. In our work, the LSTM model uses historical stock data along with sentiments from news items to create a better predictive model