Skip to main content
SpringerLink
Log in

Short Term Firm-Specific Stock Forecasting with BDI Framework

  • Published:
Computational Economics Aims and scope Submit manuscript

Abstract

In today’s information age, a comprehensive stock trading decision support system which aids a stock investor in decision making without relying on random guesses and reading financial news from various sources is the need of the hour. This paper investigates the predictive power of technical, sentiment and stock market analysis coupled with various machine learning and classification tools in predicting stock trends over the short term for a specific company. Large dataset stretching over a duration of ten years has been used to train, test and validate our system. The efficacy of supervised non-shallow and prototyping learning architectures are illustrated by comparison of results obtained through myriad optimization, classification and clustering algorithms. The results obtained from our system reveals a significant improvement over the efficient market hypothesis for specific companies and thus strongly challenges it. Technical parameters and algorithms used have shown a significant impact on the predictive power of the system. The predictive accuracy obtained is as high as 70–75% using linear vector quantization. It has been found that sentiment analysis has strong correlation with the future market trends. The proposed system provides a comprehensive decision support system which aids in decision making for stock trading. We also present a novel application of the BDI framework to systematically apply the learning and prediction phases.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Abounoori, E. & Tazehabadi, A. (2009). Forecasting stock price using macroeconomic variables: A hybrid ardl, arima and artificial neural network. In International conference on information and financial engineering, 2009, ICIFE 2009 (pp. 149–153).

  • Ahmed, M., Sriram, A., & Singh, S. (2014). Towards a generic framework for short term firm-specific stock forecasting. In 2014 international conference on advances in computing, communications and informatics (ICACCI) (pp. 2681–2688).

  • Bergstra, J., Breuleux, O., Bastien, F., Lamblin, P., Pascanu, R., Desjardins, G., Turian, J., Warde-Farley, D., & Bengio, Y. (2010). Theano: A CPU and GPU math expression compiler. In Proceedings of the python for scientific computing conference (SciPy). (Oral Presentation).

  • Bishop, C. M. (2006). Pattern recognition and machine learning. New York: Springer.

    Google Scholar 

  • Bollen, J., & Mao, H. (2011). Twitter mood as a stock market predictor. Computer, 44(10), 91–94.

    Article  Google Scholar 

  • Bottou, L. (1998). Online learning and stochastic approximations. In D. Saad (Ed.), Online learning and neural networks (pp. 9–42). Cambridge, UK: Cambridge University Press.

    Google Scholar 

  • Box, G., Jenkins, G., & Reinsel, G. (2008). Time series analysis: forecasting and control (4th ed.). New York: Wiley

  • Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32.

    Article  Google Scholar 

  • Buitinck, L., Louppe, G., Blondel, M., Pedregosa, F., Mueller, A., Grisel, O., et al. (2013). API design for machine learning software: Experiences from the scikit-learn project. In ECML PKDD Workshop: Languages for data mining and machine learning (pp. 108–122).

  • Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3), 273–297.

    Google Scholar 

  • Dastani, M., & Steunebrink, B. (2009). Modularity in bdi-based multi-agent programming languages. In IEEE/WIC/ACM international joint conferences on web intelligence and intelligent agent technologies, 2009. WI-IAT ’09 (vol. 2, pp. 581–584).

  • Duke University. (2014). Random walk model. http://people.duke.edu/~rnau/411rand.htm. Accessed Apr 2014.

  • Fama, E. F. (1964). The distribution of the daily differences of the logarithms of stock prices. Ph.D. thesis, University of Chicago.

  • Fernandez-Rodrıguez, F., Gonzalez-Martel, C., & Sosvilla-Rivero, S. (2000). On the profitability of technical trading rules based on artificial neural networks: Evidence from the madrid stock market. Economics Letters, 69(1), 89–94.

    Article  Google Scholar 

  • Freund, Y., & Schapire, R. E. (1997). A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences, 55(1), 119–139.

    Article  Google Scholar 

  • Friedman, J. H. (2002). Stochastic gradient boosting. Computational Statistics & Data Analysis, 38(4), 367–378.

    Article  Google Scholar 

  • Gupta, R., Garg, N., & Singh, S. (2013). Stock market prediction accuracy analysis using kappa measure. In 2013 international conference on communication systems and network technologies (CSNT) (pp. 635–639).

  • Haykin, S. (1999). Neural networks: A comprehensive foundation, International edition. Upper Saddle River: Prentice Hall.

    Google Scholar 

  • Huang, Y. C., & Tsai, P. L. (2008). Effectiveness of closing call auctions: Evidence from the Taiwan stock exchange. Emerging Markets Finance and Trade, 44(3), 5–20.

    Article  Google Scholar 

  • Human Oriented. (2014). Decision tree classifier. http://mines.humanoriented.com/classes/2010/fall/csci568/portfolio_exports/lguo/decisionTree.html. Accessed Apr 2014.

  • Khan, A. U., Bandopadhyaya, T., & Sharma, S. (2008). Genetic algorithm based backpropagation neural network performs better than backpropagation neural network in stock rates prediction. Journal of Computer Science and Network Security, 8(7), 162–166.

    Google Scholar 

  • Kimoto, T., Asakawa, K., Yoda, M., & Takeoka, M. (1990). Stock market prediction system with modular neural networks. In 1990 IJCNN International Joint Conference on Neural Networks, 1990 (pp. 1–6). IEEE.

  • Kohonen, T. (Ed.). (1997). Self-organizing maps. New York: Springer.

    Google Scholar 

  • Lawrence, R. (1997). Using neural networks to forecast stock market prices. University of Manitoba.

  • Li, C., & Chiang, T.-W. (2013). Complex neurofuzzy arima forecasting 2014: A new approach using complex fuzzy sets. IEEE Transactions on Fuzzy Systems, 21(3), 567–584.

    Article  Google Scholar 

  • Li, F., & Liu, C. (2009). Application study of bp neural network on stock market prediction. In Ninth International Conference on Hybrid Intelligent Systems, 2009. HIS’09 (vol. 3, pp. 174–178). IEEE.

  • Majumder, M., & Hussian, M. A. (2014). Forecasting of Indian stock market index using artificial neural network. http://www.nseindia.com/content/research/FinalPaper206.pdf. Accessed 15 March 2014.

  • Mehrara, M., Moeini, A., & Ahrari, M. G. (2010). Using technical analysis with neural network for prediction stock price index in tehran stock exchange. Middle Eastern Finance and Economics, 6(6), 50–61.

    Google Scholar 

  • Mittal, A., & Goel, A. (2014). Stock prediction using twitter sentiment analysis. http://cs229.stanford.edu/proj2011/GoelMittal-StockMarketPredictionUsingTwitterSentimentAnalysis.pdf. Accessed 22 March 2014.

  • Money GSA. (2014). Factors that affect stock prices—get smarter about money, answering your money question. http://www.getsmarteraboutmoney.ca/en/managing-your-money/investing/stocks/Pages/Factors-that-can-affect-stock-prices.aspx. Accessed 8 April 2014.

  • NeuroLab. (2014). Neurolab—python plugin. https://pypi.python.org/pypi/neurolab. Accessed 12 March 2014.

  • Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., et al. (2011a). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12, 2825–2830.

    Google Scholar 

  • Princeton University. (2014). Wordnet—A lexical database for English. http://wordnet.princeton.edu/. Accessed 30 March 2014.

  • Quandl. (2014). Quandl-find and use data easily. http://www.quandl.com/. Accessed Apr 2014.

  • R Project. (2014). The r project for statistical computing. http://www.r-project.org/. Accessed 11 February 2014.

  • Rao, A. S., Georgeff, M. P. (1995). Bdi agents: From theory to practice. In Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (pp. 312–319).

  • Rosenblatt, F. (1962). Principles of neurodynamics: Perceptronsand the theory of brain mechanisms. Report (Cornell AeronauticalLaboratory). Spartan Books.

  • Russell, I. (2014). The delta rule—University of Hartford. http://uhavax.hartford.edu/compsci/neural-networks-delta-rule.html. Accessed 27 February 2014.

  • Schumaker, R. P., & Chen, H. (2009). Textual analysis of stock market prediction using breaking financial news: The azfin text system. ACM Transactions on Information Systems (TOIS), 27(2), 12.

    Article  Google Scholar 

  • Spiderfinancial. (2014). Holt–Winters double exponential smoothing. http://www.spiderfinancial.com/support/documentation/numxl/reference-manual/smoothing/desmth. Accessed Apr 2014.

  • StockCharts.com. (2014a). Fundamental analysis. http://stockcharts.com/school/doku.php?id=chart_school:overview:fundamental_analysis. Accessed Apr 2014.

  • StockCharts.com. (2014b). Technical analysis. http://stockcharts.com/school/doku.php?id=chart_school:overview:technical_analysis. Accessed Apr 2014.

  • Subrahmanian, V. S., & Reforgiato, D. (2008). Ava: Adjective-verb-adverb combinations for sentiment analysis. IEEE Intelligent Systems, 23(4), 43–50.

    Article  Google Scholar 

  • Thangarajah, J., Padgham, L., & Harland, J. (2002). Representation and reasoning for goals in bdi agents. Australian Computer Science Communications, 24(1), 259–265.

    Google Scholar 

  • Walt, S. v d, Colbert, S. C., & Varoquaux, G. (2011). The numpy array: A structure for efficient numerical computation. Computing in Science and Engineering, 13(2), 22–30.

    Article  Google Scholar 

  • White, H. (1988). Economic prediction using neural networks: The case of ibm daily stock returns. In IEEE International Conference on Neural Networks, 1988 (pp. 451–458). IEEE.

  • Wikipedia. (2014a). Efficient-market hypothesis—wikipedia, the free encyclopedia. http://en.wikipedia.org/w/index.php?title=Efficient-market_hypothesis&oldid=607795702. Accessed 9 May 2014.

  • Wikipedia. (2014b). Naive Bayes classifier—wikipedia, the free encyclopedia. http://en.wikipedia.org/w/index.php?title=Naive_Bayes_classifier&oldid=608189614. Accessed 16 May 2014.

  • Wikipedia. (2014c). Support vector machine—Wikipedia, the free encyclopedia. http://en.wikipedia.org/w/index.php?title=Support_vector_machine&oldid=608411211. Accessed 16 May 2014.

  • Wu, J.-Y., & Lu, C.-J. (2012). Computational intelligence approaches for stock price forecasting. In 2012 international symposium on computer, consumer and control (IS3C) (pp. 52–55). IEEE.

  • Yahoo. (2014). Yahoo finance. https://finance.yahoo.com/.

Download references

Author information

Author notes

  1. Anirudh Sriram

    Present address: Mu-Sigma, Bangalore, India

Authors and Affiliations

  1. Department of Computer Science and Technology, University of Cambridge, Cambridge, CB3 0FD, UK

    Mansoor Ahmed

  2. Department of Information and Communication Technology, Manipal Institute of Technology, Manipal Academy of Higher Education (MAHE), Manipal, 576104, India

    Anirudh Sriram & Sanjay Singh

Authors
  1. Mansoor Ahmed
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anirudh Sriram
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sanjay Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sanjay Singh.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ahmed, M., Sriram, A. & Singh, S. Short Term Firm-Specific Stock Forecasting with BDI Framework. Comput Econ 55, 745–778 (2020). https://doi.org/10.1007/s10614-019-09911-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10614-019-09911-0

Keywords

Search

Navigation