Skip to main content
Log in

A study on novel filtering and relationship between input-features and target-vectors in a deep learning model for stock price prediction

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

From past to present, the prediction of stock price in stock market has been a knotty problem. Many researchers have made various attempts and studies to predict stock prices. The prediction of stock price in stock market has been of concern to researchers in many disciplines, including economics, mathematics, physics, and computer science. This study intends to learn fluctuation of stock prices in stock market by using recently spotlighted techniques of deep learning to predict future stock price. In previous studies, we have used price-based input-features to measure performance changes in deep learning models. Results of this studies have revealed that the performance of stock price models would change according to varied input-features configured based on stock price. Therefore, we have concluded that more novel input-feature in deep learning model is needed to predict patterns of stock price fluctuation more precisely. In this paper, for predicting stock price fluctuation, we design deep learning model using 715 novel input-features configured on the basis of technical analyses. The performance of the prediction model was then compared to another model that employed simple price-based input-features. Also, rather than taking randomly collected set of stocks, stocks of a similar pattern of price fluctuation were filtered to identify the influence of filtering technique on the deep learning model. Finally, we compared and analyzed the performances of several models using different configuration of input-features and target-vectors.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Lee JW (2013) A stock trading system based on supervised learning of highly volatile stock price patterns. Journal of KIISE : Computing Practices and Letters 19(1):23–29

    Article  Google Scholar 

  2. Kim IM, Park SK (2009) The predictability of korean stock returns and volatility clock samples. The Korean Economic Association 57(3):195–221

    Google Scholar 

  3. Kim SD (2012) Data mining tool for stock investors’ decision support. The Journal of the Korea Contents Association 12(2):472–482

    Article  Google Scholar 

  4. Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Kudlur M (2016) Tensorflow: A system for large-scale machine learning. In OSDI 16:265–283

    Google Scholar 

  5. Song YJ, Lee JW (2017) A design and implementation of deep learning model for stock prediction using tensorflow. Korea Computer Congress 2017, pp 799–801

  6. Song YJ, Lee JW, Lee JW (2017) Performance evaluation of price-based input features in stock price prediction using tensorflow. KIISE Transactions on Computing Practices 23(11):625–631

    Article  Google Scholar 

  7. Lee JW, Kim SY, Kim SD, Lee JW, Chae JS (2003) A two-phase stock trading system based on pattern matching and automatic rule induction. Korea Information Processing Society 10(3):257–264

    Google Scholar 

  8. Bollinger J (2001) Bollinger On bollinger band

  9. Arnat L (2016) Stock price prediction by deep learning

  10. Guthrie D, Allison B, Liu W, Guthrie L, Wilks Y (2006) A closer look at skip-gram modelling. In: Proceedings of the 5th international Conference on Language Resources and Evaluation (LREC-2006), pp 1–4

  11. Akita R, Yoshihara A, Matsubara T, Uehara K (2016) Deep learning for stock prediction using numerical and textual information. In: IEEE/ACIS 15th International Conference on Computer and Information Science (ICIS), 2016. IEEE, pp 1–6

  12. Gers F (2001) Long short-term memory in recurrent neural networks Unpublished PhD dissertation. Ecole Polytechnique fédérale de Lausanne, Lausanne

    Google Scholar 

  13. Le Q, Mikolov T (2014) Distributed representations of sentences and documents. In: International Conference on Machine Learning, pp 1188–1196

  14. Goldberg Y, Levy O (2014) word2vec explained: Deriving mikolov et al.’s negative-sampling word-embedding method. arXiv:1402.3722

  15. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems, pp 2672–2680

  16. Zhou X, Pan Z, Hu G, Tang S, Zhao C (2018) Stock market prediction on high-frequency data using generative adversarial nets. mathematical problems in engineering

  17. Abhinandan G, Dev Kumar C, Tanupriya C (2017) Stock prediction using functional link artificial neural network (FLANN). In: 2017 3rd International Conference on Computational Intelligence and Networks (CINE), pp 10–16

  18. Ding X, Zhang Y, Liu T, Duan J (2015) Deep learning for event-driven stock prediction. In Ijcai, pp 2327–2333

  19. Troiano L, Villa EM, Loia V (2018) Replicating a trading strategy by means of LSTM for financial industry applications. IEEE transactions on industrial informatics

  20. Yao Y, Rosasco L, Caponnetto A (2007) On early stopping in gradient descent learning. Constructive Approx 26(2):289– 315

    Article  MathSciNet  MATH  Google Scholar 

  21. Brock W, Lakonishok J, LeBaron B (1992) Simple technical trading rules and the stochastic properties of stock returns. The Journal of finance 47(5):1731–1764

    Article  Google Scholar 

  22. Blume L, Easley D, O’hara M (1994) Market statistics and technical analysis: The role of volume. The Journal of Finance 49(1):153–181

    Article  Google Scholar 

  23. Broder AZ, Glassman SC, Manasse MS, Zweig G (1997) Syntactic clustering of the web. Computer Networks and ISDN Systems 29(8-13):1157–1166

    Article  Google Scholar 

  24. Colby RW (2002) The encyclopedia of technical market indicators. Hardcover, 2nd edn. McGraw-Hill Education, pp 832

  25. Theano http://deeplearning.net/software/theano/

  26. Torch http://torch.ch/

  27. Caffe http://caffe.berkeleyvision.org/

  28. Python Available: https://www.python.org/

  29. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research 15(1):1929–1958

    MathSciNet  MATH  Google Scholar 

  30. Lee JW (2007) Integrated multiple simulation for optimizing performance of stock trading systems based on neural networks. The KIPS Transactions: PartB. 14(2):127–134

    Google Scholar 

Download references

Acknowledgements

This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (NRF-2018R1D1A1B07040312)

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jongwoo Lee.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Song, Y., Lee, J.W. & Lee, J. A study on novel filtering and relationship between input-features and target-vectors in a deep learning model for stock price prediction. Appl Intell 49, 897–911 (2019). https://doi.org/10.1007/s10489-018-1308-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-018-1308-x

Keywords

Navigation