Advertisement

Financial Data Forecasting Using Optimized Echo State Network

  • Junxiu Liu
  • Tiening Sun
  • Yuling Luo
  • Qiang Fu
  • Yi Cao
  • Jia Zhai
  • Xuemei Ding
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11305)

Abstract

The echo state network (ESN) is a dynamic neural network, which simplifies the training process in the conventional neural network. Due to its powerful non-linear computing ability, it has been applied to predict the time series. However, the parameters of the ESN need to be set experimentally, which can lead to instable performance and there is space to further improve its performance. In order to address this challenge, an improved fruit fly optimization algorithm (IFOA) is proposed in this work to optimize four key parameters of the ESN. Compared to the original fruit fly optimization algorithm (FOA), the proposed IFOA improves the optimization efficiency, where two novel particles are proposed in the fruit flies swarm, and the search process of the swarm is transformed from two-dimensional to three-dimensional space. The proposed approach is applied to financial data sets. Experimental results show that the proposed FOA-ESN and IFOA-ESN models are more effective (~50% improvement) than others, and the IFOA-ESN can obtain the best prediction accuracy.

Keywords

Echo state network Fruit fly algorithm Time series Algorithm optimization 

Notes

Acknowledgement

This research is supported by the National Natural Science Foundation of China under Grant 61603104, the Guangxi Natural Science Foundation under Grants 2016GXNSFCA380017, 2015GXNSFBA139256 and 2017GXNSFAA198180, the funding of Overseas 100 Talents Program of Guangxi Higher Education, the Doctoral Research Foundation of Guangxi Normal University under Grant 2016BQ005, the Scientific Research Funds for the Returned Overseas Chinese Scholars from State Education Ministry, the Funds for Young Key Program of Education Department from Fujian Province, China (Grant No. JZ160425), and Program of Education Department of Fujian Province, China (Grant No. I201501005).

References

  1. 1.
    Jaeger, H.: Survey: reservoir computing approaches to recurrent neural network training. Comput. Sci. Rev. 3, 127–149 (2009)CrossRefGoogle Scholar
  2. 2.
    Wang, H., Yan, X.: Improved simple deterministically constructed cycle reservoir network with sensitive iterative pruning algorithm. Neurocomputing 145, 353–362 (2014)CrossRefGoogle Scholar
  3. 3.
    Jaeger, H.: The “echo state” approach to analysing and training recurrent neural networks. Technology GMD Technical report 148, German National Research Center Information, German (2001)Google Scholar
  4. 4.
    Maass, W., Natschl, T., Markram, H.: Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput. 14, 2531–2560 (2014)CrossRefGoogle Scholar
  5. 5.
    Steil, J.J.: Backpropagation-decorrelation: online recurrent learning with O(N) complexity. In: IEEE International Joint Conference on Neural Networks, pp. 843–848 (2004)Google Scholar
  6. 6.
    Shi, Z., Han, M.: Support vector echo-state machine for chaotic time series prediction. IEEE Trans. Neural Netw. 18, 359–372 (2007)CrossRefGoogle Scholar
  7. 7.
    Skowronski, M.D., Harris, J.G.: Automatic speech recognition using a predictive echo state network classifier. Neural Netw. 20, 414–423 (2007)CrossRefGoogle Scholar
  8. 8.
    Song, Q., Zhao, X., Feng, Z., An, Y., Song, B.: Hourly electric load forecasting algorithm based on echo state neural network. In: IEEE Control and Decision Conference, pp. 3893–3897 (2011)Google Scholar
  9. 9.
    An, Y., Zhao, X., Song, Q.: Short-term traffic flow forecasting via echo state neural networks. In: IEEE Seventh International Conference on Natural Computation, pp. 844–847 (2011)Google Scholar
  10. 10.
    Embrechts, M., Alexandre, L., Linton, J.: Reservoir computing for static pattern recognition. In: European Symposium on Artificial Neural Networks, pp. 101–124 (2009)Google Scholar
  11. 11.
    Zhai, F., Lin, X., Yang, Z., Song, Y.: Notice of retraction financial time series prediction based on echo state network. In: IEEE Sixth International Conference on Natural Computation, pp. 3983–3987 (2010)Google Scholar
  12. 12.
    Ozturk, M.C., Xu, D.: Analysis and design of echo state networks for function approximation. Neural Comput. 19, 111–138 (2007)CrossRefGoogle Scholar
  13. 13.
    Pan, W.: A new fruit fly optimization algorithm: taking the financial distress model as an example. Knowl.-Based Syst. 26, 69–74 (2012)CrossRefGoogle Scholar
  14. 14.
    Lukoševičius, M.: A practical guide to applying echo state networks. In: Montavon, G., Orr, Geneviève B., Müller, K.-R. (eds.) Neural Networks: Tricks of the Trade. LNCS, vol. 7700, pp. 659–686. Springer, Heidelberg (2012).  https://doi.org/10.1007/978-3-642-35289-8_36CrossRefGoogle Scholar
  15. 15.
    Lin, W.: A novel 3D fruit fly optimization algorithm and its applications in economics. Neural Comput. Appl. 27, 1391–1413 (2016)CrossRefGoogle Scholar
  16. 16.
    Wang, F.: A hybrid particle swarm algorithm with roulette selection operator. J. Southwest China Norm. Univ. 31, 93–96 (2006)Google Scholar
  17. 17.
    Shen, W., Han, Y.: Short term forecasting of Shanghai composite index based on GARCH and data mining technique. In: IEEE Circuits, Communications and System, pp. 63–66 (2010)Google Scholar
  18. 18.
    Phani, B.V., Chandra, B., Raghav, V.: Quest for efficient option pricing prediction model using machine learning techniques. In: International Joint Conference, pp. 654–657 (2011)Google Scholar
  19. 19.
    Black, F., Scholes, M.: The pricing of options and corporate liabilities. Polit. Econ. 81, 637–654 (2010)MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Junxiu Liu
    • 1
  • Tiening Sun
    • 1
  • Yuling Luo
    • 1
  • Qiang Fu
    • 1
  • Yi Cao
    • 2
  • Jia Zhai
    • 3
  • Xuemei Ding
    • 4
    • 5
  1. 1.Faculty of Electronic EngineeringGuangxi Normal UniversityGuilinChina
  2. 2.Department of Business Transformation and Sustainable Enterprise, Surrey Business SchoolUniversity of SurreySurreyUK
  3. 3.Salford Business SchoolUniversity of SalfordSalfordUK
  4. 4.College of Mathematics and InformaticsFujian Normal UniversityFuzhouChina
  5. 5.School of Computing, Engineering and Intelligent SystemsUlster UniversityLondonderryUK

Personalised recommendations