Prediction Capabilities of Evolino RNN Ensembles

  • Nijolė MaknickienėEmail author
  • Algirdas Maknickas
Part of the Studies in Computational Intelligence book series (SCI, volume 613)


Modern portfolio theory of investment-based financial market forecasting use probability distributions. This investigation used an ensemble of genetic algorithm based recurrent neural networks (RNN), which allows to obtain multi-modal distribution for predictions. Comparison of the two different models—scatted points based prediction and distributions based prediction—opens new opportunities to create profitable investment tool, which was tested in real time demo market. Dependence of forecasting accuracy on the number of Evolino recurrent neural networks ensemble was obtained for five forecasting points ahead. This study allows to optimize the cluster based computational time and resources required for sufficiently accurate prediction.


Distribution of expected returns Ensembles Evolino Financial markets Prediction Recurrent neural networks 


  1. 1.
    Kaastra, I., Boyd, M.: Designing a neural network for forecasting financial and economic time series. Neurocomputing 10(3), 215–236 (1996)CrossRefGoogle Scholar
  2. 2.
    Walczak, S.: An empirical analysis of data requirements for financial forecasting with neural networks. J. Manag. Inf. Syst. 17(4), 203–222 (2001)MathSciNetGoogle Scholar
  3. 3.
    Zhou, Z.H., Wu, J., Tang, W.: Ensembling neural networks: many could be better than all. Artif. Intell. 137(1), 239–263 (2002)MathSciNetCrossRefzbMATHGoogle Scholar
  4. 4.
    Tsakonas, A., Dounias, G.: An architecture-altering and training methodology for neural logic networks: Application in the banking sector. In: Madani, K. (ed.) Proceedings of the 1st International Workshop on Artificial Neural Networks and Intelligent Information Processing, ANNIIP 2005, Barcelona, Spain, NSTICC Press (Sep 2005) 82–93 In conjunction with ICINCO 2005Google Scholar
  5. 5.
    Nguyen, H., Chan, C.: Multiple neural networks for a long term time series forecast. Neural Comput. Appl. 13(1), 90–98 (2004)CrossRefGoogle Scholar
  6. 6.
    Garcia-Pedrajas, N., Hervas-Martinez, C., Ortiz-Boyer, D.: Cooperative coevolution of artificial neural network ensembles for pattern classification. IEEE Trans. Evolut. Comput. 9(3), 271–302 (June, 2005)Google Scholar
  7. 7.
    Siwek, K., Osowski, S., Szupiluk, R.: Ensemble neural network approach for accurate load forecasting in a power system. Int. J. Appl. Math. Comput. Sci. 19(2), 303–315 (2009)CrossRefzbMATHGoogle Scholar
  8. 8.
    Uchigaki, S., Uchida, S., Toda, K., Monden, A.: An ensemble approach of simple regression models to cross-project fault prediction. In: 13th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel Distributed Computing (SNPD), pp. 476–481, Aug 2012Google Scholar
  9. 9.
    Brezak, D., Bacek, T., Majetic, D., Kasac, J., Novakovic, B.: A comparison of feed-forward and recurrent neural networks in time series forecasting. In: IEEE Conference on Computational Intelligence for Financial Engineering Economics (CIFEr), pp. 1–6, March, 2012Google Scholar
  10. 10.
    Kuo, L.L.R., Lee, C.: Integration of artificial neural networks and fuzzy delphi for stock market forecasting. In: IEEE International Conference on Systems, Man, and Cybernetics, vol. 2, IEEE, pp. 1073–1078 (1996)Google Scholar
  11. 11.
    Chang, P., Wang, Y.: Fuzzy delphi and back-propagation model for sales forecasting in pcb industry. Expert Syst. Appl. 30(4), 715–726 (2006)CrossRefGoogle Scholar
  12. 12.
    Kabir, G., Sumi, R.: Integrating fuzzy delphi method with artificial neural network for demand forecasting of power engineering company. Manag. Sci. Lett. 2(5) (2012)Google Scholar
  13. 13.
    Rutkauskas, A.V.: Formation of adequate investment portfolio for stochasticity of profit possibilities. Prop. Manag. 4(2), 100–115 (2000)Google Scholar
  14. 14.
    Rutkauskas, A.V., Miečinskienė, A., Stasytytė, V.: Investment decisions modelling along sustainable development concept on financial markets. Technol. Econ. Dev. Econ. 14(3), 417–427 (2008)Google Scholar
  15. 15.
    Rutkauskas, A.V., Lapinskaitė-Vvohlfahrt, I.: Marketing finance strategy based on effective risk management. In: The 6th International Scientific Conference Business and Managemen, vol. 1, pp. 162–169, Technika (13–14 May 2010)Google Scholar
  16. 16.
    Rutkauskas, A.V., Stasytytė, V.: Optimal portfolio search using efficient surface and three-dimensional utility function. Technol. Econ. Dev. Econ. 17(2), 305–326 (2011)Google Scholar
  17. 17.
    Rutkauskas, A.V.: Using sustainability engineering to gain universal sustainability efficiency. Sustainability 4(6), 1135–1153 (2012)CrossRefGoogle Scholar
  18. 18.
    Riley, B.: Practical statistical inference for the opinions a.of biased experts blake riley. In: The 50th Annual Meeting of the MVEA, vol. 2., Missouri Valley Economic Association (2012)Google Scholar
  19. 19.
    Hutter, M.: On universal prediction and bayesian confirmation. Theor. Comput. Sci. 384(1), 33–48 (2007)MathSciNetCrossRefzbMATHGoogle Scholar
  20. 20.
    Schmidhuber, J., Wierstra, D., Gomez, F.: Modeling systems with internal state using evolino. In: Proceedings of the conference on genetic and evolutionary computation (GECCO). Washington, ACM Press, New York, NY, USA, pp. 1795–1802 (2005)Google Scholar
  21. 21.
    Wierstra, D., Gomez, F.J., Schmidhuber, J.: Evolino: Hybrid neuroevolution/optimal linear search for sequence learning. In: Proceedings of the 19th International Joint Conference on Artificial Intelligence (IJCAI), pp. 853–858, Edinburgh (2005)Google Scholar
  22. 22.
    Schmidhuber, J., Wierstra, D., Gagliolo, M., Gomez, F.: Training recurrent networks by evolino. Neural Comput. 19(3), 757–779 (2007)CrossRefzbMATHGoogle Scholar
  23. 23.
    Maknickienė, N., Maknickas, A.: Financial market prediction system with evolino neural network and delphi method. J. Bus. Econ. Manag. 14(2), 403–413 (2013)Google Scholar
  24. 24.
    Wheeler, D.: Problems with skewness and kurtosis (2013)Google Scholar
  25. 25.
    Maknickas, A., Maknickienė, N.: Influence of data orthogonality to accuracy and stability of financial market predictions. In: 4th International Conference on Neural Computation Theory and Applications (NCTA 2012), pp. 616–619, Barselaona, Spain, October (2012)Google Scholar
  26. 26.
    Dalcin, L.: (2012/12/01)
  27. 27.
    Fox, G., Johnson, M., Lyzenga, G., Otto, S., Salmon, J., Walker, D.: Solving problems on concurrent processors 1, 1373849 (1988)Google Scholar
  28. 28.
    Kumar, V., Gmma, A., Anshul, G.: Introduction to parallel computing: Design and analysis of algorithms (1994)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Vilnius Gediminas Technical UniversityVilniusLithuania

Personalised recommendations