Abstract
The tasks of forecasting time series arise in many areas of computer science. Algorithms based on machine learning do a good job of this task. In this work, we performed a comparative analysis of a number of algorithms for predicting time series by reservoir neural networks (echo-state networks) according to the forecast accuracy and the time it takes to build the forecast. To test forecasting algorithms, data sets obtained from the Mackey-Glass equation were used. The experiments showed that the sigmoidal and radial networks with a SOM projector give the most accurate forecast, but they are also the least fast. A new reservoir optimization algorithm is proposed - a direct version of the Infomax method. The functionality of the mutual information of the input and output of the reservoir is maximized. This algorithm requires non-negativity of data values, but it works much faster than the well-known iterative version of Infomax and a radial network with a SOM projector, although it slightly reduces the forecast accuracy.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Montgomery, D.C., Jennings, C.L., Kulahci, M.: Introduction to Time Series Analysis and Forecasting. Wiley, Hoboken (2008)
Haykin, S.: Neural Networks and Learning Machines, 3rd edn. Pearson Prentice Hall, New York (2009)
Jaeger, H.: Adaptive nonlinear system identification with echo state networks. In: Advances in Neural Information Processing Systems (2003)
Lukosevicius, M., Jaeger, H.: Reservoir computing approaches to recurrent neural network training. Comput. Sci. Rev. 3(3), 127–149 (2009)
Maass, W.: Liquid state machines: motivation, theory, and applications. In: Computability in Context, pp. 275–296 (2011)
Bell, A.J., Sejnowski, T.J.: An information-maximisation approach to blind separation and blind deconvolution. Neural Comput. 7(6), 1129–1159 (1995)
Løkse, S., Bianchi, F.M., Jenssen, R.: Training echo state networks with regularization through dimensionality reduction. Cogn. Comput. 9, 364–378 (2017)
Wang, Y.: Applications of recurrent neural network on financial time series. MCs thesis, Imperial College London (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Tarkov, M.S., Chernov, I.A. (2021). Time Series Prediction by Reservoir Neural Networks. In: Kryzhanovsky, B., Dunin-Barkowski, W., Redko, V., Tiumentsev, Y. (eds) Advances in Neural Computation, Machine Learning, and Cognitive Research IV. NEUROINFORMATICS 2020. Studies in Computational Intelligence, vol 925. Springer, Cham. https://doi.org/10.1007/978-3-030-60577-3_36
Download citation
DOI: https://doi.org/10.1007/978-3-030-60577-3_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-60576-6
Online ISBN: 978-3-030-60577-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)