Abstract
In this study, we propose a method for time series prediction using restricted Boltzmann machine (RBM), which is one of stochastic neural networks. The idea comes from Hinton & Salakhutdinov’s multilayer “encoder” network which realized dimensionality reduction of data. A 3-layer deep network of RBMs is constructed and after pre-training RBMs using their energy functions, gradient descent training (error back propagation) is adopted to execute fine-tuning. Additionally, to deal with the problem of neural network structure determination, particle swarm optimization (PSO) is used to find the suitable number of units and parameters. Moreover, a preprocessing, “trend removal” to the original data, was also performed in the forecasting. To compare the proposed predictor with conventional neural network method, i.e., multi-layer perceptron (MLP), CATS benchmark data was used in the prediction experiments.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Crone, S., Nikolopoulos, K.: Results of the NN3 neural network forecasting competition. In: The 27 th International Symposium on Forecasting, Program, vol. 129 (2007)
Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning Representation by Back-Propagating Errors. Nature 232(2), 533–536 (1986)
Hinton, G.E., Salakhutdinov, R.R.: Reducing the Dimensionality of Data with Neural Networks. Science 313(4), 504–507 (2006)
Roux, N.L., Bengio, Y.: Representational Power of Restricted Boltzmann Machines and Deep Belief Networks. Neural Computation 20(2), 1631–1649 (2008)
Hinton, G.E., Sejnowski, T.J.: Learning and Relearning in Boltzmann Machines. In: Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Foundations, vol. 1. MIT Press, Cambridge (1986)
Ackley, D.H., Hinton, G.E., Sejnowski, T.J.: A Learning Algorithm for Boltzmann Machines. Cognitive Science 9(1), 147–169 (1985)
Kennedy, J., Eberhart, R.C.: Particle Swarm Optimization. In: IEEE International Conference on Neural Networks, pp. 1942–1948 (1995)
Lendasse, A., Oja, E., Simula, O., Verleysen, M.: Time Series Prediction Competition: The CATS Benchmark. In: International Joint Conference on Neural Networks, pp. 1615–1620 (2004)
Lendasse, A., Oja, E., Simula, O., Verleysen, M.: Time Series Prediction Competition: The CATS Benchmark. Neurocomputing 70(2), 2325–2329 (2007)
Box, G.E.P., Jenkins, G.: Time Series Analysis, Forecasting and Control. Cambridge University Press, Cambridge (1976)
Zhang, G.P.: Time Series Forecasting Using a Hybrid ARIMA and Neural Network Model. Neurocomputing 50(2), 159–175 (2003)
Gardner, E., McKenzie, E.: Seasonal Exponential Smoothing with Damped Trends. Management Science 35(3), 372–376 (1989)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kuremoto, T., Kimura, S., Kobayashi, K., Obayashi, M. (2012). Time Series Forecasting Using Restricted Boltzmann Machine. In: Huang, DS., Gupta, P., Zhang, X., Premaratne, P. (eds) Emerging Intelligent Computing Technology and Applications. ICIC 2012. Communications in Computer and Information Science, vol 304. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31837-5_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-31837-5_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31836-8
Online ISBN: 978-3-642-31837-5
eBook Packages: Computer ScienceComputer Science (R0)