Abstract
A Self Organizing Map (SOM) projects high-dimensional feature vectors onto a low-dimensional space. If an appropriate feature vector is chosen, this ability may be used for measuring and adjusting different levels of diversity in the selection of models for building ensembles. In this paper, we present the results of using a SOM for selecting suitable models in ensembles used for long-term time series prediction. The temporal behavior of the predictors is represented by feature vectors built with a sequence of the errors achieved in each prediction step. Each neuron in the map represents a cluster of models with similar accuracy; the adjustment of diversity between models is achieved by measuring the distance between neurons on the map. Our experiments showed that this strategy generated ensembles with an appropriate level of diversity among their components, obtaining a better performance than just using a unique model.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Andrawis, R.R., Atiya, A.F., El-Shishiny, H.: Forecast combinations of computational intelligence and linear models for the nn5 time series forecasting competition. Int. J. Forecast. 27(3), 672–688 (2011)
Armstrong, J.S.: Long-range Forecasting from Crystall Ball to Computer, 2nd edn. Wiley (1985)
Beale, M.H., Hagan, M.T., Demuth, Howard, B.: Neural Network Toolbox User’s Guide R2012b. MathWorks (2012)
Bishop, C.M., Svensen, M., Williams, C.K.I.: GTM: the generative topographic mapping. Neural Comput. 10(1), 215–234 (1998)
Box, G.E.P., Jenkins, G.M., Reinsel, G.C.: Time Series Analysis Forecasting and Control, 3rd edn. Prentice-Hall International (1994)
Chappell, G.J., Taylor, J.G.: The temporal kohonen map. Neural Netw. 6(3), 441–445 (1993)
Crone, S.F.: Competition instructions. Web (2010). http://www.neural-forecasting-competition.com/instructions.htm
Crone, S.F., Hibon, M., Nikolopoulos, K.: Advances in forecasting with neural networks? Empirical evidence from the NN3 competition on time series prediction. Int. J. Forecast. 27(3), 635–660 (2011)
Cunningham, P., Carney, J.: Diversity versus quality in classification ensembles based on feature selection. In: Lopez de Mantaras, R., Plaza, E. (eds.) Machine Learning: ECML 2000, Lecture Notes in Computer Science, vol. 1810, pp. 109–116. Springer, Berlin Heidelberg (2000)
Fonseca-Delgado, R., Gómez-Gil, P.: An assessment of ten-fold and monte carlo cross validations for time series forecasting. In: 2013 10th International Conference on Electrical Engineering, Computing Science and Automatic Control (CCE), pp. 215–220 (2013)
Fonseca-Delgado, R., Gómez-Gil, P.: Selecting and combining models with self-organizing maps for long-term forecasting of chaotic time series. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 2616–2623 (2014)
Haykin, S.: Neural Networks A Comprehensive Foundation, 2 edn. Pearson Prentice Hall (1999)
Kohonen, T.: The self-organizing map. Proc. IEEE 78(9), 1464–1480 (1990)
Koskela, T., Varsta, M., Heikkonen, J., Kaski, K.: Temporal sequence processing using recurrent som. In: 1998 Second International Conference on Knowledge-Based Intelligent Electronic Systems, 1998. Proceedings KES ’98, Apr, vol. 1, pp. 290–297 (1998)
Kuncheva, L., Whitaker, C.: Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Mach. Learn. 51(2), 181–207 (2003)
Lemke, C., Gabrys, B.: Meta-learning for time series forecasting and forecast combination. Neurocomputing 73(10–12), 2006–2016 (2010)
Leontaritis, I.J., Billings, S.A.: Input-output parametric models for non-linear systems part ii: stochastic non-linear systems. Int. J. Control 41(2), 329–344 (1985)
Mackey, M.C., Glass, L.: Oscillation and chaos in physiological control systems. Science 197(4300), 287–289 (1977)
Ni, H., Yin, H.: A self-organising mixture autoregressive network for fx time series modelling and prediction. Neurocomputing 72(16–18), 3529–3537 (2009), financial Engineering Computational and Ambient Intelligence (IWANN 2007)
Olier, I., Vellido, A.: Advances in clustering and visualization of time series using gtm through time. Neural Netw. 21(7), 904–913 (2008)
Ouyang, Y., Yin, H.: A neural gas mixture autoregressive network for modelling and forecasting fx time series. Neurocomputing 135, 171–179 (2014)
Picard, R.R., Cook, R.D.: Cross-validation of regression models. J. Am. Stat. Assoc. 79(387), 575–583 (1984)
Strickert, M., Hammer, B.: Neural gas for sequences. In: Proceedings of the Workshop on Self-Organizing Maps (WSOM03), pp. 53–57 (2003)
Strickert, M., Hammer, B.: Merge som for temporal data. Neurocomputing 64, 39–71 (2005), trends in Neurocomputing: 12th European Symposium on Artificial Neural Networks 2004
Acknowledgments
R. Fonseca thanks the National Council of Science and Technology (CONACYT), México, for the scholarship granted to him, No. 234540. This research has been partially supported by CONACYT, project grant No. CB-2010-155250.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Fonseca-Delgado, R., Gómez-Gil, P. (2016). Modeling Diversity in Ensembles for Time-Series Prediction Based on Self-Organizing Maps. In: Merényi, E., Mendenhall, M., O'Driscoll, P. (eds) Advances in Self-Organizing Maps and Learning Vector Quantization. Advances in Intelligent Systems and Computing, vol 428. Springer, Cham. https://doi.org/10.1007/978-3-319-28518-4_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-28518-4_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-28517-7
Online ISBN: 978-3-319-28518-4
eBook Packages: EngineeringEngineering (R0)