Advertisement

A Novel Weighted Ensemble Technique for Time Series Forecasting

  • Ratnadip Adhikari
  • R. K. Agrawal
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7301)

Abstract

Improvement of time series forecasting accuracy is an active research area having significant importance in many practical domains. Extensive works in literature suggest that substantial enhancement in accuracies can be achieved by combining forecasts from different models. However, forecasts combination is a difficult as well as a challenging task due to various reasons and often simple linear methods are used for this purpose. In this paper, we propose a nonlinear weighted ensemble mechanism for combining forecasts from multiple time series models. The proposed method considers the individual forecasts as well as the correlations in pairs of forecasts for creating the ensemble. A successive validation approach is formulated to determine the appropriate combination weights. Three popular models are used to build up the ensemble which is then empirically tested on three real-world time series. Obtained forecasting results, measured through three well-known error statistics demonstrate that the proposed ensemble method provides significantly better accuracies than each individual model.

Keywords

Time Series Forecasting Ensemble Technique Box-Jenkins Models Artificial Neural Networks Elman Networks 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Gooijer, J.G., Hyndman, R.J.: 25 Years of time series forecasting. J. Forecasting 22(3), 443–473 (2006)CrossRefGoogle Scholar
  2. 2.
    Box, G.E.P., Jenkins, G.M.: Time Series Analysis: Forecasting and Control, 3rd edn. Holden-Day, California (1970)zbMATHGoogle Scholar
  3. 3.
    Armstrong, J.S.: Combining Forecasts. In: Armstrong, J.S. (ed.) Principles of Forecasting: A Handbook for Researchers and Practitioners. Kluwer Academic Publishers, Norwell (2001)Google Scholar
  4. 4.
    Zhang, G.P.: Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing 50, 159–175 (2003)zbMATHCrossRefGoogle Scholar
  5. 5.
    Bates, J.M., Granger, C.W.J.: Combination of forecasts. Operational Research Quarterly 20(4), 451–468 (1969)CrossRefGoogle Scholar
  6. 6.
    Clemen, R.T.: Combining forecasts: A review and annotated bibliography. J. Forecasting 5(4), 559–583 (1989)CrossRefGoogle Scholar
  7. 7.
    Aksu, C., Gunter, S.: An empirical analysis of the accuracy of SA, OLS, ERLS and NRLS combination forecasts. J. Forecasting 8(1), 27–43 (1992)CrossRefGoogle Scholar
  8. 8.
    Zou, H., Yang, Y.: Combining time series models for forecasting. J. Forecasting 20(1), 69–84 (2004)CrossRefGoogle Scholar
  9. 9.
    Jose, V.R.R., Winkler, R.L.: Simple robust averages of forecasts: Some empirical results. International Journal of Forecasting 24(1), 163–169 (2008)CrossRefGoogle Scholar
  10. 10.
    Lemke, C., Gabrys, B.: Meta-learning for time series forecasting and forecast combination. Neurocomputing 73, 2006–2016 (2010)CrossRefGoogle Scholar
  11. 11.
    Bunn, D.: A Bayesian approach to the linear combination of forecasts. Operational Research Quarterly 26(2), 325–329 (1975)zbMATHCrossRefGoogle Scholar
  12. 12.
    Frietas, P.S., Rodrigues, A.J.: Model combination in neural-based forecasting. European Journal of Operational Research 173(3), 801–814 (2006)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Zhang, G., Patuwo, B.E., Hu, M.Y.: Forecasting with articial neural networks: The state of the art. J. Forecasting 14, 35–62 (1998)CrossRefGoogle Scholar
  14. 14.
    Faraway, J., Chatfield, C.: Time series forecasting with neural networks: a comparative study using the airline data. J. Applied Statistics 47(2), 231–250 (1998)CrossRefGoogle Scholar
  15. 15.
    Reidmiller, M., Braun, H.: A direct adaptive method for faster backpropagation learning: The rprop algorithm. In: Proceedings of the IEEE Int. Conference on Neural Networks (ICNN), San Francisco, pp. 586–591 (1993)Google Scholar
  16. 16.
    Demuth, M., Beale, M., Hagan, M.: Neural Network Toolbox User’s Guide. The MathWorks, Natic (2010)Google Scholar
  17. 17.
    Lim, C.P., Goh, W.Y.: The application of an ensemble of boosted Elman networks to time series prediction: A benchmark study. J. of Computational Intelligence 3, 119–126 (2005)Google Scholar
  18. 18.
    Time Series Data Library, http://robjhyndman.com/TSDL
  19. 19.
    Yahoo! Finance, http://finance.yahoo.com
  20. 20.
    Pacific FX database, http://fx.sauder.ubc.ca/data.html

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Ratnadip Adhikari
    • 1
  • R. K. Agrawal
    • 1
  1. 1.School of Computer and Systems SciencesJawaharlal Nehru UniversityIndia

Personalised recommendations