Skip to main content
SpringerLink
Log in

A New Bootstrapped Hybrid Artificial Neural Network Approach for Time Series Forecasting

  • Published:
Computational Economics Aims and scope Submit manuscript

Abstract

In this study, a new bootstrapped hybrid artificial neural network is proposed for forecasting. This new neural network provides input significance, linearity and nonlinearity hypothesis tests in a unique network structure via a residual bootstrap approach. The network has three parts: linear, non-linear and a combination with associated weights and biases. These weights are used to test the input significance, linearity and nonlinearity hypotheses with this new method providing empirical distributions for forecasts and weights. The proposed method employs a bagging approach to obtain forecasts. It is then applied to real-time series including the M4 Competition data set and stock exchange time series where its performance is compared with appropriate benchmark methods including other popular neural networks. The proposed method results are less affected than other neural networks by initial random weights, which means that the results of the proposed method are more stable and precise. The new method provides improvements in forecasting accuracy over the established benchmarks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Anders, U., & Korn, O. (1999). Model selection in neural networks. Neural Network, 12, 309–323.

    Article  Google Scholar 

  • Balkin, S. D., & Ord, J. K. (2000). Automatic neural network modeling for univariate time series. International Journal of Forecasting, 16, 509–515.

    Article  Google Scholar 

  • Barker, J. (2020). Machine learning in M4: What makes a good unstructured model? International Journal of Forecasting. https://doi.org/10.1016/j.ijforecast.2019.06.001.

    Article  Google Scholar 

  • Barrow, D. K., & Crone, S. F. (2016). Cross-validation aggregation for combining autoregressive neural network forecasts. International Journal of Forecasting, 32, 1120–1137.

    Article  Google Scholar 

  • Bradley, M. D., & Jansen, D. W. (2004). Forecasting with a nonlinear dynamic model of stock returns and industrial production. International Journal of Forecasting, 20, 321–342.

    Article  Google Scholar 

  • Crone, S. F., Hibon, M., & Nikolopoulos, K. (2014). Advances in forecasting with neural networks? Empirical evidence from the nn3 competition on time series prediction (vol 27, pg 635, 2011). International Journal of Forecasting, 30, 1138.

    Article  Google Scholar 

  • Dantas, T. M., & Oliveira, F. L. C. (2018). Improving time series forecasting: An approach combining bootstrap aggregation, clusters and exponential smoothing. International Journal of Forecasting, 34(2018), 748–761.

    Article  Google Scholar 

  • Ebrahimpour, R., Nikooc, H., Masoudnia, S., Yousef, M. R., & Ghaem, M. S. (2011). Mixture of MLP-experts for trend forecasting of time series: A case study of the Tehran stock exchange. International Journal of Forecasting, 27, 804–816.

    Article  Google Scholar 

  • Fildes, R. (2020). Learning from forecasting competitions. International Journal of Forecasting, 36, 186–188.

    Article  Google Scholar 

  • Gorr, W. L., Nagin, D., & Szczypula, J. (1994). Comparative study of artificial neural network and statistical models for predicting student grade point averages. International Journal of Forecasting, 10, 17–34.

    Article  Google Scholar 

  • Granger, C. W. J. (1992). Forecasting stock market prices: Lessons for forecasters. International Journal of Forecasting, 8, 3–13.

    Article  Google Scholar 

  • Hyndman, R. J. (2020). A brief history of forecasting competitions. International Journal of Forecasting, 36(1), 7–14. https://doi.org/10.1016/j.ijforecast.2019.03.015.

    Article  Google Scholar 

  • Karaboga, D. (2005). An idea based on honey bee swarm for numerical optimization. TR-06, Erciyes University, Engineering Faculty, Computer Engineering Department.

  • Karaboga, D., Akay, B., & Ozturk, C. (2007). Artificial bee colony (ABC) optimization algorithm for training feed-forward neural networks. In V. Torra, Y. Narukawa, & Y. Yoshida (Eds.), Modeling decisions for artificial intelligence. MDAI 2007. Lecture Notes in Computer Science (Vol. 4617). Berlin: Springer.

    Google Scholar 

  • Kourentzes, N., Barrow, D. K., & Crone, F. S. (2014). Neural network ensemble operators for time series forecasting. Expert Systems with Applications, 41, 4235–4244.

    Article  Google Scholar 

  • Lam, J.-P., & Veall, M. R. (2002). Bootstrap prediction intervals for single period regression forecasts. International Journal of Forecasting, 18, 125–130.

    Article  Google Scholar 

  • Lee, T. H., White, H., & Granger, C. (1993). Testing for neglected nonlinearity in time series models. Journal Econometrics, 56, 269–290.

    Article  Google Scholar 

  • Lohrmann, C., & Luukka, P. (2019). Classification of intraday S&P500 returns with a Random Forest. International Journal of Forecasting, 35, 390–407.

    Article  Google Scholar 

  • Makridakis, S., Spiliotis, E., & Assimakopoulos, V. (2018). The M4 competition: Results, findings, conclusion and way forward. International Journal of Forecasting, 34, 802–808.

    Article  Google Scholar 

  • Masarotto, G. (1990). Bootstrap prediction intervals for autoregressions. International Journal of Forecasting, 6, 229–239.

    Article  Google Scholar 

  • McMillan, D. G. (2007). Non-linear forecasting of stock returns: Does volume help? International Journal of Forecasting, 23, 115–126.

    Article  Google Scholar 

  • Moody, J. (1994). Prediction risk and architecture selection for neural networks. From statistics to neural networks. NATO ASI (Series F: Computer and Systems Sciences), 136, 147–165.

    Google Scholar 

  • Moody, J., & Utans, J. (1994). Architecture selection strategies for neural networks: Application to corporate bond rating prediction. Neural networks in the Capital Markets (pp. 277–300). New York: Wiley.

    Google Scholar 

  • Nyberg, H. (2011). Forecasting the direction of the US stock market with dynamic binary probit models. International Journal of Forecasting, 27, 561–578.

    Article  Google Scholar 

  • Olson, D., & Mossman, C. (2003). Neural network forecasts of Canadian stock returns using accounting ratios. International Journal of Forecasting, 19, 453–465.

    Article  Google Scholar 

  • Politis, L. P., & Dimitris, N. (2016). Bootstrap prediction intervals for linear, nonlinear and nonparametric autoregressions. Journal of Statistical Planing and Inference, 177, 1–27.

    Article  Google Scholar 

  • Refenes, A.-P. N., & Zapranis, A. D. (1999). Neural model identification, variable selection and model adequacy. Journal of Forecasting, 18, 299–332.

    Article  Google Scholar 

  • Sarantis, N. (2001). Nonlinearities, cyclical behaviour and predictability in stock markets: International evidence. International Journal of Forecasting, 17, 459–482.

    Article  Google Scholar 

  • Smyl, S. (2019). A hybrid method of exponential smoothing and recurrent neural networks for time series forecasting. International Journal of Forecasting. https://doi.org/10.1016/j.ijforecast.2019.03.017.

    Article  Google Scholar 

  • Szafranek, S. (2019). Bagged neural networks for forecasting Polish (low) inflation. International Journal of Forecasting, 35, 1042–1059.

    Article  Google Scholar 

  • Terasvirta, T., Lin, C. F., & Granger, C. (1993). Power of the neural network linearity in time series models. Journal of Time Series Analysis, 14, 209–220.

    Article  Google Scholar 

  • Timmermann, A., & Granger, J. W. C. (2004). Efficient market hypothesis and forecasting. International Journal of Forecasting, 20(1), 15–27.

    Article  Google Scholar 

  • Tiwari, M. K., & Chattejee, C. (2010a). Uncertainity assessment and ensemble flood forecasting using bootstrap based artificial neural networks. Journal of Hydrology, 382, 20–33.

    Article  Google Scholar 

  • Tiwari, M. K., & Chattejee, C. (2010b). Development of an accurate and reliable hourly flood forecasting model using wavelet-bootstrap-ANN (WBANN) hybrid approach. Journal of Hydrology, 384, 458–470.

    Article  Google Scholar 

  • White, H. (1989). An additional hidden unit test for neglected nonlinearity in multilayer feedforward networks. In Proceedings of the international joint conference on neural networks, II (pp. 451–455), New York, IEEE Press.

  • Yolcu, U., Egrioglu, E., Bas, E., Yolcu, O. C., & Dalar, A. Z. (2019). Probabilistic forecasting, linearity and nonlinearity hypothesis tests with bootstrapped linear and nonlinear artificial neural network. Journal of Experimental & Theoretical Artificial Intelligence. https://doi.org/10.1080/0952813X.2019.1595167.

    Article  Google Scholar 

  • Yolcu, U., Jin, Y., & Egrioglu, E. (2017). An ensemble of single multiplicative neuron models for probabilistic prediction. In 2016 IEEE symposium series on computational intelligence. Article No. 7849975.

  • Zapranis, A. D., & Refenes, A.-P. N. (1999). Principles of neural model identification, selection, and adequacy: With applications to financial econometrics. London: Springer-Verlag.

    Book  Google Scholar 

Download references

Acknowledgements

This study is supported by Turkish Science and Technological Researches Foundation with Award Number: 1059B191800872, Recipient: Erol Egrioglu.

Author information

Authors and Affiliations

  1. Department of Statistics, Faculty of Arts and Science, Giresun University, 28200, Giresun, Turkey

    Erol Eğrioğlu

  2. Department of Management Science, Management Science School, Marketing Analytics and Forecasting Research Center, Lancaster University, Lancaster, UK

    Erol Eğrioğlu & Robert Fildes

Authors
  1. Erol Eğrioğlu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Robert Fildes
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Erol Eğrioğlu.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Eğrioğlu, E., Fildes, R. A New Bootstrapped Hybrid Artificial Neural Network Approach for Time Series Forecasting. Comput Econ 59, 1355–1383 (2022). https://doi.org/10.1007/s10614-020-10073-7

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10614-020-10073-7

Keywords

Search

Navigation