Ensemble Neural Network Optimization Using the Particle Swarm Algorithm with Type-1 and Type-2 Fuzzy Integration for Time Series Prediction

Part of the Studies in Computational Intelligence book series (SCI, volume 574)


This paper shows the optimization of ensemble neural networks using the Particle Swarm algorithm for time series prediction with Type-1 and Type-2 Fuzzy Integration. The time series that is being considered in this paper is the Dow Jones Time Series. Simulation results show that the ensemble approach produces good prediction of the Dow Jones time series.


Ensemble neural networks Particle swarm Optimization Time series prediction 



We would like to express our gratitude to the CONACYT, Tijuana Institute of Technology for the facilities and resources granted for the development of this research.


  1. 1.
    Brockwell, P.D., Richard, A.D.: Introduction to Time Series and Forecasting, pp. 1–219. Springer, New York (2002)Google Scholar
  2. 2.
    Krogh, A., Vedelsby, J.: Neural network ensembles, cross validation, and active learning. In: Tesauro, G., Touretzky, D., Leen, T. (eds.), Advances in Neural Information Processing Systems, vol. 7, pp. 231–238. MIT Press, Cambridge (1995)Google Scholar
  3. 3.
    Castillo, O., Melin, P.: Hybrid intelligent systems for time series prediction using neural networks, fuzzy logic, and fractal theory neural networks. IEEE Trans. 13(6), 1395–1408 (2002)Google Scholar
  4. 4.
    Golberg, D. (ed.): Genetic Algorithms in Search, Optimization and Machine Learning. Addison Wesley (1989)Google Scholar
  5. 5.
    Plummer, E.A. Time Series Forecasting with Feed-Forward Neural Networks: Guidelines and Limitations. University of Wyoming 2000Google Scholar
  6. 6.
    Maguire, L.P., Roche, B., McGinnity, T.M., McDaid, L.J.: Predicting a chaotic time series using a fuzzy neural network. 12(1–4), 125–136 (1998) Google Scholar
  7. 7.
    Multaba, I.M., Hussain, M.A. Application of Neural Networks and Other Learning. Technologies in Process Engineering. Imperial Collage Press (2001)Google Scholar
  8. 8.
    Sollich P., Krogh, A., Learning with ensembles: how over-fitting can be useful. In: Touretzky, D.S., Mozer, M.C., Hasselmo, M.E. (eds.) Advances in Neural Information Processing Systems 8, Denver, CO, pp. 190–196, MIT Press, Cambridge (1996)Google Scholar
  9. 9.
    Yadav, R.N., Kalra, P.K., John, J.: Time series prediction with single multiplicative neuron model. Soft Comput. Time Ser. Prediction Appl. Soft Comput. 7(4), 1157–1163 (2007)CrossRefGoogle Scholar
  10. 10.
    Yao, X., Liu, Y.: Making use of population information in evolutionary artificial neural networks. IEEE Trans. Syst. Man and Cybern. Part B: Cybern. 28(3), 417–425 (1998)MathSciNetGoogle Scholar
  11. 11.
    Zhou, Z.-H., Jiang, Y., Yang, Y.-B., Chen, S.-F.: Lung cancer cell identification based on artificial neural network ensembles. Artif. Intell. Med. 24(1), 25–36 (2002)CrossRefMATHGoogle Scholar
  12. 12.
    Dow Jones Company. New York, 10 Jan 2010
  13. 13.
    Dow Jones Indexes. 5 Sept 2010
  14. 14.
    Karnik, N., Mendel, M.: Applications of type-2 fuzzy logic systems to forecasting of time-series. Inf. Sci. 120(1–4), 89–111 (1999)CrossRefMATHGoogle Scholar
  15. 15.
    Zhao, L. Yang, Y.: PSO-based single multiplicative neuron model for time series prediction. Expert Syst. Appl. 36(2), 2805-2812 (2009)Google Scholar
  16. 16.
    Reeves, R.C., Row E.J.: Genetic Algorithms: Principles and Perspectives, A Guide to GA Theory, pp. 2–17, Kluwer Academic Publishers, New York (2003)Google Scholar
  17. 17.
    Zadeh, L.A.: Fuzzy sets and applications: selected papers. In: R.R. Yager et al. (eds.). Wiley, New York (1987)Google Scholar
  18. 18.
    Pulido, M., Mancilla, A., Melin, P.: An Ensemble Neural Network Architecture with Fuzzy Response Integration for Complex Time Series Prediction Evolutionary Design of Intelligent Systems in Modeling, Simulation and Control. pp. 85–110, Springer, Berlin (2009)Google Scholar
  19. 19.
    Sharkey, A.: One combining Artificial of Neural Nets. Department of Computer Science University of Sheffield, UK (1996)Google Scholar
  20. 20.
    Sharkey, A.A.: Combining Artificial Neural Nets: Ensemble and Modular Multi-Net Systems. Springer, London (1999)Google Scholar
  21. 21.
    Shimshoni, Y.N.: Initiator Classification of seismic signal by integrating ensemble of neural networks. IEEE Trans. Sig. Process. 461(5), 1194–1201 (1998)Google Scholar
  22. 22.
    Castillo, O., Melin, P.: Type-2 Fuzzy Logic: Theory and Applications Neural Networks, pp. 30–43, Springer (2008)Google Scholar
  23. 23.
    Castillo, O., Melin, P.: Simulation and forecasting complex economic time series using neural networks and fuzzy logic, Proceedings of the International Neural Networks Conference, vol. 3, pp. 1805–1810. San Diego (2001)Google Scholar
  24. 24.
    Castillo, O., Melin P.: Simulation and forecasting complex financial time series using neural networks and fuzzy logic, Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, vol. 4, pp. 2664–2669. Tucson, AZ ( 2001)Google Scholar
  25. 25.
    Jang, J.S.R, Sun, C.T. Mizutani, E.: Neuro-Fuzzy and Sof Computing. Prentice Hall, New Jersey (1996)Google Scholar
  26. 26.
    Castillo, P.O., Gonzalez, S., Cota, J., Trujillo, W., Osuna, P.: Design of Modular Neural Networks with Fuzzy Integration Applied to Time Series Prediction. vol. 41, pp. 265–273, Springer, Berlin (2007)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Tijuana Institute of TechnologyTijuanaMéxico

Personalised recommendations