A Distributed Support Vector Machines Architecture for Chaotic Time Series Prediction

  • Jian Cheng
  • Jian-sheng Qian
  • Yi-nan Guo
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4232)


Chaos limits predictability so that the prediction of chaotic time series is very difficult. Originated from the idea of combining several models to improve prediction accuracy and robustness, a new approach is presented to model and predict chaotic time series based on a distributed support vector machines in the embedding phase space. A three-stage architecture of the distributed support vector machines is proposed to improve its prediction accuracy and generalization performance for chaotic time series. In the first stage, Fuzzy C-means clustering algorithm is adopted to partition the input dataset into several subsets. Then, in the second stage, all the submodels are constructed by least squares support vector machines that best fit partitioned subsets, respectively, with Gaussian radial basis function kernel and the optimal free parameters. A fuzzy synthesis algorithm is used in the third stage to combine the outputs of submodels to obtain the final output, in which the degrees of memberships are generated by the relationship between a new input sample data and each subset center. All the models are evaluated by coal mine gas concentration in the experiment. The simulation shows that the distributed support vector machines achieves significant improvement in the generalization performance and the storage consumption in comparison with the single support vector machine model.


Support Vector Machine Root Mean Square Error Little Square Support Vector Machine Chaotic Time Series Little Square Support Vector Machine Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Weigend, A.S., Gershenfeld, N.A.: Time Series Prediction: Forecasting the Future and Understanding the Past. Addison-Wesley, Reading (1994)Google Scholar
  2. 2.
    Leung, H., Lo, T., Wang, S.: Prediction of Noisy Chaotic Time Series Using an Optimal Radial Basis Function Neural Network. IEEE Transactions Neural Networks 12(5), 1163–1172 (2001)CrossRefGoogle Scholar
  3. 3.
    Vapnik, V.N.: An Overview of Statistical Learning Theory. IEEE Transactions Neural Networks 10(5), 988–999 (1999)CrossRefGoogle Scholar
  4. 4.
    Cristianini, N., Taylor, J.S.: An Introduction to Support Vector Machines: and Other Kernel- based Learning Methods. Cambridge University Press, New York (2000)Google Scholar
  5. 5.
    Cho, S.B., Kim, J.H.: Combining Multiple Neural Networks by Fuzzy Integral for Recognition. IEEE Transactions on System, Man and Cybernetics 25(2), 380–384 (1992)Google Scholar
  6. 6.
    Kegelmeyer, W.P., Bowyer, K.: Combination of Multiple Classifiers Using Local Accuracy Estimates. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(4), 405–410 (1997)CrossRefGoogle Scholar
  7. 7.
    Bezdek, J.C.: Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press, New York (1981)MATHGoogle Scholar
  8. 8.
    Farmer, J.D., Sidorowich, J.J.: Predicting Chaotic Time Series. Phys. Rev. Lett. 59, 845–848 (1987)CrossRefMathSciNetGoogle Scholar
  9. 9.
    Takens, F.: On the Numerical Determination of the Dimension of An Attractor. In: EAMT-WS 1993. Lecture Notes in Mathematics, vol. 898, pp. 230–241. Springer, Berlin (1981)CrossRefGoogle Scholar
  10. 10.
    Ahmad, Z., Zhang, J.: A Comparison of Different Methods for Combining Multiple Neural Networks Models. In: Proceedings of the 2002 International Joint Conference on Neural Networks, vol. 1, pp. 828–833 (2002)Google Scholar
  11. 11.
    Kim, K.J.: Financial Time Series Forecasting Using Support Vector Machines. Neurocomputing 55, 307–319 (2003)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Jian Cheng
    • 1
  • Jian-sheng Qian
    • 1
  • Yi-nan Guo
    • 1
  1. 1.School of Information and Electrical EngineeringChina University of Mining and, TechnologyXu ZhouChina

Personalised recommendations