Fuzzy descriptor systems and spectral analysis for chaotic time series prediction

  • Masoud Mirmomeni
  • Caro Lucas
  • Masoud Shafiee
  • Babak N. Araabi
  • Elaheh Kamaliha
Original Article

Abstract

Predicting future behavior of chaotic time series and systems is a challenging area in the literature of nonlinear systems. The prediction accuracy of chaotic time series is extremely dependent on the model and the learning algorithm. In addition, the generalization property of the proposed models trained by limited observations is of great importance. In the past two decades, singular or descriptor systems and related fuzzy descriptor models have been the subjects of interest due to their many practical applications in modeling complex phenomena. In this study fuzzy descriptor models, as a more recent neurofuzzy realization of locally linear descriptor systems, which have led to the introduction of intuitive incremental learning algorithm that is called Generalized Locally Linear Model Tree algorithm, are implemented in their optimal structure to be compared with several other methods. A simple but efficient technique, based on the error indices of multiple validation sets, is used to optimize the number of neurons as well as to prevent over fitting in the incremental learning algorithms. The aim of the paper is to demonstrate the advantages of fuzzy descriptor models and to make a fair comparison between the most successful neural and neurofuzzy approaches in their best structures according to prediction accuracy, generalization, and computational complexity. The Mackey–Glass time series, Lorenz time series (as two well-known classic benchmarks), Darwin sea level pressure time series and long-term prediction of Disturbance Storm Time index, an important index of geomagnetic activity (as two natural chaotic dynamics) are used as practical examples to evaluate the power of the proposed method in long term prediction of chaotic dynamics.

Keywords

Long term prediction Chaotic time series Singular spectrum analysis Fuzzy descriptor models GLoLiMoT 

References

  1. 1.
    Rezaei Yousefi MM, Mirmomeni M, Lucas C (2007) Input variables selection using mutual information for neurofuzzy modeling with the application to time series forecasting. In: Proceedings of IEEE international joint conference on neural networks: IJCNN, Orlando, Florida, USA, August 12–17Google Scholar
  2. 2.
    Koskela T, Varsta M, Heikkonen J, Kaski K (1997) Time series prediction using RSOM with local linear models, Research reports B15, Laboratory of Computational Engineering, Helsinki University of Technology, ISBN 951-22-3788-1Google Scholar
  3. 3.
    Casdagli M (1989) Nonlinear prediction of chaotic time series. Physica D 35:335–356MATHCrossRefMathSciNetGoogle Scholar
  4. 4.
    Chen S, Wu Y, Luk BL (1999) Combined genetic algorithm optimization and regularized othogonal least squares learning for radial basis function networks. IEEE Trans Neural Netw 10(5):1239–1243CrossRefGoogle Scholar
  5. 5.
    Leung H, Lo T, Wang S (2001) Prediction of noisy chaotic time series using an optimal radial basis function neural network. IEEE Trans Neural Netw 12(5):1163–1172CrossRefGoogle Scholar
  6. 6.
    Weigend A, Huberman B, Rumelhart DE (1990) Predicting the future: a connectionist approach. Int J Neural Syst 1:193–209CrossRefGoogle Scholar
  7. 7.
    Weigend A, Huberman B, Rumelhart DE (1992) Predicting sunspots and exchange rates with connectionist networks. In: Casdagli E (ed) Nonlinear modeling and forecasting. Addison-Wesley, Reading, pp 395–432Google Scholar
  8. 8.
    Mirmomeni M, Lucas C, Moshiri B (2007) Long term prediction of chaotic time series with the aid of neurofuzzy models, spectral analysis and correlation analysis. In: Proceedings of IEEE international joint conference on neural networks. IJCNN, Orlando, FL, USA, August 12–17Google Scholar
  9. 9.
    Haykin S (1994) Neural networks: a comprehensive foundation. MacMillan, New YorkMATHGoogle Scholar
  10. 10.
    Hornik K, Stinchombe M, White H (1989) Multilayer feedforward networks are universal approximators. Neural Comput 2:359–366Google Scholar
  11. 11.
    Park J, Sandberg IW (1993) Approximation and radial basis function networks. Neural Comput 5(2):305–316CrossRefGoogle Scholar
  12. 12.
    Elsner JB (1992) Predicting time series using a neural network as a method of distinguishing chaos from noise. J Phys A: Math Gen A 25:843–850CrossRefGoogle Scholar
  13. 13.
    Nelles O (2001) Nonlinear system identification. Springer, BerlinMATHGoogle Scholar
  14. 14.
    Gholipour A, Lucas C, Nadjar Araabi B, Mirmomeni M, Shafiee M (2007) Extracting the main patterns of natural time series for long-term neurofuzzy prediction. Neural Comput Appl 16(4–5):383–393Google Scholar
  15. 15.
    Abarbanel HDI (1996) Analysis of observed chaotic data. Springer, New YorkMATHGoogle Scholar
  16. 16.
    Ott E (1993) Chaos in dynamical systems. Cambridge University Press, CambridgeMATHGoogle Scholar
  17. 17.
    Ott E, Sauer T, Yorke JA (eds) (1994) Coping with chaos: analysis of chaotic data and the exploitation of chaotic systems. Wiley, New YorkMATHGoogle Scholar
  18. 18.
    Petgen H-O, Jürgens H, Saupe D (1992) Chaos and fractals new frontiers of science. Springer, New YorkGoogle Scholar
  19. 19.
    Leung H, Lo T, Wang S (2001) Prediction of noisy chaotic time series using an optimal radial basis function neural network. IEEE Trans Neural Netw 12:1163–1172CrossRefGoogle Scholar
  20. 20.
    Fredrich K (1986) Estimating the dimension of weather and climate attractors. J Atmos Sci 43:419–432CrossRefGoogle Scholar
  21. 21.
    Medio A (1992) Chaotic dynamics: theory and applications to economics. Cambridge University Press, CambridgeMATHGoogle Scholar
  22. 22.
    Navone HD, Ceccatto HA (1995) Forecasting chaos from small data sets: a comparison of different nonlinear algorithms. J Phys A 28(12):3381–3388MATHCrossRefGoogle Scholar
  23. 23.
    Jones AJ (2004) New tools in non-linear modeling and prediction. CMS 1:109–149MATHCrossRefGoogle Scholar
  24. 24.
    Yonchev A, Findeisen R, Ebenbauer C, Allgöower F (2004) Model predictive control of linear continuous time singular systems subject to input constraints. In: 43rd IEEE conference on decision and control, December 14–17, Atlantis, Paradise Island, BahamasGoogle Scholar
  25. 25.
    Raouf J, Boukas EK (2004) Observer-based controller design for linear singular systems with markovian switching. In: 43rd IEEE conference on decision and control, December 14–17, Atlantis, Paradise Island, BahamasGoogle Scholar
  26. 26.
    Mirmomeni M, Lucas C, Shafiee M, Nadjar Araabi B (2008) Introducing an incremental learning method for fuzzy descriptor models to identify nonlinear singular systems. In: 16th Mediterranean conference on control and automation, Congress Centre, Ajaccio, France, June 25–2, pp 7753–758Google Scholar
  27. 27.
    Taniguchi T, Tanaka K, Wang HO (1999) Fuzzy descriptor systems and fuzzy controller designs. In: Proceedings of the 8th International Fuzzy System Association World Congress, pp 655–659Google Scholar
  28. 28.
    Taniguchi T, Tanaka K, Yamafuji K, Wang HO (1999) Fuzzy descriptor systems: stability analysis and design via LMIs. In: Proceedings American control conference, pp 1827–1831Google Scholar
  29. 29.
    Brown M, Harris C (1995) Neurofuzzy adaptive modeling and control. Prentice Hall, UKGoogle Scholar
  30. 30.
    Takagi T, Sugeno M (1985) Fuzzy identification of systems and its applications to modeling and control. IEEE Trans Syst Man Cybern 15:116–132MATHGoogle Scholar
  31. 31.
    Jang JR (1993) ANFIS: adaptive network-based fuzzy inference system. IEEE Trans Syst Man Cybern 23(3):665–685CrossRefMathSciNetGoogle Scholar
  32. 32.
    Kavli T (1993) ASMOD: an algorithm for adaptive spline modeling of observation data. Int J Control 58(4):947–967MATHCrossRefMathSciNetGoogle Scholar
  33. 33.
    Mirmomeni M, Nadjar Araabi B, Lucas C(2007) Development of LoLiMoT learning method for training neurofuzzy models on-line. In: European symposium on time series prediction (ESTSP07), Otaniemi, Espoo, Finland, February 7–9, pp 113–122Google Scholar
  34. 34.
    Vautard R, Ghil M (1989) Singular spectrum analysis in nonlinear dynamics with applications to paleoclimatic time series. Physica D 35:395–424MATHCrossRefMathSciNetGoogle Scholar
  35. 35.
    Vautard R, Yiou P, Ghil M (1992) Singular spectrum analysis: a toolkit for short noisy chaotic signals. Physica D 58:95–126CrossRefGoogle Scholar
  36. 36.
    Kugiumtzis D, Lillekjendlie B, Christophersen N (1994) Chaotic time series, part I: estimation of some invariant properties in state space. Model Identif Control 15(4):205–224MATHCrossRefMathSciNetGoogle Scholar
  37. 37.
    Verghese GC, Levy BC, Kailath T (1981) A generalized state-space for singular systems. IEEE Trans Autom Control AC-26(4)Google Scholar
  38. 38.
    Ailon A (1991) Decoupling of square singular systems via proportional state feedback. IEEE Trans Autom Control 36(1)Google Scholar
  39. 39.
    Dai L (1989) Singular control systems. Springer, New YorkMATHCrossRefGoogle Scholar
  40. 40.
    Wang J, Zhang Q, Liu W, Xin X, Sreeram V (2004) H model reduction for singular systems. In: Proceedings of 2004 American Control Conference, June 30–July 2, Boston, Massachusetts, pp 119–124Google Scholar
  41. 41.
    Halfmann C, Nelles O, Holzmann H (1999) Modeling and identification of the vehicle suspension characteristics using local linear model trees. In: Proceedings of IEEE international conference on control applications, Khala-Coast Island, Hawaii, USA, pp 1484–1489Google Scholar
  42. 42.
    Jalili-Kharaajoo M, Ranji R, Bagherzadeh H (2003) Predictive control of a fossil power plant based on locally linear model tree (LOLIMOT). Proceedings of 2003 IEEE conference on control applications, CCA 2003, Istanbul, Turkey, 23–25 June, pp 633–638Google Scholar
  43. 43.
    Fink A, Nelles O, Isermann R (2002) Nonlinear internal model control for MISO systems based on local linear neuro-fuzzy models. 15th IFAC World Congress, Part I, vol 15, Barcelona, SpainGoogle Scholar
  44. 44.
    Gholipour A, Abbaspour A, Araabi BN, Lucas C (2003) Enhancements in the prediction of solar activity by locally linear model tree. In: Proceedings of MIC2003: 22nd international conference on modeling, identification and control, Innsbruck, Austria, pp 158–161Google Scholar
  45. 45.
    Gholipour A, Lucas C, Araabi BN, Shafiee M (2005) Solar activity forecast: spectral analysis and neurofuzzy prediction. J Atmos Solar Terrestrial Phys 67:595–603CrossRefGoogle Scholar
  46. 46.
    Mackey M, Glass L (1977) Oscillation and chaos in physiological control systems. Science 197:281–287CrossRefGoogle Scholar
  47. 47.
    Lorenz EN (1963) Deterministic non-periodic flow. J Atmos Sci 20:130–141CrossRefGoogle Scholar
  48. 48.
    Fröyland J (1992) Introduction to chaos and coherence. IOP, LondonMATHGoogle Scholar
  49. 49.
    Kaplan A, Kushnir Y, Kane MA (2000) Reduced space optimal interpolation of historical of marine sea level pressure: 1854–1992. J Clim 13:2987–3002CrossRefGoogle Scholar
  50. 50.
    Mendelssohn R, Bograd SJ, Schwing FB, Palacios DM (2005) Teaching old indices new tricks: a state-space analysis of El Niño related climate indices. Geophys Res Lett 32:L07709. doi:10.1029/2005GL022350 CrossRefGoogle Scholar
  51. 51.
    Mirmomeni M, Shafiee M, Lucas C, Araabi BN (2006) Introducing a new learning method for fuzzy descriptor systems with the aid of spectral analysis to forecast solar activity. J Atmos Solar Terrestrial Phys 68:2061–2074CrossRefGoogle Scholar
  52. 52.

Copyright information

© Springer-Verlag London Limited 2009

Authors and Affiliations

  • Masoud Mirmomeni
    • 1
    • 4
  • Caro Lucas
    • 1
    • 4
  • Masoud Shafiee
    • 2
  • Babak N. Araabi
    • 1
    • 4
  • Elaheh Kamaliha
    • 3
  1. 1.Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of EngineeringUniversity of TehranTehranIran
  2. 2.Faculty of Electrical EngineeringAmir Kabir University of TechnologyTehranIran
  3. 3.Computer Engineering DepartmentSharif University of TechnologyTehranIran
  4. 4.Institute for Studies in Theoretical Physics and MathematicsSchool of Intelligent SystemsTehranIran

Personalised recommendations