Evolving Systems

, Volume 7, Issue 1, pp 61–72 | Cite as

Potential of evolving AR and ARX models in signal recovering

  • Ahmad KalhorEmail author
Original Paper


Linear dynamic models, due to their agile structure, are capable to follow and predict fast variations of real-world systems. On the other hand, recovering outcome signals of real-world systems is a straightforward approach to predict them. In this paper, potential of some dynamic linear models—including autoregressive (AR), autoregressive with exogenous inputs (ARX) models and their extended adaptive and evolving versions–are studied in signal recovering. At first, a common signal is represented as summation of some basic temporal functions named TMs (TMs); then, capabilities of the considered models are explained and compared in generating signals with different combinations of TMs. The given explanations and results are supported by theorems, Corollaries, illustrative examples and a real-world example of signal recovering. It is demonstrated that adaptive and particularly evolving AR and ARX models are more capable in signal recovering than regular AR and ARX models. Also, it is proved that if exogenous inputs as incoming signals of an ARX model were not available, under some constraints, there is an AR model which can produce the output of the ARX model. This result is extended for adaptive and evolving AR and ARX models, too.


Evolving AR model Signal recovering Temporal modes Mode restoration 


  1. Angelov P (2006), Machine Learning (Collaborative Systems) UK patent application, GB-0621734.3, 1 Nov 2006Google Scholar
  2. Angelov P, Filev D (2004) An approach to online identification of Takagi Sugeno fuzzy models. IEEE Trans Syst Man Cybern B 34:484–498CrossRefGoogle Scholar
  3. Angelov P, Zhou X (2006) Evolving fuzzy systems from data streams in real-time, In: Proc. Int. Symp. on evolving fuzzy systems, pp 29–35Google Scholar
  4. Angelov P, Zhou X (2008), Online learning fuzzy rule-based system structure from data streams, IEEE International Conference on Fuzzy Systems, FUZZ-IEEE, pp 915–922Google Scholar
  5. Angelov P, Filev D, Kasabov(Eds.) N (2010) Evolving intelligent systems: methodology and applications, WileyGoogle Scholar
  6. Box GEP, Jenkins GM, Reinsel GC (1994) Time series analysis: forecasting and control, 3rd edn. Prentice-Hall, Englewood CliffszbMATHGoogle Scholar
  7. EUNITE network (2001), World-wide competition within the EUNITE network: Accessed 23 June 2014
  8. Faruk DÖ (2010) A hybrid neural network and ARIMA model for water quality time series prediction’. Eng Appl Artif Intell 23:586–594CrossRefGoogle Scholar
  9. Feriyonika Dewantoro G (2013) Fuzzy sliding mode control for enhancing injection velocity performance in injection molding machine. Int J Artif Intell 10(S13):75–87Google Scholar
  10. Ferreira PJSG (1992) Incomplete sampling series and the recovery of missing samples from oversampled band-limited signals. IEEE Trans Signal Process 40:225–227CrossRefGoogle Scholar
  11. Gholipour A, Araabi BN, Lucas C (2006) Predicting chaotic time series using neural and neurofuzzy models: a comparative study, presented at neural processing letters, pp 217–239Google Scholar
  12. Górriz JM, Puntonet CG, Salmerón M, de la Rosa JJG (2004) New model for time-series forecasting using rbf´s and exogenous data. Neural Comput Appl 13:101–111CrossRefGoogle Scholar
  13. Hamzaçebi C, Akay D, Kutay F (2009) Comparison of direct and iterative artificial neural network forecast approaches in multi-periodic time series forecasting. Expert Syst Appl 36:3839–3844CrossRefGoogle Scholar
  14. Hirabayashi A (2007) Consistent sampling and signal recovery. IEEE Trans Signal Process 55:4104–4115CrossRefMathSciNetGoogle Scholar
  15. Joelianto E, Anura DC, Priyanto M (2013) ANFIS—hybrid reference control for improving transient response of controlled systems using PID controller. Int J Artif Intell 10(S13):88–111Google Scholar
  16. Kalhor A (2014) A self tuning regulator for nonlinear time varying control systems based on evolving linear models. IEEE Evolving and Adaptive Intelligent Systems, LinzCrossRefGoogle Scholar
  17. Kalhor A, Araabi BN, Lucas C (2010) An online predictor model as adaptive habitually linear and transiently nonlinear model’. Evol Syst 1(1):29–41CrossRefGoogle Scholar
  18. Kalhor A, Iranmanesh H, Abdollahzade M (2012) Online modeling of real-world time series through evolving AR models’, WCCI 2012 IEEE World Congress on Computational Intelligence, June, BrisbaneGoogle Scholar
  19. Kalhor A, Araabi BN, Lucas C (2013a) Reducing the number of local linear models in neuro–fuzzy modeling: a split-and-merge clustering approach’. Appl Soft Comput J 13:939–946CrossRefGoogle Scholar
  20. Kalhor A, Araabi BN, Lucas C (2013b) Online extraction of main linear trends for nonlinear time varying processes. Inf Sci 220:22–33CrossRefGoogle Scholar
  21. Kasabov N (2002) DENFIS: dynamic evolving neural fuzzy inference system and its application for time series prediction. IEEE Trans Fuzzy Syst 10:144–154CrossRefGoogle Scholar
  22. Khashei M, Hejazi SR, Bijar M (2008) A new hybrid artificial neural networks and fuzzy regression model for time series forecasting original research article. Fuzzy Sets Syst 159:769–786CrossRefzbMATHGoogle Scholar
  23. Lughofer ED (2008) FLEXFIS: a robust incremental learning approach for evolving Takagi-Sugeno Fuzzy models. IEEE Trans Fuzzy Syst 16:1393–1410CrossRefGoogle Scholar
  24. Makridakis SG, Wheelwright SC, Hyndman RJ (1998) Forecasting: Methods and Applications, WileyGoogle Scholar
  25. Mills TC (1990) Time series techniques for economists. University Press, CambridgeGoogle Scholar
  26. Moura, M das C, Zio E, Lins ID, Droguett E (2011) Failure and reliability prediction by support vector machines regression of time series data. Reliab Eng Syst Saf 96:1527–1534CrossRefGoogle Scholar
  27. Needella D, Troppb JA (2009) CoSaMP: iterative signal recovery from incomplete and inaccurate samples’. Appl Comput Harmon Anal 26:301–321CrossRefMathSciNetGoogle Scholar
  28. Nguyen TM, Wu QMJ (2013) A fuzzy logic model based Markov random field for medical image segmentation. Evol Syst 4(3):171–181CrossRefGoogle Scholar
  29. Nunn I, White T (2005) The application of antigenic search techniques to time series forecasting, In GECCO ‘05. In: Proceedings of the 2005 conference on Genetic and evolutionary computation, New York, pp 353–360Google Scholar
  30. Odior AO (2013) Application of neural network and fuzzy model to grinding process control. Evol Syst 4(3):195–201CrossRefGoogle Scholar
  31. Ogata K (1994) Discrete-time control systems, 2nd edn. Prentice Hall, Englewood CliffsGoogle Scholar
  32. Oppenheim AV, Willsky AS, Hamid S (1996) Signals and systems, 2nd edn. Prentice Hall, NJGoogle Scholar
  33. Platt J (1991) A resource-allocating network for function interpolation. Neural Comput 3:213–225CrossRefMathSciNetGoogle Scholar
  34. Preitl S, Precup RE, Fodor J, Bede B (2006) Iterative feedback tuning in fuzzy control systems, theory and applications. Acta Polytechnica Hungarica 3(3):81–96Google Scholar
  35. Qui PY, Huang ZT, Jiang WL, Zhang C (2008) Improved blind-spreading sequence estimation algorithm for direct sequence spread spectrum signals’. Signal Processing, IET 2:139–146CrossRefGoogle Scholar
  36. Rezaii TY, Tinati MA, Beheshti S (2013) Adaptive efficient sparse estimator achieving oracle properties. Signal Process IET 7:259–268CrossRefMathSciNetGoogle Scholar
  37. Salmerón M, Ortega J, Puntonet CG, Prieto A (2001) Improved ran sequential prediction using orthogonal techniques. Neurocomputing 41:153–172CrossRefzbMATHGoogle Scholar
  38. Skrjanc I, Blazic S, Matko D (2002) Direct fuzzy model-reference adaptive control. Int J Intell Syst 17(10):943–963CrossRefzbMATHGoogle Scholar
  39. Skrjanc I, Blazic B, Agamennoni OE (2005) Identification of dynamical systems with a robust interval fuzzy model. Automatica 41(2):327–332CrossRefMathSciNetzbMATHGoogle Scholar
  40. Tay FEH, Cao LJ (2002) Modified support vector machines in financial time series forecasting. Neurocomputing 48:847–861CrossRefzbMATHGoogle Scholar
  41. Tomescu ML, Preitl S, Precup RE, Tar JK (2007) Stability analysis method for fuzzy control systems dedicated controlling nonlinear processes. Acta Polytechnica Hungarica 4(3):127–141Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  1. 1.Faculty of New Sciences and TechnologiesUniversity of TehranTehranIran

Personalised recommendations