Online Time Series Changes Detection Based on Neuro-Fuzzy Approach

  • Yevgeniy Bodyanskiy
  • Artem Dolotov
  • Dmytro Peleshko
  • Yuriy Rashkevych
  • Olena Vynokurova


The problem of fault detection of time series properties is attractive for many researchers in different areas for a long enough time. The results of the solution of this problem are used in many areas, such as monitoring of the manufacturing processes, control of moving object, bioinformatics, medical diagnostics tasks, and video stream processing. Nowadays, a fairly large number of approaches are proposed for solving this problem. Among popular approaches, there are methods, which are based on statistical analysis of time series, mathematical models of objects that generate these time series, pattern recognition, clustering, and artificial neural networks. The situation is more complicated if the information is fed for processing in online mode, and changes of signal properties can have both abrupt type (faults, outliers, and anomalies) and enough slow drift. At that, these time series can be represented in the vector or matrix sequences form and have not only stochastic character but also chaotic one. In this case, the approach based on computational intelligence methods, first of all, the neuro-fuzzy models with online learning algorithms, can have the most effectiveness. In cases where changes in monitored objects have a smooth slow nature, and as a result, it is impossible to establish a crisp boundary between segments of time series. In this situation, the use of fuzzy clustering methods is effective. At the same time, since algorithms of fuzzy clustering (both probabilistic and possibilistic) are intended to operate in batch mode, their online modifications are proposed, which essentially present the gradient procedures for minimizing conventional fuzzy goal functions. Thus, neuro-fuzzy algorithms are proposed for the fuzzy segmentation of multidimensional time series, which allow detecting in a real time both abrupt and smooth changes in the properties of stochastic and chaotic sequences.


Time series Neuro-fuzzy models Online learning in dynamic processes Fuzzy clustering Fuzzy segmentation Fault detection 


  1. 1.
    Bodyanskiy, Y.: Computational intelligence techniques for data analysis. Lect. Notes Inf. P-72, 15–36 (2005)Google Scholar
  2. 2.
    Gorshkov, Y., Kokshenev, I., Bodyanskiy, Y., Kolodyazhniy, V., Shilo, O.: Robust recursive fuzzy clustering-based segmentation of biomedical time series. In: Proceedings of 2006 International Symposium on Evolving Fuzzy Systems, Lankaster, UK, 2006, pp. 101–105. (2006)Google Scholar
  3. 3.
    Han, J., Kamber, M.: Data Mining: Concepts and Techniques. Morgan Kaufmann, San Francisco (2006)zbMATHGoogle Scholar
  4. 4.
    Bow, S.-T.: Pattern Recognition and Image Preprocessing. Marcel Dekker, Inc., New York (2002)CrossRefGoogle Scholar
  5. 5.
    Aggarwal, С., Reddy, C.: Data Clustering: Algorithms and Applications. Chapman and Hall/CRC, Boca Raton (2014)CrossRefGoogle Scholar
  6. 6.
    Bezdek, J.C.: Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press, New York (1981)CrossRefGoogle Scholar
  7. 7.
    MacQueen, J.: On convergence of k-means and partitions with minimum average variance. Ann. Math. Statist. 36, 1084 (1965)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Gorshkov, Y., Kolodyazhniy, V., Bodyanskiy, Y.: New recursive learning algorithms for fuzzy Kohonen clustering network. In: Proceedings of 17th International Workshop on Nonlinear Dynamics of Electronic Systems (NDES-2009), June 21–24, 2009, Rapperswil, pp. 58–61. (2009)Google Scholar
  9. 9.
    Bodyanskiy, Y., Gorshkov, Y., Kokshenev, I., Kolodyazhniy, V.: Evolving fuzzy classification of non-stationary time series. In: Angelov, P., Filev, D.P., Kasabov, N. (eds.) Evolving Intelligent Systems Methodology and Applications, pp. 446–464. John Wiley & Sons, New York (2008)Google Scholar
  10. 10.
    Gustafson, E.E., Kessel, W.C.: Fuzzy clustering with a fuzzy covariance matrix. In: Proceedings of IEEE CDC, San Diego, California, pp. 761–766. (1979)Google Scholar
  11. 11.
    Gath, I., Geva, A.B.: Unsupervised optimal fuzzy clustering. IEEE Trans. Pattern Anal. Mach. Intell. 11, 773–781 (1989)CrossRefGoogle Scholar
  12. 12.
    Krishnapuram, R., Keller, J.: A possibilistic approach to clustering. IEEE Trans. Fuzzy Syst. 1, 98–110 (1993)CrossRefGoogle Scholar
  13. 13.
    Chung, F.L., Lee, T.: Fuzzy competitive learning. Neural Netw. 7(3), 539–552 (1994)CrossRefGoogle Scholar
  14. 14.
    Park, D.C, Dagher, I.: Gradient based fuzzy c-means (GBFCM) algorithm. In: Proceedings of IEEE International Conference on Neural Networks, IEEE Press, Orlando, FL, USA, pp. 1626–1631. (1994)Google Scholar
  15. 15.
    Fritzke, B.: A growing neural gas network learns topologies. Adv. Neural Inf. Process. Syst. 7, 625–632 (1995)Google Scholar
  16. 16.
    Hoeppner, F., Klawonn, F.: Fuzzy clustering of sampled functions. In: Proceedings of 19-th International Conference North American Fuzzy Information Processing Society (NAFIPS), Atlanta, USA, pp. 251–255. (2000)Google Scholar
  17. 17.
    Khamassi, I., Sayed-Mouchaweh, M., Hammami, M., Ghedira, K.: Discussion and review on evolving data streams and concepts drift adapting. Evol. Syst. 8(1), 1–23 (2018)CrossRefGoogle Scholar
  18. 18.
    Lughofer, E., Weigl, E., Heidl, W., Eitzinger, C., Radauer, T.: Recognizing input space and target concept drifts with scarcely labelled and unlabeled instances. Inf. Sci. 355–356, 127–151 (2016)CrossRefGoogle Scholar
  19. 19.
    Lughofer, E., Pratama, M., Skrjanc, I.: Incremental rule splitting in generalized evolving fuzzy systems for autonomous drift compensation. IEEE Trans. Fuzzy Syst. 26(4), 1854–1865 (2018)CrossRefGoogle Scholar
  20. 20.
    Pau, L.F.: Failure diagnosis and performance monitoring. Dekker, New York (1981)zbMATHGoogle Scholar
  21. 21.
    Chui, C.K.: An Introduction to Wavelets. Academic, New York (1992)zbMATHGoogle Scholar
  22. 22.
    Bodyanskiy, Y., Lamonova, N., Pliss, I., Vynokurova, O.: An adaptive learning algorithm for a wavelet neural network. Expert. Syst. 22(5), 235–240 (2005)CrossRefGoogle Scholar
  23. 23.
    Huber, P.J.: Robust Statistics. John Wiley & Sons, New York (1981)CrossRefGoogle Scholar
  24. 24.
    Karayiannis, N.B., Venetsanopoulos, A.N.: Fast learning algorithm for neural networks. IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process. 39, 453–474 (1992)CrossRefGoogle Scholar
  25. 25.
    Bodyanskiy, Y., Lamonova N., Vynokurova, O.: Recurrent learning algorithm for double-wavelet neuron. In: Proceedings of XII-th International Conference “Knowledge – Dialogue – Solution”, Varna, pp. 77–84. (2006)Google Scholar
  26. 26.
    Narendra, K.S., Parthasarathy, K.: Identification and control of dynamic systems using neural networks. IEEE Trans. Neural Netw. 1, 4–26 (1990)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Yevgeniy Bodyanskiy
    • 1
  • Artem Dolotov
    • 1
  • Dmytro Peleshko
    • 2
  • Yuriy Rashkevych
    • 3
  • Olena Vynokurova
    • 1
    • 3
  1. 1.Kharkiv National University of Radio ElectronicsKharkivUkraine
  2. 2.IT Step UniversityLvivUkraine
  3. 3.Ministry of Education and Science of UkraineKyivUkraine

Personalised recommendations