Skip to main content
Log in

A model of binaural auditory nerve oscillator network for bearing fault diagnosis by integrating two-channel vibration signals

  • Original Paper
  • Published:
Nonlinear Dynamics Aims and scope Submit manuscript

Abstract

Rolling bearing plays an important role in rotary machines. In rotating machine fault diagnosis, two-channel signals that are recorded from bearing provide sufficient information. It is meaningful to integrate two-channel signals for improving the comprehensiveness and accuracy of status information extracted from the signals. Human auditory nerve system can integrate the binaural information through the mechanism of neurons oscillation and delivery of oscillation. In view of the aspects mentioned above, to simulate the operating mechanism of human binaural auditory system, a double-layer auditory nerve oscillator network (DLNON) model, whose inputs are two-channel vibration signals, is proposed for features extraction and faults diagnosis. By this model, independent component analysis (ICA) is used at the first place to reduce the correlation and increase the independence between the signals; then, outputs of ICA are processed by short-time Fourier transform (STFT) and spectral envelop to reduce the complexity of frequency structure and highlight the formant informant of signal. After that, two results of time–frequency envelop are processed, respectively, by the first-layer oscillator network to obtain synchronous oscillatory period function (SOPF). Finally, information of two SOPFs and two time–frequency envelops is integrated by the second-layer oscillator network, so as to simulate auditory masking effect. The synchronous oscillatory feature function (SOFF) reflected the feature of two-channel signals is obtained by calculating the oscillatory result (SOPF) of the second oscillator network. The performance of DLNON model is evaluated by experiments. The results show that this model can effectively extract fault features, and distinguish fault types, fault severity ratings.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28
Fig. 29

Similar content being viewed by others

Data availability

The datasets analyzed during the current study are available in the Case Western Reserve University Bearing Data Center Website repository, [http://csegroups.case.edu/bearingdatacenter/home].

Abbreviations

\({\mathbf{A}}\) :

Original signal matrix

\(x\) :

The first channel signal in \({\mathbf{A}}\)

\(y\) :

The second channel signal in \({\mathbf{A}}\)

\({\mathbf{A^{\prime}}}\) :

Whitened signal matrix

\({\mathbf{B}}\) :

Whitened matrix

\({\mathbf{D}}\) :

Eigenvalue matrix of covariance matrix

\({\mathbf{U^{\prime}}}\) :

Feature vector matrix

\({\mathbf{Q}}\) :

Separation matrix

\({\mathbf{Y}}\) :

Signal matrix removed correlation

\(x_{1}\) :

The first channel signal in \({\mathbf{Y}}\)

\(y_{1}\) :

The second channel signal in \({\mathbf{Y}}\)

\(w\) :

Rectangular window function

\(M\) :

The number of neurons to the \(m\) direction

\(N\) :

The number of neurons to the \(n\) direction

\(R\) :

The number of final SOPF

\(gs\) :

The number of \(\psi^{(2)}\)

\({\mathbf{\rm O}}\) :

The neuron

\(G\) :

Nonlinear time function

\(2N\) :

Length of window function

\(W\) :

Overlapping points of window function

\({\mathbf{K}}_{mn}\) :

External input of neuron

\({\text{ST}}_{1}\) :

Result of short-time Fourier transform of \(x_{1}\)

\({\text{ST}}_{2}\) :

Result of short-time Fourier transform of \(y_{1}\)

\(en_{1}\) :

Spectral envelopes of \({\text{ST}}_{1}\)

\(en_{2}\) :

Spectral envelopes of \({\text{ST}}_{2}\)

\(P_{mn}\) :

Coupling term of oscillation

\(\chi_{mn}\) :

Membrane potential

\(\zeta_{mn}\) :

Activity level of ion channel

\(S1^{mn}\) :

Connection weight of the first-layer network for \(en_{1}\)

\(S2^{mn}\) :

Connection weight of the first-layer network for \(en_{2}\)

\(\psi_{2}^{(1)}\) :

SOPF of the first-layer network for \(en_{2}\)

\(\psi_{1}^{(1)}\) :

SOPF of the first-layer network for \(en_{1}\)

\(S_{z}^{mn}\) :

Connection weight of global inhibitory neuron

\(S_{{}}^{mn}\) :

Connection weight of the second layer

\({\rm T}_{1}^{\left( 1 \right)}\) :

The period of each neuron the first network in the first layer

\(OC\) :

The number of oscillatory neurons

\(L\) :

The number of oscillatory periods of unequal value

\(C_{l}^{{}}\) :

The final period for \(\psi_{1}^{(1)}\)

\(\psi^{(2)}\) :

SOPF of the second-layer network

\(\omega\) :

Synchronous oscillatory feature functions (SOFF)

\(\varpi\) :

The final SOFF

\(\Omega\) :

The number of fault types

\(\varpi_{s}\) :

The final SOFF of identified signal

\(\eta\) :

Euclidean distance

\(\sigma\) :

Manhattan distance

\(J\) :

Recognition distance

References

  1. Lee, C.-Y., Le, T.-A.: Intelligence bearing fault diagnosis model using multiple feature extraction and binary particle swarm optimization with extended memory. IEEE Access 8, 198343–198356 (2020)

    Article  Google Scholar 

  2. Zhang, K., Chen, P., Yang, M., Song, L., Xu, Y.: The Harmogram: a periodic impulses detection method and its application in bearing fault diagnosis. Mech. Syst. Sig. Process. 165, 108374 (2022)

    Article  Google Scholar 

  3. Wang, J., Du, G., Zhu, Z., Shen, C., He, Q.: Fault diagnosis of rotating machines based on the EMD manifold. Mech. Syst. Sig. Process. 135, 106443 (2020)

    Article  Google Scholar 

  4. Liu, Z., Peng, D., Zuo, M.J., Xia, J., Qin, Y.: Improved Hilbert-Huang transform with soft sifting stopping criterion and its application to fault diagnosis of wheelset bearings. ISA Trans. 125, 426–444 (2021)

    Article  Google Scholar 

  5. Belaid, K., Miloudi, A., Bournine, H.: The processing of resonances excited by gear faults using continuous wavelet transform with adaptive. A fault pulse extraction and feature enhancement method for bearing fault diagnosis. Measurement 180, 109718 (2021)

    Article  Google Scholar 

  6. Ma, H., Feng, Z.: Planet bearing fault diagnosis using multipoint optimal minimum entropy deconvolution adjusted. J. Sound Vib. 449, 235–273 (2019)

    Article  Google Scholar 

  7. Xu, Y., Zhen, D., Gu, J.X., Rabeyee, K., Chu, F., Gu, F., Ball, A.D.: Autocorrelated envelopees for early fault detection of rolling bearings. Mech. Syst. Sig. Process. 146, 106990 (2021)

    Article  Google Scholar 

  8. Cheng, Z., Wang, R.: Enhanced symplectic characteristics mode decomposition method and its application in fault diagnosis of rolling bearing. Measurement 166, 108108 (2020)

    Article  Google Scholar 

  9. Buchaiah, S., Shakya, P.: Bearing fault diagnosis and prognosis using data fusion based feature extraction and feature selection. Measurement 188, 110506 (2022)

    Article  Google Scholar 

  10. Liu, J., Shao, Y.: Overview of dynamic modelling and analysis of rolling element bearings with localized and distributed faults. Nonlinear Dyn. 93, 1765–1798 (2018)

    Article  Google Scholar 

  11. Attoui, I., Fergani, N., Boutasseta, N., Oudjani, B., Deliou, A.: A new time–frequency method for identification and classification of ball bearing faults. J. Sound Vib. 397, 241–265 (2017)

    Article  Google Scholar 

  12. Liu, Z., Guo, W., Tang, Z., Chen, Y.: Multi-sensor data fusion using a relevance vector machine based on an ant colony for gearbox fault detection. Sensors 15, 21857–21875 (2015)

    Article  Google Scholar 

  13. Stief, A., Ottewill, J.R., Tan, R., Cao, Y.: Process and alarm data integration under a two-stage Bayesian framework for fault diagnostics. IFAC-PapersOnLine 51, 1220–1226 (2018)

    Article  Google Scholar 

  14. Guan, Y., Meng, Z., Sun, D., Liu, J., Fan, F.: 2MNet: multi-sensor and multi-scale model toward accurate fault diagnosis of rolling bearing. Reliab. Eng. Syst. Saf. 216, 108017 (2021)

    Article  Google Scholar 

  15. Dubrovsky, N., Rimskaya-Korsakova, L.: A simulation network of first order auditory neurons for preprocessing of acoustic signals, Proceedings of OCEANS'94, IEEE, 1994, pp. II/235-II/238 vol. 232.

  16. Bamiou, D.E., Werring, D., Cox, K., Stevens, J., Musiek, F.E., Brown, M.M., Luxon, L.M.: Patient-reported auditory functions after stroke of the central auditory pathway. Stroke 43, 1285–1289 (2012)

    Article  Google Scholar 

  17. Li, S., Qi, X., Hu, H., Wang, Y.: Synchronized oscillation in a modular neural network composed of columns. Sci China Ser C-Life Sci. 48, 6–1 (2005)

    Article  Google Scholar 

  18. Idris, Z., Kandasamy, R., Reza, F., Abdullah, J.M.: Neural oscillation, network, eloquent cortex and epileptogenic zone revealed by magnetoencephalography and awake craniotomy. Asian J. Neurosurg. 9, 144 (2014)

    Article  Google Scholar 

  19. Wang, D.L., Brown, G.J.: Separation of speech from interfering sounds based on oscillatory correlation. IEEE Trans. Neural Netw. 10, 684–697 (1999)

    Article  Google Scholar 

  20. K. Hoshino, H. Igarashi.: An image recognition based on neural oscillator network, Neural networks (IJCNN), the 2010 international joint conference on, IEEE, 1–6 (2010).

  21. Qiao, Y., Meng, Y., Duan, L., Fang, F., Miao, J.: Qualitative analysis and application of locally coupled neural oscillator network. Neural Comput. Appl. 21, 1551–1562 (2012)

    Article  Google Scholar 

  22. Liu, X., Wang, D., Ramirez, J.R.: Extracting hydrographic objects from satellite images using a two-layer neural network, Neural Networks Proceedings, 1998. IEEE World Congress on Computational Intelligence. The 1998 IEEE International Joint Conference on, IEEE, 897–902 (1998)

  23. Li, Y., Zhang, J., Dai, L., Zhang, Z.: Novel method for time-frequency structure description based on synchronized oscillatory network of auditory nerve fiber. Ji xie Gong Cheng Xue Bao. 48, 55–62 (2012)

    Google Scholar 

  24. Cao, M., Kawamura, A.: An evolutionary design scheme of neural oscillatory network for generation of biped walking patterns, Advanced Motion Control, 1998. AMC'98-Coimbra, 1998 5th International Workshop on, IEEE, 666–671 (1998)

  25. Jia, F., Lei, Y., Lin, J., Zhou, X., Lu, N.: Deep neural networks: a promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data. Mech. Syst. Sig. Process. 72, 303–315 (2016)

    Article  Google Scholar 

  26. Warren, J., Jennings, A., Griffiths, T.: Analysis of the spectral envelopee of sounds by the human brain. Neuroimage 24, 1052–1057 (2005)

    Article  Google Scholar 

  27. Griffiths, T.D., Kumar, S., Warren, J.D., Stewart, L., Stephan, K.E., Friston, K.J.: Approaches to the cortical analysis of auditory objects. Hear. Res. 229, 46–53 (2007)

    Article  Google Scholar 

  28. Hyvarinen, A.: Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. Neural Netw. 10, 626–634 (1999)

    Article  Google Scholar 

  29. Tu, S., Chen, H.: Blind source separation of underwater acoustic signal by use of negentropy-based fast ICA algorithm, Computational Intelligence & Communication Technology (CICT), 2015 IEEE International Conference on, IEEE, 608–611(2015)

  30. Li, X., Li, W., Sun, Y., Zhao, H.: Blind source separation of vibration signal of electric traction experiment system, Intelligent Control and Information Processing (ICICIP), 2010 International Conference on, IEEE, 93–96 (2010)

  31. Brito, N.S.D., de Souza, B.A., dos Santos, W.C., de Andrade Fortunato, L.M.: Analysis of the influence of the window used in the Short-Time Fourier Transform for High Impedance Fault detection, 2016 17th International Conference on Harmonics and Quality of Power (ICHQP). IEEE, 350–355(2016)

  32. Haque, S.: Utilizing auditory masking in automatic speech recognition, Audio Language and Image Processing (ICALIP), 2010 International Conference on. IEEE, 1758–1764 (2010)

  33. Betea, B., Dobra, P., Trusca, M.: Simplified mathematical model of the bearings with defects, System Theory, Control and Computing (ICSTCC), 2012 16th International Conference on, IEEE, 1–6 (2012)

  34. Sassi, S., Badri, B., Thomas, M.: A numerical model to predict damaged bearing vibrations. J. Vib. Control. 13(11), 1603–1628 (2007)

    Article  MATH  Google Scholar 

  35. Paliwal, D., Choudhur, A., Govandhan, T.: Identification of faults through wavelet transform vis-à-vis fast Fourier transform of noisy vibration signals emanated from defective rolling element bearings. Front. Mech. Eng. 9(2), 130–141 (2014)

    Article  Google Scholar 

  36. Liu, C., Shi, B., Yang, X., Li, N., Wu, H.: Automatic buildings extraction from LiDAR data in urban area by neural oscillator network of visual cortex. IEEE J. Select. Top. Appl. Earth Observ. Remote Sens. 6, 2008–2019 (2013)

    Article  Google Scholar 

  37. Chen, K., Wang, D.: A dynamically coupled neural oscillator network for image segmentation. Neural Netw. 15, 423–439 (2002)

    Article  Google Scholar 

  38. Hindmarsh, J.L., Rose, R.: A model of neuronal bursting using three coupled first order differential equations. Proc. R. Soc. Lond. B: Biol. Sci. 221, 87–102 (1984)

    Article  Google Scholar 

  39. Wang, P., Wang, Y., Liu, H., Sheng, Y., Wang, X., Wei, Z.: Speech enhancement based on auditory masking properties and log-spectral distance, Computer Science and Network Technology (ICCSNT), 2013 3rd International Conference on, IEEE, 1060–1064 (2013)

  40. Sidorov, M., Sopov, E., Ivanov, Minker, W.: Feature and decision level audio-visual data fusion in emotion recognition problem, Informatics in Control, Automation and Robotics (ICINCO), 2015 12th International Conference on, IEEE, 246–251(2015)

  41. Loparo, K.A.: Bearings vibration data set, Case Western Reserve University http://csegroups.case.edu/bearingdatacenter/home

  42. Smith, W.A., Randall, R.B.: Rolling element bearing diagnostics using the Case Western Reserve University data: a benchmark study. Mech. Syst. Sig. Process. 64, 100–131 (2015)

    Article  Google Scholar 

  43. Zhou, H., Jin, C., Dong, G., Wang, H., Yuan, H.: Bearing fault recognition method based on neighbourhood component analysis and coupled hidden Markov model. Mech. Syst. Sig. Process. 66–67, 568–581 (2016)

    Article  Google Scholar 

Download references

Acknowledgements

The author appreciates the free download of the original bearing fault data and one picture provided by Case Western Reserve University Bearing Data Center Website.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yungong Li.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest concerning the publication of this manuscript.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix 1

See Figs.

Fig. 30
figure 30

Intermediate result of feature extraction of outer ring CE fault type

30,

Fig. 31
figure 31

Intermediate result of feature extraction of inner ring fault type

31,

Fig. 32
figure 32

Intermediate result of feature extraction of ball fault type

32,

Fig. 33
figure 33

Intermediate result of feature extraction of normal bearing and outer ring OR fault type

33.

Appendix 2

1 normal, 2 inner ring (severity rating 1), 3 ball (severity rating 1), 4 outer ring (CE severity rating 1), 5 outer ring (OR severity rating 1), 6 outer ring (OP severity rating 1), 7 inner ring (severity rating 2), 8 ball (severity rating 2), 9 outer ring (CE severity rating 2), 10 inner ring (severity rating 3), 11 ball (severity rating 3), 12 outer ring (CE severity rating 3), 13 outer ring (OR severity rating 3), 14 outer ring (OP severity rating 3).

See Figs.

Fig. 34
figure 34

SOFFs of fault signal under no load

34,

Fig. 35
figure 35

SOFFs of fault signal under load one

35,

Fig. 36
figure 36

SOFFs of fault signal under load two

36,

Fig. 37
figure 37

SOFFs of fault signal under load three

37.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, X., Li, Y., Sun, M. et al. A model of binaural auditory nerve oscillator network for bearing fault diagnosis by integrating two-channel vibration signals. Nonlinear Dyn 111, 4779–4805 (2023). https://doi.org/10.1007/s11071-022-08079-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11071-022-08079-x

Keywords

Navigation