Skip to main content
SpringerLink
Log in

Independent vector analysis based on binary grey wolf feature selection and extreme learning machine for bearing fault diagnosis

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

This paper develops a new architecture for bearing fault diagnosis based on independent vector analysis, feature selection, and extreme learning machines classifiers. The suggested method applied to vibration signals includes the following steps: First, the independent vector analysis is introduced to separate vibration signal components from each other. Second, statistical parameters are extracted from all the obtained sources. Then three binary optimisation algorithms such as binary bat algorithm, binary particle swarm optimisation and binary grey wolf optimisation are employed for feature selection one by one. Finally, three classifiers based on extreme learning, artificial neural networks and random forest are used to perform the classification step. The obtained results show that independent vector analysis followed by feature selection based on binary grey wolf optimisation and classification using an extreme learning machine provides an optimal input vector which contains only five features for each sample and a very small misdiagnosis rate equal to 0.76%. The obtained results also prove that the suggested methodology gives the best classification results and high visibility compared to the other studied approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Data availability

The used dataset in this paper is downloaded in November 2020 from the Dynamic and Identification Research Group (DIRG) at ftp://ftp.polito.it/people/DIRG_BearingData/.

References

  1. Habbouche H, Benkedjouh T, Amirat Y, Benbouzid M (2021) Gearbox failure diagnosis using a multisensor data-fusion machine-learning-based approach. Entropy. https://doi.org/10.3390/e23060697

    Article  MathSciNet  Google Scholar 

  2. Bonnett AH, Yung C (2008) Increased efficiency versus increased reliability. IEEE Ind Appl Mag 14(1):29–36. https://doi.org/10.1109/MIA.2007.909802

    Article  Google Scholar 

  3. Li H, Huang J, Yang X, Luo J, Zhang L, Pang Y (2020) Fault diagnosis for rotating machinery using multiscale permutation entropy and convolutional neural networks. Entropy 22:851. https://doi.org/10.3390/e22080851

    Article  MathSciNet  Google Scholar 

  4. Razavi-Far R, Hallaji E, Farajzadeh-Zanjani M, Saif M, Kia SH, Henao H, Capolino G-A (2019) Information fusion and semi-supervised deep learning scheme for diagnosing gear faults in induction machine systems. IEEE Trans Ind Electron 66:6331–6342

    Article  Google Scholar 

  5. Li Y, Zou L, Jiang L, Zhou X (2019) Fault diagnosis of rotating machinery based on combination of deep belief network and one-dimensional convolutional neural network. IEEE Access 7:165710–165723. https://doi.org/10.1109/ACCESS.2019.2953490

    Article  Google Scholar 

  6. Jinde Z, Junsheng C, Yang Y, Luo S (2014) A rolling bearing fault diagnosis method based on multi-scale fuzzy entropy and variable predictive model-based class discrimination. Mech Mach Theory 78:187–200. https://doi.org/10.1016/j.mechmachtheory.2014.03.014

    Article  Google Scholar 

  7. Yan R, Gao R, Chen X (2014) Wavelets for fault diagnosis of rotary machines: a review with applications. Signal Process 96:1–15. https://doi.org/10.1016/j.sigpro.2013.04.015

    Article  Google Scholar 

  8. Gan M, Wang C, Zhu C (2015) Construction of hierarchical diagnosis network based on deep learning and its application in the fault pattern recognition of rolling element bearings. Mech Syst Signal Process. https://doi.org/10.1016/j.ymssp.2015.11.014

    Article  Google Scholar 

  9. Liang J, Zhang Y, Zhong J, Yang H (2019) A novel multi-segment feature fusion based fault classification approach for rotating machinery. Mech Syst Signal Process 122:19–41. https://doi.org/10.1016/j.ymssp.2018.12.009

    Article  Google Scholar 

  10. Ushijima T, Tachioka Y, Uenohara S, Furuya K (2020) Sparse independent vector analysis based on mel filter. 2020 IEEE 9th Global Conference on Consumer Electronics (GCCE), pp. 555–556. https://doi.org/10.1109/GCCE50665.2020.9291707

  11. Uddin Z, Jamel N, Altaf M, Orakzai F (2021) Independent vector analysis inspired amateur drone detection through acoustic signals. IEEE Access 9:63456–63462. https://doi.org/10.1109/ACCESS.2021.3074966

    Article  Google Scholar 

  12. Ono N (2011) Stable and fast update rules for independent vector analysis based on auxiliary function technique. 2011 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), pp. 189–192. https://doi.org/10.1109/ASPAA.2011.6082320

  13. Xue Q, Xu B, He C, Liu F, Ju B, Lu S, Liu Y (2021) Feature extraction using hierarchical dispersion entropy for rolling bearing fault diagnosis. IEEE Trans Instrum Meas 70:1–11. https://doi.org/10.1109/TIM.2021.3092513

    Article  Google Scholar 

  14. Li J, Cheng K, Wang S, Morstatter F, Trevino RP, Tang J, Liu H (2018) Feature selection. ACM Comput Surv 50(6):1–45. https://doi.org/10.1145/3136625

    Article  Google Scholar 

  15. Xue B, Zhang M, Browne WN, Yao X (2016) A survey on evolutionary computation approaches to feature selection. IEEE Trans Evol Comput 20(4):606–626. https://doi.org/10.1109/tevc.2015.2504420

    Article  Google Scholar 

  16. Dokeroglu T, Deniz A, Kiziloz HE (2022) A comprehensive survey on recent metaheuristics for feature selection. Neurocomputing 494:269–296. https://doi.org/10.1016/j.neucom.2022.04.083

    Article  Google Scholar 

  17. Sharma A, Muniyappa A, Kankar P (2014) Feature extraction and fault severity classification in ball bearings. J Vib Control 22(1):176–192. https://doi.org/10.1177/1077546314528021

    Article  Google Scholar 

  18. Liu TI, Singonahalli JH, Iyer NR (1996) Detection of roller bearing defects using expert system and fuzzy logic. Mech Syst Signal Process 10(5):595–614. https://doi.org/10.1006/mssp.1996.0041

    Article  Google Scholar 

  19. Tian J, Morillo C, Azarian MH, Pecht M (2016) Motor bearing fault detection using spectral kurtosis-based feature extraction coupled with k-nearest neighbor distance analysis. IEEE Trans Ind Electron 63(3):1793–1803. https://doi.org/10.1109/tie.2015.2509913

    Article  Google Scholar 

  20. Baraldi P, Podofillini L, Mkrtchyan L, Zio E, Dang VN (2015) Comparing the treatment of uncertainty in Bayesian networks and fuzzy expert systems used for a human reliability analysis application. Reliab Eng Syst Saf 138:176–193. https://doi.org/10.1016/j.ress.2015.01.016

    Article  Google Scholar 

  21. Wu X, Wang Z, Liu Y, He Xie H (2019) Health monitoring on the spacecraft bearings in high-speed rotating systems by using the clustering fusion of normal acoustic parameters. Appl Sci 9:3246

    Article  Google Scholar 

  22. Biswanath Samanta KRA-B (2003) Artificial neural network based fault diagnostics of rolling element bearings using time-domain features. Mech Syst Signal Process 17:317–328

    Article  Google Scholar 

  23. Alguindigue IE, Loskiewicz-Buczak A, Uhrig RE (1993) Monitoring and diagnosis of rolling element bearings using artificial neural networks. IEEE Trans Ind Electron 40(2):209–217. https://doi.org/10.1109/41.222642

    Article  Google Scholar 

  24. Jack LB, Nandi A (2000) Genetic algorithms for feature selection in machine condition monitoring with vibration signals. Vis Image Signal Process IEE Proc 147:205–212. https://doi.org/10.1049/ip-vis:20000325

    Article  Google Scholar 

  25. Kankar P, Sharma SC, Harsha S (2011) Fault diagnosis of ball bearings using machine learning methods. Expert Syst Appl 38:1876–1886. https://doi.org/10.1016/j.eswa.2010.07.119

    Article  Google Scholar 

  26. Ozdemir O, Kaya A (2019) Classification with extreme learning machine. 2019 INSI CONGRESS 2019 I. International Science and Innovation Congress. https://www.insicongress.com/language/en/archive/

  27. Uddin Z, Nebhen J, Altaf M, Orakzai FA (2021) Independent vector analysis inspired amateur drone detection through acoustic signals. IEEE Access 9:63456–63462. https://doi.org/10.1109/ACCESS.2021.3074966

    Article  Google Scholar 

  28. Lee IT (2009) Machine learning algorithms for independent vector analysis and blind source separation. PhD thesis, USA. AAI3373454

  29. Anderson M, Adali T, Li X-L (2012) Joint blind source separation with multivariate gaussian model: algorithms and performance analysis. Trans Sig Proc 60(4):1672–1683. https://doi.org/10.1109/TSP.2011.2181836

    Article  MathSciNet  MATH  Google Scholar 

  30. Ieee standard for transitions, pulses, and related waveforms—redline. IEEE Std 181-2011 (Revision of IEEE Std 181-2003) - Redline, 1–71 (2011)

  31. Rani ASS, Rajalaxmi RR (2015) Unsupervised feature selection using binary bat algorithm. 2015 2nd International Conference on Electronics and Communication Systems (ICECS), pp. 451–456. https://doi.org/10.1109/ECS.2015.7124945

  32. Zhao D, He Y (2016) A novel binary bat algorithm with chaos and doppler effect in echoes for analog fault diagnosis. Analog Integr Circuits Signal Process. https://doi.org/10.1007/s10470-016-0728-y

    Article  Google Scholar 

  33. Liu Q, Liu Z, Xie R, Zhou SH, Liu YF (2013) Radar assignment for stealth targets detection and tracking based on bpso in air-defense radar network. IET International Radar Conference 2013, Institution of Engineering and Technology, pp. 1–5. https://doi.org/10.1049/cp.2013.0307

  34. Kennedy J, Eberhart RC (1997) A discrete binary version of the particle swarm algorithm.1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation, 5, 4104–41085. https://doi.org/10.1109/ICSMC.1997.637339

  35. Qiaorong Z, Guochang G (2008) Path planning based on improved binary particle swarm optimization algorithm. 2008 IEEE Conference on Robotics, Automation and Mechatronics, pp. 462–466. https://doi.org/10.1109/RAMECH.2008.4681408

  36. Pan G, Liu D, Yan H (2009) Reduction methods of attributes based on improved BPSO. 2009 Second International Symposium on Knowledge Acquisition and Modeling, vol. 1, pp. 142–144. https://doi.org/10.1109/KAM.2009.202

  37. Xu J, Tian F, Wang L, Miao Z (2022) Binary particle swarm optimization intelligent feature optimization algorithm-based magnetic resonance image in the diagnosis of adrenal tumor. Contrast Media Mol Imaging 2022:1–8. https://doi.org/10.1155/2022/5143757

    Article  Google Scholar 

  38. Emary E, Zawbaa HM, Hassanien AE (2016) Binary grey wolf optimization approaches for feature selection. Neurocomputing 172:371–381

    Article  Google Scholar 

  39. Goudos SK, Boursianis A, Salucci M, Rocca P (2020) Dualband patch antenna design using binary grey wolf optimizer. 2020 IEEE International Symposium on Antennas and Propagation and North American Radio Science Meeting, pp. 1777–1778. https://doi.org/10.1109/IEEECONF35879.2020.9330100

  40. Gao K, Deng X, Cao Y (2019) Industrial process fault classification based on weighted stacked extreme learning machine. 2019 CAA Symposium on Fault Detection, Supervision and Safety for Technical Processes (SAFEPROCESS), pp. 328–332. https://doi.org/10.1109/SAFEPROCESS45799.2019.9213317

  41. Li L, Zeng J, Jiao L, Liang P, Liu F, Yang S (2020) Online active extreme learning machine with discrepancy sampling for polsar classification. IEEE Trans Geosci Remote Sens 58(3):2027–2041. https://doi.org/10.1109/TGRS.2019.2952236

    Article  Google Scholar 

  42. Yaseen ZM, Faris H, Al-Ansari N (2020) Hybridized extreme learning machine model with salp swarm algorithm: a novel predictive model for hydrological application. Complexity 2020:1–14. https://doi.org/10.1155/2020/8206245

    Article  Google Scholar 

  43. Wang S-J, Chen H, Yan W-J, Chen Y-H, Fu X (2013) Face recognition and micro-expression recognition based on discriminant tensor subspace analysis plus extreme learning machine. Neural Process Lett 39:1–19. https://doi.org/10.1007/s11063-013-9288-7

    Article  Google Scholar 

  44. Huang G-B (2014) An insight into extreme learning machines: random neurons, random features and kernels. Cogn Comput 6:376–390. https://doi.org/10.1007/s12559-014-9255-2

    Article  Google Scholar 

  45. Wei J, Liu H, Yan G, Sun F (2017) Robotic grasping recognition using multi-modal deep extreme learning machine. Multidimens Syst Signal Process. https://doi.org/10.1007/s11045-016-0389-0

    Article  MathSciNet  Google Scholar 

  46. Fan Q, Liu T (2020) Smoothing l0 regularization for extreme learning machine. Math Probl Eng 2020:1–10. https://doi.org/10.1155/2020/9175106

    Article  MathSciNet  Google Scholar 

  47. Xiao D, Li B, Mao Y (2017) A multiple hidden layers extreme learning machine method and its application. Math Probl Eng 2017:1–10. https://doi.org/10.1155/2017/4670187

    Article  Google Scholar 

  48. Daga A, Fasana A, Marchesiello S, Garibaldi L (2019) The politecnico di torino rolling bearing test rig: description and analysis of open access data. Mech Syst Signal Process 120:252–273. https://doi.org/10.1016/j.ymssp.2018.10.010

    Article  Google Scholar 

  49. Nakamura RYM, Pereira LAM, Costa KA, Rodrigues D, Papa JP, Yang X-S (2012) Bba: A binary bat algorithm for feature selection. In: 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images, pp. 291–297. https://doi.org/10.1109/SIBGRAPI.2012.47

  50. Yang X-S (2012) Bat algorithm for multi-objective optimisation . https://doi.org/10.48550/ARXIV.1203.6571

  51. Dökeroğlu T, Sevinç E, Kucukyilmaz T, Cosar A (2019) A survey on new generation metaheuristic algorithms. Comput Ind Eng. https://doi.org/10.1016/j.cie.2019.106040

    Article  Google Scholar 

  52. He Y, Ma W, Zhang J (2016) The parameters selection of PSO algorithm influencing on performance of fault diagnosis. MATEC Web Conf 63:02019. https://doi.org/10.1051/matecconf/20166302019

    Article  Google Scholar 

  53. Suganthan PN (1999) Particle swarm optimiser with neighbourhood operator. In: Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406), vol. 3, pp. 1958–19623. https://doi.org/10.1109/CEC.1999.785514

  54. Boussaïd I, Lepagnot J, Siarry P (2013) A survey on optimization metaheuristics. Inf Sci 237: 82–117. https://doi.org/10.1016/j.ins.2013.02.041. Prediction, Control and Diagnosis using Advanced Neural Computations

  55. Faris H, Aljarah I, Al-Betar MA, Mirjalili S (2017) Grey wolf optimizer: a review of recent variants and applications. Neural Comput Appl 30(2):413–435. https://doi.org/10.1007/s00521-017-3272-5

    Article  Google Scholar 

  56. Chantar H, Mafarja M, Alsawalqah H, Heidari AA, Aljarah I, Faris H (2019) Feature selection using binary grey wolf optimizer with elite-based crossover for arabic text classification. Neural Comput Appl 32(16):12201–12220. https://doi.org/10.1007/s00521-019-04368-6

    Article  Google Scholar 

  57. Zhang N, Ding S, Zhang J (2016) Multi layer ELM-RBF for multi-label learning. Appl Soft Comput 43:535–545. https://doi.org/10.1016/j.asoc.2016.02.039

    Article  Google Scholar 

  58. Fu A, Dong C, Wang L (2014) An experimental study on stability and generalization of extreme learning machines. Int J Mach Learn Cybern 6(1):129–135. https://doi.org/10.1007/s13042-014-0238-0

    Article  Google Scholar 

  59. Song K, Xu P, Chen Y, Zhang T, Wei G, Wang Q (2019) A fault diagnosis and reconfiguration strategy for self-validating hydrogen sensor array based on MWPCA and ELM. IEEE Access 7:115075–115092. https://doi.org/10.1109/access.2019.2936128

    Article  Google Scholar 

  60. Wei H, Zhang Q, Shang M, Gu Y (2021) Extreme learning machine-based classifier for fault diagnosis of rotating machinery using a residual network and continuous wavelet transform. Measurement 183:109864. https://doi.org/10.1016/j.measurement.2021.109864

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to express sincere thanks to the Dynamic and Identification Research Group (DIRG) in the Department of Mechanical and Aerospace Engineering at Politecnico di Torino, Italy for providing the bearing vibration data which is used in this paper.

Author information

Authors and Affiliations

  1. LABGET Laboratory, Electrical Engineering Department, Larbi Tebessi University, Tebessa, Algeria

    Chouaib Souaidia, Tawfik Thelaidjia & Salah Chenikher

Authors
  1. Chouaib Souaidia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tawfik Thelaidjia
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Salah Chenikher
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chouaib Souaidia.

Ethics declarations

Conflict of interest

All authors declare that they have no conflict of interest to disclose or personal relationships that could have appeared to affect the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Souaidia, C., Thelaidjia, T. & Chenikher, S. Independent vector analysis based on binary grey wolf feature selection and extreme learning machine for bearing fault diagnosis. J Supercomput 79, 7014–7036 (2023). https://doi.org/10.1007/s11227-022-04931-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-022-04931-4

Keywords

Search

Navigation