Skip to main content
SpringerLink
Log in

Rolling bearing fault diagnosis based on feature fusion with parallel convolutional neural network

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

Deep learning has seen increased application in the data-driven fault diagnosis of manufacturing system components such as rolling bearing. However, deep learning methods often require a large amount of training data. This is a major barrier in particular for bearing datasets whose sizes are generally limited due to the high costs of data acquisition especially for fault scenarios. When small datasets are employed, over-fitting may occur for a deep learning network with many parameters. To tackle this challenge, in this research, we propose a new methodology of parallel convolutional neural network (P-CNN) for bearing fault identification that is capable of feature fusion. Raw vibration signals in the time domain are divided into non-overlapping training data slices, and two different convolutional neural network (CNN) branches are built in parallel to extract features in the time domain and in the time-frequency domain, respectively. Subsequently, in the merged layer, the time-frequency features extracted by continuous wavelet transform (CWT) are fused together with the time-domain features as inputs to the final classifier, thereby enriching feature information and improving network performance. By incorporating empirical feature extraction such as CWT, this proposed method can effectively enable deep learning even with dataset size limitation in practical bearing diagnosis. The algorithm is validated through case studies on publicly accessible experimental rolling bearing datasets. A wide range of dataset sizes is tested with cross-validation, and influencing factors on network performance are discussed. Compared with existing methods, the proposed approach not only possesses higher accuracy but also exhibits better stability and robustness as training dataset sizes and load conditions vary. The concept of feature fusion through P-CNN can be extended to other fault diagnosis applications in manufacturing systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Attoui I, Oudjani B, Boutasseta N, Fergani N, Bouraiou A (2020) Novel predictive features using a wrapper model for rolling bearing fault diagnosis based on vibration signal analysis. Int J Adv Manuf Technol 106:9–12

    Google Scholar 

  2. Wang H, Chen J, Zhou Y, Ni G (2019) Early fault diagnosis of rolling bearing based on noise-assisted signal feature enhancement and stochastic resonance for intelligent manufacturing, Int J Adv Manuf Technol 1 - 4, 1 - 7

  3. Xu Q, Lu S, Jia W, Jiang C (2020) Imbalanced fault diagnosis of rotating machinery via multi-domain feature extraction and cost-sensitive learning. J Intell Manuf 31:1467–1481

    Google Scholar 

  4. Sousa R, Antunes J, Coutinho F, Silva E, Santos J, Ferreira H (2019) Robust cepstral-based features for anomaly detection in ball bearings. Int J Adv Manuf Technol 103:2377–2390

    Google Scholar 

  5. Singh J, Darpe AK, Singh SP (2018) Rolling element bearing fault diagnosis based on over-complete rational dilation wavelet transform and auto-correlation of analytic energy operator. Mech Syst Signal Process 100:662–693

    Google Scholar 

  6. Yeap, Y.M., Ukil, A., 2016. Fault detection in HVDC system using Short Time Fourier Transform, In: 2016 IEEE Power and Energy Society General Meeting.

    Google Scholar 

  7. Manjurul Islam MM, Kim J-M (2019) Automated bearing fault diagnosis scheme using 2D representation of wavelet packet transform and deep convolutional neural network. Comput Ind 106:142–153

    Google Scholar 

  8. Djebala A, Babouri M, Ouelaa N (2015) Rolling bearing fault detection using a hybrid method based on empirical mode decomposition and optimized wavelet multi-resolution analysis. Int J Adv Manuf Technol 79:2093–2105

    Google Scholar 

  9. Zhang D, Yu D (2017) Multi-fault diagnosis of gearbox based on resonance-based signal sparse decomposition and comb filter. Measurement 103:361–369

    Google Scholar 

  10. Moumene I, Ouelaa N (2016) Application of the wavelets multiresolution analysis and the high-frequency resonance technique for gears and bearings faults diagnosis. Int J Adv Manuf Technol 83:1315–1339

    Google Scholar 

  11. Liang P, Deng C, Wu J (2019) Compound fault diagnosis of gearboxes via multi-label convolutional neural network and wavelet transform. Comput Ind 113:103–132

    Google Scholar 

  12. Vincent P, Larochelle H, Lajoie I (2010) Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11:3371–3408

    MathSciNet  MATH  Google Scholar 

  13. Qi Y, Shen C, Wang D (2017) Stacked sparse autoencoder-based deep network for fault diagnosis of rotating machinery. IEEE Access 5:15066–15079

    Google Scholar 

  14. de Moura EP, Souto CR, Silva AA (2011) Evaluation of principal component analysis and neural network performance for bearing fault diagnosis from vibration signal processed by RS and DF analyses. Mech Syst Signal Process 25(5):1765–1772

    Google Scholar 

  15. Zhu K, Song X, Xue D (2014) A roller bearing fault diagnosis method based on hierarchical entropy and support vector machine with particle swarm optimization algorithm. Measurement 47:669–675

    Google Scholar 

  16. Chen Z, Li W (2017) Multisensor feature fusion for bearing fault diagnosis using sparse autoencoder and deep belief network. IEEE T Instrum Meas 66(7):1693–1702

    Google Scholar 

  17. Gan M, Wang C, Zhu C (2018) Fault feature enhancement for rotating machinery based on quality factor analysis and manifold learning. J Intell Manuf 29(2):463–480

    Google Scholar 

  18. Lu Y, Xie R, Liang S (2019) Adaptive online dictionary learning for bearing fault diagnosis. Int J Adv Manuf Technol 101:195–202

    Google Scholar 

  19. Tsironi E, Barros P, Weber C (2017) An analysis of convolutional long short-term memory recurrent neural networks for gesture recognition. Neurocomputing 268:76–86

    Google Scholar 

  20. Weimer D, Scholz-Reiter S, B. (2016) Design of deep convolutional neural network architectures for automated feature extraction in industrial inspection. CIRP Ann Manuf Technol 65(1):417–420

    Google Scholar 

  21. Ince T, Kiranyaz S, Eren L (2016) Real-time motor fault detection by 1 - D convolutional neural networks. IEEE Trans Ind Electron 63(11):7067–7075

    Google Scholar 

  22. Abdeljaber O, Avci O, Kiranyaz S (2017) Real-time vibration-based structural damage detection using one-dimensional convolutional neural networks. J Sound Vib 388:154–170

    Google Scholar 

  23. Pan J, Zi Y, Chen J (2017) LiftingNet: a novel deep learning network with layerwise feature learning from noisy mechanical data for fault classification, IEEE T Ind. Electron. 65(6):4973–4982

    Google Scholar 

  24. Duan Z, Wu T, Guo S, Shao T, Malekian R, Li Z (2018) Development and trend of condition monitoring and fault diagnosis of multi-sensors information fusion for rolling bearings: a review. Int J Adv Manuf Technol 96:803–819

    Google Scholar 

  25. LeCun Y, Boser BE, Denker J (1989) Back propagation applied to handwritten zip code recognition. Neural Comput 1(4):541–551

    Google Scholar 

  26. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks, In: the Advances in neural information processing systems, 1097 - 1105

  27. Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition, In: the International Conference on Learning Representations, 1 - 14

  28. Szegedy C, Vanhoucke V, Ioffe S (2016) Rethinking the inception architecture for computer vision, In: the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2818 - 2826

  29. Wen, L., Gao, L., Li, X., 2018. A new data-driven intelligent fault diagnosis by using convolutional neural network, In: the IEEE International Conference on Industrial Engineering and Engineering Management, 813-817.

    Google Scholar 

  30. Zhang W, Li C, Peng G (2018) A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load. Mech Syst Signal Process 100:439–453

    Google Scholar 

  31. Zhang R, Tao H, Wu L (2017) Transfer learning with neural networks for bearing fault diagnosis in changing working conditions. IEEE Access 5:14347–14357

    Google Scholar 

  32. Cao P, Zhang S, Tang J (2018) Preprocessing-free gear fault diagnosis using small datasets with deep convolutional neural network-based transfer learning. IEEE Access 6:26241–26253

    Google Scholar 

  33. Manjurul Islam MM, Kim JM (2018) Motor bearing fault diagnosis using deep convolutional neural networks with 2D analysis of vibration signal, In: the 31st Canadian Conference on Artificial Intelligence, 8 - 11

  34. Li X, Zhang W, Ding Q (2018) A robust intelligent fault diagnosis method for rolling element bearings base d on deep distance metric learning. Neurocomputing 310:77–95

    Google Scholar 

  35. Janssens O, Slavkovikj V, Vervisch B (2016) Convolutional neural network based fault detection for rotating machinery. J Sound Vib 377:331–345

    Google Scholar 

  36. Ma S, Chu F (2019) Ensemble deep learning-based fault diagnosis of rotor bearing systems. Comput Ind 105:143–152

    Google Scholar 

  37. Zan T, Liu Z, Wang H, Wang M, Gao X (2020) Control chart pattern recognition using the convolutional neural network. J Intell Manuf 31:703–716

    Google Scholar 

  38. Ragab A, Yacout S, Ouali M, Osman H (2019) Prognostics of multiple failure modes in rotating machinery using a pattern based classifier and cumulative incidence functions. J Intell Manuf 30(1):255–274

    Google Scholar 

  39. Yan R, Gao RX, Chen X (2014) Wavelets for fault diagnosis of rotary machines: a review with applications. Signal Process 96:1–15

    Google Scholar 

  40. Miao R, Gao Y, Ge L (2019) Online defect recognition of narrow overlap weld based on two-stage recognition model combining continuous wavelet transform and convolutional neural network. Comput Ind 112:103–115

    Google Scholar 

  41. Khan A, Sung J, Kang J (2019) Multi-channel fusion convolutional neural network to classify syntactic anomaly from language-related ERP components, Inform. Fusion 52:53–61

    Google Scholar 

  42. Liu Y, Chen X, Wang Z (2018) Deep learning for pixel-level image fusion: Recent advances and future prospects, Inform. Fusion 42:158–173

    Google Scholar 

  43. Long J, Shelhamer E, Darrell T (2014) Fully convolutional networks for semantic segmentation, IEEE T. Pattern Anal 39(4):640–650

    Google Scholar 

  44. Cui Z, Chen W, Chen Y (2016) Multi-scale convolutional neural networks for time series classification, arXiv preprint arXiv: 1603. 06995

  45. Zeiler MD, Taylor GW, Fergus R (2011) Adaptive deconvolutional networks for mid and high level feature learning, In: the Proceedings of the IEEE International Conference on Computer Vision, 2018 - 2025

  46. Srivastava N, Hinton G, Krizhevsky A (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958

    MathSciNet  MATH  Google Scholar 

  47. Smith WA, Randall RB (2015) Rolling element bearing diagnostics using the case western reserve university data: a benchmark study. Mech Syst Signal Process 64:100–131

    Google Scholar 

  48. Zhao, W., Wang, Z., Lu, C., 2016. Fault diagnosis for centrifugal pumps using deep learning and softmax regression, In: the 12th world congress on intelligent control and automation (WCICA).

    Google Scholar 

  49. Feng Y, Lu B, Zhang D (2015) Fault feature extraction for rolling bearing based on dual impulse Morlet Wavelet, In: ASME. International design engineering technical conferences and computers and information in engineering conference, V008T13A064

Download references

Funding

Mingxuan Liang acknowledges the supports by the National Natural Science Foundation of China under Grant 51705494 and the Natural Science Foundation of Zhejiang Province, China, under Grant LQ17E050005. Pei Cao and J. Tang acknowledge the support by the National Science Foundation, USA, under Grant 1741171.

Author information

Authors and Affiliations

  1. College of Mechanical and Electrical Engineering, China Jiliang University, Hangzhou, 310018, China

    Mingxuan Liang

  2. Department of Mechanical Engineering, University of Connecticut, Storrs, CT, 06269, USA

    Pei Cao & J. Tang

Authors
  1. Mingxuan Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pei Cao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. J. Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Mingxuan Liang, Pei Cao, and Jiong Tang worked together to generate the conception of the work. Mingxuan Liang carried out algorithm development and data analysis and interpretation, and played the lead role in drafting the paper with Pei Cao’s support. Jiong Tang provided advisement to Mingxuan Liang and Pei Cao, and also provided critical revision of the paper.

Corresponding author

Correspondence to J. Tang.

Ethics declarations

Conflict of interest

The authors declare they have no conflict of interest.

Ethical approval

Not applicable.

Consent to participate

Not applicable.

Consent to publication

Not applicable.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liang, M., Cao, P. & Tang, J. Rolling bearing fault diagnosis based on feature fusion with parallel convolutional neural network. Int J Adv Manuf Technol 112, 819–831 (2021). https://doi.org/10.1007/s00170-020-06401-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-020-06401-8

Keywords

Search

Navigation