Skip to main content
Log in

Semi-supervised multitask deep convolutional generative adversarial network for unbalanced fault diagnosis of rolling bearing

  • Technical Paper
  • Published:
Journal of the Brazilian Society of Mechanical Sciences and Engineering Aims and scope Submit manuscript

Abstract

In the process of data collection of rolling bearing, it is inevitable to get unbalanced data, including unlabeled samples, relatively few fault samples and abundant normal samples. To further improve sample efficiency, this paper proposes semi-supervised multitask deep convolutional generative adversarial network (SM-DCGAN). One-dimensional raw vibration signals are transformed into two-dimensional grayscale images. Different from traditional DCGAN, the proposed SM-DCGAN fuses the tasks of discrimination and classification to form multitask discriminator, which can simultaneously train labeled and unlabeled samples. Subsequently, knowledge distillation method is used to achieve simple fault classifier from multitask discriminator. Then, unbalanced samples can be expanded by generator in SM-DCGAN. Unlabeled samples, labeled samples and expanded samples are input into the simple fault classifier to realize semi-supervised fault diagnosis. The results of rolling bearing fault diagnosis experiments fully prove that the proposed SM-DCGAN has high accuracy, great robustness and sufficient stability for unbalanced fault samples.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Availability of data and materials

Not applicable.

Code availability

Not applicable.

References

  1. Zhang K, Tian W, Chen P, Ma C, Xu Y (2021) Sparsity-guided multi-scale empirical wavelet transform and its application in fault diagnosis of rolling bearings. J Braz Soc Mech Sci Eng 43(8):1–17

    Article  Google Scholar 

  2. Zhu D, Liu G, He W, Yin B (2021) Fault feature extraction of rolling element bearing based on EVMD. J Braz Soc Mech Sci Eng 43(12):1–14

    Article  Google Scholar 

  3. Li Y, Huang X, Zhao C, Ding P (2021) Stochastic fractal search-optimized multi-support vector regression for remaining useful life prediction of bearings. J Braz Soc Mech Sci Eng 43(9):1–18

    Article  Google Scholar 

  4. Wei J, Huang H, Yao L, Hu Y, Fan Q, Huang D (2021) New imbalanced bearing fault diagnosis method based on sample-characteristic oversampling technique (SCOTE) and multi-class LS-SVM. Appl Soft Comput 101:107043

    Article  Google Scholar 

  5. Che C, Wang H, Ni X, Lin R (2020) Hybrid multimodal fusion with deep learning for rolling bearing fault diagnosis. Measurement 173:108655

    Article  Google Scholar 

  6. Park S, Lee S, Park J (2020) Data augmentation method for improving the accuracy of human pose estimation with cropped images. Pattern Recognit Lett 126:244–250

    Article  Google Scholar 

  7. Zhang X, Lu X, Li W, Wang S (2021) Prediction of the remaining useful life of cutting tool using the Hurst exponent and CNN-LSTM. Int J Adv Manuf Technol 112(7):2277–2299

    Article  Google Scholar 

  8. Joel T, Sivakumar R (2018) An extensive review on despeckling of medical ultrasound images using various transformation techniques. Appl Acoust 128:18–27

    Article  Google Scholar 

  9. Zhan M, Huang P, Liu X, Liao G, Zhang Z, Wang Z, Fan H (2020) An ISAR imaging and cross-range scaling method based on phase difference and improved axis rotation transform. Digit Signal Process 104:102798

    Article  Google Scholar 

  10. Bang S, Baek F, Park S, Kim W, Kim H (2020) Image augmentation to improve construction resource detection using generative adversarial networks, cut-and-paste, and image transformation techniques. Autom Constr 115:103198

    Article  Google Scholar 

  11. Liang Y, Huang H, Cai Z, Hao Z, Tan KC (2019) Deep infrared pedestrian classification based on automatic image matting. Appl Soft Comput 77:484–496

    Article  Google Scholar 

  12. Gao R, Qi P, Zhang Z (2021) Performance analysis of spectrum sensing schemes based on energy detector in generalized Gaussian noise. Signal Process 181:107893

    Article  Google Scholar 

  13. Krizhevsky A, Sutskever I, Hinton GE (2017) ImageNet classification with deep convolutional neural networks. Commun ACM 60(6):84–90

    Article  Google Scholar 

  14. Li Y, Wang Q, Zhang J, Hu L, Ouyang W (2021) The theoretical research of generative adversarial networks: an overview. Neurocomputing 435:26–41

    Article  Google Scholar 

  15. Zhou D, Huang D, Hao J, Ren Y, Jiang P, Jia X (2020) Vibration-based fault diagnosis of the natural gas compressor using adaptive stochastic resonance realized by Generative Adversarial Networks. Eng Fail Anal 116:104759

    Article  Google Scholar 

  16. Zhou F, Yang S, Fujiata H, Chen D, Wen C (2020) Deep learning fault diagnosis method based on global optimization GAN for unbalanced data. Knowl-Based Syst 187:104837

    Article  Google Scholar 

  17. Wang Y, Sun G, Jin Q (2020) Imbalanced sample fault diagnosis of rotating machinery using conditional variational auto-encoder generative adversarial network. Appl Soft Comput 92:106333

    Article  Google Scholar 

  18. Zhao B, Yuan Q (2021) Improved generative adversarial network for vibration-based fault diagnosis with imbalanced data. Measurement 169:108522

    Article  Google Scholar 

  19. Yu K, Lin TR, Ma H, Li X, Li X (2021) A multi-stage semi-supervised learning approach for intelligent fault diagnosis of rolling bearing using data augmentation and metric learning. Mech Syst Signal Process 146:107043

    Article  Google Scholar 

  20. Liu L, Wang L, Hu B, Qiong Q, Wen J, Rosenblum DS (2018) Learning structures of interval-based Bayesian networks in probabilistic generative model for human complex activity recognition. Pattern Recognit 81:545–561

    Article  Google Scholar 

  21. Wang B, Gu T, Lu Y, Yang B (2020) Prediction of energies for reaction intermediates and transition states on catalyst surfaces using graph-based machine learning models. Mol Catal 498:111266

    Article  Google Scholar 

  22. Xie X, Sun S (2020) General multi-view semi-supervised least squares support vector machines with multi-manifold regularization. Inf Fusion 62:63–72

    Article  Google Scholar 

  23. Zhang L, Yang L, Ma T, Shen F, Shen F, Cai Y, Zhou C (2021) A self-training semi-supervised machine learning method for predictive mapping of soil classes with limited sample data. Geoderma 384:114809

    Article  Google Scholar 

  24. Gu X (2020) A self-training hierarchical prototype-based approach for semi-supervised classification. Inf Sci 535:204–224

    Article  MathSciNet  Google Scholar 

  25. Pan T, Chen J, Xie J, Chang Y, Zhou Z (2020) Intelligent fault identification for industrial automation system via multi-scale convolutional generative adversarial network with partially labeled samples. ISA Trans 101:379–389

    Article  Google Scholar 

  26. Zhang L, Wei H, Lyu Z, Wei H, Li P (2021) A small-sample faulty line detection method based on generative adversarial networks. Expert Syst Appl 169:114378

    Article  Google Scholar 

  27. Cheng M, Fang F, Pain CC, Navon IM (2020) Data-driven modelling of nonlinear spatio-temporal fluid flows using a deep convolutional generative adversarial network. Comput Methods Appl Mech Eng 365:113000

    Article  MathSciNet  Google Scholar 

  28. Salimans T, Goodfellow I, Zaremba W, Cheung V, Radford A, Chen X (2016) Improved techniques for training GANs. In Proceedings of the 30th international conference on neural information processing systems, 2016, pp 2234–2242

  29. Wang Z, Du J (2021) Joint architecture and knowledge distillation in CNN for Chinese text recognition. Pattern Recognit 111:107722

    Article  Google Scholar 

  30. Hao H, Tang W, Zhu W, Yang G, Li X, Huang Z, Mao H, Si B (2020) Feasibility study on wheelset fatigue damage with NOFRFs-KL divergence detection method in SIMO. J Sound Vib 483:115447

    Article  Google Scholar 

  31. Pedronette DCG, Latecki LJ (2021) Rank-based self-training for graph convolutional networks. Inf Process Manag 58(2):102443

    Article  Google Scholar 

  32. Che C, Wang H, Ni X, Fu Q (2020) Domain adaptive deep belief network for rolling bearing fault diagnosis. Comput Ind Eng 143:106427

    Article  Google Scholar 

Download references

Funding

This work is financially supported in part by Joint Funds of the National Natural Science Foundation of China (NSFC) under Grant U1833110.

Author information

Authors and Affiliations

Authors

Contributions

CC summarized the existing researches and contributed ideas that apply the intelligent learning to the fault diagnosis and supplied experimental data analysis. HW contributed ideas about data applying and designed the framework of algorithm. RL and XN provided the simulation experimental supports and contributed to the data acquisition and processing.

Corresponding author

Correspondence to Changchang Che.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Consent to participate

All authors participated on the manuscript draft and approved the submission.

Consent for publication

All the authors agreed to publish the manuscript.

Ethics approval

The paper doesn’t involve human subjects. There is no risk of damage to the University’s reputation because of the sensitivity of the chosen topic.

Additional information

Technical Editor: Samuel da Silva.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Che, C., Wang, H., Lin, R. et al. Semi-supervised multitask deep convolutional generative adversarial network for unbalanced fault diagnosis of rolling bearing. J Braz. Soc. Mech. Sci. Eng. 44, 276 (2022). https://doi.org/10.1007/s40430-022-03576-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s40430-022-03576-x

Keywords

Navigation