Skip to main content
SpringerLink
Log in

Optimal transport strategy-based meta-attention network for fault diagnosis of rotating machinery with zero sample

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Deep learning-based methods are widely applied to fault diagnostics, which depend on adequate samples. However, fault samples are often limited and even not available in industrial applications. To solve this problem, an optimal transport strategy-based meta-attention network (OTS-MAN) is proposed for the fault diagnosis by exploiting the fault knowledge learned from few source domains to diagnose the target domain with zero sample. Firstly, a new meta-attention network is built to mine discriminative features of each class from the source domain. Then, an optimal transport strategy is designed to align the feature distribution of each category between known fault in the source domain and unknown fault in the target domain. Finally, the similarity scores are obtained to assess the health status of the target domain. The proposed OTS-MAN is trained only with known source domain data and can diagnose unknown faults without previous access to target domain data. The validity of the proposed method is implemented through using two cases. The results indicate that the OTS-MAN has a better fault diagnosis accuracy than existing methods, and its noise immunity is also improved.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Data availability

The data analyzed in this study is partly from https://ti.arc.nasa.gov/tech/dash/groups/pcoe/prognostic-data-repository/ and partly available on request from the corresponding author upon reasonable request.

References

  1. Xing ZY, Zhao RZ, Wu YC, He TJ (2022) Intelligent fault diagnosis of rolling bearing based on novel CNN model considering data imbalance. Appl Intell 52:16281–16293

    Article  Google Scholar 

  2. Hou YD, Ma JL, Wang JJ, Li TZ, Chen ZQ (2023) Enhanced generative adversarial networks for bearing imbalanced fault diagnosis of rotating machinery. Appl Intell 53(21):25201–15

    Article  Google Scholar 

  3. Meng Z, He HH, Cao W, Li JM, Cao LX, Fan JJ, Zhu M, Fan FJ (2023) A novel generation network using feature fusion and guided adversarial learning for fault diagnosis of rotating machinery. Expert Syst Appl 234:121058

    Article  Google Scholar 

  4. Zhang ZQ, Zhou FN, Karimi HR, Fujita H, Hu X, Wen CL, Wang TZ (2023) Attention gate guided multiscale recursive fusion strategy for deep neural network-based fault diagnosis. Eng Appl Artif Intel 126:107052

    Article  Google Scholar 

  5. Lu N, Cui ZY, Hu HY, Yin T (2023) Multi-view and Multi-level network for fault diagnosis accommodating feature transferability. Expert Syst Appl 213:119057

    Article  Google Scholar 

  6. Su J, Song HJ, Song FY (2022) Fault diagnosis of steam power system based on convolutional neural network, Chinese. J Ship Res 17:96–102

    Google Scholar 

  7. Xu J, Zhang H, Zhou L, Fan Y (2023) Zero-Shot Compound Fault Diagnosis Method Based on Semantic Learning and Discriminative Features. IEEE Instrum Meas 72:1–13

    Google Scholar 

  8. Chen ZY, Wu J, Deng C, Wang XQ, Wang YH (2022) Deep Attention Relation Network: A Zero-Shot Learning Method for Bearing Fault Diagnosis Under Unknown Domains. IEEE T Reliab 72(1):79–89

    Article  Google Scholar 

  9. Pan TY, Chen JL, Xie JS, Zhou ZT, He SL (2021) Deep Feature Generating Network: A New Method for Intelligent Fault Detection of Mechanical Systems Under Class Imbalance. IEEE T Ind Inform 17:6282–6293

    Article  Google Scholar 

  10. Xu K, Kong XG, Wang QB, Yang SK, Huang NN, Wang JJ (2022) A bearing fault diagnosis method without fault data in new working condition combined dynamic model with deep learning. Adv Eng Inform 54:101795

    Article  Google Scholar 

  11. Zhou FN, Yang S, Fujita H, Chen DM, Wen CL (2020) Deep learning fault diagnosis method based on global optimization GAN for unbalanced data. Knowl-Based Syst 187:104837

    Article  Google Scholar 

  12. Yu JB, Liu GL (2020) Knowledge extraction and insertion to deep belief network for gearbox fault diagnosis. Knowl-Based Syst 197:105883

    Article  Google Scholar 

  13. Gao DW, Zhu YS, Ren ZJ, Yan K, Kang W (2021) A novel weak fault diagnosis method for rolling bearings based on LSTM considering quasi-periodicity. Knowl-Based Syst 231:107413

    Article  Google Scholar 

  14. Wu YC, Zhao RZ, Jin WY, He TJ, Ma SC, Shi MK (2021) Intelligent fault diagnosis of rolling bearings using a semi-supervised convolutional neural network. Appl Intell 51:2144–2160

    Article  Google Scholar 

  15. Chen ZY, Wu J, Deng C, Wang C, Wang YH (2022) Residual deep subdomain adaptation network: A new method for intelligent fault diagnosis of bearings across multiple domains. Mech Mach Theory 169:104635

    Article  Google Scholar 

  16. Liu JF, Yu X, Wan HB (2022) Rolling bearing fault diagnosis method based on modified fourier mode decomposition and band entropy. Chin J Ship Res 17:190–197

    Google Scholar 

  17. Zheng M, Zhi K, Zeng J, Tian C, You L (2022) A hybrid CNN for image denoising. J Artificial Intell Technol 2:93–99

    Google Scholar 

  18. Zhou F, Liu S, Fujita H, Hu X, Zhang Y, Wang B, Wang K (2024) Fault diagnosis based on federated learning driven by dynamic expansion for model layers of imbalanced client. Expert Syst Appl 238:121982

    Article  Google Scholar 

  19. Zhang HD, Yuan X, Li DY, You J, Liu B, Zhao XM, Cai WM, Ju S (2022) An effective framework using identification and image reconstruction algorithm for train component defect detection. Appl Intell 52:10116–10134

    Article  Google Scholar 

  20. Fan WT, Huang HY, Liang C, Liu X, Peng SJ (2023) Unsupervised meta-learning via spherical latent representations and dual VAE-GAN. Appl Intell 53(19):22775–88

    Article  Google Scholar 

  21. Wang X, Jiang HK, Liu YP, Yang Q (2023) Data-augmented patch variational autoencoding generative adversarial networks for rolling bearing fault diagnosis. Meas Sci Technol 34(5):055102

    Article  Google Scholar 

  22. Yang S, Zhou YF, Chen X, Deng CY, Li C (2023) Fault diagnosis of wind turbines with generative adversarial network-based oversampling method. Meas Sci Technol 34(4):044004

    Article  Google Scholar 

  23. Hu WY, Wang TY, Chu FL (2023) A Wasserstein generative digital twin model in health monitoring of rotating machines. Comput Ind 145:103807

    Article  Google Scholar 

  24. Su CW, Wang XR, Liu RJ, Guo ZY, Sang ST, Yu S, Zhang HF (2023) Fault diagnosis method based on triple generative adversarial nets for imbalanced data. Meas Sci Technol 34(3):035007

    Article  Google Scholar 

  25. Cabrera D, Villacis M, Cerrada M, Sanchez RV, Li C, Sancho F, Long JY, Estupinan E (2022) Adversarial Fault Detector Guided by One-Class Learning for a Multistage Centrifugal Pump, IEEE-Asme T Mech

    Google Scholar 

  26. Shang ZW, Zhang J, Li WX, Qian SQ, Liu JY, Gao MS (2023) A Novel Small Samples Fault Diagnosis Method Based on the Self-attention Wasserstein Generative Adversarial Network, Neural Process Lett

    Google Scholar 

  27. Tang Z, Bo L, Liu XF, Wei DP (2022) A semi-supervised transferable LSTM with feature evaluation for fault diagnosis of rotating machinery. Appl Intell 52:1703–1717

    Article  Google Scholar 

  28. Xue XA, Zhao XP, Zhang YH, Ma MY, Bu C, Peng P (2024) Federated transfer learning with consensus knowledge distillation for intelligent fault diagnosis under data privacy preserving. Meas Sci Technol 35(1):015108

    Article  Google Scholar 

  29. Tan HC, Xie SC, Ma W, Yang CX, Zheng SW (2023) Correlation feature distribution matching for fault diagnosis of machines. Reliab Eng Syst Safe 231:108981

    Article  Google Scholar 

  30. Mao WT, Wang GS, Kou LL, Liang XH (2023) Deep Domain-Adversarial Anomaly Detection With One-Class Transfer Learning. IEEE-Caa J Automatic 10:524–546

    Article  Google Scholar 

  31. Tian Y, Wang YW, Peng X, Zhang W (2023) A fault diagnosis method for few-shot industrial processes based on semantic segmentation and hybrid domain transfer learning. Appl Intell 53(23):28268–90

    Article  Google Scholar 

  32. An YY, Zhang K, Chai Y, Liu Q, Huang XH (2023) Domain adaptation network base on contrastive learning for bearings fault diagnosis under variable working conditions. Expert Syst Appl 212:118802

    Article  Google Scholar 

  33. Wang QB, Xu YB, Yang SK, Chang JT, Zhang JG, Kong XG (2023) A domain adaptation method for bearing fault diagnosis using multiple incomplete source data. J Intell Manuf

  34. Su ZH, Zhang JY, Tang JX, Wang YX, Xu HB, Zou JX, Fan SC (2023) A novel deep transfer learning method with inter-domain decision discrepancy minimization for intelligent fault diagnosis. Knowl-Based Syst 259:110065

    Article  Google Scholar 

  35. Li CJ, Li SB, Wang H, Gu FS, Ball AD (2023) Attention-based deep meta-transfer learning for few-shot fine-grained fault diagnosis. Knowl-Based Syst 264:110345

    Article  Google Scholar 

  36. Luo SY, Huang XF, Wang YZ, Luo RM, Zhou Q (2022) Transfer learning based on improved stacked autoencoder for bearing fault diagnosis. Knowl-Based Syst 256:109846

    Article  Google Scholar 

  37. Ren C, Jiang B, Lu NY, Simani S, Gao FR (2023) Meta-Learning With Distributional Similarity Preference for Few-Shot Fault Diagnosis Under Varying Working Conditions. IEEE T Cybernetics

  38. Yang J, Wang XM (2024) Meta-learning with deep flow kernel network for few shot cross-domain remaining useful life prediction. Reliab Eng Syst Safe 244:109928

    Article  Google Scholar 

  39. Wu K, Nie YK, Wu J, Wang YH (2023) Prior knowledge-based self-supervised learning for intelligent bearing fault diagnosis with few fault samples. Meas Sci Technol 34(10):105104

    Article  Google Scholar 

  40. Long JY, Zhang RX, Chen YB, Zhao R, Yang Z, Huang YW, Li C (2023) A Customized Meta-Learning Framework for Diagnosing New Faults From Unseen Working Conditions With Few Labeled Data. IEEE-Asme T Mech

  41. Zhang T, Jiao JY, Lin J, Li H, Hua JD, He D (2022) Uncertainty-based contrastive prototype-matching network towards cross-domain fault diagnosis with small data. Knowl-Based Syst 254:109651

    Article  Google Scholar 

  42. Ma RY, Han T, Lei WX (2023) Cross-domain meta learning fault diagnosis based on multi-scale dilated convolution and adaptive relation module. Knowl-Based Syst 261:110175

    Article  Google Scholar 

  43. Zheng XQ, Yue CY, Wei J, Xue AK, Ge M, Kong YG (2023) Few-shot intelligent fault diagnosis based on an improved meta-relation network. Appl Intell 53(24):30080–96

    Article  Google Scholar 

  44. Ma L, Jiang B, Xiao L, Lu N (2023) Digital twin-assisted enhanced meta-transfer learning for rolling bearing fault diagnosis. Mech Syst Signal Pr 200:110490

    Article  Google Scholar 

  45. Fan C, Zhang Y, Ma H, Ma Z, Yu K, Zhao S, Zhang X (2024) A novel metric-based model with the ability of zero-shot learning for intelligent fault diagnosis. Eng Appl Artif Intel 129:107605

    Article  Google Scholar 

  46. Chen ZY, Li ZR, Wu J, Deng C, Dai W (2022) Deep residual shrinkage relation network for anomaly detection of rotating machines. J Manuf Syst 65:579–590

    Article  Google Scholar 

  47. Pan XR, Ge CJ, Lu R, Song SJ, Chen GF, Huang ZY, Huang G (2022) On the integration of self-attention and convolution. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 815–825

  48. Cuturi M (2013) Sinkhorn distances: Lightspeed computation of optimal transport. Adv Neural Inf Process Syst 26:2292–2300

    Google Scholar 

  49. Yang B, Lei YG, Xu SC, Lee CG (2022) An Optimal Transport-Embedded Similarity Measure for Diagnostic Knowledge Transferability Analytics Across Machines. IEEE T Ind Electron 69:7372–7382

    Article  Google Scholar 

  50. Gousseau W, Antoni J, Girardin F, Griffaton J (2016) Analysis of the Rolling Element Bearing data set of the Center for Intelligent Maintenance Systems of the University of Cincinnati

    Google Scholar 

  51. Smith WA, Randall RB (2015) Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study. Mech Syst Signal Pr 64–65:100–131

    Article  Google Scholar 

  52. He KM, Zhang XY, Ren SQ, Sun J (2016) Ieee, Deep Residual Learning for Image Recognition, CVPR 2016. pp. 770–778

  53. Chen ZY, Wang C, Wu J, Deng C, Wang YH (2022) Deep convolutional transfer learning-based structural damage detection with domain adaptation. Appl Intell 1–15

  54. Wang JH, Zhai YP (2020) Prototypical Siamese Networks for Few-shot Learning. ICEIEC 2020:178–181

    Google Scholar 

  55. Vinyals O, Blundell C, Lillicrap T, Kavukcuoglu K, Wierstra D (2016) Matching Networks for One Shot Learning. Adv Neural Inf Process Syst 29

  56. Chen ZY, Wang YH, Wu J, Deng C, Jiang WX (2022) Wide Residual Relation Network-Based Intelligent Fault Diagnosis of Rotating Machines with Small Samples. Sensors-Basel 22(11):4161

    Article  Google Scholar 

  57. Yang JL, Wang CD, Wei CA (2022) A novel Brownian correlation metric prototypical network for rotating machinery fault diagnosis with few and zero shot learners. Adv Eng Inform 54:101815

    Article  Google Scholar 

  58. Chen ZY, Wu K, Wu J, Deng C, Wang YH (2023) Residual shrinkage transformer relation network for intelligent fault detection of industrial robot with zero-fault samples. Knowl-Based Syst 268:110452

    Article  Google Scholar 

  59. Zhang G, Zeng YJ, Zhang TQ (2023) Second-order coupled tristable stochastic resonance and its application in bearing fault detection under different noises. Nonlinear Dynam 1–23.

Download references

Acknowledgements

This research is supported in part by the National Natural Science Foundation of China under the Grant No. 51875225, and in part by Hubei Provincial Natural Science Foundation for Innovation Groups under Grant No. 2021CFA026.

Author information

Authors and Affiliations

  1. School of Naval Architecture and Ocean Engineering, Huazhong University of Science and Technology, Wuhan, 430074, China

    Ke Wu, Kaiwei Yu, Jun Wu & Yan Liu

  2. China Ship Development and Design Center, Wuhan, 430060, China

    Chong Chen

  3. National Center of Technology Innovation for Intelligent Design and Numerical Control, Wuhan, 430074, China

    Jun Wu

Authors
  1. Ke Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kaiwei Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chong Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jun Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Ke Wu: Writing-Original draft preparation, Methodology, Formal analysis. Kaiwei Yu: Software, Validation, Visualization, Investigation. Chong Chen: Project administration. Jun Wu: Writing-Reviewing and Editing, Conceptualization, Methodology, Supervision, Funding acquisition. Yan Liu: Conceptualization, Methodology.

Corresponding author

Correspondence to Jun Wu.

Ethics declarations

Competing interests

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wu, K., Yu, K., Chen, C. et al. Optimal transport strategy-based meta-attention network for fault diagnosis of rotating machinery with zero sample. Appl Intell (2024). https://doi.org/10.1007/s10489-024-05524-9

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10489-024-05524-9

Keywords

Search

Navigation