Skip to main content
Log in

Deep Transfer Learning in Mechanical Intelligent Fault Diagnosis: Application and Challenge

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Mechanical intelligent fault diagnosis is an important method to accurately identify the health status of mechanical equipment and ensure its safe operation. With the advent of the “big data” era, it has become an inevitable tendency to choose different deep network models to improve the ability of data processing and classify faults. Meanwhile, in order to improve the generalization performances of fault diagnosis methods in different diagnosis scenarios, some fault diagnosis algorithms based on deep transfer learning have been developed. This paper introduces the concepts of deep transfer learning and explains the investigation motive. The advent in intelligent fault diagnosis of instances-based deep transfer learning, network-based deep transfer learning, mapping based deep transfer learning and adversarial-based deep transfer learning in recent years are summarized. Finally, we discuss the existing problems and development trend of deep transfer learning for intelligent fault diagnosis. This research has a positive significance for utilising deep transfer learning method in mechanical fault diagnosis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig.4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Lei Y, Jia F, Kong D, Lin J, Xing S (2018) Opportunities and challenges of machinery intelligent fault diagnosis in big data era. J Mech Eng 54(05):94–104

    Article  Google Scholar 

  2. Hoang D, Kang H (2019) A survey on deep learning based bearing fault diagnosis. Neurocomputing 335:327–335

    Article  Google Scholar 

  3. Wang Y, Wang Z (2021) Data-driven model-free adaptive fault-tolerant control for a class of discrete-time systems. IEEE Trans Circuits Syst II: Express Briefs 1–1

  4. Zhang QH, Qin A, Lei S (2015) Vibration sensor based intelligent fault diagnosis system for large machine unit in petrochemical industries. Int J Distrib Sens Netw 13:239405

    Article  Google Scholar 

  5. Sun G, Zhang Q, Shao L (2013) The build of a new non-dimensional indicator for fault diagnosis in rotating machinery. Int J Wirel Mobile Comput 6(3):271–276

    Article  Google Scholar 

  6. Zhang H, Ma J, Li X, Xiao S, Gu F, Ball A (2021) Fluid-asperity interaction induced random vibration of hydrodynamic journal bearings towards early fault diagnosis of abrasive wear. Tribol Int 160:107028

    Article  Google Scholar 

  7. Liu R, Jing L, Meng X, Lyu B (2021) Mixed elastohydrodynamic analysis of a coupled journal-thrust bearing system in a rotary compressor under high ambient pressure. Tribol Int 159:1–18

    Article  Google Scholar 

  8. Zhang X, Liu Z, Wang J, Wang J (2019) Time-frequency analysis for bearing fault diagnosis using multiple q-factor gabor wavelets. ISA Trans 87:225–234

    Article  Google Scholar 

  9. Feng Z, Zhu W, Zhang D (2019) Time-Frequency demodulation analysis via vold-kalman filter for wind turbine planetary gearbox fault diagnosis under nonstationary speeds. Mech Syst Signal Process 128:93–109

    Article  Google Scholar 

  10. Chen X, Feng Z (2019) Time-frequency space vector modulus analysis of motor current for planetary gearbox fault diagnosis under variable speed conditions. Mech Syst Signal Process 121:636–654

    Article  Google Scholar 

  11. Sun R, Yang Z, Chen X, Tian S, Xie Y (2018) Gear fault diagnosis based on the structured sparsity time-frequency analysis. Mech Syst Signal Process 102:346–363

    Article  Google Scholar 

  12. Wang L, Liu Z, Cao H, Zhang X (2020) Subband averaging kurtogram with dual-tree complex wavelet packet transform for rotating machinery fault diagnosis. Mech Syst Signal Process 142:106755

    Article  Google Scholar 

  13. Zhou R, Bao W, Li N, Huang X, Yu D (2010) Mechanical equipment fault diagnosis based on redundant second generation wavelet packet transform. Digital Signal Process 20(1):276–288

    Article  Google Scholar 

  14. Rajeswari C, Sathiyabhama B, Devendiran S (2014) Bearing fault diagnosis using wavelet packet transform, hybrid pso and support vector machine. Procedia Eng 97:1772–1783

    Article  Google Scholar 

  15. Qu J, Zhang Z, Gong T (2016) A novel intelligent method for mechanical fault diagnosis based on dual-tree complex wavelet packet transform and multiple classifier fusion. Neurocomputing 171:837–853

    Article  Google Scholar 

  16. Feng Z, Chen X, Liang M (2016) Joint envelope and frequency order spectrum analysis based on iterative generalized demodulation for planetary gearbox fault diagnosis under nonstationary conditions. Mech Syst Signal Process 76–77:242–264

    Article  Google Scholar 

  17. Dibaj A, Hassannejad R, Ettefagh M, Ehghaghi M (2020) Incipient fault diagnosis of bearings based on parameter-optimized VMD and envelope spectrum weighted kurtosis index with a new sensitivity assessment threshold. ISA Trans 114:413–433

    Article  Google Scholar 

  18. Li L, Yao L, Wang H, Gao Z (2021) Iterative learning fault diagnosis and fault tolerant control for stochastic repetitive systems with Brownian motion. ISA Trans

  19. Zhou Y, Yan S, Ren Y, Liu S (2021) Rolling bearing fault diagnosis using transient-extracting transform and linear discriminant analysis. Measurement 178:109298

    Article  Google Scholar 

  20. Chen B, Song D, Zhang W, Cheng Y, Wang Z (2021) A performance enhanced time-varying morphological filtering method for bearing fault diagnosis. Measurement 176:109163

    Article  Google Scholar 

  21. Tiwari P, Upadhyay S (2021) Novel self-adaptive vibration signal analysis: concealed component decomposition and its application in bearing fault diagnosis. J Sound Vib 502:116079

    Article  Google Scholar 

  22. Zhao K, Shao HD (2020) Intelligent fault diagnosis of rolling bearing using adaptive deep gated recurrent unit. Neural Process Lett 51(1):1165–1184

    Article  Google Scholar 

  23. Wang FT, Liu XF, Deng G, Yu XG, Li HK (2019) Remaining life prediction method for rolling bearing based on the long short-term memory network. Neural Process Lett 50:2437–2454

    Article  Google Scholar 

  24. Pandey SK, Janghel RR (2019) Recent deep learning techniques, challenges and its applications for medical healthcare system: a review. Neural Process Lett 50:1907–1935

    Article  Google Scholar 

  25. Wen C, Feiya LV (2020) Review on deep learning based fault diagnosis. Acta Electron Sin 42(01):234–248

    Google Scholar 

  26. Tan G, Wang Z (2021) Reachable set estimation of delayed Markovian jump neural networks based on an improved reciprocally convex inequality. IEEE Trans Neural Netw Learn Syst 1–6

  27. Tan G, Wang Z, Shi Z (2021) Proportional-integral state estimator for quaternion-valued neural networks with time-varying delays. IEEE Trans Neural Netw Learn Syst 23:2162–2388

    Google Scholar 

  28. Chen Z, Chen X, José, Li C (2019) Application of deep learning in equipment prognostics and health management. Acta Instrum Sin 40(09):206–226

    Google Scholar 

  29. Weiss K, Khoshgoftaar T, Wang D (2016) A survey of transfer learning. J Big Data 3(1):1–40

    Article  Google Scholar 

  30. Li C, Zhang S, Qin Y, Estupinan E (2020) A systematic review of deep transfer learning for machinery fault diagnosis. Neurocomputing 407:121–135

    Article  Google Scholar 

  31. Zhang T, Chen J, Li F (2021) Intelligent fault diagnosis of machines with small & imbalanced data: A state-of-the-art review and possible extensions. ISA Trans 119:152–171

    Article  Google Scholar 

  32. Lei Y, Yang B, Jiang X (2020) Applications of machine learning to machine fault diagnosis: a review and roadmap. Mech Syst Signal Process 138:106587

    Article  Google Scholar 

  33. Zhuang F, Luo P, Qing H, Shi Z (2015) Survey on transfer learning research. Acta Softw Sin 26(01):26–39

    MathSciNet  Google Scholar 

  34. Zhuang F, Qi Z, Duan K (2020) A comprehensive survey on transfer learning. Proc IEEE 99:1–34

    Google Scholar 

  35. Mao W, Feng W (2021) A new deep auto-encoder method with fusing discriminant information for bearing fault diagnosis. Mech Syst Signal Process 150(12):107233

    Article  Google Scholar 

  36. Li X, Jiang H, Niu M (2020) An enhanced selective ensemble deep learning method for rolling bearing fault diagnosis with beetle antennae search algorithm. Mech Syst Signal Process 142:106752

    Article  Google Scholar 

  37. Zhao M, Kang M, Tang B (2018) Deep residual networks with dynamically weighted wavelet coefficients for fault diagnosis of planetary gearboxes. IEEE Trans Ind Electron 65(5):4290–4300

    Article  Google Scholar 

  38. Cococcioni M, Lazzerini B, Volpi S (2013) Robust diagnosis of rolling element bearings based on classification techniques. IEEE Trans Ind Inf 9(4):2256–2263

    Article  Google Scholar 

  39. Xia S, Chen B, Wang G (2021) mCRF and mRD: two classification methods cased on a novel multiclass label noise filtering learning framework. IEEE Trans Neural Netw Learn Syst 99:1–15

    Google Scholar 

  40. Wang Z, Huang H, Wang Y (2020) Fault diagnosis of planetary gearbox using multi-criteria feature selection and heterogeneous ensemble learning classification. Measurement 173(5):108654

    Google Scholar 

  41. Xia S, Wang G, Chen Z, Duan Y, Liu Q (2018) Complete random forest based class noise filtering learning for improving the generalizability of classifiers. IEEE Trans Knowl Data Eng 31:1–1

    Google Scholar 

  42. Qin Y, Wang X, Zou J (2019) The optimized deep belief networks with improved logistic sigmoid units and their application in fault diagnosis for planetary gearboxes of wind turbines. IEEE Trans Ind Electron 66(5):3814–3824

    Article  Google Scholar 

  43. Zuo L, Jing M, Li J (2020) Challenging tough samples in unsupervised domain adaptation. Pattern Recognit 110:107540

    Article  Google Scholar 

  44. Wang CJ, Xu ZL (2021) An intelligent fault diagnosis model based on deep neural network for few-shot fault diagnosis. Neurocomputing 0925-2312

  45. Che CC, Wang HW, Ni XM, Fu Q (2020) Domain adaptive deep belief network for rolling bearing fault diagnosis. Comput Ind Eng 143:106427

    Article  Google Scholar 

  46. Souza RM, Nascimento EG, Miranda UA, Silva WJ, Lepikson HA (2021) Deep learning for diagnosis and classification of faults in industrial rotating machinery. Comput Ind Eng 153:107060

    Article  Google Scholar 

  47. Chen S, Ge H, Li H (2021) Hierarchical deep convolution neural networks based on transfer learning for transformer rectifier unit fault diagnosis. Measurement 167:108257

    Article  Google Scholar 

  48. Li F, Tang TJ, He QY (2021) Deep convolution domain-adversarial transfer learning for fault diagnosis of rolling bearings. Measurement 169:108339

    Article  Google Scholar 

  49. Dai W, Yang Q, Xue G (2007) Boosting for transfer learning. In: Proceedings of the 24th international conference on Machine learning, pp 193–200

  50. Shen F, Chen C, Yan R (2017) Application of SVD and transfer learning strategy on motor fault diagnosis. J Vib Eng 30(01):118–126

    Google Scholar 

  51. Shen F, Chen C, Xu J, Yan R (2019) Application of spectral centroid transfer in bearing fault diagnosis under varying working conditions. Acta Instrum Sin 40(05):99–108

    Google Scholar 

  52. Chen C, Shen F, Yan R (2017) Enhanced least squares support vector machine-based transfer learning strategy for bearing fault diagnosis. Acta Instrum Sin 38(01):33–40

    Google Scholar 

  53. Wu Z, Jiang H, Lu T, Zhao K (2020) A deep transfer maximum classifier discrepancy method for rolling bearing fault diagnosis under few labeled data. Knowl Based Syst 196:105814

    Article  Google Scholar 

  54. Wu K, Jiang H, Zhao K, Li X (2020) An adaptive deep transfer learning method for bearing fault diagnosis. Measurement 151:107227

    Article  Google Scholar 

  55. Qian W, Li S, Jiang X (2019) Deep transfer network for rotating machine fault analysis. Pattern Recognit 96:106993

    Article  Google Scholar 

  56. Qian W, Li S, Yi P, Zhang K (2019) A novel transfer learning method for robust fault diagnosis of rotating machines under variable working conditions. Measurement 138:514–525

    Article  Google Scholar 

  57. Zhang W, Li X, Jia X, Ma H, Luo Z, Li X (2019) Machinery fault diagnosis with imbalanced data using deep generative adversarial networks. Measurement 152:107377

    Article  Google Scholar 

  58. Wang W, Sun C, Wang L, Chen B (2020) Research on Fault diagnosis technology of planetary gearbox using deep learning generative. Mech Sci Technol 39(01):117–123

    Google Scholar 

  59. Wu C, Feng F, Wu S, Chen T, Jiang P (2019) An effective method for imbalanced sample generation and its application in fault diagnosis of planetary gearbox. Acta Ordnance Eng 40(07):1349–1357

    Google Scholar 

  60. Xie P, Zhang Z (2001) A new approach to conform feature samples for fault diagnosis classifiers. Syst Eng Electron 23(11):35–35

    Google Scholar 

  61. Liu R, Yang B, Zio E, Chen X (2018) Artificial intelligence for fault diagnosis of rotating machinery: a review. Mech Syst Signal Process 108:33–47

    Article  Google Scholar 

  62. Wang J, Ma Y, Zhang L, Gao R, Wu D (2018) Deep learning for smart manufacturing: methods and applications. J Manuf Syst 48:144–156

    Article  Google Scholar 

  63. Zhang L, Guo L, Gao H, Dong D, Fu G, Hong X (2020) Instance-based ensemble deep transfer learning network: a new intelligent degradation recognition method and its application on ball screw. Mech Syst Signal Process 140:106681

    Article  Google Scholar 

  64. Murugan K, Kishore G, Inam (2021) Hyperspectral image classification using ensemble transfer learning. J Phys Conf Ser 1916(1):012082

    Article  Google Scholar 

  65. Xia S, Xia Y, Yu H (2019) Transferring ensemble representations using deep convolutional neural networks for small-scale image classification. IEEE Access 7:168175–168186

    Article  Google Scholar 

  66. Wen L, Li X, Li X, Gao L (2019) A new transfer learning based on VGG-19 network for fault diagnosis. In: Proceedings of IEEE 23rd international conference on computer supported cooperative work in design (CSCWD), Porto, Portugal, pp 205–209

  67. Cao P, Zhang S, Tang J (2018) Preprocessing-free gear fault diagnosis using small datasets with deep convolutional neural network-based transfer learning. IEEE Access 6:26241–26253

    Article  Google Scholar 

  68. Zhang R, Tao H, Wu L, Guan Y (2017) Transfer learning with neural networks for bearing fault diagnosis in changing working conditions. IEEE Access 5:14347–14357

    Article  Google Scholar 

  69. Shao S, Stephen M, Yan R (2019) Highly accurate machine fault diagnosis using deep transfer learning. IEEE Trans Ind Inf 15(4):2446–2455

    Article  Google Scholar 

  70. Yu Y, He M, Liu B, Chen C (2019) Research on acoustic emission signal recognition of bearing fault based on TL-LSTM. Chin J Sci Instrum 40(05):51–59

    Google Scholar 

  71. Sun M, Wang H, Liu P, Huang S, Fan P (2019) A sparse stacked denoising autoencoder with optimized transfer learning applied to the fault diagnosis of rolling bearings. Measurement 146:305–314

    Article  Google Scholar 

  72. Ren J, Hu X, Zhu F (2017) Effectiveness prediction of weapon equipment system-of-systems based on deep learning feature transfer. Syst Eng Electron Technol 39(12):2745–2749

    Google Scholar 

  73. He Z, Shao H, Zhong X, Yang Y, Cheng J (2020) An intelligent fault diagnosis method for rotor-bearing system using small labeled infrared thermal images and enhanced CNN transferred from CAE. Adv Eng Inform 46:101150

    Article  Google Scholar 

  74. He Z, Shao H, Wang P (2020) Deep transfer multi-wavelet auto-encoder for intelligent fault diagnosis of gearbox with few target training samples. Knowl Based Syst 191:105313

    Article  Google Scholar 

  75. He Z, Shao H, Jing L, Cheng J, Yang Y (2020) Transfer fault diagnosis of bearing installed in different machines using enhanced deep auto-encoder. Measurement 152:107393

    Article  Google Scholar 

  76. Hasan M, Islam M, Kim J (2019) Acoustic spectral imaging and transfer learning for reliable bearing fault diagnosis under variable speed conditions. Measurement 138:620–631

    Article  Google Scholar 

  77. Wen L, Gao L, Dong Y, Zhu Z (2019) A negative correlation ensemble transfer learning method for fault diagnosis based on convolutional neural network. Math Bioences Eng 16(5):3311–3330

    Article  MathSciNet  Google Scholar 

  78. Wang M, Deng W (2018) Deep visual domain adaptation: a survey. Neurocomputing 312:135–153

    Article  Google Scholar 

  79. Ghifary M, Kleijn W, Zhang M (2014) Domain adaptive neural networks for object recognition. In: Pacific rim international conference on artificial intelligence. Springer, pp 898–904

  80. Tzeng E, Hoffma J, Zhang N (2014) Deep domain confusion: maximizing for domain invariance. arXiv:1412.3474

  81. Long M, Wang J (2015) Learning transferable features with deep adaptation networks. In: International conference on machine learning (ICML)

  82. Long M, Cao Y, Cao Z, Wang J, Jordan I (2019) Transferable representation learning with deep adaptation Networks. IEEE Trans Pattern Anal Mach Intell 41(12):3071–3085

    Article  Google Scholar 

  83. Long M, Wang J, Cao Y, Sun J, Philip S (2016) Deep learning of transferable representation for scalable domain adaptation. IEEE Trans Knowl Data Eng 28(8):2027–2040

    Article  Google Scholar 

  84. Long M, Wang J, Jordan M (2016) Deep transfer learning with joint adaptation networks. In: ICML, pp 2208–2217

  85. Li J, Li X, He D, Qu Y (2020) A domain adaptation model for early gear pitting fault diagnosis based on deep transfer learning network. Proc Inst Mech Eng Part O J Risk Reliab 234(1):168–182

    Google Scholar 

  86. Guo L, Lei Y, Xing S (2019) Deep convolutional transfer learning network: a new method for intelligent fault diagnosis of machines with unlabeled data. IEEE Trans Ind Electron 66(9):7316–7325

    Article  Google Scholar 

  87. Ainapure A, Li X, Singh J (2020) Enhancing intelligent cross-domain fault diagnosis performance on rotating machines with noisy health labels. Procedia Manuf 48:940–946

    Article  Google Scholar 

  88. Yang B, Lei Y, Jia F, Xing S (2019) An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings. Mech Syst Signal Process 122:692–706

    Article  Google Scholar 

  89. Xiao D, Huang Y, Zhao L (2019) Domain adaptive motor fault diagnosis using deep transfer learning. IEEE Access 7:80937–80949

    Article  Google Scholar 

  90. Xu J, Huang J, Zhao Y, Zhou L (2020) A robust intelligent fault diagnosis method for rolling bearings based on deep convolutional neural network and domain adaptation. Procedia Comput Sci 174:400–405

    Article  Google Scholar 

  91. Wang J, Xie J, Zhang L (2016) A factor analysis based transfer learning method for gearbox diagnosis under various operating conditions. In: International symposium on flexible automation. IEEE, pp 81–86

  92. Wang X, Shen C, Xia M (2020) Multi-scale deep intra-class transfer learning for bearing fault diagnosis. Reliab Eng Syst Saf 202:107050

    Article  Google Scholar 

  93. Xu K, Li S, Wang J (2019) A novel convolutional transfer feature discrimination network for imbalanced fault diagnosis under variable rotational speed. Meas Sci Technol 30(10):105107

    Article  Google Scholar 

  94. Sun C, Ma M, Zhao Z (2018) Deep transfer learning based on sparse auto-encoder for remaining useful life prediction of tool in manufacturing. IEEE Trans Ind Inf 15(4):2416–2425

    Article  Google Scholar 

  95. Li W, Liang Y (2020) Deep transfer learning based diagnosis for machining process lifecycle. Procedia CIRP 90:642–647

    Article  Google Scholar 

  96. Lu W, Liang B, Cheng Y (2017) Deep model based domain adaptation for fault diagnosis. IEEE Trans Ind Electron 64(99):2296–2305

    Article  Google Scholar 

  97. Han T, Liu CM, Yang W (2020) Deep transfer network with joint distribution adaptation: a new intelligent fault diagnosis framework for industry application. ISA Trans 97:269–281

    Article  Google Scholar 

  98. Liu SW, Jiang HK, Wu ZH, Li XQ (2021) Rolling bearing fault diagnosis using variational autoencoding generative adversarial networks with deep regret analysis. Measurement 168:108371

    Article  Google Scholar 

  99. Ganin Y, Ustinova E, Ajakan H (2017) Domain-adversarial training of neural networks. J Mach Learn Res 17(1):189–209

    MathSciNet  MATH  Google Scholar 

  100. Jin Y, Liu X, Yao M, Huang F (2019) Fault diagnosis model of rolling bearing under variable condition based on domain adversarial migration. Process Autom Instrum 40(12):55–60

    Google Scholar 

  101. Li Q, Shen CQ, Chen L, Zhu ZK (2021) Knowledge mapping-based adversarial domain adaptation: a novel fault diagnosis method with high generalizability under variable working conditions. Mech Syst Signal Process 147:107095

    Article  Google Scholar 

  102. Li X, Zhang W, Ma H, Luo Z, Li X (2020) Partial transfer learning in machinery cross-domain fault diagnostics using class-weighted adversarial networks. Neural Netw 129:313–322

    Article  Google Scholar 

  103. Jiao J, Zhao M, Lin J, Liang K (2020) Residual joint adaptation adversarial network for intelligent transfer fault diagnosis. Mech Syst Signal Process 145:106962

    Article  Google Scholar 

  104. Li J, Huang R, Li W (2020) Intelligent fault diagnosis for bearing dataset using adversarial transfer learning based on stacked auto-encoder. Procedia Manuf 49:75–80

    Article  Google Scholar 

  105. Jiao J, Lin J, Zhao M, Liang K (2020) Double-level adversarial domain adaptation network for intelligent fault diagnosis. Knowl Based Syst 205:106236

    Article  Google Scholar 

  106. Chen Z, Bei Y, Rudin C (2020) Concept whitening for interpretable image recognition. Nat Mach Intell 2(12):772–782

    Article  Google Scholar 

  107. Dai D, Tang C, Wang G, Xia S (2021) Building partially understandable convolutional neural networks by differentiating class-related neural nodes. Neurocomputing 452:169–181

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by the National Natural Science Foundation of China (Grant No. 51975394), the Natural Science Foundation of Jiangsu Province (No. BK20211336) and Postgraduate Research & Practice Innovation Program of Jiangsu Province (Grant No. KYCX20_2752). The author would appreciate the anonymous reviewers and the editor for their valuable comments.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Quansheng Jiang or Qingkui Zhang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Qian, C., Zhu, J., Shen, Y. et al. Deep Transfer Learning in Mechanical Intelligent Fault Diagnosis: Application and Challenge. Neural Process Lett 54, 2509–2531 (2022). https://doi.org/10.1007/s11063-021-10719-z

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-021-10719-z

Keywords

Navigation