Abstract
Mechanical intelligent fault diagnosis is an important method to accurately identify the health status of mechanical equipment and ensure its safe operation. With the advent of the “big data” era, it has become an inevitable tendency to choose different deep network models to improve the ability of data processing and classify faults. Meanwhile, in order to improve the generalization performances of fault diagnosis methods in different diagnosis scenarios, some fault diagnosis algorithms based on deep transfer learning have been developed. This paper introduces the concepts of deep transfer learning and explains the investigation motive. The advent in intelligent fault diagnosis of instances-based deep transfer learning, network-based deep transfer learning, mapping based deep transfer learning and adversarial-based deep transfer learning in recent years are summarized. Finally, we discuss the existing problems and development trend of deep transfer learning for intelligent fault diagnosis. This research has a positive significance for utilising deep transfer learning method in mechanical fault diagnosis.
Similar content being viewed by others
References
Lei Y, Jia F, Kong D, Lin J, Xing S (2018) Opportunities and challenges of machinery intelligent fault diagnosis in big data era. J Mech Eng 54(05):94–104
Hoang D, Kang H (2019) A survey on deep learning based bearing fault diagnosis. Neurocomputing 335:327–335
Wang Y, Wang Z (2021) Data-driven model-free adaptive fault-tolerant control for a class of discrete-time systems. IEEE Trans Circuits Syst II: Express Briefs 1–1
Zhang QH, Qin A, Lei S (2015) Vibration sensor based intelligent fault diagnosis system for large machine unit in petrochemical industries. Int J Distrib Sens Netw 13:239405
Sun G, Zhang Q, Shao L (2013) The build of a new non-dimensional indicator for fault diagnosis in rotating machinery. Int J Wirel Mobile Comput 6(3):271–276
Zhang H, Ma J, Li X, Xiao S, Gu F, Ball A (2021) Fluid-asperity interaction induced random vibration of hydrodynamic journal bearings towards early fault diagnosis of abrasive wear. Tribol Int 160:107028
Liu R, Jing L, Meng X, Lyu B (2021) Mixed elastohydrodynamic analysis of a coupled journal-thrust bearing system in a rotary compressor under high ambient pressure. Tribol Int 159:1–18
Zhang X, Liu Z, Wang J, Wang J (2019) Time-frequency analysis for bearing fault diagnosis using multiple q-factor gabor wavelets. ISA Trans 87:225–234
Feng Z, Zhu W, Zhang D (2019) Time-Frequency demodulation analysis via vold-kalman filter for wind turbine planetary gearbox fault diagnosis under nonstationary speeds. Mech Syst Signal Process 128:93–109
Chen X, Feng Z (2019) Time-frequency space vector modulus analysis of motor current for planetary gearbox fault diagnosis under variable speed conditions. Mech Syst Signal Process 121:636–654
Sun R, Yang Z, Chen X, Tian S, Xie Y (2018) Gear fault diagnosis based on the structured sparsity time-frequency analysis. Mech Syst Signal Process 102:346–363
Wang L, Liu Z, Cao H, Zhang X (2020) Subband averaging kurtogram with dual-tree complex wavelet packet transform for rotating machinery fault diagnosis. Mech Syst Signal Process 142:106755
Zhou R, Bao W, Li N, Huang X, Yu D (2010) Mechanical equipment fault diagnosis based on redundant second generation wavelet packet transform. Digital Signal Process 20(1):276–288
Rajeswari C, Sathiyabhama B, Devendiran S (2014) Bearing fault diagnosis using wavelet packet transform, hybrid pso and support vector machine. Procedia Eng 97:1772–1783
Qu J, Zhang Z, Gong T (2016) A novel intelligent method for mechanical fault diagnosis based on dual-tree complex wavelet packet transform and multiple classifier fusion. Neurocomputing 171:837–853
Feng Z, Chen X, Liang M (2016) Joint envelope and frequency order spectrum analysis based on iterative generalized demodulation for planetary gearbox fault diagnosis under nonstationary conditions. Mech Syst Signal Process 76–77:242–264
Dibaj A, Hassannejad R, Ettefagh M, Ehghaghi M (2020) Incipient fault diagnosis of bearings based on parameter-optimized VMD and envelope spectrum weighted kurtosis index with a new sensitivity assessment threshold. ISA Trans 114:413–433
Li L, Yao L, Wang H, Gao Z (2021) Iterative learning fault diagnosis and fault tolerant control for stochastic repetitive systems with Brownian motion. ISA Trans
Zhou Y, Yan S, Ren Y, Liu S (2021) Rolling bearing fault diagnosis using transient-extracting transform and linear discriminant analysis. Measurement 178:109298
Chen B, Song D, Zhang W, Cheng Y, Wang Z (2021) A performance enhanced time-varying morphological filtering method for bearing fault diagnosis. Measurement 176:109163
Tiwari P, Upadhyay S (2021) Novel self-adaptive vibration signal analysis: concealed component decomposition and its application in bearing fault diagnosis. J Sound Vib 502:116079
Zhao K, Shao HD (2020) Intelligent fault diagnosis of rolling bearing using adaptive deep gated recurrent unit. Neural Process Lett 51(1):1165–1184
Wang FT, Liu XF, Deng G, Yu XG, Li HK (2019) Remaining life prediction method for rolling bearing based on the long short-term memory network. Neural Process Lett 50:2437–2454
Pandey SK, Janghel RR (2019) Recent deep learning techniques, challenges and its applications for medical healthcare system: a review. Neural Process Lett 50:1907–1935
Wen C, Feiya LV (2020) Review on deep learning based fault diagnosis. Acta Electron Sin 42(01):234–248
Tan G, Wang Z (2021) Reachable set estimation of delayed Markovian jump neural networks based on an improved reciprocally convex inequality. IEEE Trans Neural Netw Learn Syst 1–6
Tan G, Wang Z, Shi Z (2021) Proportional-integral state estimator for quaternion-valued neural networks with time-varying delays. IEEE Trans Neural Netw Learn Syst 23:2162–2388
Chen Z, Chen X, José, Li C (2019) Application of deep learning in equipment prognostics and health management. Acta Instrum Sin 40(09):206–226
Weiss K, Khoshgoftaar T, Wang D (2016) A survey of transfer learning. J Big Data 3(1):1–40
Li C, Zhang S, Qin Y, Estupinan E (2020) A systematic review of deep transfer learning for machinery fault diagnosis. Neurocomputing 407:121–135
Zhang T, Chen J, Li F (2021) Intelligent fault diagnosis of machines with small & imbalanced data: A state-of-the-art review and possible extensions. ISA Trans 119:152–171
Lei Y, Yang B, Jiang X (2020) Applications of machine learning to machine fault diagnosis: a review and roadmap. Mech Syst Signal Process 138:106587
Zhuang F, Luo P, Qing H, Shi Z (2015) Survey on transfer learning research. Acta Softw Sin 26(01):26–39
Zhuang F, Qi Z, Duan K (2020) A comprehensive survey on transfer learning. Proc IEEE 99:1–34
Mao W, Feng W (2021) A new deep auto-encoder method with fusing discriminant information for bearing fault diagnosis. Mech Syst Signal Process 150(12):107233
Li X, Jiang H, Niu M (2020) An enhanced selective ensemble deep learning method for rolling bearing fault diagnosis with beetle antennae search algorithm. Mech Syst Signal Process 142:106752
Zhao M, Kang M, Tang B (2018) Deep residual networks with dynamically weighted wavelet coefficients for fault diagnosis of planetary gearboxes. IEEE Trans Ind Electron 65(5):4290–4300
Cococcioni M, Lazzerini B, Volpi S (2013) Robust diagnosis of rolling element bearings based on classification techniques. IEEE Trans Ind Inf 9(4):2256–2263
Xia S, Chen B, Wang G (2021) mCRF and mRD: two classification methods cased on a novel multiclass label noise filtering learning framework. IEEE Trans Neural Netw Learn Syst 99:1–15
Wang Z, Huang H, Wang Y (2020) Fault diagnosis of planetary gearbox using multi-criteria feature selection and heterogeneous ensemble learning classification. Measurement 173(5):108654
Xia S, Wang G, Chen Z, Duan Y, Liu Q (2018) Complete random forest based class noise filtering learning for improving the generalizability of classifiers. IEEE Trans Knowl Data Eng 31:1–1
Qin Y, Wang X, Zou J (2019) The optimized deep belief networks with improved logistic sigmoid units and their application in fault diagnosis for planetary gearboxes of wind turbines. IEEE Trans Ind Electron 66(5):3814–3824
Zuo L, Jing M, Li J (2020) Challenging tough samples in unsupervised domain adaptation. Pattern Recognit 110:107540
Wang CJ, Xu ZL (2021) An intelligent fault diagnosis model based on deep neural network for few-shot fault diagnosis. Neurocomputing 0925-2312
Che CC, Wang HW, Ni XM, Fu Q (2020) Domain adaptive deep belief network for rolling bearing fault diagnosis. Comput Ind Eng 143:106427
Souza RM, Nascimento EG, Miranda UA, Silva WJ, Lepikson HA (2021) Deep learning for diagnosis and classification of faults in industrial rotating machinery. Comput Ind Eng 153:107060
Chen S, Ge H, Li H (2021) Hierarchical deep convolution neural networks based on transfer learning for transformer rectifier unit fault diagnosis. Measurement 167:108257
Li F, Tang TJ, He QY (2021) Deep convolution domain-adversarial transfer learning for fault diagnosis of rolling bearings. Measurement 169:108339
Dai W, Yang Q, Xue G (2007) Boosting for transfer learning. In: Proceedings of the 24th international conference on Machine learning, pp 193–200
Shen F, Chen C, Yan R (2017) Application of SVD and transfer learning strategy on motor fault diagnosis. J Vib Eng 30(01):118–126
Shen F, Chen C, Xu J, Yan R (2019) Application of spectral centroid transfer in bearing fault diagnosis under varying working conditions. Acta Instrum Sin 40(05):99–108
Chen C, Shen F, Yan R (2017) Enhanced least squares support vector machine-based transfer learning strategy for bearing fault diagnosis. Acta Instrum Sin 38(01):33–40
Wu Z, Jiang H, Lu T, Zhao K (2020) A deep transfer maximum classifier discrepancy method for rolling bearing fault diagnosis under few labeled data. Knowl Based Syst 196:105814
Wu K, Jiang H, Zhao K, Li X (2020) An adaptive deep transfer learning method for bearing fault diagnosis. Measurement 151:107227
Qian W, Li S, Jiang X (2019) Deep transfer network for rotating machine fault analysis. Pattern Recognit 96:106993
Qian W, Li S, Yi P, Zhang K (2019) A novel transfer learning method for robust fault diagnosis of rotating machines under variable working conditions. Measurement 138:514–525
Zhang W, Li X, Jia X, Ma H, Luo Z, Li X (2019) Machinery fault diagnosis with imbalanced data using deep generative adversarial networks. Measurement 152:107377
Wang W, Sun C, Wang L, Chen B (2020) Research on Fault diagnosis technology of planetary gearbox using deep learning generative. Mech Sci Technol 39(01):117–123
Wu C, Feng F, Wu S, Chen T, Jiang P (2019) An effective method for imbalanced sample generation and its application in fault diagnosis of planetary gearbox. Acta Ordnance Eng 40(07):1349–1357
Xie P, Zhang Z (2001) A new approach to conform feature samples for fault diagnosis classifiers. Syst Eng Electron 23(11):35–35
Liu R, Yang B, Zio E, Chen X (2018) Artificial intelligence for fault diagnosis of rotating machinery: a review. Mech Syst Signal Process 108:33–47
Wang J, Ma Y, Zhang L, Gao R, Wu D (2018) Deep learning for smart manufacturing: methods and applications. J Manuf Syst 48:144–156
Zhang L, Guo L, Gao H, Dong D, Fu G, Hong X (2020) Instance-based ensemble deep transfer learning network: a new intelligent degradation recognition method and its application on ball screw. Mech Syst Signal Process 140:106681
Murugan K, Kishore G, Inam (2021) Hyperspectral image classification using ensemble transfer learning. J Phys Conf Ser 1916(1):012082
Xia S, Xia Y, Yu H (2019) Transferring ensemble representations using deep convolutional neural networks for small-scale image classification. IEEE Access 7:168175–168186
Wen L, Li X, Li X, Gao L (2019) A new transfer learning based on VGG-19 network for fault diagnosis. In: Proceedings of IEEE 23rd international conference on computer supported cooperative work in design (CSCWD), Porto, Portugal, pp 205–209
Cao P, Zhang S, Tang J (2018) Preprocessing-free gear fault diagnosis using small datasets with deep convolutional neural network-based transfer learning. IEEE Access 6:26241–26253
Zhang R, Tao H, Wu L, Guan Y (2017) Transfer learning with neural networks for bearing fault diagnosis in changing working conditions. IEEE Access 5:14347–14357
Shao S, Stephen M, Yan R (2019) Highly accurate machine fault diagnosis using deep transfer learning. IEEE Trans Ind Inf 15(4):2446–2455
Yu Y, He M, Liu B, Chen C (2019) Research on acoustic emission signal recognition of bearing fault based on TL-LSTM. Chin J Sci Instrum 40(05):51–59
Sun M, Wang H, Liu P, Huang S, Fan P (2019) A sparse stacked denoising autoencoder with optimized transfer learning applied to the fault diagnosis of rolling bearings. Measurement 146:305–314
Ren J, Hu X, Zhu F (2017) Effectiveness prediction of weapon equipment system-of-systems based on deep learning feature transfer. Syst Eng Electron Technol 39(12):2745–2749
He Z, Shao H, Zhong X, Yang Y, Cheng J (2020) An intelligent fault diagnosis method for rotor-bearing system using small labeled infrared thermal images and enhanced CNN transferred from CAE. Adv Eng Inform 46:101150
He Z, Shao H, Wang P (2020) Deep transfer multi-wavelet auto-encoder for intelligent fault diagnosis of gearbox with few target training samples. Knowl Based Syst 191:105313
He Z, Shao H, Jing L, Cheng J, Yang Y (2020) Transfer fault diagnosis of bearing installed in different machines using enhanced deep auto-encoder. Measurement 152:107393
Hasan M, Islam M, Kim J (2019) Acoustic spectral imaging and transfer learning for reliable bearing fault diagnosis under variable speed conditions. Measurement 138:620–631
Wen L, Gao L, Dong Y, Zhu Z (2019) A negative correlation ensemble transfer learning method for fault diagnosis based on convolutional neural network. Math Bioences Eng 16(5):3311–3330
Wang M, Deng W (2018) Deep visual domain adaptation: a survey. Neurocomputing 312:135–153
Ghifary M, Kleijn W, Zhang M (2014) Domain adaptive neural networks for object recognition. In: Pacific rim international conference on artificial intelligence. Springer, pp 898–904
Tzeng E, Hoffma J, Zhang N (2014) Deep domain confusion: maximizing for domain invariance. arXiv:1412.3474
Long M, Wang J (2015) Learning transferable features with deep adaptation networks. In: International conference on machine learning (ICML)
Long M, Cao Y, Cao Z, Wang J, Jordan I (2019) Transferable representation learning with deep adaptation Networks. IEEE Trans Pattern Anal Mach Intell 41(12):3071–3085
Long M, Wang J, Cao Y, Sun J, Philip S (2016) Deep learning of transferable representation for scalable domain adaptation. IEEE Trans Knowl Data Eng 28(8):2027–2040
Long M, Wang J, Jordan M (2016) Deep transfer learning with joint adaptation networks. In: ICML, pp 2208–2217
Li J, Li X, He D, Qu Y (2020) A domain adaptation model for early gear pitting fault diagnosis based on deep transfer learning network. Proc Inst Mech Eng Part O J Risk Reliab 234(1):168–182
Guo L, Lei Y, Xing S (2019) Deep convolutional transfer learning network: a new method for intelligent fault diagnosis of machines with unlabeled data. IEEE Trans Ind Electron 66(9):7316–7325
Ainapure A, Li X, Singh J (2020) Enhancing intelligent cross-domain fault diagnosis performance on rotating machines with noisy health labels. Procedia Manuf 48:940–946
Yang B, Lei Y, Jia F, Xing S (2019) An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings. Mech Syst Signal Process 122:692–706
Xiao D, Huang Y, Zhao L (2019) Domain adaptive motor fault diagnosis using deep transfer learning. IEEE Access 7:80937–80949
Xu J, Huang J, Zhao Y, Zhou L (2020) A robust intelligent fault diagnosis method for rolling bearings based on deep convolutional neural network and domain adaptation. Procedia Comput Sci 174:400–405
Wang J, Xie J, Zhang L (2016) A factor analysis based transfer learning method for gearbox diagnosis under various operating conditions. In: International symposium on flexible automation. IEEE, pp 81–86
Wang X, Shen C, Xia M (2020) Multi-scale deep intra-class transfer learning for bearing fault diagnosis. Reliab Eng Syst Saf 202:107050
Xu K, Li S, Wang J (2019) A novel convolutional transfer feature discrimination network for imbalanced fault diagnosis under variable rotational speed. Meas Sci Technol 30(10):105107
Sun C, Ma M, Zhao Z (2018) Deep transfer learning based on sparse auto-encoder for remaining useful life prediction of tool in manufacturing. IEEE Trans Ind Inf 15(4):2416–2425
Li W, Liang Y (2020) Deep transfer learning based diagnosis for machining process lifecycle. Procedia CIRP 90:642–647
Lu W, Liang B, Cheng Y (2017) Deep model based domain adaptation for fault diagnosis. IEEE Trans Ind Electron 64(99):2296–2305
Han T, Liu CM, Yang W (2020) Deep transfer network with joint distribution adaptation: a new intelligent fault diagnosis framework for industry application. ISA Trans 97:269–281
Liu SW, Jiang HK, Wu ZH, Li XQ (2021) Rolling bearing fault diagnosis using variational autoencoding generative adversarial networks with deep regret analysis. Measurement 168:108371
Ganin Y, Ustinova E, Ajakan H (2017) Domain-adversarial training of neural networks. J Mach Learn Res 17(1):189–209
Jin Y, Liu X, Yao M, Huang F (2019) Fault diagnosis model of rolling bearing under variable condition based on domain adversarial migration. Process Autom Instrum 40(12):55–60
Li Q, Shen CQ, Chen L, Zhu ZK (2021) Knowledge mapping-based adversarial domain adaptation: a novel fault diagnosis method with high generalizability under variable working conditions. Mech Syst Signal Process 147:107095
Li X, Zhang W, Ma H, Luo Z, Li X (2020) Partial transfer learning in machinery cross-domain fault diagnostics using class-weighted adversarial networks. Neural Netw 129:313–322
Jiao J, Zhao M, Lin J, Liang K (2020) Residual joint adaptation adversarial network for intelligent transfer fault diagnosis. Mech Syst Signal Process 145:106962
Li J, Huang R, Li W (2020) Intelligent fault diagnosis for bearing dataset using adversarial transfer learning based on stacked auto-encoder. Procedia Manuf 49:75–80
Jiao J, Lin J, Zhao M, Liang K (2020) Double-level adversarial domain adaptation network for intelligent fault diagnosis. Knowl Based Syst 205:106236
Chen Z, Bei Y, Rudin C (2020) Concept whitening for interpretable image recognition. Nat Mach Intell 2(12):772–782
Dai D, Tang C, Wang G, Xia S (2021) Building partially understandable convolutional neural networks by differentiating class-related neural nodes. Neurocomputing 452:169–181
Acknowledgements
This research was supported by the National Natural Science Foundation of China (Grant No. 51975394), the Natural Science Foundation of Jiangsu Province (No. BK20211336) and Postgraduate Research & Practice Innovation Program of Jiangsu Province (Grant No. KYCX20_2752). The author would appreciate the anonymous reviewers and the editor for their valuable comments.
Author information
Authors and Affiliations
Corresponding authors
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Qian, C., Zhu, J., Shen, Y. et al. Deep Transfer Learning in Mechanical Intelligent Fault Diagnosis: Application and Challenge. Neural Process Lett 54, 2509–2531 (2022). https://doi.org/10.1007/s11063-021-10719-z
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-021-10719-z