Abstract
Modern machines generally operate under varying working conditions, which induces significant data distribution discrepancies in the gathered condition monitoring signals. However, most of the existing machine learning–based methods, especially deep learning (DL)–based fault prognostic methods, neglect the data distribution discrepancy between the training and testing data. As a result, most of the existing DL-based methods can only generalize well under identical working conditions, which is infeasible in real engineering practice. To solve this critical issue, a novel dual-branch neural network with a domain adversarial module is developed to achieve transfer fault prognostics across different operating conditions. A dual-branch-based DL model is first utilized to extract abundant degradation features from the heterogeneous inputs. Then, the domain adversarial technique is employed to solve the significant distribution discrepancy problem existing across different operating conditions. The proposed approach is validated experimentally through two rolling element bearing open-sourced datasets, i.e., the XJTU-SY bearing dataset and the PRONOSTIA bearing dataset. The experimental results demonstrate that the proposed method can accurately achieve the transfer fault prognostic task without any labelled data in the target domain, and performance comparisons with other state-of-the-art approaches are also presented.
Similar content being viewed by others
Data availability
XJTU-SY bearing datasets are available at https://biaowang.tech/xjtu-sy-bearing-datasets/, which are provided by the Institute of Design Science and Basic Component at Xi’an Jiaotong University (XJTU), Shaanxi, P. R. China, and the Changxing Sumyoung Technology Co., Ltd. (SY), Zhejiang, P. R. China. PRONOSTIA bearing datasets are available at https://github.com/wkzs111/phm-ieee-2012-data-challenge-dataset, which are provided by the FEMTO-ST Institute.
Code availability
Code can be available upon request.
References
Mao W, Liu Y, Ding L, Safian A, Liang X (2020) A new structured domain adversarial neural network for transfer fault diagnosis of rolling bearings under different working conditions. IEEE Trans Instrum Meas 28(70):1–3
Li H, Soares CG, Huang HZ (2020) Reliability analysis of a floating offshore wind turbine using Bayesian Networks. Ocean Eng 217:107827
Li H, Díaz H, Soares CG (2021) A failure analysis of floating offshore wind turbines using AHP-FMEA methodology. Ocean Eng 234:109261
Zhang Q, Huang CG, Li H, Feng G, Peng W (2022) Electrochemical impedance spectroscopy based state of health estimation for lithium-ion battery considering temperature and state of charge effect. IEEE Trans Transp Electrification. https://doi.org/10.1109/TTE.2022.3160021
Zhou R, Zhu R, Huang CG, Peng W (2022) State of health estimation for fast-charging lithium-ion battery based on incremental capacity analysis. J Energy Storage 51:104560
Huang CG, Huang HZ, Li YF (2019) A bidirectional LSTM prognostics method under multiple operational conditions. IEEE Trans Industr Electron 66(11):8792–8802
Rathore MM, Paul A, Hong WH, Seo H, Awan I, Saeed S (2018) Exploiting IoT and big data analytics: defining smart digital city using real-time urban data. Sustain Cities Soc 40:600–610
Rathore MM, Ahmad A, Paul A, Rho S (2016) Urban planning and building smart cities based on the internet of things using big data analytics. Comput Netw 101:63–80
Saeed F, Paul A, Rehman A, Hong WH, Seo H (2018) IoT-based intelligent modeling of smart home environment for fire prevention and safety. J Sens Actuator Netw 7(1):11
Hu J, Chen P (2020) Predictive maintenance of systems subject to hard failure based on proportional hazards model. Reliab Eng Syst Saf 196:106707
Hu J, Sun Q, Ye ZS (2021) Replacement and repair optimization for production systems under random production waits. IEEE Trans Reliab. https://doi.org/10.1109/TR.2021.3111651
Sun Q, Ye ZS, Chen N (2017) Optimal inspection and replacement policies for multi-unit systems subject to degradation. IEEE Trans Reliab 67(1):401–413
Lei Y, Li N, Guo L, Li N, Yan T, Lin J (2018) Machinery health prognostics: a systematic review from data acquisition to RUL prediction. Mech Syst Signal Process 104:799–834
Lu Y, Li Q, Liang SY (2018) Physics-based intelligent prognosis for rolling bearing with fault feature extraction. Int J Adv Manuf Technol 97(1):611–620
Peng W, Ye ZS, Chen N (2018) Joint online RUL prediction for multivariate deteriorating systems. IEEE Trans Industr Inf 15(5):2870–2878
Liu M, Yao X, Zhang J, Chen W, Jing X, Wang K (2020) Multi-sensor data fusion for remaining useful life prediction of machining tools by IABC-BPNN in dry milling operations. Sensors 20(17):4657
Huang CG, Yin X, Huang HZ, Li YF (2019) An enhanced deep learning-based fusion prognostic method for RUL prediction. IEEE Trans Reliab 69(3):1097–1109
Rahmatov N, Paul A, Saeed F, Hong WH, Seo H, Kim J (2019) Machine learning–based automated image processing for quality management in industrial Internet of Things. Int J Distrib Sens Netw 15(10):1550147719883551
Bhattacharjee D, Paul A, Kim JH, Karthigaikumar P (2018) An immersive learning model using evolutionary learning. Comput Electr Eng 65:236–249
Vahid N, Farrokh S (2021) A review on deep learning in machining and tool monitoring: methods, opportunities, and challenges. Int J Adv Manuf Technol 115:2683–2709
Houssem H, Tarak B, Noureddine Z (2021) Intelligent prognostics of bearings based on bidirectional long short-term memory and wavelet packet decomposition. Int J Adv Manuf Technol 114:145–157
Saeed F, Paul A, Ahmed MJ, Gul MJ, Hong WH, Seo H (2021) Intelligent implementation of residential demand response using multiagent system and deep neural networks. Concurr Comput Pract Exp 33(22):e6168
Zhao R, Wang D, Yan R, Mao K, Shen F, Wang J (2017) Machine health monitoring using local feature-based gated recurrent unit networks. IEEE Trans Industr Electron 65(2):1539–1548
Huang CG, Huang HZ, Li YF, Peng W (2021) A novel deep convolutional neural network-bootstrap integrated method for RUL prediction of rolling bearing. J Manuf Syst 61:757–772
Zhu J, Chen N, Peng W (2018) Estimation of bearing remaining useful life based on multiscale convolutional neural network. IEEE Trans Industr Electron 66(4):3208–3216
Peng W, Ye ZS, Chen N (2019) Bayesian deep-learning-based health prognostics toward prognostics uncertainty. IEEE Trans Industr Electron 67(3):2283–2293
Saeed F, Ahmed MJ, Gul MJ, Hong KJ, Paul A, Kavitha MS (2021) A robust approach for industrial small-object detection using an improved faster regional convolutional neural network. Sci Rep 11(1):1–3
Din S, Paul A, Ahmad A, Gupta BB, Rho S (2018) Service orchestration of optimizing continuous features in industrial surveillance using big data based fog-enabled internet of things. IEEE Access 6:21582–21591
Olimov B, Kim J, Paul A (2020) Dcbt-net: training deep convolutional neural networks with extremely noisy labels. IEEE Access 8:220482–220495
Liu Y, Wang K, Li G, Lin L (2021) Semantics-aware adaptive knowledge distillation for sensor-to-vision action recognition. IEEE Trans Image Process 30:5573–5588
Liu Y, Lu Z, Li J, Yang T, Yao C (2019) Deep image-to-video adaptation and fusion networks for action recognition. IEEE Trans Image Process 29:3168–3182
Haris M, Hasan MN, Qin S (2021) Early and robust remaining useful life prediction of supercapacitors using BOHB optimized Deep Belief Network. Appl Energy 286:116541
Li T, Zhao Z, Sun C, Yan R, Chen X (2021) Hierarchical attention graph convolutional network to fuse multi-sensor signals for remaining useful life prediction. Reliab Eng Syst Saf 215:107878
Saxena A, Goebel K, Simon D, Eklund N (2008) Damage propagation modeling for aircraft engine run-to-failure simulation. In 2008 International Conference On Prognostics and Health Management. IEEE, pp 1–9
Nectoux P, Gouriveau R, Medjaher K, Ramasso E, Chebel-Morello B, Zerhouni N, Varnier C (2012) PRONOSTIA: an experimental platform for bearings accelerated degradation tests. In 2012 International Conference on Prognostics and Health Management. IEEE, pp 1–8
Wang B, Lei Y, Li N, Li N (2018) A hybrid prognostics approach for estimating remaining useful life of rolling element bearings. IEEE Trans Reliab 69(1):401–412
Huang W, Khorasgani H, Gupta C, Farahat A, Zheng S (2018) Remaining useful life estimation for systems with abrupt failures. In Annual conference of the PHM society. IEEE, pp 24–27
Zhu J, Chen N, Shen C (2020) A new data-driven transferable remaining useful life prediction approach for bearing under different working conditions. Mech Syst Signal Process 139:106602
Pan SJ, Yang Q (2009) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359
Shen S, Sadoughi M, Li M, Wang Z, Hu C (2020) Deep convolutional neural networks with ensemble learning and transfer learning for capacity estimation of lithium-ion batteries. Appl Energy 260:114296
Cao Y, Jia M, Ding P, Ding Y (2021) Transfer learning for remaining useful life prediction of multi-conditions bearings based on bidirectional-GRU network. Measurement 178:109287
Ding Y, Jia M, Cao Y (2021) Remaining useful life estimation under multiple operating conditions via deep subdomain adaptation. IEEE Trans Instrum Meas 70:1–1
Cheng H, Kong X, Chen G, Wang Q, Wang R (2021) Transferable convolutional neural network based remaining useful life prediction of bearing under multiple failure behaviors. Measurement 168:108286
Zhang W, Li X, Ma H, Luo Z, Li X (2021) Transfer learning using deep representation regularization in remaining useful life prediction across operating conditions. Reliab Eng Syst Saf 211:107556
Li N, Lei Y, Lin J, Ding SX (2015) An improved exponential model for predicting remaining useful life of rolling element bearings. IEEE Trans Industr Electron 62(12):7762–7773
Ganin Y, Lempitsky V (2015) Unsupervised domain adaptation by backpropagation. In: International conference on machine learning. PMLR, pp 1180–1189
Chicco D, Warrens MJ, Jurman G (2021) The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation. Peer J Comput Sci 7:e623
De Myttenaere A, Golden B, Le Grand B, Rossi F (2016) Mean absolute percentage error for regression models. Neurocomputing 192:38–48
Mao W, He J, Zuo MJ (2019) Predicting remaining useful life of rolling bearings based on deep feature representation and transfer learning. IEEE Trans Instrum Meas 69(4):1594–1608
Van der Maaten L, Hinton G (2008) Visualizing data using t-SNE. Journal of machine learning research 9(11)
Pan SJ, Tsang IW, Kwok JT, Yang Q (2010) Domain adaptation via transfer component analysis. IEEE Trans Neural Networks 22(2):199–210
Ghifary M, Kleijn WB, Zhang M (2014) Domain adaptive neural networks for object recognition. In Pacific Rim International Conference On Artificial Intelligence. Springer, pp 898–904
Acknowledgements
The authors would like to give many thanks to Xi’an Jiaotong University, Changxing Sumyoung Technology Co., Ltd, and FEMTO-ST institute for sharing experimental setup and datasets.
Funding
This work was sponsored by the National Natural Science Foundation of China (no. 62003377), China Postdoctoral Science Foundation (no. 2021M693607), Ministry of Natural Resources in Guangdong Province (no. GDNRC[2021]38), and Guangdong Provincial Department of Science and Technology (no. 2019B090904005).
Author information
Authors and Affiliations
Contributions
Cheng-Geng Huang: conceptualization; methodology; writing–original draft. Changhao Men: experimental validation. Mohammad Yazdi: writing–review and editing. Yu Han: resources, supervision, and funding. Weiwen Peng: project administration and funding.
Corresponding author
Ethics declarations
Ethical approval
Authors consent to ethics approval.
Consent to participate
Authors consent to participate.
Consent for publication
All authors have given their permission for publishing this work.
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Huang, CG., Men, C., Yazdi, M. et al. Transfer fault prognostic for rolling bearings across different working conditions: a domain adversarial perspective. Int J Adv Manuf Technol (2022). https://doi.org/10.1007/s00170-022-09452-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00170-022-09452-1