Abstract
An accurate estimate of remaining useful life (RUL) in health monitoring is a critical challenge. Deep learning as an effective solution to predict RUL has been applied frequently in recent years. However, the high computational load of very deep networks and inconsistent window lengths in real applications are a big deal. This paper proposes a multi-window stacking method with simple architectures to overcome these issues. In this method, raw multivariate time series are preprocessed with different window lengths to create new samples. Simple networks are trained for these samples. In health monitoring in training phase machines work to failure, while in testing phase monitoring data are cut down in early cycles, therefore, available run times are shorter in the test dataset. In our proposed method, RUL predictions of test data are replaced with prior smaller window predictions, when window lengths are increased. All multiple predictions as predictors are entered into a ridge regression to determine the optimized weights of each prediction. Experimental results demonstrate the superiority of the proposed method in comparison with other state-of-the-art models on the same dataset.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Babu, Giduthuri Sateesh, Peilin Zhao, and Xiao-Li Li (2016) Deep convolutional neural network based regression approach for estimation of remaining useful life. In International conference on database systems for advanced applications 214–28. Springer,Cham. https://doi.org/10.1007/978-3-319-32025-0_14
Chen, Xin, Ge Jin, Siqi Qiu, Minglei Lu, and Danjiong Yu (2020) Direct Remaining Useful Life Estimation Based on Random Forest Regression. In 2020 Global Reliability and Prognostics and Health Management (PHM-Shanghai). https://doi.org/10.1109/PHM-Shanghai49105.2020.9281004
Chollet, François(2018) Deep Learning with Python. Manning Publications Co
der Laan V, Mark J, Polley EC, Hubbard AE (2007) Super learner. Stat appl genet mol biol. https://doi.org/10.2202/1544-6115.1309
Elforjani M (2020) Diagnosis and prognosis of real world wind turbine gears. Renew Energy 147:1676–93. https://doi.org/10.1016/j.renene.2019.09.109
Frederick, Dean K, Jonathan A DeCastro, and Jonathan S Litt (2007) User's guide for the commercial modular aero-propulsion system simulation (C-MAPSS)
Friedman J, Hastie T, Tibshirani R (2010) Regularization paths for generalized linear models via coordinate descent. J stat softw 33:1–22
Heimes, Felix O (2008)Recurrent neural networks for remaining useful life estimation. In 2008 international conference on prognostics and health management 1-6. IEEE. https://doi.org/10.1109/PHM.2008.4711422
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural comput 9:1735–80. https://doi.org/10.1162/neco.1997.9.8.1735
Hong, Chang Woo, Kwangsuk Lee, Min-Seung Ko, Jae-Kyeong Kim, Kyungwon Oh, and Kyeon Hur (2020) Multivariate Time Series Forecasting for Remaining Useful Life of Turbofan Engine Using Deep-Stacked Neural Network and Correlation Analysis. In 2020 IEEE International Conference on Big Data and Smart Computing (BigComp) 63–70. IEEE. https://doi.org/10.1109/BigComp48618.2020.00-98
James, Gareth, Daniela Witten, Trevor Hastie, and Robert Tibshirani (2013) An introduction to statistical learning. Springer, New York
Kiranyaz S, Avci O, Abdeljaber O, Ince T, Gabbouj M, Inman DJ (2021) 1D convolutional neural networks and applications: a survey. Mech Sys Sig Process 151:107398. https://doi.org/10.1016/j.ymssp.2020.107398
Kutner, Michael H, Christopher J Nachtsheim, John Neter, and William Li (2005) Applied linear statistical models McGraw-Hill Irwin Boston, Boston
Lei Y, Li N, Guo L, Li N, Yan T, Lin J (2018) Machinery health prognostics: a systematic review from data acquisition to RUL prediction. Mech Sys Sig Process 104:799–834. https://doi.org/10.1016/j.ymssp.2017.11.016
Li X, Ding Q, Sun JQ (2018) Remaining useful life estimation in prognostics using deep convolution neural networks. Reliability Eng Sys Saf 172:1–11. https://doi.org/10.1016/j.ress.2017.11.021
Li H, Zhao W, Zhang Y, Zio E (2020) Remaining useful life prediction using multi-scale deep convolutional neural network. Appl Soft Comput 89:106113. https://doi.org/10.1016/j.asoc.2020.106113
Nieto PJ, García-Gonzalo E, Sánchez Lasheras F, Javierde Cos Juez F (2015) Hybrid PSO–SVM-based method for forecasting of the remaining useful life for aircraft engines and evaluation of its reliability. Reliability Eng Sys Saf 138:219–31. https://doi.org/10.1016/j.ress.2015.02.001
Park P, Jung M, Di Marco P (2020) Remaining useful life estimation of bearings using data-driven ridge regression. Appl Sci 10:8977. https://doi.org/10.3390/app10248977
Qian Y, Yan R, Shijie H (2014) Bearing degradation evaluation using recurrence quantification analysis and Kalman filter. IEEE Transac Inst Measurement 63:2599–610. https://doi.org/10.1109/TIM.2014.2313034
Rigamonti M, Baraldi P, Zio E, Roychoudhury I, Goebel K, Poll S (2018) Ensemble of optimized echo state networks for remaining useful life prediction. Neurocomputing 281:121–38. https://doi.org/10.1016/j.neucom.2017.11.062
Saxena, Abhinav, Kai Goebel, Don Simon, and Neil Eklund (2008) Damage propagation modeling for aircraft engine run-to-failure simulation. In 2008 international conference on prognostics and health management 1-9. IEEE. https://doi.org/10.1109/PHM.2008.4711414
Wang Y, Yang C, Di X, Ge J, Cui W (2021) Evaluation and prediction method of rolling bearing performance degradation based on attention-LSTM. Shock Vib. https://doi.org/10.1155/2021/6615920
Wolpert DH (1992) Stacked generalization. Neural netw 5:241–59. https://doi.org/10.1016/S0893-6080(05)80023-1
Wu J, Kui H, Cheng Y, Zhu H, Shao X, Wang Y (2020) Data-driven remaining useful life prediction via multiple sensor signals and deep long short-term memory neural network. ISA trans 97:241–50. https://doi.org/10.1016/j.isatra.2019.07.004
Xia T, Dong Y, Xiao L, Shichang D, Pan E, Xi L (2018) Recent advances in prognostics and health management for advanced manufacturing paradigms. Reliability Eng Sys Saf 178:255–68. https://doi.org/10.1016/j.ress.2018.06.021
Xia T, Ya Song Y, Zheng EP, Xi L (2020) An ensemble framework based on convolutional bi-directional LSTM with multiple time windows for remaining useful life estimation. Comput ind 115:103182. https://doi.org/10.1016/j.compind.2019.103182
You MY, Li L, Meng G, Ni J (2010) Two-zone Proportional hazard model for equipment remaining useful life prediction. J Manuf Sci Eng 132:041008. https://doi.org/10.1115/1.4001580
Zhang J, Wang P, Yan R, Gao RX (2018) Long short-term memory for machine remaining life prediction. J manuf sys 48:78–86. https://doi.org/10.1016/j.jmsy.2018.05.011
Zhang B, Zhang S, Li W (2019) Bearing performance degradation assessment using long short-term memory recurrent network. Comput ind 106:14–29. https://doi.org/10.1016/j.compind.2018.12.016
Zhang G, Liang W, She B, Tian F (2021) Rotating machinery remaining useful life prediction scheme using deep-learning-based health indicator and a new RVM. Shock Vib. https://doi.org/10.1155/2021/8815241
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Rights and permissions
About this article
Cite this article
Khooran, M., Golbahar Haghighi, M.R. & Malekzadeh, P. Remaining Useful Life Prediction by Stacking Multiple Windows Networks with a Ridge Regression. Iran J Sci Technol Trans Mech Eng 47, 583–594 (2023). https://doi.org/10.1007/s40997-022-00526-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40997-022-00526-9