Abstract
In this paper, we introduce a new chronological loss function for training models to predict remaining useful life (RUL) of industrial assets based on multivariate time-series observations. The chronological loss, an alternative to the more traditional mean-squared error (MSE) loss, incorporates a monotonicity constraint, an upper bound, and a lower bound on the RUL estimates at each time step. We also present a fully-convolutional network (FCN) as a superior competitor to the current state-of-the-art approaches that are based on LSTM. Our experiments on public benchmark datasets demonstrate that deep models trained using chronological loss outperform those trained using the traditional MSE loss. We also observe that the proposed FCN architecture outperforms LSTM-based predictive models for RUL estimation on most datasets in this study. Our experiments demonstrate the potential of the proposed models to assist in observing degradation trends. Finally, we derive a sensor-importance score from the trained FCN model to enable cost savings by minimizing the number of sensors that need to be placed for asset monitoring without sacrificing RUL estimation accuracy.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Elsheikh, A., Yacout, S., Ouali, M.S.: Bidirectional handshaking lstm for remaining useful life prediction. Neurocomputing 323, 148–156 (2019)
Graves, A., Fernández, S., Schmidhuber, J.: Bidirectional LSTM networks for improved phoneme classification and recognition. In: Duch, W., Kacprzyk, J., Oja, E., Zadrożny, S. (eds.) ICANN 2005. LNCS, vol. 3697, pp. 799–804. Springer, Heidelberg (2005). https://doi.org/10.1007/11550907_126
Gugulothu, N., TV, V., Malhotra, P., Vig, L., Agarwal, P., Shroff, G.: Predicting remaining useful life using time series embeddings based on recurrent neural networks. arXiv preprint arXiv:1709.01073 (2017)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Hoffer, E., Hubara, I., Soudry, D.: Train longer, generalize better: closing the generalization gap in large batch training of neural networks. In: Advances in Neural Information Processing Systems, pp. 1731–1741 (2017)
Ioffe, S., Szegedy, C.: Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 (2015)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
Li, H., Kadav, A., Durdanovic, I., Samet, H., Graf, H.P.: Pruning filters for efficient convnets. arXiv preprint arXiv:1608.08710 (2016)
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)
Nair, V., Hinton, G.E.: Rectified linear units improve restricted boltzmann machines. In: Proceedings of the 27th International Conference on Machine Learning (ICML-10), pp. 807–814 (2010)
Saxena, A., Goebel, K., Simon, D., Eklund, N.: Damage propagation modeling for aircraft engine run-to-failure simulation. In: Prognostics and Health Management, 2008. PHM 2008. International Conference on, pp. 1–9. IEEE (2008)
Schwabacher, M., Goebel, K.: A survey of artificial intelligence for prognostics. In: AAAI Fall Symposium: Artificial Intelligence for Prognostics, pp. 108–115 (2007)
Si, X.S., Wang, W., Hu, C.H., Zhou, D.H.: Remaining useful life estimation-a review on the statistical data driven approaches. Eur. J. Oper. Res. 213(1), 1–14 (2011)
Wang, J., Wen, G., Yang, S., Liu, Y.: Remaining useful life estimation in prognostics using deep bidirectional lstm neural network. In: 2018 Prognostics and System Health Management Conference (PHM-Chongqing), pp. 1037–1042. IEEE (2018)
Wang, Z., Yan, W., Oates, T.: Time series classification from scratch with deep neural networks: a strong baseline. In: 2017 International Joint Conference on Neural Networks (IJCNN), pp. 1578–1585. IEEE (2017)
Wu, Y., Yuan, M., Dong, S., Lin, L., Liu, Y.: Remaining useful life estimation of engineered systems using vanilla lstm neural networks. Neurocomputing 275, 167–179 (2018)
Zhang, Y., Xiong, R., He, H., Liu, Z.: A lstm-rnn method for the lithuim-ion battery remaining useful life prediction. In: 2017 Prognostics and System Health Management Conference (PHM-Harbin), pp. 1–4. IEEE (2017)
Zhao, G., Zhang, G., Ge, Q., Liu, X.: Research advances in fault diagnosis and prognostic based on deep learning. In: 2016 Prognostics and System Health Management Conference (PHM-Chengdu), pp. 1–6. IEEE (2016)
Zhao, R., Yan, R., Wang, J., Mao, K.: Learning to monitor machine health with convolutional bi-directional lstm networks. Sensors 17(2), 273 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Harpale, A. (2020). Chronologically Guided Deep Network for Remaining Useful Life Estimation. In: Nicosia, G., et al. Machine Learning, Optimization, and Data Science. LOD 2020. Lecture Notes in Computer Science(), vol 12566. Springer, Cham. https://doi.org/10.1007/978-3-030-64580-9_10
Download citation
DOI: https://doi.org/10.1007/978-3-030-64580-9_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-64579-3
Online ISBN: 978-3-030-64580-9
eBook Packages: Computer ScienceComputer Science (R0)