Skip to main content

Chronologically Guided Deep Network for Remaining Useful Life Estimation

  • Conference paper
  • First Online:
Machine Learning, Optimization, and Data Science (LOD 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12566))

  • 1295 Accesses

Abstract

In this paper, we introduce a new chronological loss function for training models to predict remaining useful life (RUL) of industrial assets based on multivariate time-series observations. The chronological loss, an alternative to the more traditional mean-squared error (MSE) loss, incorporates a monotonicity constraint, an upper bound, and a lower bound on the RUL estimates at each time step. We also present a fully-convolutional network (FCN) as a superior competitor to the current state-of-the-art approaches that are based on LSTM. Our experiments on public benchmark datasets demonstrate that deep models trained using chronological loss outperform those trained using the traditional MSE loss. We also observe that the proposed FCN architecture outperforms LSTM-based predictive models for RUL estimation on most datasets in this study. Our experiments demonstrate the potential of the proposed models to assist in observing degradation trends. Finally, we derive a sensor-importance score from the trained FCN model to enable cost savings by minimizing the number of sensors that need to be placed for asset monitoring without sacrificing RUL estimation accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://ti.arc.nasa.gov/tech/dash/groups/pcoe/prognostic-data-repository/.

References

  1. Elsheikh, A., Yacout, S., Ouali, M.S.: Bidirectional handshaking lstm for remaining useful life prediction. Neurocomputing 323, 148–156 (2019)

    Article  Google Scholar 

  2. Graves, A., Fernández, S., Schmidhuber, J.: Bidirectional LSTM networks for improved phoneme classification and recognition. In: Duch, W., Kacprzyk, J., Oja, E., Zadrożny, S. (eds.) ICANN 2005. LNCS, vol. 3697, pp. 799–804. Springer, Heidelberg (2005). https://doi.org/10.1007/11550907_126

    Chapter  Google Scholar 

  3. Gugulothu, N., TV, V., Malhotra, P., Vig, L., Agarwal, P., Shroff, G.: Predicting remaining useful life using time series embeddings based on recurrent neural networks. arXiv preprint arXiv:1709.01073 (2017)

  4. Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)

    Article  Google Scholar 

  5. Hoffer, E., Hubara, I., Soudry, D.: Train longer, generalize better: closing the generalization gap in large batch training of neural networks. In: Advances in Neural Information Processing Systems, pp. 1731–1741 (2017)

    Google Scholar 

  6. Ioffe, S., Szegedy, C.: Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 (2015)

  7. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  8. Li, H., Kadav, A., Durdanovic, I., Samet, H., Graf, H.P.: Pruning filters for efficient convnets. arXiv preprint arXiv:1608.08710 (2016)

  9. Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)

    Google Scholar 

  10. Nair, V., Hinton, G.E.: Rectified linear units improve restricted boltzmann machines. In: Proceedings of the 27th International Conference on Machine Learning (ICML-10), pp. 807–814 (2010)

    Google Scholar 

  11. Saxena, A., Goebel, K., Simon, D., Eklund, N.: Damage propagation modeling for aircraft engine run-to-failure simulation. In: Prognostics and Health Management, 2008. PHM 2008. International Conference on, pp. 1–9. IEEE (2008)

    Google Scholar 

  12. Schwabacher, M., Goebel, K.: A survey of artificial intelligence for prognostics. In: AAAI Fall Symposium: Artificial Intelligence for Prognostics, pp. 108–115 (2007)

    Google Scholar 

  13. Si, X.S., Wang, W., Hu, C.H., Zhou, D.H.: Remaining useful life estimation-a review on the statistical data driven approaches. Eur. J. Oper. Res. 213(1), 1–14 (2011)

    Article  MathSciNet  Google Scholar 

  14. Wang, J., Wen, G., Yang, S., Liu, Y.: Remaining useful life estimation in prognostics using deep bidirectional lstm neural network. In: 2018 Prognostics and System Health Management Conference (PHM-Chongqing), pp. 1037–1042. IEEE (2018)

    Google Scholar 

  15. Wang, Z., Yan, W., Oates, T.: Time series classification from scratch with deep neural networks: a strong baseline. In: 2017 International Joint Conference on Neural Networks (IJCNN), pp. 1578–1585. IEEE (2017)

    Google Scholar 

  16. Wu, Y., Yuan, M., Dong, S., Lin, L., Liu, Y.: Remaining useful life estimation of engineered systems using vanilla lstm neural networks. Neurocomputing 275, 167–179 (2018)

    Article  Google Scholar 

  17. Zhang, Y., Xiong, R., He, H., Liu, Z.: A lstm-rnn method for the lithuim-ion battery remaining useful life prediction. In: 2017 Prognostics and System Health Management Conference (PHM-Harbin), pp. 1–4. IEEE (2017)

    Google Scholar 

  18. Zhao, G., Zhang, G., Ge, Q., Liu, X.: Research advances in fault diagnosis and prognostic based on deep learning. In: 2016 Prognostics and System Health Management Conference (PHM-Chengdu), pp. 1–6. IEEE (2016)

    Google Scholar 

  19. Zhao, R., Yan, R., Wang, J., Mao, K.: Learning to monitor machine health with convolutional bi-directional lstm networks. Sensors 17(2), 273 (2017)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Abhay Harpale .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Harpale, A. (2020). Chronologically Guided Deep Network for Remaining Useful Life Estimation. In: Nicosia, G., et al. Machine Learning, Optimization, and Data Science. LOD 2020. Lecture Notes in Computer Science(), vol 12566. Springer, Cham. https://doi.org/10.1007/978-3-030-64580-9_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-64580-9_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-64579-3

  • Online ISBN: 978-3-030-64580-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics