Skip to main content

Dilated Convolutional Recurrent Deep Network with Transfer Learning for Remaining Useful Life Prediction

  • Conference paper
  • First Online:
Trends and Applications in Knowledge Discovery and Data Mining (PAKDD 2020)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 12237))

Included in the following conference series:

  • 600 Accesses

Abstract

Remaining Useful Life (RUL) prediction of industrial systems/components helps to reduce the risk of system failure as well as facilitates efficient and flexible maintenance strategies. However, due to cost and/or time limitations, it is a major challenge to collect sufficient lifetime data, especially the fault/failure data, from an industrial system for training an efficient model to predict the RUL. In addition, many of these systems work under dynamically changing operating conditions, which would require model retraining for adapting and generalizing to new conditions. In order to address these issues, we propose an architecture comprising a Dilated Convolutional Neural Network, which utilises non-causal dilations, combined with a Long Short-Term Memory Network: DCNN-LSTM model for RUL prediction. This model was validated on the publicly available NASA turbofan dataset and its performance was benchmarked against previously proposed models, showing the improvement by our proposed model. Next, DCNN-LSTM model was used in a transfer learning setting where both the issues of model retraining and limited availability of experimental data were addressed. The results showed a significant reduction in training time compared to the time required for retraining models from scratch, while achieving similar performance. Moreover, the proposed method also achieved at par performance by utilizing a much smaller amount of data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Kim, N.-H., An, D., Choi, J.-H.: Prognostics and Health Management of Engineering Systems. An Introduction. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-44742-1

    Book  Google Scholar 

  2. An, D., Kim, N.H., Choi, J.-H.: Practical options for selecting data-driven or physics-based prognostics algorithms with reviews. Reliab. Eng. Syst. Saf. 133(C), 223–236 (2015)

    Article  Google Scholar 

  3. Zhang, W., Yang, D., Wang, H.: Data-driven methods for predictive maintenance of industrial equipment: a survey. IEEE Syst. J. 13(3), 2213–2227 (2019)

    Article  Google Scholar 

  4. Sateesh Babu, G., Zhao, P., Li, X.-L.: Deep convolutional neural network based regression approach for estimation of remaining useful life. In: Navathe, S.B., Wu, W., Shekhar, S., Du, X., Wang, X.S., Xiong, H. (eds.) DASFAA 2016. LNCS, vol. 9642, pp. 214–228. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-32025-0_14

    Chapter  Google Scholar 

  5. Han, Z., Zhao, J., Leung, H., Ma, K.F., Wang, W.: A review of deep learning models for time series prediction. IEEE Sens. J. PP(99), 1 (2019)

    Google Scholar 

  6. Hsu, C.-S., Jiang, J.-R.: Remaining useful life estimation using long short-term memory deep learning, pp. 58–61. IEEE (2018)

    Google Scholar 

  7. Wang, J., Wen, G., Yang, S., Liu, Y.: Remaining useful life estimation in prognostics using deep bidirectional LSTM neural network, pp. 1037–1042. IEEE (2018)

    Google Scholar 

  8. Pascanu, R., Mikolov, T., Bengio, Y.: On the difficulty of training recurrent neural networks. presented at the Proceedings of the 30th International Conference on International Conference on Machine Learning, Atlanta, GA, USA, vol. 28 (2013)

    Google Scholar 

  9. Jayasinghe, L., Samarasinghe, T., Yuen, C., Low, J.C.N., Ge, S.S.: Temporal convolutional memory networks for remaining useful life estimation of industrial machinery (2018)

    Google Scholar 

  10. Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., Liu, C.: A survey on deep transfer learning. In: Kůrková, V., Manolopoulos, Y., Hammer, B., Iliadis, L., Maglogiannis, I. (eds.) ICANN 2018. LNCS, vol. 11141, pp. 270–279. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01424-7_27

    Chapter  Google Scholar 

  11. Ansi, Z., et al.: Transfer learning with deep recurrent neural networks for remaining useful life estimation. Appl. Sci. 8(12), 2416 (2018)

    Article  Google Scholar 

  12. Ramasso, E., Saxena, A.: Performance benchmarking and analysis of prognostic methods for CMAPSS datasets. Int. J. Progn. Health Manag. 5(2), 1–15 (2014)

    Google Scholar 

  13. van den Oord, A., et al.: WaveNet: a generative model for raw audio (2016)

    Google Scholar 

  14. Chang, S.-Y., et al.: Temporal modeling using dilated convolution and gating for voice-activity-detection. In: ICASSP (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shaista Hussain .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lee, J.Y., Das, A.K., Hussain, S., Feng, Y. (2020). Dilated Convolutional Recurrent Deep Network with Transfer Learning for Remaining Useful Life Prediction. In: Lu, W., Zhu, K.Q. (eds) Trends and Applications in Knowledge Discovery and Data Mining. PAKDD 2020. Lecture Notes in Computer Science(), vol 12237. Springer, Cham. https://doi.org/10.1007/978-3-030-60470-7_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-60470-7_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-60469-1

  • Online ISBN: 978-3-030-60470-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics