Skip to main content
SpringerLink
Log in

Remaining useful life prediction based on spatiotemporal autoencoder

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Remaining Useful Life (RUL) prediction has received a lot of attention as the core of prognostics and health management (PHM) technology. Deep learning-based RUL prediction methods are currently the most popular, and in order to solve the problem that most of the current deep RUL prediction studies do not consider the structural information between sensors, we propose a spatiotemporal autoencoder (STAE)-based RUL prediction method. The method extracts the time domain information from the data through the temporal convolutional network. It obtains the structural information of the sensors by converting the time series data into a graph structure by utilizing the maximal information coefficient and then performing the graph representation learning. For the two obtained features, a feature fusion method based on the graph attention mechanism is used for fusion and finally, the new fused features are utilized for RUL prediction. To validate the effectiveness of STAE, we conducted experiments on the simulated dataset C-MAPSS and the real satellite dataset SCS-PSS, and our proposed method outperforms the baseline method on both datasets. The results suggest that considering structural information between sensors in the deep RUL prediction model can improve prediction accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Algorithm 1
Fig. 4
Algorithm 2
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Data availability

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Zhang Z, Si X, Hu C, Lei Y (2018) Degradation data analysis and remaining useful life estimation: A review on Wiener-process-based methods. Eur J Oper Res 271:775–796

    Article  MathSciNet  ADS  Google Scholar 

  2. Mo Y, Wu Q, Li X, Huang B (2021) Remaining useful life estimation via transformer encoder enhanced by a gated convolutional unit. J Intell Manuf 32:1997–2006

    Article  Google Scholar 

  3. Bao HQ, Song LJ, Zhang ZZ, Han BK, Wang JR, Ma JQ (2023) Prediction of the remaining useful life of rolling bearings by LSTM based on multidomain characteristics and a dual-attention mechanism. J Mech Sci Technol 129:413–428

    Google Scholar 

  4. Li J, Huang FG, Qin HH, Pan JF (2023) Research on Remaining Useful Life Prediction of Bearings Based on MBCNN-BiLSTM. Appl Sci-Basel 13:18

    Google Scholar 

  5. Ben Ali J, Chebel-Morello B, Saidi L, Malinowski S, Fnaiech F (2015) Accurate bearing remaining useful life prediction based on Weibull distribution and artificial neural network. Mech Syst Signal Process 56–57:150–172

    Article  ADS  Google Scholar 

  6. Jouin M, Gouriveau R, Hissel D, Pera MC, Zerhouni N (2016) Degradations analysis and aging modeling for health assessment and prognostics of PEMFC. Reliab Eng Syst Saf 148:78–95

    Article  Google Scholar 

  7. Pang XQ, Huang R, Wen J, Shi YH, Jia JF, Zeng JC (2019) A Lithium-ion Battery RUL Prediction Method Considering the Capacity Regeneration Phenomenon. Energies 12:14

    Article  Google Scholar 

  8. Muhammad N, Fang ZG, Shoaib M (2020) Remaining useful life (RUL) estimation of electronic solder joints in rugged environment under random vibration. Microelectron Reliab 107:8

    Article  Google Scholar 

  9. Li Y, Liu KL, Foley AM, Zulke A, Berecibar M, Nanini-Maury E (2019) Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review. Renew Sustain Energy Rev 113:109254

    Article  Google Scholar 

  10. Si XS, Wang WB, Hu CH, Zhou DH (2011) Remaining useful life estimation - A review on the statistical data driven approaches. Eur J Oper Res 213:1–14

    Article  MathSciNet  Google Scholar 

  11. Peng YH, Pan XP, Wang SB, Wang CL, Wang J, Wu JJ (2021) An aero-engine RUL prediction method based on VAE-GAN. In: 2021 IEEE 24th International conference on computer supported cooperative work in design (CSCWD). IEEE, pp 953–957

  12. Xu WY, Jiang QS, Shen YH, Xu FY, Zhu QX (2022) RUL prediction for rolling bearings based on Convolutional Autoencoder and status degradation model. Appl Soft Comput 130:11–13

    Article  Google Scholar 

  13. Tian ZG (2009) An Artificial Neural Network Approach for Remaining Useful Life Prediction of Equipments Subject to Condition Monitoring. J Intell Manuf 23:227–237

    Article  Google Scholar 

  14. Jain AK, Lad BK (2015) Predicting remaining useful life of high speed milling cutters based on artificial neural network. In: 2015 International conference on robotics, automation, control and embedded systems (RACE). IEEE, pp 1–5

  15. Kang ZQ, Catal C, Tekinerdogan B (2021) Remaining Useful Life (RUL) Prediction of Equipment in Production Lines Using Artificial Neural Networks. Sensors 21:20

    Google Scholar 

  16. Wang FT, Wang B, Dun BS, Chen XT, Yan DW, Zhu H (2016) Remaining life prediction of rolling bearing based on PCA and improved logistic regression model. J Vibroeng 18:5192–5203

    Article  Google Scholar 

  17. Li YX, Shi JM, Wang G, Liu XD (2016) A data-driven prognostics approach for RUL based on principle component and instance learning. In: 2016 IEEE International Conference on Prognostics and Health Management (ICPHM). IEEE, pp 1–7

  18. Li YX, Shan XM, Zhao W, Wang G (2019) A LS-SVM based approach for turbine engines prognostics using sensor data. In: 2019 IEEE International conference on industrial technology (ICIT). IEEE, pp 983–987

  19. Ordonez C, Lasheras FS, Roca-Pardinas J, Juez FJD (2019) A hybrid ARIMA-SVM model for the study of the remaining useful life of aircraft engines. J Comput Appl Math 346:184–191

    Article  MathSciNet  Google Scholar 

  20. Liu ZX, Wang HG, Hao MX, Wu DH (2023) Prediction of RUL of Lubricating Oil Based on Information Entropy and SVM. Lubricants 11:14

    Article  Google Scholar 

  21. Wang G, Lyu Z, Li XY (2023) An Optimized Random Forest Regression Model for Li-Ion Battery Prognostics and Health Management. Batteries-Basel 9:17

    CAS  Google Scholar 

  22. Wang HR, Li DW, Li DJ, Liu CQ, Yang XQ, Zhu GF (2023) Remaining Useful Life Prediction of Aircraft Turbofan Engine Based on Random Forest Feature Selection and Multi-Layer Perceptron. Appl Sci-Basel 13:17

    CAS  Google Scholar 

  23. Patil S, Patil A, Handikherkar V, Desai S, Phalle VM, Kazi FS, et al (2018) Remaining useful life prediction of rolling element bearing using random forest and gradient boosting technique. In: ASME international mechanical engineering congress and exposition, vol 52187. American Society of Mechanical Engineers

  24. Khurana D, Koli A, Khatter K, Singh S (2023) Natural language processing: state of the art, current trends and challenges. Multimed Tools Appl 82:3713–3744

    Article  PubMed  Google Scholar 

  25. Zhang X, Chen MH, Qin Y (2018) NLP-QA framework based on LSTM-RNN. In: 2018 2nd International conference on data science and business analytics (ICDSBA). IEEE, pp 307–311

  26. Bensalah N, Ayad H, Adib A, El Farouk AI (2021) CRAN: An hybrid CNN-RNN attention-based model for arabic machine translation. In: Networking, intelligent systems and security: proceedings of NISS 2021. Springer, Singapore,  pp 87–102

  27. Yu WN, Kim IY, Mechefske C (2020) An improved similarity-based prognostic algorithm for RUL estimation using an RNN autoencoder scheme. Reliab Eng Syst Saf 199:12

    Article  Google Scholar 

  28. Wang YD, Zhao YF (2023) Three-stage feature selection approach for deep learning-based RUL prediction methods. Qual Reliab Eng Int 39:1223–1247

    Article  Google Scholar 

  29. Xu M, Bai YY, Qian PJ (2022) Remaining useful life prediction based on improved LSTM hybrid attention neural network. In: International conference on intelligent computing. Springer International Publishing, Cham, pp 709–718

  30. Yousuf S, Khan SA, Khursheed S (2022) Remaining useful life (RUL) regression using Long-Short Term Memory (LSTM) networks. Microelectron Reliab 139:10

    Article  Google Scholar 

  31. Akcan E, Kaya Y (2023) A new approach for remaining useful life prediction of bearings using 1D-ternary patterns with LSTM. J Braz Soc Mech Sci Eng 45:16

    Article  Google Scholar 

  32. Peng C, Wu JQ, Wang QL, Gui WH, Tang ZH (2022) Remaining Useful Life Prediction Using Dual-Channel LSTM with Time Feature and Its Difference. Entropy 24:21

    Article  MathSciNet  Google Scholar 

  33. Wang ZQ, Liu N, Chen CL, Guo YM (2023) Adaptive self-attention LSTM for RUL prediction of lithium-ion batteries. Inf Sci 635:398–413

    Article  Google Scholar 

  34. Babu GS, Zhao P, Li XL (2016) Deep convolutional neural network based regression approach for estimation of remaining useful life. In: Database systems for advanced applications: 21st International conference, DASFAA 2016, Dallas, TX, USA, April 16-19, 2016, Proceedings, Part I 21. Springer International Publishing, pp 214–228

  35. Gao YX, Wang XH, Yan LP (2021) Bearing remaining useful life prediction by combining CNN with PSO_LSSVM. In: 2021 33rd Chinese control and decision conference (CCDC). IEEE, pp 7124–7129

  36. Luo JL, Chen T, Xiao F, Peng YL (2023) Remaining useful life prediction of PEMFC based on CNN-Birnn model. Int J Green Energy 12:2569–2577

    Google Scholar 

  37. Zhang XY, Shi BW, Feng BW, Liu LL, Gao ZG (2023) A hybrid method for cutting tool RUL prediction based on CNN and multistage Wiener process using small sample data. Measurement 213:16

    Article  Google Scholar 

  38. Ruan DW, Wu YH, Yan JP (2021) Remaining useful life prediction for aero-engine based on LSTM and CNN. In: 2021 33rd Chinese control and decision conference (CCDC). IEEE, pp 6706–6712

  39. Xie QL, Liu RC, Huang JH, Su JH (2023) Residual life prediction of lithium-ion batteries based on data preprocessing and a priori knowledge-assisted CNN-LSTM. Energy 281:15

    Article  Google Scholar 

  40. Zhao KS, Zhang J, Chen SW, Wen PF, Ping W, Zhao S (2023) Remaining useful life prediction method based on convolutional neural network and long short-term memory neural network. In: Prognostics and health management conference. IEEE, pp 336–43

  41. Rumelhart DE, Hinton GE, Williams RJJN (1986) Learning representations by back-propagating errors. Nature 323:533–6

    Article  ADS  Google Scholar 

  42. Han X, Zhong Y, Zhao B, Zhang L (2017) Scene classification based on a hierarchical convolutional sparse auto-encoder for high spatial resolution imagery. Int J Remote Sens 38:514–536

    Article  Google Scholar 

  43. Ren L, Sun Y, Cui J, Zhang L (2018) Bearing remaining useful life prediction based on deep autoencoder and deep neural networks. J Manuf Syst 48:71–77

    Article  Google Scholar 

  44. Lea C, Vidal R, Reiter A, Hager GD (2016) Temporal convolutional networks: a unified approach to action segmentation. In: Computer vision–ECCV 2016 workshops: Amsterdam, The Netherlands, October 8-10 and 15-16, 2016, Proceedings, Part III 14. Springer International Publishing, pp 47–54

  45. Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Xiaohua Z, Unterthiner T et al (2020) An image is Worth 16x16 words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929

  46. Wu S, Jiang Y, Luo H, Yin SJCEP (2021) Remaining useful life prediction for ion etching machine cooling system using deep recurrent neural network-based approaches. Control Eng Pract 109:104748

    Article  Google Scholar 

  47. Yan J, Mu L, Wang L, Ranjan R, Zomaya AY (2020) Temporal Convolutional Networks for the Advance Prediction of ENSO. Sci Rep 10:8055

    Article  CAS  PubMed  PubMed Central  ADS  Google Scholar 

  48. Rohan A (2022) Holistic Fault Detection and Diagnosis System in Imbalanced, Scarce, Multi-Domain (ISMD) Data Setting for Component-Level Prognostics and Health Management (PHM). Mathematics 10:2031

    Article  Google Scholar 

  49. Wang P, Chen P, Yuan Y, Liu D, Huang Z, Hou X, et al (2018) Understanding convolution for semantic segmentation. In: 2018 IEEE winter conference on applications of computer vision (WACV). IEEE, pp 1451–1460

  50. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  51. Reshef DN, Reshef YA, Finucane HK, Grossman SR, McVean G, Turnbaugh PJ et al (2011) Detecting Novel Associations in Large Data Sets. Science 334:1518–1524

    Article  CAS  PubMed  PubMed Central  ADS  Google Scholar 

  52. Velickovic P, Cucurull G, Casanova A, Romero A, Lio P, Bengio YJs (2017) Graph attention networks. arXiv preprint arXiv:1710.10903

  53. Wu Z, Pan S, Chen F, Long G, Zhang C, Yu PS (2021) A Comprehensive Survey on Graph Neural Networks. IEEE Trans Neural Netw Learn Syst 32:4–24

    Article  MathSciNet  PubMed  Google Scholar 

  54. Peng W, Chen A, Chen J (2018) Using general master equation for feature fusion. Future Gener Comput Syst Int J Escience 82:119–126

    Article  Google Scholar 

  55. Saxena A, Goebel K, Simon D, Eklund N (2008) Damage propagation modeling for aircraft engine run-to-failure simulation. In: 2008 international conference on prognostics and health management. IEEE, pp 1–9

  56. Ramasso E (2014) Investigating computational geometry for failure prognostics. Int J Prognostics Health Manag 5:1–18

    Google Scholar 

  57. Zheng S, Ristovski K, Farahat A, Gupta C (2017) Long short-term memory network for remaining useful life estimation. In: 2017 IEEE international conference on prognostics and health management (ICPHM). IEEE, pp 88–95

  58. Li H, Zhao W, Zhang Y, Zio E (2020) Remaining useful life prediction using multi-scale deep convolutional neural network. Appl Soft Comput 89:106113

    Article  Google Scholar 

  59. Costa N, Sánchez L (2022) Variational encoding approach for interpretable assessment of remaining useful life estimation. Reliab Eng Syst Saf 222:108353

    Article  Google Scholar 

  60. Srivastava Nitish (2013) Improving neural networks with dropout. J Chem Inform Model 53(9):1689–1699

    Google Scholar 

  61. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958

    MathSciNet  Google Scholar 

  62. Jin W, Ma Y, Liu X, Tang X, Wang S, Tang J (2020) Graph structure learning for robust graph neural networks. In: Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining. ACM, pp 66–74

Download references

Funding

This work was supported by Postgraduate Research & Practice Innovation Program of NUAA under Grant xcxjh20211607 and National Science and Technology Innovation 2030-Key Project of “New Generation Artificial Intelligence” under Grant 2021ZD0113103.

Author information

Authors and Affiliations

  1. College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, 211106, China

    Tao Xu, Dechang Pi & Shi Zeng

Authors
  1. Tao Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dechang Pi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shi Zeng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tao Xu.

Ethics declarations

Declarations

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, T., Pi, D. & Zeng, S. Remaining useful life prediction based on spatiotemporal autoencoder. Multimed Tools Appl (2024). https://doi.org/10.1007/s11042-024-18251-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11042-024-18251-7

Keywords

Search

Navigation