Skip to main content
SpringerLink
Log in

IIoT-Based Prognostic Health Management Using a Markov Decision Process Approach

  • Conference paper
  • First Online:
Ubiquitous Networking (UNet 2019)

Part of the book series: Lecture Notes in Computer Science ((LNCCN,volume 12293))

Included in the following conference series:

  • 337 Accesses

Abstract

Recent advances in Industrial Internet of Things (IIoT) made them a key component of the Industry 4.0. Thus, several aspects of the latter, such as scheduling maintenance operations, could benefit from the existing IIoT infrastructure. We consider an IIoT-based Prognostic Health Management network for industrial facilities. Our objective is to characterize the optimal maintenance policy that favors grouping maintenance operations while reducing the deterioration and failure costs. We rely on Markov Decision Process with full information Theory to develop a realistic model for the IIoT-based PHM system in an industrial facility with multiple components prone to failure. We investigate the structural properties of optimal policies and provide numerical investigations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Vichare, N.M., Pecht, M.G.: Prognostics and health management of electronics. IEEE Trans. Compon. Packag. Technol. 29(1), 222–229 (2006)

    Article  Google Scholar 

  2. Orsagh, R., Brown, D., Roemer, M., Dabnev, T., Hess, A.: Prognostic health management for avionics system power supplies. In: IEEE Aerospace Conference, pp. 3585–3591 (2005)

    Google Scholar 

  3. Scanff, E., Feldman, K., Ghelam, S., Sandborn, P., Glade, M., Foucher, B.: Life cycle cost impact of using prognostic health management (PHM) for helicopter avionics. Microelectron. Reliab. 47(12), 1857–1864 (2007)

    Article  Google Scholar 

  4. Brotherton, T., Jahns, G., Jacobs, J., Wroblewski, D.: Prognosis of faults in gas turbine engines. In: Proceedings of IEEE Aerospace Conference Proceedings, vol. 6, pp. 163–171 (2000)

    Google Scholar 

  5. Kirkland, L.V., Pombo, T., Nelson, K., Berghout, F.: Avionics health management: searching for the prognostics grail. In: Proceedings of IEEE Aerospace Conference, vol. 5, pp. 3448–3454 (2004)

    Google Scholar 

  6. Wilkinson, C., Humphrey, D., Vermeire, B., Houston, J.: Prognostic and health management for avionics. In: Proceedings of IEEE Aerospace Conference, vol. 5, pp. 3435–3447 (2004)

    Google Scholar 

  7. Gertsbakh, I.B.: Models of preventive maintenance (1977)

    Google Scholar 

  8. Jardine, A.K., Lin, D., Banjevic, D.: A review on machinery diagnostics and prognostics implementing condition-based maintenance. Mech. Syst. Sig. Process. 20(7), 1483–1510 (2006)

    Article  Google Scholar 

  9. Peng, Y., Dong, M., Zuo, M.J.: Current status of machine prognostics in condition-based maintenance: a review. Int. J. Adv. Manuf. Technol. 50(1–4), 297–313 (2010)

    Article  Google Scholar 

  10. Jeschke, S., Brecher, C., Meisen, T., Özdemir, D., Eschert, T.: Industrial internet of things and cyber manufacturing systems. In: Jeschke, S., Brecher, C., Song, H., Rawat, D.B. (eds.) Industrial Internet of Things. SSWT, pp. 3–19. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-42559-7_1

    Chapter  Google Scholar 

  11. Sadeghi, A.-R., Wachsmann, C., Waidner, M.: Security and privacy challenges in industrial internet of things. In: 2015 52nd ACM/EDAC/IEEE Proceedings of Design Automation Conference (DAC), pp. 1–6 (2015)

    Google Scholar 

  12. Hossain, M.S., Muhammad, G.: Cloud-assisted industrial internet of things (IIOT)-enabled framework for health monitoring. Comput. Netw. 101, 192–202 (2016)

    Article  Google Scholar 

  13. Serpanos, D., Wolf, M.: Industrial internet of things. In: Internet-of-Things (IoT) Systems, pp. 37–54 (2018)

    Google Scholar 

  14. Kwon, D., Hodkiewicz, M.R., Fan, J., Shibutani, T., Pecht, M.G.: IoT-based prognostics and systems health management for industrial applications. IEEE Access 4, 3659–3670 (2016)

    Article  Google Scholar 

  15. Lee, J., Kao, H.-A., Yang, S.: Service innovation and smart analytics for industry 4.0 and big data environment. Proc. CIRP 16, 3–8 (2014)

    Article  Google Scholar 

  16. Sonntag, D., Zillner, S., van der Smagt, P., Lörincz, A.: Overview of the CPS for smart factories project: deep learning, knowledge acquisition, anomaly detection and intelligent user interfaces. In: Jeschke, S., Brecher, C., Song, H., Rawat, D.B. (eds.) Industrial Internet of Things. SSWT, pp. 487–504. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-42559-7_19

    Chapter  Google Scholar 

  17. Xanthopoulos, A., Kiatipis, A., Koulouriotis, D., Stieger, S.: Reinforcement learning-based and parametric production-maintenance control policies for a deteriorating manufacturing system. IEEE Access 6, 576–588 (2017)

    Article  Google Scholar 

  18. Wan, J., Tang, S., Li, D., Wang, S., Liu, C., Abbas, H., Vasilakos, A.V.: A manufacturing big data solution for active preventive maintenance. IEEE Trans. Ind. Inform. 13(4), 2039–2047 (2017)

    Article  Google Scholar 

  19. Yan, H., Wan, J., Zhang, C., Tang, S., Hua, Q., Wang, Z.: Industrial big data analytics for prediction of remaining useful life based on deep learning. IEEE Access 6, 17190–17197 (2018)

    Article  Google Scholar 

  20. Feng, Q., Bi, X., Zhao, X., Chen, Y., Sun, B.: Heuristic hybrid game approach for fleet condition-based maintenance planning. Reliab. Eng. Syst. Saf. 157, 166–176 (2017)

    Article  Google Scholar 

  21. Fathi Aghdam, F., Liao, H.: Prognostics-based two-operator competition in proactive replacement and service parts procurement. Eng. Econ. 59(4), 282–306 (2014)

    Article  Google Scholar 

  22. Batzel, T.D., Swanson, D.C.: Prognostic health management of aircraft power generators. IEEE Trans. Aerosp. Electron. Syst. 45(2), 473–482 (2009)

    Article  Google Scholar 

  23. Lee, J., Wu, F., Zhao, W., Ghaffari, M., Liao, L., Siegel, D.: Prognostics and health management design for rotary machinery systems - reviews, methodology and applications. Mech. Syst. Sig. Process. 42, 314–334 (2014)

    Article  Google Scholar 

  24. Puterman, M.L.: Markov Decision Process Discrete: Stochastic Dynamic Programming. Wiley, Hoboken (2014)

    Google Scholar 

  25. Krishnamurthy, V.: Structural Results for Partially Observed Markov Decision Processes (2015)

    Google Scholar 

  26. Sharma, N., Mastronarde, N., Chakareski, J.: Structural Properties of Optimal Transmission Policies for Delay-Sensitive Energy Harvesting Wireless Sensors. arXiv preprint arXiv:1803.09778 (2018)

Download references

Author information

Authors and Affiliations

  1. Industrial and Seismic Engineering Team, EGIS Laboratory, National School for Applied Sciences of Oujda, Mohammed Premier University, Oujda, Morocco

    Khadija Berhili & Yahya Berrehili

  2. Modélisation et Simulation Numérique Research Team, M2N Laboratory, National School for Applied Sciences of Oujda, Mohammed Premier University, Oujda, Morocco

    Mohammed-Amine Koulali

Authors
  1. Khadija Berhili
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohammed-Amine Koulali
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yahya Berrehili
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammed-Amine Koulali .

Editor information

Editors and Affiliations

  1. University of Limoges, Limoges, France

    Oussama Habachi

  2. University of Limoges, Limoges, France

    Vahid Meghdadi

  3. Hassan II University, Casablanca, Morocco

    Essaid Sabir

  4. University of Limoges, Limoges, France

    Jean-Pierre Cances

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Berhili, K., Koulali, MA., Berrehili, Y. (2020). IIoT-Based Prognostic Health Management Using a Markov Decision Process Approach. In: Habachi, O., Meghdadi, V., Sabir, E., Cances, JP. (eds) Ubiquitous Networking. UNet 2019. Lecture Notes in Computer Science(), vol 12293. Springer, Cham. https://doi.org/10.1007/978-3-030-58008-7_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-58008-7_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-58007-0

  • Online ISBN: 978-3-030-58008-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation