Abstract
This paper develops a reward model for the optimization of preventive maintenance for a complex production system functioning in any one of k unobservable operating states. The changes of the states are driven by a non-homogeneous Markov (NHM) process X(t) with known characteristics. The system fails according to a point process whose intensity is modulated by the unobservable state. Failures are rectified through minimal repairs (MRs) whose costs are associated with age and the state process X(t). The modeling approach also allows both the revenue stream and the preventive maintenance cost to be characterized by the state process X(t). The paper first formulates the reward model depending on the unobservable state process estimated through the filtering theorem argument by projection on the observed history including failure point process observations. The estimation of the state process allows failure prediction and maximizing revenue stream implemented through scheduling periodic overhauls. A case study is provided to illustrate the proposed method.
Similar content being viewed by others
References
Arjas, E., Haara, P., & Norros, I. (1992). Filtering the histories of a partially observed marked point process. Stochastic Processes and their Applications, 40(2), 225–250.
Ahmadi, R. (2014). Optimal maintenance scheduling for a complex manufacturing system subject to deterioration. Annals of Operations Research, 217(1), 1–29.
Ahmadi, R. (2016). An optimal replacement policy for complex multi-component systems. International Journal of Production Research, 54(17), 5303–5316.
Ahmadi, R., & Fouladirad, M. (2017). An integrated approach to maintenance scheduling of multi-state production systems subject to deterioration. Reliability Engineering and System Safety, 159, 108–118.
Aven, T., & Jensen, U. (1999). Stochastic models in reliability, Springer.
Alimian, M., Saidi-Mehrabad, M., & Jabbarzadeh, A. (2019). A robust integrated production and preventive maintenance planning model for multi-state systems with uncertain demand and common cause failures. Journal of Manufacturing Systems, 50, 263–277.
Bergman, B. (1978). Optimal replacement under a general failure model. Advances in Applied Probability, 10(2), 431–451.
Baruah, P., & Chinnam, R. B. (2005). HMMs for diagnostics and prognostics in machining processes. International Journal of Production Research, 43(6), 1275–1293.
Brémaud, P. (1981). Point processes and queues, Springer.
Banjevic, D., & Jardine, A. K. S. (2006). Calculation of reliability function and remaining useful life for a Markov failure time process. IMA Journal of Management Mathematics, 17, 115–130.
Cheng, G. Q., Zhou, B. H., & Li, L. (2017). Joint optimization of lot sizing and condition-based maintenance for multi-component production systems. Computers & Industrial Engineering, 110, 538–549.
Cholette, D., & Djurdjanovic, D. (2014). Degradation modeling and monitoring of machines using operation-specific hidden Markov models. IIE Transactions, 46, 1107–1123.
Celen, M., & Djurdjanovic, D. (2020). Integrated maintenance and operations decision making with imperfect degradation state observations. International Journal of Manufacturing systems, 55, 302–316.
Finkelstein, M., Cha, J. H., & Levitin, G. (2020). A hybrid preventive maintenance model for systems with partially observable degradation. IMA Journal of Management Mathematics, 31(3), 345–365.
Gao, K., Peng, R., Qu, L., & Wu, S. (2020). Jointly optimizing lot sizing and maintenance policy for a production system with two failure modes. Reliability Engineering and System Safety, 202, 1–15.
Huynh, K. T., Castro, I. T., Barros, A., & Bérenguer, C. (2012). On the construction of mean residual life for maintenance decision-making. IFAC Proceedings Volumes, 45(20), 654–659.
Huynh, K. T., Castro, I. T., Barros, A., & Bérenguer, C. (2012). Modeling age-based maintenance strategies with minimal repairs for systems subject to competing failure modes due to degradation and shocks. European Journal of Operational Research, 218(1), 140–151.
Jensen, U., & Hsu, G. H. (1993). Optimal stopping by means of point process observations with applications in reliability. Mathematics of Operations Research, 18(3), 511–765.
Jhang, J. P., & Sheub, S. H. (1999). Opportunity-based age replacement policy with minimal repair. Reliability Engineering and System Safety, 64(3), 339–344.
Jafari, L., & Makis, V. (2016). Joint optimization of lot-sizing and maintenance policy for a partially observable two-unit system. International Journal of Advanced Manufacturing Technology, 87, 1621–1639.
Kolesar, P. (1966). Minimum cost replacement under Markovian deterioration. Management Science, 12(9), 694–706.
Khatab, A., Diallo, C., Aghezzaf, E. H., & Venkatari, U. (2019). Integrated production quality and condition-based maintenance optimisation for a stochastically deteriorating manufacturing system. International Journal of Production Research, 57(8), 2480–2497.
Kulikova, M. V., Tsyganova, J. V., & Kulikov, G. Y. (2021). Optimizing the integrated economic production quantity for a stochastically deteriorating production system under condition-based maintenance. Journal of Computational and Applied Mathematics, 387, 112487.
Liu, B., Zhao, X., Liu, Y., & Do, P. (2020). Maintenance optimisation for systems with multi-dimensional degradation and imperfect inspections. International Journal of Production Research. https://doi.org/10.1080/00207543.2020.1844919
Lugtigheid, D., Banjevic, D., & Jardine, A. K. S. (2004). Modeling repairable system reliability with explanatory variables and repair and maintenance actions. IMA Journal of Management Mathematics, 15, 89–110.
Liu, Y., Chen, Y., & Jiang, T. (2020b). Dynamic selective maintenance optimization for multi-state systems over a finite horizon: A deep reinforcement learning approach. Europen Journal of Operational Research, 283(1), 166–181.
Lu, S., Pei, J., Liu, X., & Pardalos, P. M. (2021). A hybrid DBH-VNS for high-end equipment production scheduling with machine failures and preventive maintenance activities. Journal of Computational and Applied Mathematics, 384, 113195.
Liu, B., Do, P., Lung, B., & Xie, M. (2020). Stochastic filtering approach for condition-based maintenance considering sensor degradation. IEEE Transactions on Automation Science and Engineering, 17(1), 177–190.
Moghaddass, R., & Ertekin, Ş. (2018). Joint optimization of ordering and maintenance with condition monitoring data. Annals of Operations Research, 263, 271–310.
Mizutani, S., Zhao, X., & Nakagawa, T. (2021). Age and periodic replacement policies with two failure modes in general replacement models. Reliability Engineering and System Safety, 214, 107754.
Nakagawa, T., & Zhao, X. (2015). Maintenance Overtime Policies in Reliability Theory, Springer Cham.
Nguyen, S. H. S., Do, P., Vu, H. C., & Iung, B. (2019). Dynamic maintenance grouping and routing for geographically dispersed production systems. Reliability Engineering and System Safety, 185, 392–404.
Nino-Ruiz, E. D., Guzman, L., & Jabba, D. (2021). An ensemble Kalman filter implementation based on the Ledoit and Wolf covariance matrix estimator. Journal of Computational and Applied Mathematics, 384, 113163.
Naderkhani, F., & Makis, V. (2015). Optimal condition-based maintenance policy for a partially observable system with two sampling intervals. International Journal of Advanced Manufacturing Technology, 78, 795–805.
Panagiotidou, S., & Tagaras, G. (2007). Optimal preventive maintenance for equipment with two quality states and general failure time distributions. European Journal of Operations Research, 180(1), 329–353.
Pan, Y., & Thomas, M. U. (2010). Repair and replacement decisions for warranted products under Markov deterioration. IEEE Transactions on Reliability, 59(2), 368–373.
Reuben, L. C. K., & Mba, D. (2014). Diagnostics and prognostics using switching Kalman filters. Structural Health Monitoring, 13(3), 1–11.
Rice, W. F., Cassady, C. R. & Nachlas, J. A. (1998). Optimal maintenance plans under limited maintenance time, Proceedings of the Seventh Industrial Engineering Research Conference, Alberta, Canada.
Skordilis, E., & Moghaddass, R. (2017). A condition monitoring approach for real-time monitoring of degrading systems using Kalman filter and logistic regression. International Journal of Production Research, 55, 5579–5596.
Sheu, S. H., Li, S. H., & Chang, C. C. (2012). A generalised maintenance policy with age-dependent minimal repair cost for a system subject to shocks under periodic overhaul. International Journal of Systems Science, 43(6), 1007–1013.
Sgarbossa, F., Personaa, A., & Pham, H. (2015). Using systemability function for periodic replacement policy in real environments. Quality and Reliability Engineering International, 31, 617–633.
Wu, S. (2019). A failure process model with the exponential smoothing of intensity functions. European Journal of Operational Research, 275(1), 502–513.
Wood, A. P. (1998). Optimal maintenance policies for constantly monitored systems. Naval Research Logistics, 35(4), 461–471.
Ye, Z. S., & Xie, M. (2015). Stochastic modelling and analysis of degradation for highly reliable products. Applied Stochastic Models in Business and Industry, 31(1), 16–32.
Yemane, A., & Colledani, M. (2019). Performance analysis of unreliable manufacturing systems with uncertain reliability parameters estimated from production data. International Journal of Computer Integrated Manufacturing, 32(9), 875–889.
Zhao, X., Cai, J., Mizutani, S., & Nakagawa, T. (2021). Preventive replacement policies with time of operations, mission durations, minimal repairs and maintenance triggering approaches. Journal of Manufacturing Systems, 61, 819–829.
Zhou, P., Zhang, S., Wen, L., Fu, J., Chai, T., & Wang, H. (2021). Kalman filter-based data-driven robust model-free adaptive predictive control of a complicated industrial process. IEEE Transactions on Automation Science and Engineering. https://doi.org/10.1109/TASE.2021.3061974
Zuo, M. J., Liu, B., & Murthy, D. N. P. (2000). Replacement-repair policy for multi-state deteriorating products under warranty. European Journal of Operations Research, 123(3), 519–530.
Zhang, D., Balley, A. D., & Djurdjanovic, D. (2016). Bayesian identification of hidden Markov models and their use for condition-based monitoring. IEEE Transactions on Reliability, 65(3), 1471–1482.
Acknowledgements
The author would like to express his gratitude to the four anonymous reviewers for their careful reading and constructive comments.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The author declares that he has no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix A. Proof of Proposition 1
Appendix A. Proof of Proposition 1
One can note that the cumulative process \(\Lambda (t)\) is arisen by the stochastic integration of the random function
with respect to the counting process N(t). In other words,
or, based on the relation
we have
From (A2) it follows that
Since \(\Delta \phi (t,d)\) is deterministic and \(\textbf{1}(X(t)-d)\) is \(\mathcal {F}_t\)-measurable we have
or,
That means the cumulative process \(\Lambda (t)\) admits the \(\mathcal {F}_t\)-intensity \(\lambda _c(t)\):
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Ahmadi, R. Reliability and maintenance modeling for a production system by means of point process observations. Ann Oper Res (2022). https://doi.org/10.1007/s10479-022-05139-8
Accepted:
Published:
DOI: https://doi.org/10.1007/s10479-022-05139-8