Skip to main content
Log in

The stochastic opportunistic replacement problem, part II: a two-stage solution approach

  • Published:
Annals of Operations Research Aims and scope Submit manuscript

Abstract

In Almgren et al. (The opportunistic replacement problem: analysis and case studies, preprint, Department of Mathematical Sciences, Chalmers University of Technology and University of Gothenburg, Göteborg, Sweden, 2011) we studied the opportunistic replacement problem, which is a multi-component maintenance scheduling problem with deterministic component lives. The assumption of deterministic lives is a substantial simplification, but valid in applications where critical components are assigned a technical life after which replacement is enforced. Here, we study the stochastic opportunistic replacement problem, which is a more general setting in which component lives are allowed to be stochastic. We consider a stochastic programming approach for the minimization of the expected cost over the remaining planning horizon. Further, we present a means to compute lower bounds on the recourse function. The lower bounds are used in the construction of a decomposition method which extends the integer L-shaped decomposition method to incorporate stronger optimality cuts. In order to obtain a computationally tractable model, a two-stage sample average approximation scheme is utilized. Numerical experiments on problem instances from the wind power and aviation industry as well as on two test instances are performed. The results show that the decomposition method is faster than solving the deterministic equivalent on all four instances considered. Furthermore, the numerical experiments show that decisions based on the stochastic programming approach compared with simpler maintenance policies yield maintenance decisions with a significantly lower expected total maintenance cost on two out of the four instances tested, and an equivalent maintenance cost compared to the best policy on the remaining two instances.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Algorithm 1
Algorithm 2
Algorithm 3
Fig. 1
Algorithm 4
Fig. 2

Similar content being viewed by others

Notes

  1. An opportunity can, for instance, be a planned maintenance occasion or a failure of another component, or a system shutdown.

  2. An example of a failure type which does not imply increased maintenance costs is if it consists of an enforced replacement due to condition monitoring and the availability of maintenance equipment and spare components is good.

  3. This is equivalent to considering time as measured in terms of operation time of the system.

  4. The maximum number of individuals used in a replacement schedule over the time period defined by \(\mathcal {T}\) is T+1.

  5. The evaluation in Sect. 7.1, however, explicitly considers all components.

  6. For the LPT, the technical lives of the deterministic components can be regarded as the hard lives. Reaching the technical life can, however, also be considered as a “failure”.

  7. The small difference indicates that the difference in electricity prices is not significant enough. By assuming longer stops or higher electricity prices, we obtain up to 50 % more stops in the Summer using the optimization policy.

References

  • Almgren, T., Andréasson, N., Patriksson, M. Strömberg, A.-B., & Wojciechowski, A. (2011). The opportunistic replacement problem: analysis and case studies. Preprint, Department of Mathematical Sciences, Chalmers University of Technology and University of Gothenburg, Göteborg, Sweden.

  • Andrawus, J., Watson, J., Kishk, M., & Adam, A. (2006). The selection of a suitable maintenance strategy for wind turbines. Wind. Engineering, 30(6), 471–486.

    Google Scholar 

  • Andréasson, N. (2004). Optimization of opportunistic replacement activities in deterministic and stochastic multi-component systems. Licentiate thesis, Department of Mathematical Sciences, Chalmers University of Technology and University of Gothenburg, Göteborg, Sweden.

  • Benders, J. F. (1962). Partitioning procedures for solving mixed-variables programming problems. Numerische Mathematik, 4(1), 238–252.

    Article  Google Scholar 

  • Birge, J., & Louveaux, F. (1997). Introduction to stochastic programming. New York: Springer.

    Google Scholar 

  • Budai, G., Huisman, D., & Dekker, R. (2006). Scheduling preventive railway maintenance activities. The Journal of the Operational Research Society, 57(9), 1035–1044.

    Article  Google Scholar 

  • Budai, G., Dekker, R., & Nicolai, R. P. (2008). Maintenance and production: a review of planning models. In K. A. H. Kobbacy & D. N. P. Murthy (Eds.). Springer series in reliability engineering. Complex system maintenance handbook (pp. 321–344). Berlin: Springer.

    Chapter  Google Scholar 

  • Camci, F. (2009). System maintenance scheduling with prognostics information using genetic algorithm. IEEE Transactions on Reliability, 58(3), 539–551.

    Article  Google Scholar 

  • Crocker, J., & Kumar, U. (2000). Age-related maintenance versus reliability centred maintenance: a case study on aero-engines. Reliability Engineering & Systems Safety, 67(2), 113–118.

    Article  Google Scholar 

  • Crocker, J., & Sheng, Q. (2008). Is prevention better than cure? Journal of Simulation, 2(1), 53–60.

    Article  Google Scholar 

  • Dekker, R., Wildeman, R. E., & van Egmond, R. (1996). Joint replacement in operational planning phase. European Journal of Operational Research, 91(1), 74–88.

    Article  Google Scholar 

  • Dekker, R., Wildeman, R. E., & van der Duyn Schouten, F. A. (1997). A review of multi-component maintenance models with economic dependence. Mathematical Methods of Operations Research, 45(3), 411–435.

    Article  Google Scholar 

  • Grigoriev, A., van de Klundert, J., & Spieksma, F. C. R. (2006). Modeling and solving the periodic maintenance problem. European Journal of Operational Research, 172(3), 783–797.

    Article  Google Scholar 

  • Gustafsson, E. (2010). Maintenance optimization in stochastic multicomponent systems—a dynamic programming approach. Master’s thesis, Department of Mathematical Sciences, Chalmers University of Technology and University of Gothenburg, Göteborg, Sweden.

  • Howard, R. (1960). Dynamic programming and Markov processes. New York: Wiley.

    Google Scholar 

  • Jorgenson, D. W., & Radner, R. (1960). Optimal replacement and inspection of stochastically failing equipment (Paper P-2074). Rand Corporation, Santa Monica, CA, USA.

  • Langdon, W. B., & Treleaven, P. C. (1997). Scheduling maintenance of electrical power transmission networks using genetic programming. In K. Warwick, A. Ekwue, & R. Aggarwal (Eds.), Power engineering series: Vol 22. Artificial intelligence techniques in power systems (pp. 220–237). London: The Institution of Electrical Engineers (Chap. 10).

    Chapter  Google Scholar 

  • Laporte, G., & Louveaux, F. (1993). The integer L-shaped method for stochastic integer programs with complete recourse. Operations Research Letters, 13(3), 133–142.

    Article  Google Scholar 

  • Nakagawa, T. (2005). Maintenance theory of reliability. London: Springer.

    Google Scholar 

  • Nakagawa, T. (2008). Advanced reliability models and maintenance policies. London: Springer.

    Google Scholar 

  • Papadakis, I. S., & Kleindorfer, P. R. (2005). Optimizing infrastructure network maintenance when benefits are interdependent. OR-Spektrum 27(1), 63–84.

    Article  Google Scholar 

  • Patriksson, M., Strömberg, A.-B., & Wojciechowski, A. (2012). The stochastic opportunistic replacement problem, part I: models incorporating individual component lives. Annals of Operations Research. doi:10.1007/s10479-012-1131-4.

    Google Scholar 

  • Pham, H., & Wang, H. (2000). Optimal (τ,T) opportunistic maintenance of a k-out-of-n:G system with imperfect PM and partial failure. Naval Research Logistics, 47(3), 223–239.

    Article  Google Scholar 

  • Poore, R., & Walford, C. (2008). Development of an operations and maintenance cost model to identify cost of energy savings for low wind speed turbines (Subcontract Report NREL/SR-500-40581). National Renewable Energy Laboratory, Golden, CO, USA.

  • Powell, W. B. (2007). Approximate dynamic programming. Hoboken: Wiley.

    Book  Google Scholar 

  • Van Slyke, R. M., & Wets, R. (1969). L-shaped linear programs with application to optimal control and stochastic programming. SIAM Journal on Applied Mathematics, 17(4), 638–663.

    Article  Google Scholar 

  • Wang, H. (2002). A survey of maintenance policies of deteriorating systems. European Journal of Operational Research, 139(3), 469–489.

    Article  Google Scholar 

  • Zhou, X., Xi, L., & Lee, J. (2009). Opportunistic preventive maintenance scheduling for a multi-unit series system based on dynamic programming. International Journal of Production Economics, 118(2), 361–366.

    Article  Google Scholar 

Download references

Acknowledgements

The authors thank two anonymous reviewers for their valuable comments, which improved both the presentation and the content of the paper, including modifications and simplifications of the wind turbine case. In particular, the implicit handling of components with exponentially distributed lives was a significant improvement.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Adam Wojciechowski.

Appendix A: Proof of Proposition 1

Appendix A: Proof of Proposition 1

We will present a proof of (a) based on induction over the set of times. We will first prove the induction step for the case in which only one component age differs. The proof uses the fact that the failure probability and thus the expected cost of the component at the next time step increases with age. We then show that the proposition holds in the general case. Thereafter, we will prove (b) by utilizing the possibility of replacing the component which differs in age at the next time step and utilizing the result in (a).

To simplify notation we define p i =G i (a i ) for all \(i \in \mathcal {N}\). Further, we define \(F^{a,t}: \mathbb {B}^{n} \rightarrow \mathbb {R}\) by

where \(a^{x}_{i} = a_{i}(1-x_{i})\), for each component \(i \in \mathcal {N}\). Note that F a,t(x) is the minimal objective value of (1) given the decision x. For any subset \(\mathcal {A}\subseteq \mathcal {N}\), define \(F^{*a,t}_{\mathcal {A}} = \min\{F^{a,t}(x) \mid x \in \mathbb {B}^{n}, x_{j}=1\) for \(j \in \mathcal {A}\}\). Note that this is equal to f t (ξ,a), as defined in (1), where ξ i =1 for \(i \in \mathcal {A}\) and ξ i =0 for \(i \in \mathcal {N}\backslash \mathcal {A}\). Introduce the notation \(\hat {p}_{i} = G_{i}(\hat {a}_{i})\) for \(i \in \mathcal {N}\).

(a) We will proceed by induction over the set of times, starting with T and going backwards. According to the definition, it holds that

$$C_T(\hat {a}) = 0 = C_T(a).$$

The induction assumption for \(t\in \mathcal {T}\) is that for all \(a, \hat {a}\in \mathbb {R}^{n}_{+}\) such that \(\hat {a}\leq a\) the inequality \(C_{t+1}(\hat {a}) \leq C_{t+1}(a)\) holds. We will establish that this implies a similar statement at time t.

Assume first that \(\hat {a}_{i} = a_{i}\) for \(i\in \mathcal {N}\backslash \{ l \}\), and \(\hat {a}_{l}<a_{l}\). We have that \(p_{i} = \hat {p}_{i}\) for \(i \in \mathcal {N}\backslash\{l\}\). Note that the non-decreasing failure rate function yields that \(p_{l} \geq \hat {p}_{l}\). This implies that \(F^{\hat {a},t+1}(x) \leq F^{a,t+1}(x)\) for all \(x\in \mathbb {B}^{n}\), which in turn implies that \(F^{* \hat {a}, t+1}_{\mathcal {A}} \leq F^{*a, t+1}_{\mathcal {A}}\) for all \(\mathcal {A}\subseteq \mathcal {N}\). Note also that \(F^{* a,t+1}_{\mathcal {A}} \leq F^{* a, t+1}_{\mathcal {B}}\) holds whenever \(\mathcal {A}\subseteq \mathcal {B}\subseteq \mathcal {N}\). Finally note that for any subset \(\mathcal {A}\subseteq \mathcal {N}\) such that \(l \in \mathcal {A}\) the relation \(F^{*a+1,t+1}_{\mathcal {A}\cup\{l\}} =F^{*\hat {a}+1,t+1}_{\mathcal {A}\cup\{l\}}\) holds. Using these observations we obtain that

Using the definition of C t (a) and the above results we obtain that

where the first sum loops over all combinations of component failures at time t+1. We have thus proven that \(C_{t}(\hat {a}) \leq C_{t}(a)\) holds when \(\hat {a}_{i} = a_{i}\) for \(i\in \mathcal {N}\backslash \{ l \}\), and \(\hat {a}_{l} <a_{l}\).

For a general pair \((a,\hat {a})\) such that \(\hat {a}\leq a\) we can construct a sequence \(\{a^{j}\}_{j=1}^{j=m}\) such that \(\hat {a}\leq a^{1} \leq\ldots\leq a^{m} \leq a\) and where only one entry differs between each consecutive pair in the sequence. This implies that \(C_{t}(\hat {a}) \leq C_{t}(a)\) which implies that (a) holds.

(b) For t=T the inequality is trivial. We consider the case when t∈{0,…,T−1}. The non-decreasing failure risk function yields the inequality \(\hat {p}_{l} \geq p_{l}\). Let there be given \(b,\hat {b}\in \mathbb {R}_{+}^{n}\) such that \(b_{i}=\hat {b}_{i}\) for \(i \in \mathcal {N}\backslash \{ l \}\) and \(b_{l} <\hat {b}_{l}\). Assume \(\emptyset\neq \mathcal {A}\subseteq \mathcal {N}\). Let x be defined such that \(x^{*}_{i}=1\) for \(i \in \mathcal {A}\) and \(F^{*b,t+1}_{\mathcal {A}} =F^{b,t+1}(x^{*})\). Let \(\hat {x}_{i} = x^{*}_{i}\) for \(i \in \mathcal {N}\backslash \{ l \}\) and \(\hat {x}_{l} = 1\). Then

where we have used that \(\hat {b}^{\hat {x}} = b^{\hat {x}} \leq b^{x^{*}}\) as well as the statement in (a). We have thus established that \(F^{*\hat {b},t+1}_{\mathcal {A}}\leq F^{*b,t+1}_{\mathcal {A}} + c_{l}\) holds. Similar arguments yield the inequality \(F^{*\hat {b},t+1}_{\emptyset} \leq F^{*b,t+1}_{\emptyset} + d + c_{l}\). We also have that \(F^{*b,t+1}_{ \mathcal {A}\cup \{ l \}} \leq F^{*b,t+1}(\hat {x}) \leq F^{*b,t+1}_{\mathcal {A}}+ c_{l}\) holds and, similarly, \(F^{*b,t+1}_{ \{l\}} \leq F^{*b,t+1}_{\emptyset} + c_{l} +d\) holds. Finally, we note that \(F^{*\hat {b},t+1}_{ \mathcal {A}\cup \{ l \}} = F^{*b,t+1}_{ \mathcal {A}\cup \{ l \}}\).

Using the above relations, we can now conclude that if \(\emptyset\neq \mathcal {A}\subseteq \mathcal {N}\) then

(8)

Similarly we can show that

This implies that

Returning to the original notation, we conclude that the proposition holds.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Patriksson, M., Strömberg, AB. & Wojciechowski, A. The stochastic opportunistic replacement problem, part II: a two-stage solution approach. Ann Oper Res 224, 51–75 (2015). https://doi.org/10.1007/s10479-012-1134-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10479-012-1134-1

Keywords

Navigation