Abstract
Achieving energy-efficient production has always been a critical issue for the manufacturing industry. In many production systems, the waste of energy mainly results from unbalanced machine efficiency, which brings about a considerable amount of idle time. One of the most important approaches to addressing this problem is to adopt an On/Off control policy on those underutilized machines. In this paper, serial production lines with multiple unreliable machines and finite buffers are considered. All machines are assumed to obey the Bernoulli reliability model, which is commonly used when the machine downtime is relatively short and comparable to the production cycle time (e.g., engine assembly). Besides, considering that in industrial practice, machines usually have to go through a preparation phase during mode switching, a non-negligible warm-up (cool-down) period is taken into account. An On/Off control policy is calculated for lines with two or three machines based on a Markov decision process (MDP) model, then the results are extended to multi-machine lines using a decomposition procedure. Numerical experiments show that the proposed policy achieves better system performance compared to the threshold policy that is commonly used in energy-efficient On/Off control.
Similar content being viewed by others
References
Chen G, Zhang L, Arinez J, Biller S (2013) Energy-efficient production systems through schedule-based operations. IEEE Trans Autom Sci Eng 10(1):27–37. https://doi.org/10.1109/TASE.2012.2202226
Cui P-H, Wang J-Q, Li Y, Yan F-Y (2021) Energy-efficient control in serial production lines: modeling, analysis and improvement. J Manuf Syst 60:11–21. https://doi.org/10.1016/j.jmsy.2021.04.002
EIA (2019) International energy outlook 2019. Technical report, US Energy Information Administration
Frigerio N, Matta A (2016) Analysis on energy efficient switching of machine tool with stochastic arrivals and buffer information. IEEE Trans Autom Sci Eng 13(1):238–246. https://doi.org/10.1109/TASE.2015.2492600
Frigerio N, Shanthikumar JG, Matta A (2015) Dynamic programming for energy control of machine tools in manufacturing. In: 2015 IEEE international conference on automation science and engineering (CASE). IEEE, Gothenburg, pp 39–44. https://doi.org/10.1109/CoASE.2015.7294038
Fysikopoulos A, Pastras G, Alexopoulos T, Chryssolouris G (2014) On a generalized approach to manufacturing energy efficiency. Int J Adv Manuf Technol 73:1437–1452. https://doi.org/10.1007/s00170-014-5818-3
Gahm C, Denz F, Dirr M, Tuma A (2016) Energy-efficient scheduling in manufacturing companies: a review and research framework. Eur J Oper Res 248(3):744–757. https://doi.org/10.1016/j.ejor.2015.07.017
Jia Z, Zhang L, Arinez J, Xiao G (2016) Performance analysis for serial production lines with Bernoulli Machines and Real-time WIP-based machine switch-on/off control. Int J Prod Res 54(21):6285–6301. https://doi.org/10.1080/00207543.2016.1197438
Kang N, Zhao C, Li J, Horst JA (2016) A hierarchical structure of key performance indicators for operation management and continuous improvement in production systems. Int J Prod Res 54(21):6333–6350. https://doi.org/10.1080/00207543.2015.1136082
Li J, Meerkov SM (2009) Production systems engineering. Springer, New York, London
Li L, Sun Z (2013) Dynamic energy control for energy efficiency improvement of sustainable manufacturing systems using Markov decision process. IEEE Trans Syst, Man, Cybern: Syst 43(5):1195–1205. https://doi.org/10.1109/TSMC.2013.2256856
Li Y, Cui P-H, Wang J-Q, Chang Q (2021) Energy-saving control in multistage production systems using a state-based method. IEEE Trans Autom Sci Eng. https://doi.org/10.1109/TASE.2021.3118226
Loffredo A, Frigerio N, Lanzarone E, Matta A (2021) Energy-efficient control policy for parallel and identical machines with availability constraint. IEEE Robot Autom Lett 6(3):7. https://doi.org/10.1109/LRA.2021.3085169
Meerkov SM, Zhang L (2008) Transient behavior of serial production lines with Bernoulli machines. IIE Trans 40(3):297–312. https://doi.org/10.1080/07408170701488037
Mouzon G, Yildirim MB, Twomey J (2007) Operational methods for minimization of energy consumption of manufacturing equipment. Int J Prod Res 45(18–19):4247–4271. https://doi.org/10.1080/00207540701450013
Su W, Xie X, Li J, Zheng L, Feng SC (2017) Reducing energy consumption in serial production lines with Bernoulli reliability machines. Int J Prod Res 55(24):7356–7379. https://doi.org/10.1080/00207543.2017.1349948
Su H, Frigerio N, Matta A (2016) Energy saving opportunities and value of information: a trade-off in a production line. In: Procedia CIRP, vol 48. Elsevier Procedia, Berlin, pp 301–306. https://doi.org/10.1016/j.procir.2016.03.147
Sun Z, Li L (2013) Opportunity estimation for real-time energy control of sustainable manufacturing systems. IEEE Trans Autom Sci Eng 10(1):38–44. https://doi.org/10.1109/TASE.2012.2216876
Sutton RS, Barto AG (2018) Reinforcement learning: an introduction, 2nd edn. The MIT Press, Cambridge
Tu J, Bai Y, Yang M, Zhang L, Denno P (2020) Real-time bottleneck in serial production lines with bernoulli machines: theory and case study. IEEE Trans Autom Sci Eng. https://doi.org/10.1109/TASE.2020.3021346
Wang J, Fei Z, Chang Q, Li S, Fu Y (2019) Multi-state decision of unreliable machines for energy-efficient production considering work-in-process inventory. Int J Adv Manuf Technol 102(1–4):1009–1021. https://doi.org/10.1007/s00170-018-03213-9
Wang F, Ju F, Kang N (2019) Transient analysis and real-time control of geometric serial lines with residence time constraints. IISE Trans 51(7):709–728. https://doi.org/10.1080/24725854.2018.1511937
Wang J, Feng Y, Fei Z, Li S, Chang Q (2017) Markov chain based idle status control of stochastic machines for energy saving operation. In: 2017 13th IEEE conference on automation science and engineering (CASE). IEEE, Xi’an, pp 1019–1023. https://doi.org/10.1109/COASE.2017.8256236
Yan C-B (2020) Analysis and optimization of energy consumption in two-machine Bernoulli lines with general bounds on machine efficiency. IEEE Trans Autom Sci Eng. https://doi.org/10.1109/TASE.2020.2973426
Yan C-B, Zheng Z (2020) An effective and efficient divide-and-conquer algorithm for energy consumption optimisation problem in long Bernoulli serial lines. Int J Prod Res. https://doi.org/10.1080/00207543.2020.1832276
Yan C-B, Zheng Z (2020) Problem formulation and solution methodology for energy consumption optimization in Bernoulli serial lines. IEEE Trans Autom Sci Eng. https://doi.org/10.1109/TASE.2020.2973432
Zhang L, Wang C, Arinez J, Biller S (2013) Transient analysis of Bernoulli serial lines: performance evaluation and system-theoretic properties. IIE Trans 45(5):528–543. https://doi.org/10.1080/0740817X.2012.721946
Zhao C, Li J (2015) Analysis and improvement of multiproduct Bernoulli serial lines: theory and application. IEEE Trans Syst, Man, Cybern: Syst 45(9):1218–1230. https://doi.org/10.1109/TSMC.2015.2399868
Zou J, Chang Q, Arinez J, Xiao G (2017) Data-driven modeling and real-time distributed control for energy efficient manufacturing systems. Energy 127:247–257. https://doi.org/10.1016/j.energy.2017.03.123
Acknowledgements
We thank the Editor-in-Chief, Associate Editor, and all the anonymous reviewers for their thoughtful comments on an earlier version of this manuscript.
Funding
This work was supported in part by the National Natural Science Foundation of China under Grant 62103042, in part by the Beijing Municipal Natural Science Foundation under Grant 4214076, and in part by the National Key R &D Program of China under Grant 2021YFB1714800.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix A Calculation of the transition matrix
Algorithm for calculating the state transition matrix \(\mathbf {P_{\mathrm {a}}}\) of three-machine lines is shown in Algorithm 1, where idx2state and state2idx are functions that map a state vector \(\left[ h_1,h_2,P_{\mathrm {s}}\right]\) with an index in lexicographical order. \((h_1,h_2)=\Phi _h({\mathbf {h}},{\varvec{\alpha }})\) is defined by 4 equations shown in Eq. (A1).
For two-machine lines, the calculation of \(\mathbf {P_{\mathrm {a}}}\) is shown in Algorithm 2.
Appendix B The policy iteration procedure
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wang, X., Dai, Y. & Jia, Z. Energy-efficient on/off control in serial production lines with Bernoulli machines. Flex Serv Manuf J 36, 103–128 (2024). https://doi.org/10.1007/s10696-022-09481-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10696-022-09481-8