Abstract
Aiming at the problem of uncertain scheduling of molten steel hit rate in the steel refining process, taking into account the multi-stage, multi-equipment, and multi-constrained production process conditions of refining production and the process of refining process due to the uncertainty of molten steel hit rate during the refining process, in order to obtain a scientific and feasible approximate optimal scheduling plan in a short period of time, the system state and system state transfer rules of the steel production process are defined, and the random evolution scheduling optimization system model of steel production refining based on the discrete-time Markov chain is established. At the same time, in the refining process scheduling optimization problem, the complexity of the solution will increase exponentially with the increase of the number of reprocessing processes, and a stochastic dynamic programming algorithm based on heuristic simulation strategy and improved Q learning is designed to solve the problem. Aiming at the uncertain scheduling problem of molten steel hit rate under different process production paths, simulation experiments using actual production data of a large domestic steel mill verify the effectiveness of the proposed model and algorithm.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Pang, X.F., Jiang, Y.C., Yu, S.P., Li, H.B., Gao, L., Che, Z.H.: Flexible job shop rescheduling method of steelmaking-continuous casting base on human-computer cooperation. Comput. Integr. Manuf. Syst. 24(10), 2415–2427 (2018) (in Chinese)
Mao, K.: Lagrange Relaxation Level Optimization Method and its Application to Production Scheduling of the Steelmaking-Continuous. Northeastern University (2014) (in Chinese)
Liu, G., Luh, P.B., Resch, R.: Scheduling permutation flow shops using the Lagrangian relaxation technique. Ann. Oper. Res. 3(4), 171–189 (1997)
Zheng, Z., Long, J.Y., Gao, X.Q., Gong, Y.M., Hu, W.Z.: Present situation and prospect of production control technology focusing on planning and scheduling in iron and steel enterprise. Comput. Integr. Manuf. Syst. 20(11), 2660–2674 (2014) (in Chinese)
Sun, L.L.: Research on the optimal scheduling method for the productive process of steelmaking-refining-continuous casting. Northeastern University (2014) (in Chinese)
Tan, Y.Y., Huang, Y.L., Liu, S.X.: Two-stage mathematical programming approach for steelmaking process scheduling under variable electricity price. J. Iron Steel Res. (International) 12(20), 1–8 (2013)
Acknowledgements
The research is sponsored by the National Natural Science Foundation of China (61873174, 61503259), China Postdoctoral Science Foundation Funded Project (2017M611261), Science and Technology Projects of Ministry of Housing and Urban Rural Development (2018-K1-019), Liaoning Provincial Natural Science Foundation of China (20180550613, 2020-KF-11-07), Young science and technology innovation talent support plan (RC200003), and Liaoning Revitalization Talents Program (XLYC1807115).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Sun, L., Lu, T., Sha, S., Zhu, W., Qu, Q., Yuan, B. (2021). Research on Scheduling Method for Uncertainty of Hit Rate of Molten Steel Based on Q Learning. In: Li, Y., Zhu, Q., Qiao, F., Fan, Z., Chen, Y. (eds) Advances in Simulation and Process Modelling. ISSPM 2020. Advances in Intelligent Systems and Computing, vol 1305. Springer, Singapore. https://doi.org/10.1007/978-981-33-4575-1_15
Download citation
DOI: https://doi.org/10.1007/978-981-33-4575-1_15
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-33-4574-4
Online ISBN: 978-981-33-4575-1
eBook Packages: EngineeringEngineering (R0)