Skip to main content

Research on Scheduling Method for Uncertainty of Hit Rate of Molten Steel Based on Q Learning

  • Conference paper
  • First Online:
Advances in Simulation and Process Modelling (ISSPM 2020)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1305))

Included in the following conference series:

  • 448 Accesses

Abstract

Aiming at the problem of uncertain scheduling of molten steel hit rate in the steel refining process, taking into account the multi-stage, multi-equipment, and multi-constrained production process conditions of refining production and the process of refining process due to the uncertainty of molten steel hit rate during the refining process, in order to obtain a scientific and feasible approximate optimal scheduling plan in a short period of time, the system state and system state transfer rules of the steel production process are defined, and the random evolution scheduling optimization system model of steel production refining based on the discrete-time Markov chain is established. At the same time, in the refining process scheduling optimization problem, the complexity of the solution will increase exponentially with the increase of the number of reprocessing processes, and a stochastic dynamic programming algorithm based on heuristic simulation strategy and improved Q learning is designed to solve the problem. Aiming at the uncertain scheduling problem of molten steel hit rate under different process production paths, simulation experiments using actual production data of a large domestic steel mill verify the effectiveness of the proposed model and algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Pang, X.F., Jiang, Y.C., Yu, S.P., Li, H.B., Gao, L., Che, Z.H.: Flexible job shop rescheduling method of steelmaking-continuous casting base on human-computer cooperation. Comput. Integr. Manuf. Syst. 24(10), 2415–2427 (2018) (in Chinese)

    Google Scholar 

  2. Mao, K.: Lagrange Relaxation Level Optimization Method and its Application to Production Scheduling of the Steelmaking-Continuous. Northeastern University (2014) (in Chinese)

    Google Scholar 

  3. Liu, G., Luh, P.B., Resch, R.: Scheduling permutation flow shops using the Lagrangian relaxation technique. Ann. Oper. Res. 3(4), 171–189 (1997)

    Article  MathSciNet  Google Scholar 

  4. Zheng, Z., Long, J.Y., Gao, X.Q., Gong, Y.M., Hu, W.Z.: Present situation and prospect of production control technology focusing on planning and scheduling in iron and steel enterprise. Comput. Integr. Manuf. Syst. 20(11), 2660–2674 (2014) (in Chinese)

    Google Scholar 

  5. Sun, L.L.: Research on the optimal scheduling method for the productive process of steelmaking-refining-continuous casting. Northeastern University (2014) (in Chinese)

    Google Scholar 

  6. Tan, Y.Y., Huang, Y.L., Liu, S.X.: Two-stage mathematical programming approach for steelmaking process scheduling under variable electricity price. J. Iron Steel Res. (International) 12(20), 1–8 (2013)

    Google Scholar 

Download references

Acknowledgements

The research is sponsored by the National Natural Science Foundation of China (61873174, 61503259), China Postdoctoral Science Foundation Funded Project (2017M611261), Science and Technology Projects of Ministry of Housing and Urban Rural Development (2018-K1-019), Liaoning Provincial Natural Science Foundation of China (20180550613, 2020-KF-11-07), Young science and technology innovation talent support plan (RC200003), and Liaoning Revitalization Talents Program (XLYC1807115).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Liangliang Sun .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sun, L., Lu, T., Sha, S., Zhu, W., Qu, Q., Yuan, B. (2021). Research on Scheduling Method for Uncertainty of Hit Rate of Molten Steel Based on Q Learning. In: Li, Y., Zhu, Q., Qiao, F., Fan, Z., Chen, Y. (eds) Advances in Simulation and Process Modelling. ISSPM 2020. Advances in Intelligent Systems and Computing, vol 1305. Springer, Singapore. https://doi.org/10.1007/978-981-33-4575-1_15

Download citation

  • DOI: https://doi.org/10.1007/978-981-33-4575-1_15

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-33-4574-4

  • Online ISBN: 978-981-33-4575-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics