Skip to main content

Utilising Data from Multiple Production Lines for Predictive Deep Learning Models

  • Conference paper
  • First Online:
Distributed Computing and Artificial Intelligence, Volume 1: 18th International Conference (DCAI 2021)

Abstract

A Basic Oxygen Furnace (BOF) for steel making is a complex industrial process that is difficult to monitor due to the harsh environment, so the collected production data is very limited given the process complexity. Also, such production data has a low degree of variability. An accurate machine learning (ML) model for predicting production outcome requires both large and varied data, so utilising data from multiple BOFs will allow for more capable ML models, since both the amount and variability of data increases. Data collection setups for different BOFs are different, such that data sets are not compatible to directly join for ML training. Our approach is to let a neural network benefit from these collection differences in a joint training model.

We present a neural network-based approach that simultaneously and jointly co-trains on several data sets. Our novelty is that the first network layer finds an internal representation of each individual BOF, while the other layers use this representation to concurrently learn a common BOF model. Our evaluation shows that the prediction accuracy of the common model increases compared to separate models trained on individual furnaces’ data sets. It is clear that multiple data sets can be utilised this way to increase model accuracy for better production prediction performance. For the industry, this means that the amount of available data for model training increases and thereby more capable ML models can be trained when having access to multiple data sets describing the same or similar manufacturing processes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Torrey, L., Shavlik, J.: Transfer learning. In Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques, pp. 242–264. IGI global (2010)

    Google Scholar 

  • Luo, G., Yang, Y., Yuan, Y., Chen, Z., Ainiwaer, A.: Hierarchical transfer learning architecture for low-resource neural machine translation. IEEE Access 7, 154157–154166 (2019). ISSN 2169-3536. Conference Name: IEEE Access

    Google Scholar 

  • Bae, J., Li, Y., Ståhl, N., Mathiason, G., Kojola, N.: Using machine learning for robust target prediction in a Basic Oxygen Furnace system. Metall. Mater. Trans. B 51, 1632–1645 (2020)

    Google Scholar 

  • Viana Junior, M.A., Silva, C.A., Silva, I.A.: Hybrid model associating thermodynamic calculations and artificial neural network in order to predict molten steel temperature evolution from blowing end of a BOF for secondary metallurgy. REM Int. Eng. J. 71(4), 587–592 (2018). ISSN 2448-167X

    Google Scholar 

  • Li, W., Wang, X., Wang, X., Wang, H.: Endpoint prediction of BOF steelmaking based on BP neural network combined with improved PSO. Chem. Eng. Trans. 51, 475–480 (2016)

    Article  Google Scholar 

  • Laha, D., Ren, Y., Suganthan, P.N.: Modeling of steelmaking process with effective machine learning techniques. Expert Syst. Appl. 42(10), 4687–4696 (2015). ISSN 0957-4174

    Google Scholar 

  • Bing-yao, C., Hui, Z., You-jun, Y.: Research on the BOF steelmaking endpoint temperature prediction. In: 2011 International Conference on Mechatronic Science, Electric Engineering and Computer (MEC), pp. 2278–2281, August 2011

    Google Scholar 

  • Wang, X., Han, M., Wang, J.: Applying input variables selection technique on input weighted support vector machine modeling for BOF endpoint prediction. Eng. Appl. Artif. Intell. 23(6), 1012–1018 (2010). ISSN 0952-1976

    Google Scholar 

  • Han, M., Jiang, L.: Endpoint prediction model of basic oxygen furnace steelmaking based on PSO-ICA and RBF neural network. In: 2010 International Conference on Intelligent Control and Information Processing, pp. 388–393, August 2010

    Google Scholar 

  • Cox, I.J., Lewis, R.W., Ransing, R.S., Laszczewski, H., Berni, G.: Application of neural computing in basic oxygen steelmaking. J. Mater. Process. Technol. 120(1), 310–315 (2002). ISSN 0924-0136

    Google Scholar 

  • Maas, A.L., Hannun, A.Y., Ng, A.Y.: Rectifier nonlinearities improve neural network acoustic models. In: Proceedings of ICML, vol. 30, p. 3 (2013)

    Google Scholar 

  • Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  • Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)

    MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

We would like to thank Niklas Kojola, Carl Ellström, Patrik Wikström, and Lennart Gustavsson at SSAB for the close collaboration in the Swedish Metal project under which this research is funded. The project is funded by the Knowledge Foundation in Sweden, under the grant 20170297.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Niclas Ståhl .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ståhl, N., Mathiason, G., Bae, J. (2022). Utilising Data from Multiple Production Lines for Predictive Deep Learning Models. In: Matsui, K., Omatu, S., Yigitcanlar, T., González, S.R. (eds) Distributed Computing and Artificial Intelligence, Volume 1: 18th International Conference. DCAI 2021. Lecture Notes in Networks and Systems, vol 327. Springer, Cham. https://doi.org/10.1007/978-3-030-86261-9_7

Download citation

Publish with us

Policies and ethics