Estimating Ore Production in Open-pit Mines Using Various Machine Learning Algorithms Based on a Truck-Haulage System and Support of Internet of Things

Abstract

This study aimed to develop and assess the feasibility of different machine learning algorithms for predicting ore production in open-pit mines based on a truck-haulage system with the support of the Internet of Things (IoT). Six machine learning algorithms, namely the random forest (RF), support vector machine (SVM), multi-layer perceptron neural networks (MLP neural nets), classification and regression tree, k-nearest neighbors, and M5Tree model, were developed and investigated to estimate ore production at a limestone open-pit mine in South Korea. Systems of IoT were used to collect a massive database of 16,217 observations (big data). To process this big data, a downscaling method was applied to reduce the size of the original observations to improve the computational cost of the machine learning models. Subsequently, three validation datasets were selected from the original observations and used to evaluate (after downscaling the observations) the performance and accuracy of the machine learning models in practical engineering through various performance metrics. The results revealed that the models used can be potentially used for predicting ore production in open-pit mines. The SVM, MLP neural nets, and RF models demonstrated high accuracy, with the SVM model exhibiting the most superior performance and the highest accuracy. An assessment of the validation datasets also confirmed the feasibility and stability of the models for predicting ore production. Furthermore, a sensitivity analysis indicated that the relative operation start time, relative operation end time, and interval between the operation times were the most important input variables for improving ore production in practical engineering.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Fig. 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21
Figure 22
Figure 23
Figure 24

References

  1. Alarie, S., & Gamache, M. (2002). Overview of solution strategies used in truck dispatching systems for open pit mines. International Journal of Surface Mining, Reclamation, and Environment, 16(1), 59–76.

    Google Scholar 

  2. Amiri, M., Amnieh, H. B., Hasanipanah, M., & Khanli, L. M. (2016). A new combination of artificial neural network and K-nearest neighbors models to predict blast-induced ground vibration and air-overpressure. Engineering with Computers, 32(4), 631–644.

    Google Scholar 

  3. Baek, J., & Choi, Y. (2019a). Deep neural network for ore production and crusher utilization prediction of truck haulage system in underground mine. Applied Sciences, 9(19), 4180.

    Google Scholar 

  4. Baek, J., & Choi, Y. (2019b). Simulation of truck haulage operations in an underground mine using big data from an ICT-based mine safety management system. Applied Sciences, 9(13), 2639.

    Google Scholar 

  5. Baek, J., & Choi, Y. (2020). Deep neural network for predicting ore production by truck-haulage systems in open-pit mines. Applied Sciences, 10(5), 1657.

    Google Scholar 

  6. Baek, J., Choi, Y., Lee, C., Suh, J., & Lee, S. (2017). BBUNS, Bluetooth beacon-based underground navigation system to support mine haulage operations. Minerals, 7(11), 228.

    Google Scholar 

  7. Box, G. E., & Cox, D. R. (1964). An analysis of transformations. Journal of the Royal Statistical Society. Series B (Methodological), 26(2), 211–252.

    Google Scholar 

  8. Breiman, L. (1999). Random forests. Technical Report TR567. University of California-Berkeley, Statistics Department, 1–34

  9. Breiman, L. (2017). Classification and regression trees, Routledge. 1351460498.

  10. Bronshtein, A. (2017). A quick introduction to K-Nearest Neighbors Algorithm. Retrieved from A Quick Introduction to K-Nearest Neighbors Algorithm, https,//medium. com/@ adi. bronshtein/a-quickintroduction-to-k-nearest-neighborsalgorithm-62214cea29c7.

  11. Bui, H.-B., Nguyen, H., Choi, Y., Bui, X.-N., Nguyen-Thoi, T., & Zandi, Y. (2019a). A novel artificial intelligence technique to estimate the gross calorific value of coal based on meta-heuristic and support vector regression algorithms. Applied Sciences, 9(22), 4868.

    Google Scholar 

  12. Bui, X.-N., Jaroonpattanapong, P., Nguyen, H., Tran, Q.-H., & Long, N. Q. (2019b). A novel hybrid model for predicting blast-induced ground vibration based on k-nearest neighbors and particle swarm optimization. Scientific Reports, 9(1), 1–14.

    Google Scholar 

  13. Bui, X.-N., Nguyen, H., Le, H.-A., Bui, H.-B., & Do, N.-H. (2019c). Prediction of blast-induced air over-pressure in open-pit mine, assessment of different artificial intelligence techniques. Natural Resources Research, 29(2), 571–591.

    Google Scholar 

  14. Bui, D. T., Khosravi, K., Karimi, M., Busico, G., Khozani, Z. S., Nguyen, H., et al. (2020a). Enhancing nitrate and strontium concentration prediction in groundwater by using new data mining algorithm. Science of the Total Environment, 715, 136836.

    Google Scholar 

  15. Bui, X.-N., Nguyen, H., Choi, Y., Nguyen-Thoi, T., Zhou, J., & Dou, J. (2020b). Prediction of slope failure in open-pit mines using a novel hybrid artificial intelligence model based on decision tree and evolution algorithm. Scientific Reports, 10(1), 9939.

    Google Scholar 

  16. Burt, C. N., & Caccetta, L. (2007). Match factor for heterogeneous truck and loader fleets. International Journal of Mining, Reclamation and Environment, 21(4), 262–270.

    Google Scholar 

  17. Choi, Y. (2011). New software for simulating truck-shovel operation in open pit mines. Journal of the Korean Society for Geosystem Engineering, 48(4), 448–459.

    Google Scholar 

  18. Choi, Y., & Nieto, A. (2011a). Optimal haulage routing of off-road dump trucks in construction and mining sites using Google Earth and a modified least-cost path algorithm. Automation in Construction, 20(7), 982–997.

    Google Scholar 

  19. Choi, Y., & Nieto, A. (2011b). Software for simulating open-pit truck/shovel haulage systems using Google Earth and GPSS/H. Journal of the Korean Society for Geosystem Engineering, 48(6), 734–743.

    Google Scholar 

  20. Choi, Y., Park, S., Lee, S.-J., Baek, J., Jung, J., & Park, H.-S. (2016). Development of a windows-based program for discrete event simulation of truck-loader haulage systems in an underground mine. Tunnel and Underground Space, 26(2), 87–99.

    Google Scholar 

  21. Choubin, B., Darabi, H., Rahmati, O., Sajedi-Hosseini, F., & Kløve, B. (2018). River suspended sediment modelling using the CART model, A comparative study of machine learning techniques. Science of the Total Environment, 615, 272–281.

    Google Scholar 

  22. Cortes, C., & Vapnik, V. (1995). Support vector machine. Machine learning, 20(3), 273–297.

    Google Scholar 

  23. Cristianini, N., & Shawe-Taylor, J. (2000). An introduction to support vector machines and other kernel-based learning methods, Cambridge University Press. 0521780195.

  24. da Silva, I. N., Spatti, D. H., Flauzino, R. A., Liboni, L. H. B., & dos Reis Alves, S. F. (2017). Artificial neural network architectures and training processes. Artificial neural networks (pp. 21–28). Berlin: Springer.

    Google Scholar 

  25. Demuth, H. B., Beale, M. H., De Jess, O., & Hagan, M. T. (2014). Neural network design, Martin Hagan. 0971732116.

  26. Deo, R. C., Kisi, O., & Singh, V. P. (2017). Drought forecasting in eastern Australia using multivariate adaptive regression spline, least square support vector machine and M5Tree model. Atmospheric Research, 184, 149–175.

    Google Scholar 

  27. Do, T. N., Ho, G. S., Tran, X. M., Doan, T. V., & Bui, N. D. (2020). Mining technology for exploiting deep open-pit mines in Vietnam (in Vietnamese). Journal of Mining and Earth Sciences, 61(5), 47–57.

  28. Douglas, J. (1964). Prediction Shovel-Truck production, A reconciliation of computer and conventional estimates.

  29. Drucker, H., Burges, C. J., Kaufman, L., Smola, A. J., & Vapnik, V. (1997). Support vector regression machines. Advances in neural information processing systems.

  30. Edwards, D. J., Malekzadeh, H., & Yisa, S. B. (2001). A linear programming decision tool for selecting the optimum excavator. Structural Survey.

  31. Ercelebi, S. G., & Bascetin, A. (2009). Optimization of shovel-truck system for surface mining. Journal of the Southern African Institute of Mining and Metallurgy, 109(7), 433–439.

    Google Scholar 

  32. Fang, Q., Nguyen, H., Bui, X.-N., & Nguyen-Thoi, T. (2019). Prediction of blast-induced ground vibration in open-pit mines using a new technique based on imperialist competitive algorithm and M5Rules. Natural Resources Research, 29(2), 791–806.

    Google Scholar 

  33. Fushiki, T. (2011). Estimation of prediction error by using K-fold cross-validation. Statistics and Computing, 21(2), 137–146.

    Google Scholar 

  34. Gandomi, A., & Haider, M. (2015). Beyond the hype, big data concepts, methods, and analytics. International Journal of Information Management, 35(2), 137–144.

    Google Scholar 

  35. García, V. J., Márquez, C. O., Isenhart, T. M., Rodríguez, M., Crespo, S. D., & Cifuentes, A. G. (2019). Evaluating the conservation state of the páramo ecosystem, an object-based image analysis and CART algorithm approach for central Ecuador. Heliyon, 5(10), e02701.

    Google Scholar 

  36. Gebrechorkos, S. H., Hülsmann, S., & Bernhofer, C. (2019). Statistically downscaled climate dataset for East Africa. Scientific Data, 6(1), 1–8.

    Google Scholar 

  37. Ghannad-Rezaie, M., Soltanian-Zadeh, H., Ying, H., & Dong, M. (2010). Selection–fusion approach for classification of datasets with missing values. Pattern Recognition, 43(6), 2340–2350.

    Google Scholar 

  38. Gholami, R., & Fakhari, N. (2017). Support vector machine, principles, parameters, and applications (pp. 515–535)., Handbook of Neural Computation Amsterdam: Elsevier.

    Google Scholar 

  39. Guo, H., Nguyen, H., Bui, X.-N., & Armaghani, D. J. (2019a). A new technique to predict fly-rock in bench blasting based on an ensemble of support vector regression and GLMNET. Engineering with Computers. https://doi.org/10.1007/s00366-019-00833-x.

    Article  Google Scholar 

  40. Guo, H., Nguyen, H., Vu, D.-A., & Bui, X.-N. (2019b). Forecasting mining capital cost for open-pit mining projects based on artificial neural network approach. Resources Policy. https://doi.org/10.1016/j.resourpol.2019.101474.

    Article  Google Scholar 

  41. Hartman, H. L., & Mutmansky, J. M. (2002). Introductory mining engineering, Wiley. 0471348511.

  42. Hirose, Y., Yamashita, K., & Hijiya, S. (1989). Backpropagation algorithm which varies the number of hidden units. In International 1989 joint conference on neural networks, IEEE.

  43. Joshi, A. V. (2020). Support vector machines (pp. 65–71). Machine Learning and Artificial Intelligence: Springer.

    Google Scholar 

  44. Jung, J., & Choi, Y. (2016). Collecting travel time data of mine equipments in an underground mine using reverse RFID systems. Tunnel and Underground Space, 26(4), 253–265.

    Google Scholar 

  45. Jung, J., & Choi, Y. (2017). Measuring transport time of mine equipment in an underground mine using a bluetooth beacon system. Minerals, 7(1), 1.

    Google Scholar 

  46. Keshtegar, B., Mert, C., & Kisi, O. (2018). Comparison of four heuristic regression techniques in solar radiation modeling, Kriging method vs RSM, MARS and M5 model tree. Renewable and Sustainable Energy Reviews, 81, 330–341.

    Google Scholar 

  47. Khezrimotlagh, D., Zhu, J., Cook, W. D., & Toloo, M. (2019). Data envelopment analysis and big data. European Journal of Operational Research, 274(3), 1047–1054.

    Google Scholar 

  48. Kisi, O. (2015). Pan evaporation modeling using least square support vector machine, multivariate adaptive regression splines and M5 model tree. Journal of Hydrology, 528, 312–320.

    Google Scholar 

  49. Kramer, O. (2013). K-nearest neighbors. Dimensionality reduction with unsupervised nearest neighbors (pp. 13–23). Berlin: Springer.

    Google Scholar 

  50. Krause, A., & Musingwini, C. (2007). Modelling open pit shovel-truck systems using the machine repair model. Journal of the Southern African Institute of Mining and Metallurgy, 107(8), 469–476.

    Google Scholar 

  51. Lantz, B. (2013). Machine learning with R, Packt publishing ltd. 1782162151.

  52. Lewis, R. J. (2000). An introduction to classification and regression tree (CART) analysis. Annual meeting of the society for academic emergency medicine in San Francisco, California.

  53. Li, J., Cheng, J.-H., Shi, J.-Y., & Huang, F. (2012). Brief introduction of back propagation (BP) neural network algorithm and its improvement. In D. Jin & S. Lin (Eds.), Advances in computer science and information engineering (pp. 553–558). Berlin: Springer.

    Google Scholar 

  54. Lin, W., Wu, Z., Lin, L., Wen, A., & Li, J. (2017). An ensemble random forest algorithm for insurance big data analysis. IEEE Access, 5, 16568–16575.

    Google Scholar 

  55. Livingstone, D. J. (2008). Artificial neural networks, methods and applications, Springer. 1588297187.

  56. Ma, Y., & Guo, G. (2014). Support vector machines applications, Springer. 3319023004.

  57. Markeset, T., & Kumar, U. (2018). Application of LCC techniques in selection of mining equipment and technology. Mine Planning and Equipment Selection 2000, Routledge, 635–640.

  58. Mitchell, T. M. (1997). Machine learning. 1997. Burr Ridge, IL, McGraw Hill, 45(37), 870–877.

  59. Moradi Afrapoli, A., Tabesh, M., & Askari-Nasab, H. (2019). A stochastic hybrid simulation-optimization approach towards haul fleet sizing in surface mines. Mining Technology, 128(1), 9–20.

    Google Scholar 

  60. Najafabadi, M. M., Villanustre, F., Khoshgoftaar, T. M., Seliya, N., Wald, R., & Muharemagic, E. (2015). Deep learning applications and challenges in big data analytics. Journal of Big Data, 2(1), 1.

    Google Scholar 

  61. Nguyen, H. (2019). Support vector regression approach with different kernel functions for predicting blast-induced ground vibration, a case study in an open-pit coal mine of Vietnam. SN Applied Sciences, 1(4), 283.

    Google Scholar 

  62. Nguyen, H., & Bui, X.-N. (2019). Predicting blast-induced air overpressure, a robust artificial intelligence system based on artificial neural networks and random forest. Natural Resources Research, 28(3), 893–907.

    Google Scholar 

  63. Nguyen, H., Bui, X.-N., Bui, H.-B., & Cuong, D. (2019a). Developing A XGBoost model to predict blast-induced peak particle velocity in open cast mine. A case study. Acta Geophysica. https://doi.org/10.1007/s11600-019-00268-4.

    Article  Google Scholar 

  64. Nguyen, H., Bui, X.-N., Bui, H.-B., & Mai, N.-L. (2018). A comparative study of artificial neural networks in predicting blast-induced air-blast overpressure at Deo Nai open-pit coal mine, Vietnam. Neural Computing and Applications, 32(8), 3939–3955.

    Google Scholar 

  65. Nguyen, H., Bui, X.-N., Choi, Y., Lee, C. W., & Armaghani, D. J. (2020b). A novel combination of whale optimization algorithm and support vector machine with different kernel functions for prediction of blasting-induced fly-rock in quarry mines. Natural Resources Research. https://doi.org/10.1007/s11053-020-09710-7.

    Article  Google Scholar 

  66. Nguyen, H., Bui, X.-N., & Moayedi, H. (2019b). A comparison of advanced computational models and experimental techniques in predicting blast-induced ground vibration in open-pit coal mine. Acta Geophysica, 67(4), 1025–1037.

    Google Scholar 

  67. Nguyen, H., Bui, X.-N., Tran, Q.-H., & Le, G. H. T. (2020a). A novel soft computing model for predicting blast-induced ground vibration in open-pit mines using gene expression programming (in Vietnamese). Journal of Mining and Earth Sciences, 61(5), 107–116.

  68. Nguyen, H., Bui, X.-N., Tran, Q.-H., Le, T.-Q., & Do, N.-H. (2019c). Evaluating and predicting blast-induced ground vibration in open-cast mine using ANN, a case study in Vietnam. SN Applied Sciences, 1(1), 125.

    Google Scholar 

  69. Nguyen, H., Choi, Y., Bui, X.-N., & Nguyen-Thoi, T. (2019d). Predicting blast-induced ground vibration in open-pit mines using vibration sensors and support vector regression-based optimization algorithms. Sensors, 20(1), 132.

    Google Scholar 

  70. Nguyen, H., Drebenstedt, C., Bui, X.-N., & Bui, D. T. (2019e). Prediction of blast-induced ground vibration in an open-pit mine by a novel hybrid model based on clustering and artificial neural network. Natural Resources Research, 29(2), 691–709.

    Google Scholar 

  71. Park, S., & Choi, Y. (2013). Simulation of shovel-truck haulage systems by considering truck dispatch methods.

  72. Park, S., Choi, Y., & Park, H.-S. (2014a). Simulation of shovel-truck haulage systems in open-pit mines by considering breakdown of trucks and crusher capacity. Tunnel and Underground Space, 24(1), 1–10.

    Google Scholar 

  73. Park, S., Choi, Y., & Park, H.-S. (2014b). Simulation of truck-loader haulage systems in an underground mine using GPSS/H. Tunnel and Underground Space, 24(6), 430–439.

    Google Scholar 

  74. Park, S., Lee, S., Choi, Y., & Park, H.-S. (2014c). Development of a windows-based simulation program for selecting equipments in open-pit shovel-truck haulage systems. Tunnel and Underground Space, 24(2), 111–119.

    Google Scholar 

  75. Park, S., Choi, Y., & Park, H.-S. (2016). Optimization of truck-loader haulage systems in an underground mine using simulation methods. Geosystem Engineering, 19(5), 222–231.

    Google Scholar 

  76. Quinlan, J. R. (1992). Learning with continuous classes. In 5th Australian joint conference on artificial intelligence, Singapore.

  77. Rahimikhoob, A., Asadi, M., & Mashal, M. (2013). A comparison between conventional and M5 model tree methods for converting pan evaporation to reference evapotranspiration for semi-arid region. Water Resources Management, 27(14), 4815–4826.

    Google Scholar 

  78. Rist, K. (1961). The solution of a transportation problem by use of a Monte Carlo technique, mining world, Nov, 1961. This paper was also presented and published in the Proceedings of the 1st APCOM held at the Univ. of Arizona in Tucson, L2-1.

  79. Rodriguez, J. D., Perez, A., & Lozano, J. A. (2009). Sensitivity analysis of k-fold cross validation in prediction error estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(3), 569–575.

    Google Scholar 

  80. Rothman, K. J. (2012). Epidemiology, an introduction, Oxford University Press. 0199938458.

  81. Rothman, K. J., Greenland, S., & Lash, T. L. (2008). Modern epidemiology, Lippincott Williams & Wilkins. 0781755646.

  82. Sagiroglu, S., & Sinanc, D. (2013). Big data, a review. In 2013 international conference on collaboration technologies and systems (CTS), IEEE.

  83. Samanta, B., Sarkar, B., & Mukherjee, S. (2002). Selection of opencast mining equipment by a multi-criteria decision-making process. Mining Technology, 111(2), 136–142.

    Google Scholar 

  84. Sarma, J. S., Ahuja, M., Narayanan, S., & Shankar, S. (2016). Systems and methods for auto-scaling a big data system, Google Patents

  85. Sattari, M. T., Mirabbasi, R., Sushab, R. S., & Abraham, J. (2018). Prediction of groundwater level in Ardebil plain using support vector regression and M5 tree model. Groundwater, 56(4), 636–646.

    Google Scholar 

  86. Scholkopf, B., & Smola, A. J. (2001). Learning with kernels, support vector machines, regularization, optimization, and beyond, MIT Press. 0262194759.

  87. Shang, Y., Nguyen, H., Bui, X.-N., Tran, Q.-H., & Moayedi, H. (2019). A novel artificial intelligence approach to predict blast-induced ground vibration in open-pit mines based on the firefly algorithm and artificial neural network. Natural Resources Research, 29(2), 723–737.

    Google Scholar 

  88. Siddique, M., & Tokhi, M. (2001). Training neural networks, backpropagation vs. genetic algorithms. IJCNN’01. In International joint conference on neural networks. proceedings (Cat. No. 01CH37222), IEEE.

  89. Smith, S. D., Wood, G. S., & Gould, M. (2000). A new earthworks estimating methodology. Construction Management & Economics, 18(2), 219–228.

    Google Scholar 

  90. Soofastaei, A., Aminossadati, S. M., Kizil, M. S., & Knights, P. (2016). Reducing fuel consumption of haul trucks in surface mines using artificial intelligence models.

  91. Stebel, K., Schneider, P., Kylling, A., & Svendby, T. M. (2020). Towards better exploitation of Satellite data for monitoring Air Quality in Norway using downscaling techniques (SAT4AQN). Final project report. NILU rapport.

  92. Steinberg, D., & Colla, P. (2009). CART, classification and regression trees. The top ten algorithms in data mining, 9, 179.

    Google Scholar 

  93. Suzuki, K. (2013). Artificial neural networks, Architectures and applications, BoD–Books on Demand. 9535109359.

  94. Timofeev, R. (2004). Classification and regression trees (CART) theory and applications. Berlin: Humboldt University.

    Google Scholar 

  95. Wang, L. (2005). Support vector machines, theory and applications, Springer. 3540243887.

  96. Zahiri, A., & Azamathulla, H. M. (2014). Comparison between linear genetic programming and M5 tree models to predict flow discharge in compound channels. Neural Computing and Applications, 24(2), 413–420.

    Google Scholar 

  97. Zhang, Z. (2014). Too much covariates in a multivariable model may cause the problem of overfitting. Journal of thoracic disease, 6(9), E196.

    Google Scholar 

  98. Zhang, H., Nguyen, H., Bui, X.-N., Nguyen-Thoi, T., Bui, T.-T., Nguyen, N., et al. (2020). Developing a novel artificial intelligence model to estimate the capital cost of mining projects using deep neural network-based ant colony optimization algorithm. Resources Policy, 66, 101604.

    Google Scholar 

  99. Zou, J., Han, Y., & So, S.-S. (2008). Overview of artificial neural networks. Artificial Neural Networks (pp. 14–22). Berlin: Springer.

    Google Scholar 

Download references

Acknowledgments

This work was financial supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2018R1D1A1A09083947). In addition, this study was supported by the Center for Mining, Electro-Mechanical research of Hanoi University of Mining and Geology (HUMG), Hanoi, Vietnam, and the research team of Innovations for Sustainable and Responsible Mining (ISRM) of HUMG.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Hoang Nguyen.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (PDF 3318 kb)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Choi, Y., Nguyen, H., Bui, XN. et al. Estimating Ore Production in Open-pit Mines Using Various Machine Learning Algorithms Based on a Truck-Haulage System and Support of Internet of Things. Nat Resour Res 30, 1141–1173 (2021). https://doi.org/10.1007/s11053-020-09766-5

Download citation

Keywords

  • Ore production
  • Open-pit mine
  • Truck-haulage
  • System of IoT
  • Machine learning
  • Downscaling technique