Abstract
An accurate prediction of the penetration rate (PR) of a tunnel boring machine (TBM) is essential for the schedule and cost estimation of tunnel excavation. To better meet the needs of modern information construction, more computer technologies are being used to integrate the analysis and management of construction data. Herein, an online prediction platform based on a data mining algorithm using ensemble learning (extreme gradient boosting (XGBoost)) is developed for TBM performance prediction. The platform establishes the model and displays the prediction results, while storing a considerable amount of machine data, and providing services for TBMs of multiple projects simultaneously. In establishing the prediction model, users can change the algorithm parameters according to the engineering situation. The prediction capabilities of the platform are demonstrated by 200 field samples obtained from the Songhua River water conveyance project in Jilin. The mean absolute percentage error, coefficient of determination, root mean squared error, variance account for (VAF), and a20-index of the PR are 6.07%, 0.8651, 3.5862, 87.06%, and 0.925, respectively. The results show that the prediction model has a reliable prediction accuracy, which is higher than that of the gradient boosting decision tree, and these results can be displayed on the online platform. It provides effective help for TBM intelligent tunneling.
Similar content being viewed by others
References
Afradi A, Ebrahimabadi A, Hallajian T (2019) Prediction of the penetration rate and number of consumed disc cutters of tunnel boring machines (TBMs) using artificial neural network (ANN) and support vector machine (SVM)-case study: Beheshtabad Water Conveyance Tunnel in Iran. Asian J Water, Environ Pollut 16:49–57. https://doi.org/10.3233/AJW190006
Armaghani DJ, Faradonbeh RS, Momeni E et al (2018) Performance prediction of tunnel boring machine through developing a gene expression programming equation. Eng Comput 34:129–141. https://doi.org/10.1007/s00366-017-0526-x
Armaghani DJ, Koopialipoor M, Marto A, Yagiz S (2019) Application of several optimization techniques for estimating TBM advance rate in granitic rocks. J Rock Mech Geotech Eng 11:779–789. https://doi.org/10.1016/j.jrmge.2019.01.002
Armaghani DJ, Mohamad ET, Narayanasamy MS et al (2017) Development of hybrid intelligent models for predicting TBM penetration rate in hard rock condition. Tunn Undergr Sp Technol 63:29–43. https://doi.org/10.1016/j.tust.2016.12.009
Bai S, Li M, Kong R et al (2019) Data mining approach to construction productivity prediction for cutter suction dredgers. Autom Constr 105:102833. https://doi.org/10.1016/j.autcon.2019.102833
Cao J, Gao J, Nikafshan Rad H et al (2021) A novel systematic and evolved approach based on XGBoost-firefly algorithm to predict Young’s modulus and unconfined compressive strength of rock. Eng Comput. https://doi.org/10.1007/s00366-020-01241-2
Chen TQ, Guestrin C (2016) XGBoost: a scalable tree boosting system. In: 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KNN), San Francisco, CA, USA, p 785–794. https://doi.org/10.1145/2939672.2939785
Farrokh E (2020) A study of various models used in the estimation of advance rates for hard rock TBMs. Tunn Undergr Sp Technol 97:103219. https://doi.org/10.1016/j.tust.2019.103219
Fatemi SA, Ahmadi M, Rostami J (2018) Evaluation of TBM performance prediction models and sensitivity analysis of input parameters. Bull Eng Geol Environ 77:501–513. https://doi.org/10.1007/s10064-016-0967-2
Fattahi H, Bazdar H (2017) Applying improved artificial neural network models to evaluate drilling rate index. Tunn Undergr Sp Technol 70:114–124. https://doi.org/10.1016/j.tust.2017.07.017
Feng S, Chen Z, Luo H et al (2021) Tunnel boring machines (TBM) performance prediction: a case study using big data and deep learning. Tunn Undergr Sp Technol 110:103636. https://doi.org/10.1016/j.tust.2020.103636
Friedman JH (2002) Stochastic gradient boosting. Comput Stat Data Anal 38:367–378. https://doi.org/10.1016/S0167-9473(01)00065-2
Fujii H, Yamashita A, Asama H (2015) Improvement of environmental adaptivity of defect detector for hammering test using boosting algorithm. IEEE Int Conf Intell Robot Syst 2015-Decem:6507–6514. https://doi.org/10.1109/IROS.2015.7354307
Gao X, Shi M, Song X et al (2019) Recurrent neural networks for real-time prediction of TBM operating parameters. Autom Constr 98:225–235. https://doi.org/10.1016/j.autcon.2018.11.013
Gupta A, Delhi N, Gusain K, Delhi N, Popli B, Delhi N (2016) Verifying the value and veracity of eXtreme gradient boosted decision trees on a variety of datasets. In: 11th International Conference on Industrial and Information Systems (ICIIS), Roorkee, India, p 457–462. https://doi.org/10.1109/ICIINFS.2016.8262984
Hajihassani M, Kalatehjari R, Marto A, Mohamad H, Khosrotash M (2020) 3D prediction of tunneling-induced ground movements based on a hybrid ANN and empirical methods. Eng Comput 36:251–269. https://doi.org/10.1007/s00366-018-00699-5
Heydari S, Khademi Hamidi J, Monjezi M, Eftekhari A (2019) An investigation of the relationship between muck geometry, TBM performance, and operational parameters: a case study in Golab II water transfer tunnel. Tunn Undergr Sp Technol 88:73–86. https://doi.org/10.1016/j.tust.2018.11.043
Huang YP, Yen MF (2019) A new perspective of performance comparison among machine learning algorithms for financial distress prediction. Appl Soft Comput J 83:105663. https://doi.org/10.1016/j.asoc.2019.105663
Jing LJ, Li JB, Yang C, Chen S, Zhang N, Peng XX (2019) A case study of TBM performance prediction using field tunnelling tests in limestone strata. Tunn Undergr Sp Technol 83:364–372. https://doi.org/10.1016/j.tust.2018.10.001
Kang YS, Park IH, Rhee J, Lee YH (2016) MongoDB-based repository design for IoT-generated RFID/sensor big data. IEEE Sens J 16:485–497. https://doi.org/10.1109/JSEN.2015.2483499
Konrad F, Malgorzata PW (2017) Comparative analysis of relational and non-relational databases in the context of performance in web applications. In: 13th International Scientific Conference on Beyond Databases, Architectures and Structures (BDAS), Ustron, Poland, p 153–164. https://doi.org/10.1007/978-3-319-58274-0_13
Koopialipoor M, Fahimifar A, Ghaleini EN, Momenzadeh M, Armaghani DJ (2020) Development of a new hybrid ANN for solving a geotechnical problem related to tunnel boring machine performance. Eng Comput 36:345–357. https://doi.org/10.1007/s00366-019-00701-8
Koopialipoor M, Nikouei SS, Marto A, Fahimifar A, Armaghani DJ, Mohamad ET (2019a) Predicting tunnel boring machine performance through a new model based on the group method of data handling. Bull Eng Geol Environ 78:3799–3813. https://doi.org/10.1007/s10064-018-1349-8
Koopialipoor M, Tootoonchi H, Armaghani DJ, Mohamad ET, Hedayat A (2019b) Application of deep neural networks in predicting the penetration rate of tunnel boring machines. Bull Eng Geol Environ 78:6347–6360. https://doi.org/10.1007/s10064-019-01538-7
Li J, Jing L, Zheng X, Li P, Yang C (2019) Application and outlook of information and intelligence technology for safe and efficient TBM construction. Tunn Undergr Sp Technol 93:103097. https://doi.org/10.1016/j.tust.2019.103097
Li S, Liu B, Xu X et al (2017) An overview of ahead geological prospecting in tunneling. Tunn Undergr Sp Technol 63:69–94. https://doi.org/10.1016/j.tust.2016.12.011
Li S, Liu B, Ren Y et al (2020) Deep-learning inversion of seismic data. IEEE Trans Geosci Remote Sens 58:2135–2149. https://doi.org/10.1109/TGRS.2019.2953473
Lim S, Chi S (2019) Xgboost application on bridge management systems for proactive damage estimation. Adv Eng Informatics 41:100922. https://doi.org/10.1016/j.aei.2019.100922
Liu B, Liu Z, Li S et al (2017a) Comprehensive surface geophysical investigation of karst caves ahead of the tunnel face: A case study in the Xiaoheyan section of the water supply project from Songhua River, Jilin, China. J Appl Geophys 144:37–49. https://doi.org/10.1016/j.jappgeo.2017.06.013
Liu B, Guo Q, Li S et al (2020a) Deep learning inversion of electrical resistivity data. IEEE Trans Geosci Remote Sens 58:5715–5728. https://doi.org/10.1109/TGRS.2020.2969040
Liu B, Wang R, Guan Z et al (2019) Improved support vector regression models for predicting rock mass parameters using tunnel boring machine driving data. Tunn Undergr Sp Technol 91:102958. https://doi.org/10.1016/j.tust.2019.04.014
Liu B, Wang R, Zhao G et al (2020b) Prediction of rock mass parameters in the TBM tunnel based on BP neural network integrated simulated annealing algorithm. Tunn Undergr Sp Technol 95:1–12. https://doi.org/10.1016/j.tust.2019.103103
Liu Q, Liu J, Pan Y, et al (2016) Research advances of tunnel boring machine performance prediction models for hard rock. Yanshilixue Yu Gongcheng Xuebao/Chinese J Rock Mech Eng 35:2766–2786. https://doi.org/10.13722/j.cnki.jrme.2014.1601
Liu Q, Liu J, Pan Y, Kong X, Hong K (2017b) A case study of TBM performance prediction using a Chinese rock mass classification system – hydropower classification (HC) method. Tunn Undergr Sp Technol 65:140–154. https://doi.org/10.1016/j.tust.2017.03.002
Liu Z, Li L, Fang X et al (2021) Hard-rock tunnel lithology prediction with TBM construction big data using a global-attention-mechanism-based LSTM network. Autom Constr 125:103647. https://doi.org/10.1016/j.autcon.2021.103647
Ma X, Ding C, Luan S et al (2017) Prioritizing influential factors for freeway incident clearance time prediction using the gradient boosting decision trees method. IEEE Trans Intell Transp Syst 18:2303–2310. https://doi.org/10.1109/TITS.2016.2635719
Mahdevari S, Shahriar K, Yagiz S, Akbarpour Shirazi M (2014) A support vector regression model for predicting tunnel boring machine penetration rates. Int J Rock Mech Min Sci 72:214–229. https://doi.org/10.1016/j.ijrmms.2014.09.012
Mahdiyar A, Armaghani DJ, Marto A, Nilashi M, Ismail S (2019) Rock tensile strength prediction using empirical and soft computing approaches. Bull Eng Geol Environ 78:4519–4531. https://doi.org/10.1007/s10064-018-1405-4
Mikaeil R, Zare Naghadehi M, Ghadernejad S (2018) An extended multifactorial fuzzy prediction of hard rock TBM penetrability. Geotech Geol Eng 36:1779–1804. https://doi.org/10.1007/s10706-017-0432-4
Naghadehi MZ, Samaei M, Ranjbarnia M, Nourani V (2018) State-of-the-art predictive modeling of TBM performance in changing geological conditions through gene expression programming. Meas J Int Meas Confed 126:46–57. https://doi.org/10.1016/j.measurement.2018.05.049
Park M, Lee S, Hwang S, Kim D (2020) Additive ensemble neural networks. IEEE. Access 4:1–1. https://doi.org/10.1109/access.2020.3003748
Providakis S, Rogers CDF, Chapman DN (2019) Predictions of settlement risk induced by tunnelling using BIM and 3D visualization tools. Tunn Undergr Sp Technol 92:103049. https://doi.org/10.1016/j.tust.2019.103049
Rasouli Maleki M (2018) Rock Joint Rate (RJR); a new method for performance prediction of tunnel boring machines (TBMs) in hard rocks. Tunn Undergr Sp Technol 73:261–286. https://doi.org/10.1016/j.tust.2017.12.022
Rostami J (1997) Development of a force estimation model for rock fragmentation with disc cutters through theoretical modeling and physical measurement
Rostami J, Ozdemir L, Nilsen B (1996) Comparison between CSM and NTH hard rock TBM performance prediction models. In: Proceedings of the annual technical meeting: Institute of Shaft Drilling Technology (ISDT), Las Vegas, p 1–10
Salimi A, Faradonbeh RS, Monjezi M, Moormann C (2018) TBM performance estimation using a classification and regression tree (CART) technique. Bull Eng Geol Environ 77:429–440. https://doi.org/10.1007/s10064-016-0969-0
Salimi A, Rostami J, Moormann C (2019) Application of rock mass classification systems for performance estimation of rock TBMs using regression tree and artificial intelligence algorithms. Tunn Undergr Sp Technol 92:103046. https://doi.org/10.1016/j.tust.2019.103046
Samaei M, Ranjbarnia M, Nourani V, Zare Naghadehi M (2020) Performance prediction of tunnel boring machine through developing high accuracy equations: a case study in adverse geological condition. Meas J Int Meas Confed 152:107244. https://doi.org/10.1016/j.measurement.2019.107244
Wang P, Kong X, Guo Z, Hu L (2019) Prediction of axis attitude deviation and deviation correction method based on data driven during shield tunneling. IEEE Access 7:163487–163501. https://doi.org/10.1109/ACCESS.2019.2952649
Wang R, Guo X, Li J et al (2020) A mechanical method for predicting TBM penetration rates Arab J Geosci 13. https://doi.org/10.1007/s12517-020-05305-x
Wei L, Khan M, Mehmood O et al (2019) Web-based visualisation for look-ahead ground imaging in tunnel boring machines. Autom Constr 105:102830. https://doi.org/10.1016/j.autcon.2019.04.025
Wei M, Wang Z, Wang X, Peng J, Song Y (2020) Prediction of TBM penetration rate based on Monte Carlo-BP neural network Neural Comput Appl 6. https://doi.org/10.1007/s00521-020-04993-6
Xu C, Liu X, Wang E, Wang S (2021) Prediction of tunnel boring machine operating parameters using various machine learning algorithms. Tunn Undergr Sp Technol 109:103699. https://doi.org/10.1016/j.tust.2020.103699
Xu H, Zhou J, Asteris PG, Armaghani DJ, Tahir MM (2019) Supervised machine learning techniques to the prediction of tunnel boring machine penetration rate. Appl Sci 9:1–19. https://doi.org/10.3390/app9183715
Yagiz S (2017) New equations for predicting the field penetration index of tunnel boring machines in fractured rock mass Arab J Geosci 10. https://doi.org/10.1007/s12517-016-2811-1
Yagiz S, Karahan H (2015) Application of various optimization techniques and comparison of their performances for predicting TBM penetration rate in rock mass. Int J Rock Mech Min Sci 80:308–315. https://doi.org/10.1016/j.ijrmms.2015.09.019
Yang H, Wang Z, Song K (2020) A new hybrid grey wolf optimizer-feature weighted-multiple kernel-support vector regression technique to predict TBM performance. Eng Comput. https://doi.org/10.1007/s00366-020-01217-2
Yazdani-Chamzini A, Razani M, Yakhchali SH et al (2013) Developing a fuzzy model based on subtractive clustering for road header performance prediction. Autom Constr 35:111–120. https://doi.org/10.1016/j.autcon.2013.04.001
Yu G, Zhang S, Hu M, Ken Wang Y (2020) Prediction of highway tunnel pavement performance based on digital twin and multiple time series stacking Adv Civ Eng 2020. https://doi.org/10.1155/2020/8824135
Zeng J, Roy B, Kumar D et al (2021) Proposing several hybrid PSO-extreme learning machine techniques to predict TBM performance. Eng Comput. https://doi.org/10.1007/s00366-020-01225-2
Zhang Q, Liu Z, Tan J (2019) Prediction of geological conditions for a tunnel boring machine using big operational data. Autom Constr 100:73–83. https://doi.org/10.1016/j.autcon.2018.12.022
Zhang Q, Liu Z, Tan J (2020a) Predicting the performance of tunnel boring machines using big operational data. Proc - 2020 IEEE 6th Int Conf Big Data Comput Serv Appl BigDataService 2020 179–182. https://doi.org/10.1109/BigDataService49289.2020.00035
Zhang Q, Yang K, Wang L, Zhou S (2020b) Geological type recognition by machine learning on in-situ data of EPB tunnel boring machines Math Probl Eng 2020. https://doi.org/10.1155/2020/3057893
Zhang W, Zhang R, Wu C et al (2020c) State-of-the-art review of soft computing applications in underground excavations. Geosci Front 11:1095–1106. https://doi.org/10.1016/j.gsf.2019.12.003
Zhao Z, Karimzadeh M, Gerber F, Braun T (2018) Mobile crowd location prediction with hybrid features using ensemble learning. Futur Gener Comput Syst. https://doi.org/10.1016/j.future.2018.06.025
Zhou J, Qiu Y, Armaghani DJ et al (2021a) Predicting TBM penetration rate in hard rock condition: a comparative study among six XGB-based metaheuristic techniques. Geosci Front 12:101091. https://doi.org/10.1016/j.gsf.2020.09.020
Zhou J, Qiu Y, Zhu S et al (2021b) Optimization of support vector machine through the use of metaheuristic algorithms in forecasting TBM advance rate. Eng Appl Artif Intell 97:104015. https://doi.org/10.1016/j.engappai.2020.104015
Zhou J, Yazdani Bejarbaneh B, Jahed Armaghani D, Tahir MM (2020) Forecasting of TBM advance rate in hard rock condition based on artificial neural network and genetic programming techniques. Bull Eng Geol Environ 79:2069–2084. https://doi.org/10.1007/s10064-019-01626-8
Zhou Z (2016) Machine Learning. Tsinghua University Press, Beijing
Acknowledgements
The authors wish to thank the Beijing Vibroflotation Engineering Company Limited for sharing their experiences of data gathering in the field.
Funding
This research was supported by the National Natural Science Foundation of China (NSFC) [grant number 51739007], the National Natural Science Foundation of China (NSFC) [grant number 51991391], the National Science Fund for Excellent Young Scientists Fund [grant number 51922067], Taishan Scholars (Youth Expert) Program of Shandong Province [grant number tsqn201909003], and Science & Technology Program of Department of Transport of Shandong Province [2019B47_2].
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wang, Y., Gao, X., Jiang, P. et al. An extreme gradient boosting technique to estimate TBM penetration rate and prediction platform. Bull Eng Geol Environ 81, 58 (2022). https://doi.org/10.1007/s10064-021-02527-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10064-021-02527-5