Abstract
Estimating the uniaxial compressive strength (UCS) of travertine rocks with an indirect modeling approach and machine learning algorithms is useful as models can reduce the cost and time required to obtain accurate measurements of UCS, which is important for the prediction of rock failure. This approach can also address the limitations encountered in preparing detailed measured samples using direct measurements. The current paper developed and compared the performance of three standalone tree-based machine learning models (random forest (RF), M5 model tree, and multivariate adaptive regression splines (MARS)) for the prediction of UCS in travertine rocks from the Azarshahr area of northwestern Iran. Additionally, an ensemble committee-based artificial neural network (ANN) model was developed to integrate the advantages of the three standalone models and obtain further accuracy in UCS prediction. To date, an ensemble approach for estimating UCS has not been explored. To construct and validate the models, a set of rock test data including p-wave velocity (Vp (Km/s)), Schmidt Hammer (Rn), porosity (n%), point load index (Is (MPa)), and UCS (MPa) were acquired from 93 travertine core samples. To develop the ensemble tree-based machine learning model, the input matrix representing Vp, Rn, n%, and Is data with the corresponding target variable (i.e., UCS) was incorporated with a ratio of 70:15:15 (train: validate: test). Results indicated that a standalone MARS model outperformed all other standalone tree-based models in predicting UCS. The ANN-committee model, however, obtained the best performance with an r-value of approximately 0.890, an RMSE of 3.980 MPa, an MAE of 3.225 MPa, a WI of 0.931, and an LMI of 0.537, demonstrating the improved accuracy of the ensemble model for the prediction of UCS relative to the standalone models. The results suggest that the proposed ensemble committee-based model is a useful approach for predicting the UCS of travertine rocks with a limited set of model-designed datasets.
Similar content being viewed by others
References
Dehghan S, Sattari GH, Chehreh-Chelgani S, Aliabadi MA (2010) Prediction of uniaxial compressive strength and modulus of elasticity for Travertine samples using regression and artificial neural networks. Min Sci Technol 20:41–46
Ozbek A, Unsal M, Dikec A (2013) Estimating uniaxial compressive strength of rocks using genetic expression programming. Rock Mech Geotech Eng 5(4):325–329
Briševac Z, Hrzenjak P, Buljan R (2016) Models for estimating uniaxial compressive strength and elastic modulus. Gradevinar 68(1):19–28
Karakus M, Tutmez B (2006) Fuzzy and multiple regression modeling for evaluation of intact rock strength based on point load, Schmidt hammer and sonic velocity. Rock Mech Rock Eng 39(1):45–57
Yilmaz I, Yuksek AG (2008) An example of artificial neural network (ANN) application for indirect estimation of rock parameters. Rock Mech Rock Eng 41:781–795
Tiryaki B (2008) Predicting intact rock strength for mechanical excavation using multivariate statistics, artificial neural networks and regression trees. Eng Geol 99(1–2):51–60
Barzegar R, Sattarpour M, Nikudel MR, Asghari-Moghaddam A (2016) Comparative evaluation of artificial intelligence models for prediction of uniaxial compressive strength of travertine rocks, Case study: Azarshahr area, NW Iran. Model Earth Sys Environ 2:76
Gokceoglu C (2002) A fuzzy triangular chart to predict the uniaxial compressive strength of the Ankara agglomerates from their petrographic composition. Eng Geol 66(1–2):39–51
Gokceoglu C, Zorlu K (2004) A fuzzy model to predict the uniaxial compressive strength and the modulus of elasticity of a problematic rock. Eng Appl Artif Intell 17:61–72
Liu Z, Shao J, Xu W, Wu Q (2015) Indirect estimation of unconfined compressive strength of carbonate rocks using extreme learning machine. Acta Geotech 10:651–663
Beiki M, Majdi A, Givshad AD (2013) Application of genetic programming to predict the uniaxial compressive strength and elastic modulus of carbonate rocks. Int J Rock Mech Min Sci 63:159–169
Ghasemi E, Kalhori H, Bagherpour R, Yagiz S (2018) Model tree approach for predicting uniaxial compressive strength and Young’s modulus of carbonate rocks. Bull Eng Geol Environ 77(1):331–343
Ceyran N (2014) Application of support vector machines and relevance vector machines in predicting uniaxial compressive strength of volcanic rocks. J Afr Earth Sci 100:634–644
Momeni E, Jahed Armaghani D, Hajihassani M, Amin MFM (2015) Prediction of uniaxial compressive strength of rock samples using hybrid particle swarm optimization-based artificial neural networks. Measurement 60:50–63
Saedi B, Mohammadi SD, Shahbazi H (2019) Application of fuzzy inference system to predict uniaxial compressive strength and elastic modulus of migmatites. Environ Earth Sci 78(6):208
Çelik SB (2019) Prediction of uniaxial compressive strength of carbonate rocks from nondestructive tests using multivariate regression and LS-SVM methods. Arab J Geosci 12(6):193
Hassan MA, Khalil A, Kaseb S, Kassem MA (2017) Exploring the potential of tree-based ensemble methods in solar radiation modeling. Appl Energy 203:897–916
Fan J, Yue W, Wu L, Zhang F, Cai H, Wang X, Lu X, Xiang Y (2018) Evaluation of SVM, ELM and four tree-based ensemble models for predicting daily reference evapotranspiration using limited meteorological data in different climates of China. Agric For Meteorol 263:225–241
Taghipour K, Mohajjel M (2013) Structure and generation mode of travertine fissure-ridges in Azarshahr area, Azarbaydjan, NW Iran. Iran J Geol 7(25):15–33
ISRM (1981) Rock characterization, testing and monitoring, ISRM suggested methods. ET Brown (ed.), Pergamon Press, Oxford
Pedhazur EJ (1982) Multiple regression in behavioral research: explanation and prediction. Holt Rinehart and Winston, New York
Adamowski J, Chan HF, Prasher SO, Ozga-Zielinski B, Sliusarieva A (2012) Comparison of multiple linear and nonlinear regression, autoregressive integrated moving average, artificial neural network, and wavelet artificial neural network methods for urban water demand forecasting in Montreal, Canada. Water Resour Res 48:W01528. https://doi.org/10.1029/2010WR009945
Ivakhnenko AG (1970) Heuristic self-organization in problems of engineering cybernetics. Automatica 6(2):207–219
Ho TK (1995) Random decision forests. In: Proceedings of the third international conference on document analysis and recognition, pp 278–282
Breiman L (2001) Random forests. Mach Learn 45(1):5–32
Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learning—data mining, inference and prediction. Springer, New York
Breiman L, Friedman JH, Olshen R, Stone CJ (1984) Classification and regression trees. Wadsworth, Belmont
Quinlan JR (1993) C4.5 programs for machine learning. Morgan Kaurmann, SanMateo, p 303
Rodriguez-Galiano V, Mendes MP, Garcia-Soldado MJ, Chica-Olmo M, Ribeiro L (2014) Predictive modeling of groundwater nitrate pollution using random forest and multisource variables related to intrinsic and specific vulnerability: a case study in an agricultural setting (Southern Spain). Sci Total Environ 476–477:189–206
Quinlan JR (1992) Learning with continuous classes. In: 5th Australian joint conference on artificial intelligence singapore, pp 343–348
Al-Musaylh MS, Deo RC, Adamowski JF, Li Y (2018) Short-term electricity demand forecasting with MARS, SVR and ARIMA models using aggregated demand data in Queensland, Australia. Adv Eng Info 35:1–16
Yaseen ZM, Deo RC, Hilal A, Abd AM, Bueno LC, Salcedo-Sanz S, Nehdi ML (2018) Predicting compressive strength of lightweight foamed concrete using extreme learning machine model. Adv Eng Softw 115:112–125
Mitchell TM (1997) Machine learning. Computer science series. McGraw-Hill, Burr Ridge, MATH
Rahimikhoob A, Asadi M, Mashal M (2013) A comparison between conventional and M5 model tree methods for converting pan evaporation to reference evapotranspiration for semi-arid region. Water Resour Manag 27:4815–4826
Solomatine DP, Xue Y (2004) M5 model trees compared to neural networks: application to flood forecasting in the upper reach of the Huai River in China. J Hydrol Eng 9:491–501
García Nieto PJ, García-Gonzalo E, Bové J, Arbat G, Duran-Ros M, Puig-Bargués J (2017) Modeling pressure drop produced by different filtering media in microirrigation sand filters using the hybrid ABC-MARS-based approach, MLP neural network and M5 model tree. Comput Electron Agr 139:65–74
Pal M, Deswal S (2009) M5 model tree based modelling of reference evapotranspiration. Hydrol Process 23(10):1437–1443
Wang YW, Witten IH (1997) Inducing model trees for predicting continuous classes. In: Proceedings of European conference on machine learning. University of Economics Prague
Pal M (2005) Random Forest classifier for remote sensing classification. Int J Remote Sens 26(1):217–222
Friedman JH (1991) Multivariate adaptive regression splines. Ann Stat 19:1–67
Samui P (2012) Slope stability analysis using multivariate adaptive regression spline. Metaheuristics in Water, Geotechnical and Transport Engineering: 327
Adamowski J, Chan HF, Prasher SO, Sharda VN (2012) Comparison of multivariate adaptive regression splines with coupled wavelet transform artificial neural networks for runoff forecasting in Himalayan micro-watersheds with limited data. J Hydroinf 14(3):731–744
Barzegar R, Asghari-Moghaddam A, Deo R, Fijani E, Tziritis E (2018) Mapping groundwater contamination risk of multiple aquifers using multi-model ensemble of machine learning algorithms. Sci Total Environ 621:697–712
Kisi O (2015) Pan evaporation modeling using least square support vector machine, multivariate adaptive regression splines and M5 model tree. J Hydro 528:312–320
Friedman JH, Roosen CB (1995) An introduction to multivariate adaptive regression splines. Stat Methods Med Res 4:197–217
Barzegar R, Asghari-Moghaddam A (2016) Combining the advantages of neural networks using the concept of committee machine in the groundwater salinity prediction. Model Earth Syst Environ. 2:26. https://doi.org/10.1007/s40808-015-0072-8
Barzegar R, Asghari-Moghaddam A, Baghban H (2016) A supervised committee machine artificial intelligent for improving DRASTIC method to assess groundwater contamination risk: a case study fromTabriz plain aquifer, Iran. Stoch Environ Res Risk Assess 30(3):883–899
MATLAB (2016) TreeBagger. mathworks. Available at http://www.mathworks.com/help/stats/treebagger. html (Accessed 28 Aug 2016)
Liaw A, Wiener M (2002) Classification and regression by random forest. R News 2(3):18–22
Deo RC, Downs N, Parisi A, Adamowski J, Quilty J (2017) Very short-term reactive forecasting of the solar ultraviolet index using an extreme learning machine integrated with the solar zenith angle. Environ 155:141–166
Deo RC, Kisi O, Singh VP (2017) Drought forecasting in eastern Australia using multivariate adaptive regression spline, least square support vector machine and M5Tree model. Atmos Res 184:149–175
Wanas N, Auda G, Kamel MS, Karray F (1998) On the optimal number of hidden nodes in a neural network. Proc IEEE Can Conf Electr Comput Eng 2:918–921
Mishra DA, Basu A (2013) Estimation of uniaxial compressive strength of rock materials by index tests using regression analysis and fuzzy inference system. Eng Geol 160:54–68
Barzegar R, Asghari-Moghaddam A, Adamowski J, Fijani E (2017) Comparison of machine learning models for predicting fluoride contamination in groundwater. Stoch Environ Res Risk Assess 31(10):2705–2718
Legates DR, McCabe GJ (1999) Evaluating the use of “goodness of fit” measures in hydrologic and hydroclimatic model validation. Water Resour Res 35(2):33–41
Willmott CJ (1981) On the validation of models. Phys Geogr 2:184–194
Diamantis K, Gartzos E, Migiros G (2009) Study on uniaxial compressive strength, point load strength index, dynamic and physical properties of serpentinites from Central Greece: test results and empirical relations. Eng Geol 108:199–207
Kohno M, Maeda H (2012) Relationship between point load strength index and uniaxial compressive strength of hydrothermally altered soft rocks. Int J Rock Mech Min Sci 50:147–157
Demirdag S, Tufekci K, Kayacan R, Yavuz H, Altindag R (2010) Dynamic mechanical behavior of some carbonate rocks. Int J Rock Mech Min Sci 47:307–312
Akin M, Ozsan A (2011) Evaluation of the long-term durability of yellow travertine using accelerated weathering tests. Bull Eng Geol Environ 70:101–114
Matin SS, Farahzadi L, Makaremi S, Chehreh-Chelgani S, Sattari GH (2018) Variable selection and prediction of uniaxial compressive strength and modulus of elasticity by Random Forest. Appl Soft Comput 70:980–987
Molina E, Cultrone G, Sebastian EJ, Alonso F (2013) Evaluation of stone durability using a combination of ultrasound, mechanical and accelerated aging tests. J Geophys Eng 10:1–18
Chentout M, Alloul B, Rezouk A, Belhai D (2015) Experimental study to evaluate the effect of travertine structure on the physical and mechanical properties of the material. Arab J Geosci 8:8975–8985
Jalali SH, Heidari M, Mohseni H (2017) Comparison of models for estimating uniaxial compressive strength of some sedimentary rocks from Qom Formation. Environ Earth Sci 76:753
Yang Y, Zang O (1997) A hierarchical analysis for rock engineering using artificial neural networks. Rock Mech Rock Eng 30:207–222
Jahed-Armaghani D, Tonnizam-Mohamad E, Momeni E, Monjezi M, Narayanasamy MS (2016) Prediction of the strength and elasticity modulus of granite through an expert artificial neural network. Arab J Geosci 9:48. https://doi.org/10.1007/s12517-015-2057-3
Jahed-Armaghani D, Mohammad ED, Hajihassani M, Yagiz S, Motaghedi H (2016) Application of several non-linear prediction tools for estimating uniaxial compressive strength of granitic rocks and comparison of their performances. Eng Comput 32(2):189–206
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Barzegar, R., Sattarpour, M., Deo, R. et al. An ensemble tree-based machine learning model for predicting the uniaxial compressive strength of travertine rocks. Neural Comput & Applic 32, 9065–9080 (2020). https://doi.org/10.1007/s00521-019-04418-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-019-04418-z