An ensemble tree-based machine learning model for predicting the uniaxial compressive strength of travertine rocks

Neural Computing and Applications volume 32, pages9065–9080(2020)Cite this article

Abstract

Estimating the uniaxial compressive strength (UCS) of travertine rocks with an indirect modeling approach and machine learning algorithms is useful as models can reduce the cost and time required to obtain accurate measurements of UCS, which is important for the prediction of rock failure. This approach can also address the limitations encountered in preparing detailed measured samples using direct measurements. The current paper developed and compared the performance of three standalone tree-based machine learning models (random forest (RF), M5 model tree, and multivariate adaptive regression splines (MARS)) for the prediction of UCS in travertine rocks from the Azarshahr area of northwestern Iran. Additionally, an ensemble committee-based artificial neural network (ANN) model was developed to integrate the advantages of the three standalone models and obtain further accuracy in UCS prediction. To date, an ensemble approach for estimating UCS has not been explored. To construct and validate the models, a set of rock test data including p-wave velocity (Vp (Km/s)), Schmidt Hammer (Rn), porosity (n%), point load index (Is (MPa)), and UCS (MPa) were acquired from 93 travertine core samples. To develop the ensemble tree-based machine learning model, the input matrix representing Vp, Rn, n%, and Is data with the corresponding target variable (i.e., UCS) was incorporated with a ratio of 70:15:15 (train: validate: test). Results indicated that a standalone MARS model outperformed all other standalone tree-based models in predicting UCS. The ANN-committee model, however, obtained the best performance with an r-value of approximately 0.890, an RMSE of 3.980 MPa, an MAE of 3.225 MPa, a WI of 0.931, and an LMI of 0.537, demonstrating the improved accuracy of the ensemble model for the prediction of UCS relative to the standalone models. The results suggest that the proposed ensemble committee-based model is a useful approach for predicting the UCS of travertine rocks with a limited set of model-designed datasets.

This is a preview of subscription content, log in to check access.

Access options

Buy single article

Instant access to the full article PDF.

US$ 39.95

Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

References

  1. 1.

    Dehghan S, Sattari GH, Chehreh-Chelgani S, Aliabadi MA (2010) Prediction of uniaxial compressive strength and modulus of elasticity for Travertine samples using regression and artificial neural networks. Min Sci Technol 20:41–46

    Google Scholar 

  2. 2.

    Ozbek A, Unsal M, Dikec A (2013) Estimating uniaxial compressive strength of rocks using genetic expression programming. Rock Mech Geotech Eng 5(4):325–329

    Google Scholar 

  3. 3.

    Briševac Z, Hrzenjak P, Buljan R (2016) Models for estimating uniaxial compressive strength and elastic modulus. Gradevinar 68(1):19–28

    Google Scholar 

  4. 4.

    Karakus M, Tutmez B (2006) Fuzzy and multiple regression modeling for evaluation of intact rock strength based on point load, Schmidt hammer and sonic velocity. Rock Mech Rock Eng 39(1):45–57

    Google Scholar 

  5. 5.

    Yilmaz I, Yuksek AG (2008) An example of artificial neural network (ANN) application for indirect estimation of rock parameters. Rock Mech Rock Eng 41:781–795

    Google Scholar 

  6. 6.

    Tiryaki B (2008) Predicting intact rock strength for mechanical excavation using multivariate statistics, artificial neural networks and regression trees. Eng Geol 99(1–2):51–60

    Google Scholar 

  7. 7.

    Barzegar R, Sattarpour M, Nikudel MR, Asghari-Moghaddam A (2016) Comparative evaluation of artificial intelligence models for prediction of uniaxial compressive strength of travertine rocks, Case study: Azarshahr area, NW Iran. Model Earth Sys Environ 2:76

    Google Scholar 

  8. 8.

    Gokceoglu C (2002) A fuzzy triangular chart to predict the uniaxial compressive strength of the Ankara agglomerates from their petrographic composition. Eng Geol 66(1–2):39–51

    Google Scholar 

  9. 9.

    Gokceoglu C, Zorlu K (2004) A fuzzy model to predict the uniaxial compressive strength and the modulus of elasticity of a problematic rock. Eng Appl Artif Intell 17:61–72

    Google Scholar 

  10. 10.

    Liu Z, Shao J, Xu W, Wu Q (2015) Indirect estimation of unconfined compressive strength of carbonate rocks using extreme learning machine. Acta Geotech 10:651–663

    Google Scholar 

  11. 11.

    Beiki M, Majdi A, Givshad AD (2013) Application of genetic programming to predict the uniaxial compressive strength and elastic modulus of carbonate rocks. Int J Rock Mech Min Sci 63:159–169

    Google Scholar 

  12. 12.

    Ghasemi E, Kalhori H, Bagherpour R, Yagiz S (2018) Model tree approach for predicting uniaxial compressive strength and Young’s modulus of carbonate rocks. Bull Eng Geol Environ 77(1):331–343

    Google Scholar 

  13. 13.

    Ceyran N (2014) Application of support vector machines and relevance vector machines in predicting uniaxial compressive strength of volcanic rocks. J Afr Earth Sci 100:634–644

    Google Scholar 

  14. 14.

    Momeni E, Jahed Armaghani D, Hajihassani M, Amin MFM (2015) Prediction of uniaxial compressive strength of rock samples using hybrid particle swarm optimization-based artificial neural networks. Measurement 60:50–63

    Google Scholar 

  15. 15.

    Saedi B, Mohammadi SD, Shahbazi H (2019) Application of fuzzy inference system to predict uniaxial compressive strength and elastic modulus of migmatites. Environ Earth Sci 78(6):208

    Google Scholar 

  16. 16.

    Çelik SB (2019) Prediction of uniaxial compressive strength of carbonate rocks from nondestructive tests using multivariate regression and LS-SVM methods. Arab J Geosci 12(6):193

    Google Scholar 

  17. 17.

    Hassan MA, Khalil A, Kaseb S, Kassem MA (2017) Exploring the potential of tree-based ensemble methods in solar radiation modeling. Appl Energy 203:897–916

    Google Scholar 

  18. 18.

    Fan J, Yue W, Wu L, Zhang F, Cai H, Wang X, Lu X, Xiang Y (2018) Evaluation of SVM, ELM and four tree-based ensemble models for predicting daily reference evapotranspiration using limited meteorological data in different climates of China. Agric For Meteorol 263:225–241

    Google Scholar 

  19. 19.

    Taghipour K, Mohajjel M (2013) Structure and generation mode of travertine fissure-ridges in Azarshahr area, Azarbaydjan, NW Iran. Iran J Geol 7(25):15–33

    Google Scholar 

  20. 20.

    ISRM (1981) Rock characterization, testing and monitoring, ISRM suggested methods. ET Brown (ed.), Pergamon Press, Oxford

  21. 21.

    Pedhazur EJ (1982) Multiple regression in behavioral research: explanation and prediction. Holt Rinehart and Winston, New York

  22. 22.

    Adamowski J, Chan HF, Prasher SO, Ozga-Zielinski B, Sliusarieva A (2012) Comparison of multiple linear and nonlinear regression, autoregressive integrated moving average, artificial neural network, and wavelet artificial neural network methods for urban water demand forecasting in Montreal, Canada. Water Resour Res 48:W01528. https://doi.org/10.1029/2010WR009945

    Article  Google Scholar 

  23. 23.

    Ivakhnenko AG (1970) Heuristic self-organization in problems of engineering cybernetics. Automatica 6(2):207–219

    Google Scholar 

  24. 24.

    Ho TK (1995) Random decision forests. In: Proceedings of the third international conference on document analysis and recognition, pp 278–282

  25. 25.

    Breiman L (2001) Random forests. Mach Learn 45(1):5–32

    MATH  Google Scholar 

  26. 26.

    Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learning—data mining, inference and prediction. Springer, New York

    Google Scholar 

  27. 27.

    Breiman L, Friedman JH, Olshen R, Stone CJ (1984) Classification and regression trees. Wadsworth, Belmont

    Google Scholar 

  28. 28.

    Quinlan JR (1993) C4.5 programs for machine learning. Morgan Kaurmann, SanMateo, p 303

  29. 29.

    Rodriguez-Galiano V, Mendes MP, Garcia-Soldado MJ, Chica-Olmo M, Ribeiro L (2014) Predictive modeling of groundwater nitrate pollution using random forest and multisource variables related to intrinsic and specific vulnerability: a case study in an agricultural setting (Southern Spain). Sci Total Environ 476–477:189–206

    Google Scholar 

  30. 30.

    Quinlan JR (1992) Learning with continuous classes. In: 5th Australian joint conference on artificial intelligence singapore, pp 343–348

  31. 31.

    Al-Musaylh MS, Deo RC, Adamowski JF, Li Y (2018) Short-term electricity demand forecasting with MARS, SVR and ARIMA models using aggregated demand data in Queensland, Australia. Adv Eng Info 35:1–16

    Google Scholar 

  32. 32.

    Yaseen ZM, Deo RC, Hilal A, Abd AM, Bueno LC, Salcedo-Sanz S, Nehdi ML (2018) Predicting compressive strength of lightweight foamed concrete using extreme learning machine model. Adv Eng Softw 115:112–125

    Google Scholar 

  33. 33.

    Mitchell TM (1997) Machine learning. Computer science series. McGraw-Hill, Burr Ridge, MATH

    Google Scholar 

  34. 34.

    Rahimikhoob A, Asadi M, Mashal M (2013) A comparison between conventional and M5 model tree methods for converting pan evaporation to reference evapotranspiration for semi-arid region. Water Resour Manag 27:4815–4826

    Google Scholar 

  35. 35.

    Solomatine DP, Xue Y (2004) M5 model trees compared to neural networks: application to flood forecasting in the upper reach of the Huai River in China. J Hydrol Eng 9:491–501

    Google Scholar 

  36. 36.

    García Nieto PJ, García-Gonzalo E, Bové J, Arbat G, Duran-Ros M, Puig-Bargués J (2017) Modeling pressure drop produced by different filtering media in microirrigation sand filters using the hybrid ABC-MARS-based approach, MLP neural network and M5 model tree. Comput Electron Agr 139:65–74

    Google Scholar 

  37. 37.

    Pal M, Deswal S (2009) M5 model tree based modelling of reference evapotranspiration. Hydrol Process 23(10):1437–1443

    Google Scholar 

  38. 38.

    Wang YW, Witten IH (1997) Inducing model trees for predicting continuous classes. In: Proceedings of European conference on machine learning. University of Economics Prague

  39. 39.

    Pal M (2005) Random Forest classifier for remote sensing classification. Int J Remote Sens 26(1):217–222

    Google Scholar 

  40. 40.

    Friedman JH (1991) Multivariate adaptive regression splines. Ann Stat 19:1–67

    MathSciNet  MATH  Google Scholar 

  41. 41.

    Samui P (2012) Slope stability analysis using multivariate adaptive regression spline. Metaheuristics in Water, Geotechnical and Transport Engineering: 327

  42. 42.

    Adamowski J, Chan HF, Prasher SO, Sharda VN (2012) Comparison of multivariate adaptive regression splines with coupled wavelet transform artificial neural networks for runoff forecasting in Himalayan micro-watersheds with limited data. J Hydroinf 14(3):731–744

    Google Scholar 

  43. 43.

    Barzegar R, Asghari-Moghaddam A, Deo R, Fijani E, Tziritis E (2018) Mapping groundwater contamination risk of multiple aquifers using multi-model ensemble of machine learning algorithms. Sci Total Environ 621:697–712

    Google Scholar 

  44. 44.

    Kisi O (2015) Pan evaporation modeling using least square support vector machine, multivariate adaptive regression splines and M5 model tree. J Hydro 528:312–320

    Google Scholar 

  45. 45.

    Friedman JH, Roosen CB (1995) An introduction to multivariate adaptive regression splines. Stat Methods Med Res 4:197–217

    Google Scholar 

  46. 46.

    Barzegar R, Asghari-Moghaddam A (2016) Combining the advantages of neural networks using the concept of committee machine in the groundwater salinity prediction. Model Earth Syst Environ. 2:26. https://doi.org/10.1007/s40808-015-0072-8

    Article  Google Scholar 

  47. 47.

    Barzegar R, Asghari-Moghaddam A, Baghban H (2016) A supervised committee machine artificial intelligent for improving DRASTIC method to assess groundwater contamination risk: a case study fromTabriz plain aquifer, Iran. Stoch Environ Res Risk Assess 30(3):883–899

    Google Scholar 

  48. 48.

    MATLAB (2016) TreeBagger. mathworks. Available at http://www.mathworks.com/help/stats/treebagger. html (Accessed 28 Aug 2016)

  49. 49.

    Liaw A, Wiener M (2002) Classification and regression by random forest. R News 2(3):18–22

    Google Scholar 

  50. 50.

    Deo RC, Downs N, Parisi A, Adamowski J, Quilty J (2017) Very short-term reactive forecasting of the solar ultraviolet index using an extreme learning machine integrated with the solar zenith angle. Environ 155:141–166

    Google Scholar 

  51. 51.

    Deo RC, Kisi O, Singh VP (2017) Drought forecasting in eastern Australia using multivariate adaptive regression spline, least square support vector machine and M5Tree model. Atmos Res 184:149–175

    Google Scholar 

  52. 52.

    Wanas N, Auda G, Kamel MS, Karray F (1998) On the optimal number of hidden nodes in a neural network. Proc IEEE Can Conf Electr Comput Eng 2:918–921

    Google Scholar 

  53. 53.

    Mishra DA, Basu A (2013) Estimation of uniaxial compressive strength of rock materials by index tests using regression analysis and fuzzy inference system. Eng Geol 160:54–68

    Google Scholar 

  54. 54.

    Barzegar R, Asghari-Moghaddam A, Adamowski J, Fijani E (2017) Comparison of machine learning models for predicting fluoride contamination in groundwater. Stoch Environ Res Risk Assess 31(10):2705–2718

    Google Scholar 

  55. 55.

    Legates DR, McCabe GJ (1999) Evaluating the use of “goodness of fit” measures in hydrologic and hydroclimatic model validation. Water Resour Res 35(2):33–41

    Google Scholar 

  56. 56.

    Willmott CJ (1981) On the validation of models. Phys Geogr 2:184–194

    Google Scholar 

  57. 57.

    Diamantis K, Gartzos E, Migiros G (2009) Study on uniaxial compressive strength, point load strength index, dynamic and physical properties of serpentinites from Central Greece: test results and empirical relations. Eng Geol 108:199–207

    Google Scholar 

  58. 58.

    Kohno M, Maeda H (2012) Relationship between point load strength index and uniaxial compressive strength of hydrothermally altered soft rocks. Int J Rock Mech Min Sci 50:147–157

    Google Scholar 

  59. 59.

    Demirdag S, Tufekci K, Kayacan R, Yavuz H, Altindag R (2010) Dynamic mechanical behavior of some carbonate rocks. Int J Rock Mech Min Sci 47:307–312

    Google Scholar 

  60. 60.

    Akin M, Ozsan A (2011) Evaluation of the long-term durability of yellow travertine using accelerated weathering tests. Bull Eng Geol Environ 70:101–114

    Google Scholar 

  61. 61.

    Matin SS, Farahzadi L, Makaremi S, Chehreh-Chelgani S, Sattari GH (2018) Variable selection and prediction of uniaxial compressive strength and modulus of elasticity by Random Forest. Appl Soft Comput 70:980–987

    Google Scholar 

  62. 62.

    Molina E, Cultrone G, Sebastian EJ, Alonso F (2013) Evaluation of stone durability using a combination of ultrasound, mechanical and accelerated aging tests. J Geophys Eng 10:1–18

    Google Scholar 

  63. 63.

    Chentout M, Alloul B, Rezouk A, Belhai D (2015) Experimental study to evaluate the effect of travertine structure on the physical and mechanical properties of the material. Arab J Geosci 8:8975–8985

    Google Scholar 

  64. 64.

    Jalali SH, Heidari M, Mohseni H (2017) Comparison of models for estimating uniaxial compressive strength of some sedimentary rocks from Qom Formation. Environ Earth Sci 76:753

    Google Scholar 

  65. 65.

    Yang Y, Zang O (1997) A hierarchical analysis for rock engineering using artificial neural networks. Rock Mech Rock Eng 30:207–222

    Google Scholar 

  66. 66.

    Jahed-Armaghani D, Tonnizam-Mohamad E, Momeni E, Monjezi M, Narayanasamy MS (2016) Prediction of the strength and elasticity modulus of granite through an expert artificial neural network. Arab J Geosci 9:48. https://doi.org/10.1007/s12517-015-2057-3

    Article  Google Scholar 

  67. 67.

    Jahed-Armaghani D, Mohammad ED, Hajihassani M, Yagiz S, Motaghedi H (2016) Application of several non-linear prediction tools for estimating uniaxial compressive strength of granitic rocks and comparison of their performances. Eng Comput 32(2):189–206

    Google Scholar 

Download references

Author information

Affiliations

  1. Department of Bioresource Engineering, McGill University, 21111 Lakeshore, Ste Anne de Bellevue, Sainte-Anne-de-Bellevue, QC, H9X3V9, Canada

    Rahim Barzegar & Jan Adamowski

  2. Department of Engineering Geology, Tarbiat Modares University, Tehran, Iran

    Masoud Sattarpour

  3. Institute of Agriculture and Environment (IAg&E), School of Agricultural Computational and Environmental Sciences, University of Southern Queensland, Springfield, Australia

    Ravinesh Deo

  4. School of Geology, College of Science, University of Tehran, Tehran, Iran

    Elham Fijani

Authors
  1. Rahim Barzegar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Masoud Sattarpour
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ravinesh Deo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Elham Fijani
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jan Adamowski
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rahim Barzegar.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Barzegar, R., Sattarpour, M., Deo, R. et al. An ensemble tree-based machine learning model for predicting the uniaxial compressive strength of travertine rocks. Neural Comput & Applic 32, 9065–9080 (2020). https://doi.org/10.1007/s00521-019-04418-z

Download citation

Keywords

  • Uniaxial compressive strength
  • Tree-based machine learning
  • Travertine
  • Ensemble model
  • Iran