Advertisement

An ensemble tree-based machine learning model for predicting the uniaxial compressive strength of travertine rocks

  • Rahim BarzegarEmail author
  • Masoud Sattarpour
  • Ravinesh Deo
  • Elham Fijani
  • Jan Adamowski
Original Article
  • 33 Downloads

Abstract

Estimating the uniaxial compressive strength (UCS) of travertine rocks with an indirect modeling approach and machine learning algorithms is useful as models can reduce the cost and time required to obtain accurate measurements of UCS, which is important for the prediction of rock failure. This approach can also address the limitations encountered in preparing detailed measured samples using direct measurements. The current paper developed and compared the performance of three standalone tree-based machine learning models (random forest (RF), M5 model tree, and multivariate adaptive regression splines (MARS)) for the prediction of UCS in travertine rocks from the Azarshahr area of northwestern Iran. Additionally, an ensemble committee-based artificial neural network (ANN) model was developed to integrate the advantages of the three standalone models and obtain further accuracy in UCS prediction. To date, an ensemble approach for estimating UCS has not been explored. To construct and validate the models, a set of rock test data including p-wave velocity (Vp (Km/s)), Schmidt Hammer (Rn), porosity (n%), point load index (Is (MPa)), and UCS (MPa) were acquired from 93 travertine core samples. To develop the ensemble tree-based machine learning model, the input matrix representing Vp, Rn, n%, and Is data with the corresponding target variable (i.e., UCS) was incorporated with a ratio of 70:15:15 (train: validate: test). Results indicated that a standalone MARS model outperformed all other standalone tree-based models in predicting UCS. The ANN-committee model, however, obtained the best performance with an r-value of approximately 0.890, an RMSE of 3.980 MPa, an MAE of 3.225 MPa, a WI of 0.931, and an LMI of 0.537, demonstrating the improved accuracy of the ensemble model for the prediction of UCS relative to the standalone models. The results suggest that the proposed ensemble committee-based model is a useful approach for predicting the UCS of travertine rocks with a limited set of model-designed datasets.

Keywords

Uniaxial compressive strength Tree-based machine learning Travertine Ensemble model Iran 

Notes

Compliance with ethical standards

Conflict of interest

The authors declare that they have no conflict of interest.

References

  1. 1.
    Dehghan S, Sattari GH, Chehreh-Chelgani S, Aliabadi MA (2010) Prediction of uniaxial compressive strength and modulus of elasticity for Travertine samples using regression and artificial neural networks. Min Sci Technol 20:41–46Google Scholar
  2. 2.
    Ozbek A, Unsal M, Dikec A (2013) Estimating uniaxial compressive strength of rocks using genetic expression programming. Rock Mech Geotech Eng 5(4):325–329Google Scholar
  3. 3.
    Briševac Z, Hrzenjak P, Buljan R (2016) Models for estimating uniaxial compressive strength and elastic modulus. Gradevinar 68(1):19–28Google Scholar
  4. 4.
    Karakus M, Tutmez B (2006) Fuzzy and multiple regression modeling for evaluation of intact rock strength based on point load, Schmidt hammer and sonic velocity. Rock Mech Rock Eng 39(1):45–57Google Scholar
  5. 5.
    Yilmaz I, Yuksek AG (2008) An example of artificial neural network (ANN) application for indirect estimation of rock parameters. Rock Mech Rock Eng 41:781–795Google Scholar
  6. 6.
    Tiryaki B (2008) Predicting intact rock strength for mechanical excavation using multivariate statistics, artificial neural networks and regression trees. Eng Geol 99(1–2):51–60Google Scholar
  7. 7.
    Barzegar R, Sattarpour M, Nikudel MR, Asghari-Moghaddam A (2016) Comparative evaluation of artificial intelligence models for prediction of uniaxial compressive strength of travertine rocks, Case study: Azarshahr area, NW Iran. Model Earth Sys Environ 2:76Google Scholar
  8. 8.
    Gokceoglu C (2002) A fuzzy triangular chart to predict the uniaxial compressive strength of the Ankara agglomerates from their petrographic composition. Eng Geol 66(1–2):39–51Google Scholar
  9. 9.
    Gokceoglu C, Zorlu K (2004) A fuzzy model to predict the uniaxial compressive strength and the modulus of elasticity of a problematic rock. Eng Appl Artif Intell 17:61–72Google Scholar
  10. 10.
    Liu Z, Shao J, Xu W, Wu Q (2015) Indirect estimation of unconfined compressive strength of carbonate rocks using extreme learning machine. Acta Geotech 10:651–663Google Scholar
  11. 11.
    Beiki M, Majdi A, Givshad AD (2013) Application of genetic programming to predict the uniaxial compressive strength and elastic modulus of carbonate rocks. Int J Rock Mech Min Sci 63:159–169Google Scholar
  12. 12.
    Ghasemi E, Kalhori H, Bagherpour R, Yagiz S (2018) Model tree approach for predicting uniaxial compressive strength and Young’s modulus of carbonate rocks. Bull Eng Geol Environ 77(1):331–343Google Scholar
  13. 13.
    Ceyran N (2014) Application of support vector machines and relevance vector machines in predicting uniaxial compressive strength of volcanic rocks. J Afr Earth Sci 100:634–644Google Scholar
  14. 14.
    Momeni E, Jahed Armaghani D, Hajihassani M, Amin MFM (2015) Prediction of uniaxial compressive strength of rock samples using hybrid particle swarm optimization-based artificial neural networks. Measurement 60:50–63Google Scholar
  15. 15.
    Saedi B, Mohammadi SD, Shahbazi H (2019) Application of fuzzy inference system to predict uniaxial compressive strength and elastic modulus of migmatites. Environ Earth Sci 78(6):208Google Scholar
  16. 16.
    Çelik SB (2019) Prediction of uniaxial compressive strength of carbonate rocks from nondestructive tests using multivariate regression and LS-SVM methods. Arab J Geosci 12(6):193Google Scholar
  17. 17.
    Hassan MA, Khalil A, Kaseb S, Kassem MA (2017) Exploring the potential of tree-based ensemble methods in solar radiation modeling. Appl Energy 203:897–916Google Scholar
  18. 18.
    Fan J, Yue W, Wu L, Zhang F, Cai H, Wang X, Lu X, Xiang Y (2018) Evaluation of SVM, ELM and four tree-based ensemble models for predicting daily reference evapotranspiration using limited meteorological data in different climates of China. Agric For Meteorol 263:225–241Google Scholar
  19. 19.
    Taghipour K, Mohajjel M (2013) Structure and generation mode of travertine fissure-ridges in Azarshahr area, Azarbaydjan, NW Iran. Iran J Geol 7(25):15–33Google Scholar
  20. 20.
    ISRM (1981) Rock characterization, testing and monitoring, ISRM suggested methods. ET Brown (ed.), Pergamon Press, OxfordGoogle Scholar
  21. 21.
    Pedhazur EJ (1982) Multiple regression in behavioral research: explanation and prediction. Holt Rinehart and Winston, New YorkGoogle Scholar
  22. 22.
    Adamowski J, Chan HF, Prasher SO, Ozga-Zielinski B, Sliusarieva A (2012) Comparison of multiple linear and nonlinear regression, autoregressive integrated moving average, artificial neural network, and wavelet artificial neural network methods for urban water demand forecasting in Montreal, Canada. Water Resour Res 48:W01528.  https://doi.org/10.1029/2010WR009945 Google Scholar
  23. 23.
    Ivakhnenko AG (1970) Heuristic self-organization in problems of engineering cybernetics. Automatica 6(2):207–219Google Scholar
  24. 24.
    Ho TK (1995) Random decision forests. In: Proceedings of the third international conference on document analysis and recognition, pp 278–282Google Scholar
  25. 25.
    Breiman L (2001) Random forests. Mach Learn 45(1):5–32zbMATHGoogle Scholar
  26. 26.
    Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learning—data mining, inference and prediction. Springer, New YorkzbMATHGoogle Scholar
  27. 27.
    Breiman L, Friedman JH, Olshen R, Stone CJ (1984) Classification and regression trees. Wadsworth, BelmontzbMATHGoogle Scholar
  28. 28.
    Quinlan JR (1993) C4.5 programs for machine learning. Morgan Kaurmann, SanMateo, p 303Google Scholar
  29. 29.
    Rodriguez-Galiano V, Mendes MP, Garcia-Soldado MJ, Chica-Olmo M, Ribeiro L (2014) Predictive modeling of groundwater nitrate pollution using random forest and multisource variables related to intrinsic and specific vulnerability: a case study in an agricultural setting (Southern Spain). Sci Total Environ 476–477:189–206Google Scholar
  30. 30.
    Quinlan JR (1992) Learning with continuous classes. In: 5th Australian joint conference on artificial intelligence singapore, pp 343–348Google Scholar
  31. 31.
    Al-Musaylh MS, Deo RC, Adamowski JF, Li Y (2018) Short-term electricity demand forecasting with MARS, SVR and ARIMA models using aggregated demand data in Queensland, Australia. Adv Eng Info 35:1–16Google Scholar
  32. 32.
    Yaseen ZM, Deo RC, Hilal A, Abd AM, Bueno LC, Salcedo-Sanz S, Nehdi ML (2018) Predicting compressive strength of lightweight foamed concrete using extreme learning machine model. Adv Eng Softw 115:112–125Google Scholar
  33. 33.
    Mitchell TM (1997) Machine learning. Computer science series. McGraw-Hill, Burr Ridge, MATHGoogle Scholar
  34. 34.
    Rahimikhoob A, Asadi M, Mashal M (2013) A comparison between conventional and M5 model tree methods for converting pan evaporation to reference evapotranspiration for semi-arid region. Water Resour Manag 27:4815–4826Google Scholar
  35. 35.
    Solomatine DP, Xue Y (2004) M5 model trees compared to neural networks: application to flood forecasting in the upper reach of the Huai River in China. J Hydrol Eng 9:491–501Google Scholar
  36. 36.
    García Nieto PJ, García-Gonzalo E, Bové J, Arbat G, Duran-Ros M, Puig-Bargués J (2017) Modeling pressure drop produced by different filtering media in microirrigation sand filters using the hybrid ABC-MARS-based approach, MLP neural network and M5 model tree. Comput Electron Agr 139:65–74Google Scholar
  37. 37.
    Pal M, Deswal S (2009) M5 model tree based modelling of reference evapotranspiration. Hydrol Process 23(10):1437–1443Google Scholar
  38. 38.
    Wang YW, Witten IH (1997) Inducing model trees for predicting continuous classes. In: Proceedings of European conference on machine learning. University of Economics PragueGoogle Scholar
  39. 39.
    Pal M (2005) Random Forest classifier for remote sensing classification. Int J Remote Sens 26(1):217–222Google Scholar
  40. 40.
    Friedman JH (1991) Multivariate adaptive regression splines. Ann Stat 19:1–67MathSciNetzbMATHGoogle Scholar
  41. 41.
    Samui P (2012) Slope stability analysis using multivariate adaptive regression spline. Metaheuristics in Water, Geotechnical and Transport Engineering: 327Google Scholar
  42. 42.
    Adamowski J, Chan HF, Prasher SO, Sharda VN (2012) Comparison of multivariate adaptive regression splines with coupled wavelet transform artificial neural networks for runoff forecasting in Himalayan micro-watersheds with limited data. J Hydroinf 14(3):731–744Google Scholar
  43. 43.
    Barzegar R, Asghari-Moghaddam A, Deo R, Fijani E, Tziritis E (2018) Mapping groundwater contamination risk of multiple aquifers using multi-model ensemble of machine learning algorithms. Sci Total Environ 621:697–712Google Scholar
  44. 44.
    Kisi O (2015) Pan evaporation modeling using least square support vector machine, multivariate adaptive regression splines and M5 model tree. J Hydro 528:312–320Google Scholar
  45. 45.
    Friedman JH, Roosen CB (1995) An introduction to multivariate adaptive regression splines. Stat Methods Med Res 4:197–217Google Scholar
  46. 46.
    Barzegar R, Asghari-Moghaddam A (2016) Combining the advantages of neural networks using the concept of committee machine in the groundwater salinity prediction. Model Earth Syst Environ. 2:26.  https://doi.org/10.1007/s40808-015-0072-8 Google Scholar
  47. 47.
    Barzegar R, Asghari-Moghaddam A, Baghban H (2016) A supervised committee machine artificial intelligent for improving DRASTIC method to assess groundwater contamination risk: a case study fromTabriz plain aquifer, Iran. Stoch Environ Res Risk Assess 30(3):883–899Google Scholar
  48. 48.
    MATLAB (2016) TreeBagger. mathworks. Available at http://www.mathworks.com/help/stats/treebagger. html (Accessed 28 Aug 2016)
  49. 49.
    Liaw A, Wiener M (2002) Classification and regression by random forest. R News 2(3):18–22Google Scholar
  50. 50.
    Deo RC, Downs N, Parisi A, Adamowski J, Quilty J (2017) Very short-term reactive forecasting of the solar ultraviolet index using an extreme learning machine integrated with the solar zenith angle. Environ 155:141–166Google Scholar
  51. 51.
    Deo RC, Kisi O, Singh VP (2017) Drought forecasting in eastern Australia using multivariate adaptive regression spline, least square support vector machine and M5Tree model. Atmos Res 184:149–175Google Scholar
  52. 52.
    Wanas N, Auda G, Kamel MS, Karray F (1998) On the optimal number of hidden nodes in a neural network. Proc IEEE Can Conf Electr Comput Eng 2:918–921Google Scholar
  53. 53.
    Mishra DA, Basu A (2013) Estimation of uniaxial compressive strength of rock materials by index tests using regression analysis and fuzzy inference system. Eng Geol 160:54–68Google Scholar
  54. 54.
    Barzegar R, Asghari-Moghaddam A, Adamowski J, Fijani E (2017) Comparison of machine learning models for predicting fluoride contamination in groundwater. Stoch Environ Res Risk Assess 31(10):2705–2718Google Scholar
  55. 55.
    Legates DR, McCabe GJ (1999) Evaluating the use of “goodness of fit” measures in hydrologic and hydroclimatic model validation. Water Resour Res 35(2):33–41Google Scholar
  56. 56.
    Willmott CJ (1981) On the validation of models. Phys Geogr 2:184–194Google Scholar
  57. 57.
    Diamantis K, Gartzos E, Migiros G (2009) Study on uniaxial compressive strength, point load strength index, dynamic and physical properties of serpentinites from Central Greece: test results and empirical relations. Eng Geol 108:199–207Google Scholar
  58. 58.
    Kohno M, Maeda H (2012) Relationship between point load strength index and uniaxial compressive strength of hydrothermally altered soft rocks. Int J Rock Mech Min Sci 50:147–157Google Scholar
  59. 59.
    Demirdag S, Tufekci K, Kayacan R, Yavuz H, Altindag R (2010) Dynamic mechanical behavior of some carbonate rocks. Int J Rock Mech Min Sci 47:307–312Google Scholar
  60. 60.
    Akin M, Ozsan A (2011) Evaluation of the long-term durability of yellow travertine using accelerated weathering tests. Bull Eng Geol Environ 70:101–114Google Scholar
  61. 61.
    Matin SS, Farahzadi L, Makaremi S, Chehreh-Chelgani S, Sattari GH (2018) Variable selection and prediction of uniaxial compressive strength and modulus of elasticity by Random Forest. Appl Soft Comput 70:980–987Google Scholar
  62. 62.
    Molina E, Cultrone G, Sebastian EJ, Alonso F (2013) Evaluation of stone durability using a combination of ultrasound, mechanical and accelerated aging tests. J Geophys Eng 10:1–18Google Scholar
  63. 63.
    Chentout M, Alloul B, Rezouk A, Belhai D (2015) Experimental study to evaluate the effect of travertine structure on the physical and mechanical properties of the material. Arab J Geosci 8:8975–8985Google Scholar
  64. 64.
    Jalali SH, Heidari M, Mohseni H (2017) Comparison of models for estimating uniaxial compressive strength of some sedimentary rocks from Qom Formation. Environ Earth Sci 76:753Google Scholar
  65. 65.
    Yang Y, Zang O (1997) A hierarchical analysis for rock engineering using artificial neural networks. Rock Mech Rock Eng 30:207–222Google Scholar
  66. 66.
    Jahed-Armaghani D, Tonnizam-Mohamad E, Momeni E, Monjezi M, Narayanasamy MS (2016) Prediction of the strength and elasticity modulus of granite through an expert artificial neural network. Arab J Geosci 9:48.  https://doi.org/10.1007/s12517-015-2057-3 Google Scholar
  67. 67.
    Jahed-Armaghani D, Mohammad ED, Hajihassani M, Yagiz S, Motaghedi H (2016) Application of several non-linear prediction tools for estimating uniaxial compressive strength of granitic rocks and comparison of their performances. Eng Comput 32(2):189–206Google Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2019

Authors and Affiliations

  • Rahim Barzegar
    • 1
    Email author
  • Masoud Sattarpour
    • 2
  • Ravinesh Deo
    • 3
  • Elham Fijani
    • 4
  • Jan Adamowski
    • 1
  1. 1.Department of Bioresource EngineeringMcGill UniversitySainte-Anne-de-BellevueCanada
  2. 2.Department of Engineering GeologyTarbiat Modares UniversityTehranIran
  3. 3.Institute of Agriculture and Environment (IAg&E), School of Agricultural Computational and Environmental SciencesUniversity of Southern QueenslandSpringfieldAustralia
  4. 4.School of Geology, College of ScienceUniversity of TehranTehranIran

Personalised recommendations