Abstract
This study investigates image-data-driven deep learning in the stability analysis of geosystems. For the purpose, the recent breakthrough in computer vision represented by the Convolutional Neural Network (CNN), which was later used as a core technique in developing Google’s AlphaGo, was studied for its capacity in assessing the stability of retaining walls. The concept used in the famous Dogs vs. Cats Kaggle challenge, in which machine learning algorithms are used to classify whether an image contains a dog or a cat, was employed. A CNN was used to analyze images for retaining walls to tell whether a wall is “cat” (safe) or “dog” (failed). For quantitative analysis, 2D images for retaining walls, organized as datasets of sizes from 500 to 200,000, were generated using a stochastic method and labeled using a traditional mechanistic method. An accuracy of 97.94% was achieved for predicting whether the retaining wall is safe via binary classifications with the CNN. Testing via the analysis of 20,000 additional images, which were independent and identically distributed, confirmed the results. Further investigations into the dataset sizes and computational power yielded quantitative insights into the influence of data and computing resources on the application of deep learning in the stability analysis of geosystems. The study, for the first time, proves the feasibility of stability analysis of geosystems with image data and provides a potential big data solution for geotechnical engineering as well as other civil engineering areas.
Similar content being viewed by others
References
Abdel-Rahman AH (2008) Predicting compaction of cohesionless soils using ANN. Proc Inst Civil Eng-Ground Improve 161(1):3–8
Ahmad I, El Naggar MH, Khan AN (2007) Artificial neural network application to estimate kinematic soil pile interaction response parameters. Soil Dyn Earthq Eng 27(9):892–905
Alimoradi A, Moradzadeh A, Naderi R, Salehi MZ, Etemadi A (2008) Prediction of geological hazardous zones in front of a tunnel face using TSP-203 and artificial neural networks. Tunn Undergr Space Technol 23(6):711–717
Ardalan H, Eslami A, Nariman-Zadeh N (2009) Piles shaft capacity from CPT and CPTu data by polynomial neural networks and genetic algorithms. Comput Geotech 36(4):616–625
Ashayeri I, Yasrebi S (2009) Free-swell and swelling pressure of unsaturated compacted clays; experiments and neural networks modeling. Geotech Geol Eng 27(1):137
Banimahd M, Yasrobi S, Woodward P (2005) Artificial neural network for stress–strain behavior of sandy soils: Knowledge based verification. Comput Geotech 32(5):377–386
Basheer I (2002) Stress-strain behavior of geomaterials in loading reversal simulated by time-delay neural networks. J Mater Civ Eng 14(3):270–273
Baykasoğlu A, Güllü H, Çanakçı H, Özbakır L (2008) Prediction of compressive and tensile strength of limestone via genetic programming. Expert Syst Appl 35(1):111–123
Benardos A, Kaliampakos D (2004) Modelling TBM performance with artificial neural networks. Tunn Undergr Space Technol 19(6):597–605
Bhattacharya B, Solomatine DP (2006) Machine learning in soil classification. Neural Netw 19(2):186–195
Byeon WY, Lee SR, Kim Y (2006) Application of flat DMT and ANN to Korean soft clay deposits for reliable estimation of undrained shear strength. Int J Offshore Polar Eng 16(1): 73–80
Caglar N, Arman H (2007) The applicability of neural networks in the determination of soil profiles. Bull Eng Geol Env 66(3):295–301
Çelik S, Tan Ö (2005) Determination of preconsolidation pressure with artificial neural network. Civ Eng Environ Syst 22(4):217–231
Chen X-W, Lin X (2014) Big data deep learning: challenges and perspectives. IEEE Access 2:514–525
Chen Y-L, Azzam R, Zhang F-B (2006) The displacement computation and construction pre-control of a foundation pit in Shanghai utilizing FEM and intelligent methods. Geotech Geol Eng 24(6):1781–1801
Chen Y-L, Azzam R, Fernandez-Steeger TM, Li L (2009) Studies on construction pre-control of a connection aisle between two neighbouring tunnels in Shanghai by means of 3D FEM, neural networks and fuzzy logic. Geotech Geol Eng 27(1):155
Cho SE (2009) Probabilistic stability analyses of slopes using the ANN-based response surface. Comput Geotech 36(5):787–797
Chua C, Goh AT (2005) Estimating wall deflections in deep excavations using Bayesian neural networks. Tunn Undergr Space Technol 20(4):400–409
Collobert R, Weston J (2008) A unified architecture for natural language processing: Deep neural networks with multitask learning. Proc., The 25th international conference on Machine learning, ACM, 160–167
Dahl GE, Yu D, Deng L, Acero A (2012) Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition. IEEE Trans Audio Speech Lang Process 20(1):30–42
Das BM (2015) Principles of foundation engineering. Cengage learning, Boston
Das SK, Basudhar PK (2006) Undrained lateral load capacity of piles in clay using artificial neural network. Comput Geotech 33(8):454–459
Das SK, Samui P, Sabat AK (2011) Prediction of field hydraulic conductivity of clay liners using an artificial neural network and support vector machine. Int J Geomech 12(5):606–611
Deng J, Lee C (2001) Displacement back analysis for a steep slope at the three gorges project site. Int J Rock Mech Min Sci 38(2):259–268
Ding X, Zhang Y, Liu T, Duan J (2015) Deep learning for event-driven stock prediction. Proc., IJCAI, 2327–2333
Erzin Y (2007) Artificial neural networks approach for swell pressure versus soil suction behaviour. Can Geotech J 44(10):1215–1223
Erzin Y, Cetin T (2013) The prediction of the critical factor of safety of homogeneous finite slopes using neural networks and multiple regressions. Comput Geosci 51:305–313
Fakoor R, Ladhak F, Nazi A, Huber M (2013) Using deep learning to enhance cancer diagnosis and classification. Proc., the 30th international conference on machine learning, Atlanta, Georgia, USA
Farrokhzad F, Barari A, Choobbasti A, Ibsen LB (2011) Neural network-based model for landslide susceptibility and soil longitudinal profile analyses: two case studies. J Afr Earth Sc 61(5):349–357
Ferentinou M, Sakellariou M (2007) Computational intelligence tools for the prediction of slope performance. Comput Geotech 34(5):362–384
Fu Q, Hashash YM, Jung S, Ghaboussi J (2007) Integration of laboratory testing and constitutive modeling of soils. Comput Geotech 34(5):330–345
Gangopadhyay S, Gautam TR, Gupta AD (1999) Subsurface characterization using artificial neural network and GIS. J Comput Civ Eng 13(3):153–161
Gao W, Feng X, Zheng Y (2004) Identification of a constitutive model for geo-materials using a new intelligent bionics algorithm. Int J Rock Mech Min Sci 41:454–459
Garcıa S, Romo M, Figueroa-Nazuno J (2006) Soil dynamic properties determination: a neurofuzzy system approach. Control Intell Syst 34(1):1–11
Glauner PO (2015) Deep convolutional neural networks for smile recognition. IEEE/ACM Trans Audio Speech Lang Proc 22(10):1533–1545
Goh AT, Kulhawy FH (2003) Neural network approach to model the limit state surface for reliability analysis. Can Geotech J 40(6):1235–1244
Goh A, Kulhawy F (2005) Reliability assessment of serviceability performance of braced retaining walls using a neural network approach. Int J Numer Anal Meth Geomech 29(6):627–642
Goh AT, Wong K, Broms B (1995) Estimation of lateral wall movements in braced excavations using neural networks. Can Geotech J 32(6):1059–1064
Goh AT, Kulhawy FH, Chua C (2005) Bayesian neural network analysis of undrained side resistance of drilled shafts. J Geotech Geoenviron Eng 131(1):84–93
Gokceoglu C, Yesilnacar E, Sonmez H, Kayabasi A (2004) A neuro-fuzzy model for modulus of deformation of jointed rock masses. Comput Geotech 31(5):375–383
Gowda B, Chethan V, Rao Sri Rama T (2012) Optimization of counterfort retaining wall using artificial neural network. Proc., A proceedings of national conference on contemporary civil engineering research and practices, M.I.T, Manipal
Habibagahi G, Bamdad A (2003) A neural network framework for mechanical behavior of unsaturated soils. Can Geotech J 40(3):684–693
Hanna AM, Morcous G, Helmy M (2004) Efficiency of pile groups installed in cohesionless soil using artificial neural networks. Can Geotech J 41(6):1241–1249
Hashash Y, Jung S, Ghaboussi J (2004) Numerical implementation of a neural network based material model in finite element analysis. Int J Numer Meth Eng 59(7):989–1005
Heidari A (2011) Calculation of frequency of retaining wall by back propagation neural network. Asian J Civil Eng 12(3):267–278
Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507
Hinton G, Deng L, Yu D, Dahl GE, Mohamed A-R, Jaitly N, Senior A, Vanhoucke V, Nguyen P, Sainath TN (2012) Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. IEEE Signal Process Mag 29(6):82–97
Hopmans JW, Šimunek J, Bristow KL (2002) Indirect estimation of soil thermal properties and water flux using heat pulse probe measurements: geometry and dispersion effects. Water Resour Res 38(1):7–1–7–14
Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: Convolutional architecture for fast feature embedding. Proc., proceedings of the 22nd ACM international conference on multimedia, ACM, 675–678
Kaisler S, Armour F, Espinosa JA, Money W (2013) Big data: Issues and challenges moving forward. Proc., System sciences (HICSS), 2013 46th Hawaii International Conference on System Sciences, IEEE, 995–1004
Kanungo D, Arora M, Sarkar S, Gupta R (2006) A comparative study of conventional, ANN black box, fuzzy and combined neural and fuzzy weighting procedures for landslide susceptibility zonation in Darjeeling Himalayas. Eng Geol 85(3):347–366
Kasa A, Chik Z, Mohd Raihan T (2011) “Prediction of internal stability for geogrid-reinforced segmental walls.” Proc Adv Mater Res 462:1319–1324
Kaya A (2009) Residual and fully softened strength evaluation of soils using artificial neural networks. Geotech Geol Eng 27(2):281–288
Kaya Z (2016) Predicting liquefaction-induced lateral spreading by using neural network and neuro-fuzzy techniques. Int J Geomech 16(4):04015095
Kelnar D (2016) The fourth industrial revolution: a primer on artificial intelligence (AI). Medium.com
Kim Y-S, Kim B-T (2008) Prediction of relative crest settlement of concrete-faced rockfill dams analyzed using an artificial neural network model. Comput Geotech 35(3):313–322
Kitchin R (2014) Big data, new epistemologies and paradigm shifts. Big Data Soc 1(1):2053951714528481
Kostić S, Vasović N, Todorović K, Samčović A (2016) Application of artificial neural networks for slope stability analysis in geotechnical practice. Proc., 13th Symposium on Neural Networks and Applications (NEUREL), IEEE, 1–6
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Proc., Advances in neural information processing systems, 1097–1105
Kung GT, Hsiao EC, Schuster M, Juang CH (2007) A neural network approach to estimating deflection of diaphragm walls caused by excavation in clays. Comput Geotech 34(5):385–396
Kuo Y, Jaksa M, Lyamin A, Kaggwa W (2009) ANN-based model for predicting the bearing capacity of strip footing on multi-layered cohesive soil. Comput Geotech 36(3):503–516
Kurup PU, Dudani NK (2002) Neural networks for profiling stress history of clays from PCPT data. J Geotech Geoenviron Eng 128(7):569–579
Kurup PU, Griffin EP (2006) Prediction of soil composition from CPT data using general regression neural network. J Comput Civ Eng 20(4):281–289
Lee S, Lee S, Kim Y (2003) An approach to estimate unsaturated shear strength using artificial neural network and hyperbolic formulation. Comput Geotech 30(6):489–503
Lefik M, Schrefler B (2003) Artificial neural network as an incremental non-linear constitutive model for a finite element code. Comput Methods Appl Mech Eng 192(28):3265–3283
Li R, Zhang W, Suk HI, Wang L, Li J, Shen D, Ji S (2014) "Deep learning based imaging data completion for improved brain disease diagnosis." Proc., International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer, 305–312
Lohr S (2012) "The age of big data." New York Times, 11
Lu Y (2005) Underground blast induced ground shock and its modelling using artificial neural network. Comput Geotech 32(3):164–178
Ma S, Cao L, Li H (2006) The improved neutral network and its application for valuing rock mass mechanical parameter. J Coal Sci Eng 12(1):21–24
Maji VB, Sitharam T (2008) Prediction of elastic modulus of jointed rock mass using artificial neural networks. Geotech Geol Eng 26(4):443–452
Manning CD (2016) Computational linguistics and deep learning. Comput Ling 41(4):701–707
Manyika J, Chui M, Brown B, Bughin J, Dobbs R, Roxburgh C, Byers AH (2011) Big data: the next frontier for innovation, competition, and productivity, Mckinsey Global Institute, Washington DC
Mayoraz F, Vulliet L (2002) Neural networks for slope movement prediction. The Int J Geomech 2(2):153–173
Metz C (2009) Inside Google, data drives 'everything'. The Register, UK
Millar D, Hudson J (1994) Performance monitoring of rock engineering systems using neural networks. Trans Inst Min Metall Sect A Min Ind 103: A3–A16
Moayedi H, Hayati S (2018) Applicability of a CPT-based neural network solution in predicting load-settlement responses of bored pile. Int J Geomech 18(6):06018009
Moyer C (2016) How Google’s AlphaGo beat a Go world champion. The Atlantic, March, 28
Najjar YM, Huang C (2007) Simulating the stress–strain behavior of Georgia kaolin via recurrent neuronet approach. Comput Geotech 34(5):346–361
Narendra B, Sivapullaiah P, Suresh S, Omkar S (2006) Prediction of unconfined compressive strength of soft grounds using computational intelligence techniques: a comparative study. Comput Geotech 33(3):196–208
Neaupane K, Achet S (2004a) Some applications of a backpropagation neural network in geo-engineering. Environ Geol 45(4):567–575
Neaupane KM, Achet SH (2004b) Use of backpropagation neural network for landslide monitoring: a case study in the higher Himalaya. Eng Geol 74(3):213–226
Neaupane KM, Adhikari N (2006) Prediction of tunneling-induced ground movement with the multi-layer perceptron. Tunn Undergr Space Technol 21(2):151–159
Nguyen A, Yosinski J, Clune J (2015) Deep neural networks are easily fooled: High confidence predictions for unrecognizable images. Proc., The IEEE conference on computer vision and pattern recognition, 427–436
Ohlsson S (2011) Deep learning: How the mind overrides experience. Cambridge University Press
Ozturk TE (2014) Artificial neural networks approach for earthquake deformation determination of geosynthetic reinforced retaining walls. Int J Intell Sys App Eng 2(1):1–9
Padmini D, Ilamparuthi K, Sudheer K (2008) Ultimate bearing capacity prediction of shallow foundations on cohesionless soils using neurofuzzy models. Comput Geotech 35(1):33–46
Park J, Li D, Murphey YL, Kristinsson J, McGee R, Kuang M, Phillips T (2011) Real time vehicle speed prediction using a neural network traffic model. Proc., The 2011 international joint conference on neural networks (IJCNN), IEEE, 2991–2996
Provenzano P, Ferlisi S, Musso A (2004) Interpretation of a model footing response through an adaptive neural fuzzy inference system. Comput Geotech 31(3):251–266
Romo M, Garcıa S (2003) Neurofuzzy mapping of CPT values into soil dynamic properties. Soil Dyn Earthq Eng 23(6):473–482
Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M (2015) Imagenet large scale visual recognition challenge. Int J Comput Vision 115(3):211–252
Sakellariou M, Ferentinou M (2005) A study of slope stability prediction using neural networks. Geotech Geol Eng 23(4):419
Samui P, Sitharam T (2010) Site characterization model using artificial neural network and kriging. Int J Geomech 10(5):171–180
Shahin MA (2010) Intelligent computing for modeling axial capacity of pile foundations. Can Geotech J 47(2):230–243
Shahin MA, Indraratna B (2006) Modeling the mechanical behavior of railway ballast using artificial neural networks. Can Geotech J 43(11):1144–1152
Shahin M, Jaksa M (2005) Neural network prediction of pullout capacity of marquee ground anchors. Comput Geotech 32(3):153–163
Shahin MA, Jaksa MB (2006) Pullout capacity of small ground anchors by direct cone penetration test methods and neural networks. Can Geotech J 43(6):626–637
Shahin MA, Jaksa MB (2009) "Intelligent computing for predicting axial capacity of drilled shafts." Contemporary Topics in In Situ Testing, Analysis, and Reliability of Foundations, 26–33
Shahin MA, Jaksa MB, Maier HR (2001) Artificial neural network applications in geotechnical engineering. Australian Geomech 36(1):49–62
Shahin MA, Jaksa MB, Maier HR (2002) Artificial neural network based settlement prediction formula for shallow foundations on granular soils. Australian Geomech: J News The Australian Geomech Soci 37(4):45
Shahin M, Maier H, Jaksa M (2003) Settlement prediction of shallow foundations on granular soils using B-spline neurofuzzy models. Comput Geotech 30(8):637–647
Shahin M, Jaksa M, Maier H (2005) Neural network based stochastic design charts for settlement prediction. Can Geotech J 42(1):110–120
Shahin MA, Jaksa MB, Maier HR (2008) State of the art of artificial neural networks in geotechnical engineering. Electron J Geotech Eng 8:1–26
Shang J, Ding W, Rowe R, Josic L (2004) Detecting heavy metal contamination in soil using complex permittivity and artificial neural networks. Can Geotech J 41(6):1054–1067
Shangguan Z, Li S, Luan M (2009) Intelligent forecasting method for slope stability estimation by using probabilistic neural networks. Electr J Geotech Eng, 13, Bund. C: 1–10
Silver D, Huang A, Maddison CJ, Guez A, Sifre L, Van Den Driessche G, Schrittwieser J, Antonoglou I, Panneershelvam V, Lanctot M (2016) Mastering the game of Go with deep neural networks and tree search. Nature 529(7587):484–489
Singh T, Singh V (2005) An intelligent approach to prediction and control ground vibration in mines. Geotech Geol Eng 23(3):249–262
Singh T, Verma A, Singh V, Sahu A (2005) Slake durability study of shaly rock and its predictions. Environ Geol 47(2):246–253
Singh T, Verma A, Sharma P (2007) A neuro-genetic approach for prediction of time dependent deformational characteristic of rock and its sensitivity analysis. Geotech Geol Eng 25(4):395–407
Sinha SK, Wang MC (2008) Artificial neural network prediction models for soil compaction and permeability. Geotech Geol Eng 26(1):47–64
Sitharam T, Samui P, Anbazhagan P (2008) Spatial variability of rock depth in Bangalore using geostatistical, neural network and support vector machine models. Geotech Geol Eng 26(5):503–517
Wang HB, Sassa K (2006) Rainfall-induced landslide hazard assessment using artificial neural networks. Earth Surf Proc Land 31(2):235–247
Wang CY, Zhang F, Han WD (2014) "A Study on the Application of RBF Neural Network in Slope Stability of Bayan Obo East Mine." Proc., Advanced Materials Research, Trans Tech Publ, 1507–1510
Wu X, Zhu X, Wu G-Q, Ding W (2014) Data mining with big data. IEEE Trans Knowl Data Eng 26(1):97–107
Yang Y, Rosenbaum M (2002) The artificial neural network as a tool for assessing geotechnical properties. Geotech Geol Eng 20(2):149–168
Yildiz E, Ozyazicioglu M, Özkan MY (2010) Lateral pressures on rigid retaining walls: A neural network approach. Gazi Univ J Sci 23(2):201–210
Yoo C, Kim J-M (2007) Tunneling performance prediction using an integrated GIS and neural network. Comput Geotech 34(1):19–30
Yu Y, Zhang B, Yuan H (2007) An intelligent displacement back-analysis method for earth-rockfill dams. Comput Geotech 34(6):423–434
Zeiler MD (2012) ADADELTA: An Adaptive Learning Rate Method. https://arxiv.org/abs/1212.5701
Funding
The author would like to acknowledge the financial support from the United States National Science Foundation (NSF) via Award 1742656 from the Geotechnical Engineering and Materials Program (now part of CMMI ECI). This work used the Extreme Science and Engineering Discovery Environment (XSEDE), which is supported by National Science Foundation grant number ACI-1548562.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Liu, Z., Hu, S., Sun, Y. et al. An Exploratory Investigation into Image-Data-Driven Deep Learning for Stability Analysis of Geosystems. Geotech Geol Eng 40, 735–750 (2022). https://doi.org/10.1007/s10706-021-01921-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10706-021-01921-w