Skip to main content

Advertisement

SpringerLink
Log in

Landslide detection using visualization techniques for deep convolutional neural network models

  • Original Paper
  • Published:
Natural Hazards Aims and scope Submit manuscript

Abstract

Landslides occur when masses of rock, earth, and other debris move down a slope. The slope of an area is directly responsible for the magnitude of the landslide. Being able to identify regional locations more likely to be impacted by landslides is essential if interventions to prevent loss of life and liberty are to be implemented. To further this objective, studies have been carried out using deep learning methods to assess the likelihood of landslides in a localized area. This study seeks to illuminate the reliability in using the deep learning method to effectively detect landslide zones for the purpose of enacting proactive interventions. Pre-trained models of Resnet-50, VGG-19, Inception-V3, and Xception, all of which are established deep learning approaches, were used to automatically detect regional landslides and then compare results. In addition, Grad-CAM, Grad-CAM +  + , and Score-CAM visualization techniques were considered depending on the deep learning methods used to accurately predict the location of landslides. The present research focuses on the landslides that took place in the Gündoğdu area of Rize, a city on the Black Sea cost of Turkey, from August 26 to 27, 2010, where unfortunately a significant number of individuals lost their lives. As a large number of landslide scene images are needed in order to facilitate a learning model’s deep learning, images from the area were obtained by aircraft and then organized as a dataset. Non-landslide scenes were added as a separate class in the training dataset to estimate the landslide regions more accurately. In total, 80% of the data will be used for training the model, while 20% will be used for testing the model that is built out of it. The experimental results were evaluated with the receiver operating curves and f1-score applicable to landslide detection characteristics. Obtained results show that both Resnet-50 and VGG-19 had a success rate of over 90%. Results also effectively demonstrate how the best visualization techniques for localizations are Grad-CAM and Score-CAM.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

(adapted from Alan and Soylu (2019))

Fig. 5

photographs from AFAD (2018)

Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Data availability

The data, models, and/or codes that support the findings of this study can be made available by the corresponding author upon reasonable request.

References

  • AFAD (2018) Turkish Disaster and Emergency Management Directorate, Disaster Management and Natural Disaster Statistics in Turkey

  • Alan S, Soylu N (2019) Comparison of PTEN expression in hashimoto thyroiditis, follicular adenoma, papillary and follicular carcinomas. Ann Med Res 26:1. https://doi.org/10.5455/annalsmedres.2018.01.057

    Article  Google Scholar 

  • Angelino CV, Cicala L, Parrilli S, et al. (2020) Post-Fire Assessment of Burned Areas with Landsat-8 and Sentinel-2 Imagery Together with Modis and Viirs Active Fire Products. IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium, pp 6770–6773. https://doi.org/10.1109/IGARSS39084.2020.9324512

  • Bellotti F, Bianchi M, Colombo D, et al (2014) Advanced InSAR techniques to support landslide monitoring. Pardo-Igúzquiza E., Guardiola-Albert C., Heredia J., Moreno-Merino L., Durán J., Vargas-Guzmán J. (eds) Mathematics of Planet Earth. Lecture Notes in Earth System Sciences. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32408-6_64

  • Bernat Gazibara S, Krkač M, Mihalić Arbanas S (2019) Landslide inventory mapping using LiDAR data in the City of Zagreb (Croatia). J Maps 15:773–779. https://doi.org/10.1080/17445647.2019.1671906

    Article  Google Scholar 

  • Chattopadhay A, Sarkar A, Howlader P, Balasubramanian VN (2018) Grad-CAM++: Generalized gradient-based visual explanations for deep convolutional networks. Proc—2018 IEEE Winter Conf Appl Comput Vision, WACV 2018 2018-Janua. 839–847. https://doi.org/10.1109/WACV.2018.00097

  • Chen LC, Papandreou G, Kokkinos I et al (2018a) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40:834–848. https://doi.org/10.1109/TPAMI.2017.2699184

    Article  Google Scholar 

  • Chen Z, Zhang Y, Ouyang C et al (2018b) Automated landslides detection for mountain cities using multi-temporal remote sensing imagery. Sensors 18:821. https://doi.org/10.3390/s18030821

    Article  Google Scholar 

  • Chollet F (2017) Xception: deep learning with depthwise separable convolutions. Proc—30th IEEE Conf Comput Vis Pattern Recognition, CVPR 2017 2017-Janua:1800–1807. https://doi.org/10.1109/CVPR.2017.195

  • Cruden DM, Varnes DJ (2016) Landslide Types and Processes, Special Report, Transportation Research Board, National Academy of Sciences, 247: 36–75

  • Czikhardt R, Papco J, Bakon M et al (2017) Ground stability monitoring of undermined and landslide prone areas by means of sentinel-1 multi-temporal InSAR case study from Slovakia. Geosciences 7:87. https://doi.org/10.3390/geosciences7030087

    Article  Google Scholar 

  • Di Martire D, Confuorto P, Frezza A, et al (2018) X- and C-band SAR data to monitoring ground deformations and slow-moving landslides for the 2016 Manta and Portoviejo earthquake (Manabì, Ecuador). In: 2018 IEEE International Conference on Environmental Engineering, EE 2018—Proceedings. Institute of Electrical and Electronics Engineers Inc., pp 1–6

  • Di Napoli M, Marsiglia P, Di Martire D et al (2020) Landslide susceptibility assessment of wildfire burnt areas through earth-observation techniques and a machine learning-based approach. Remote Sens 12:2505. https://doi.org/10.3390/rs12152505

    Article  Google Scholar 

  • Fiscante N, Focareta M, Galdi C, Ullo SL (2012) Analysis and validation of high-resolution satellite DEMs generated from EROS-B data for montaguto landslide. In: International Geoscience and Remote Sensing Symposium (IGARSS). pp 7549–7552

  • Ghorbanzadeh O, Blaschke T, Gholamnia K et al (2019) Evaluation of different machine learning methods and deep-learning convolutional neural networks for landslide detection. Remote Sens. https://doi.org/10.3390/rs11020196

    Article  Google Scholar 

  • Girshick R (2015) Fast R-CNN. Proc IEEE Int Conf Comput Vis 2015 Inter. https://doi.org/10.1109/ICCV.2015.169

    Article  Google Scholar 

  • Hacıefendioğlu K, Başağa HB, Demir G (2021) Automatic detection of earthquake-induced ground failure effects through Faster R-CNN deep learning-based object detection using satellite images. Nat Hazards 105:383–403. https://doi.org/10.1007/s11069-020-04315-y

    Article  Google Scholar 

  • Han H, Wang WY, Mao BH (2005) Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning. In: Huang DS., Zhang XP., Huang GB. (eds) Advances in Intelligent Computing. ICIC 2005. Lecture Notes in Computer Science, vol 3644. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11538059_91

  • He K, Zhang X, Ren S, Sun J (2016a) Deep residual learning for image recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Computer Society, pp 770–778

  • He K, Zhang X, Ren S, Sun J (2016b) Deep residual learning for image recognition. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit 2016-Decem. 770–778. https://doi.org/10.1109/CVPR.2016.90

  • Ji S, Yu D, Shen C et al (2020) Landslide detection from an open satellite imagery and digital elevation model dataset using attention boosted convolutional neural networks. Landslides 17:1337–1352. https://doi.org/10.1007/s10346-020-01353-2

    Article  Google Scholar 

  • Karpathy A (2016) Convolutional Neural Networks (CNNs /ConvNets). Retrieved CS231n Convolutional Neural Networks for Visual Recognition. In: http://cs231n.github.io/. https://cs231n.github.io/. Accessed 15 Apr 2020

  • Krizhevsky BA, Sutskever I, Hinton GE (2017) Imagenet classification with deep convolutional neural networks. Commun ACM 60:84–90

    Article  Google Scholar 

  • LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 51:436–444

    Article  Google Scholar 

  • Martha TR, Kerle N, Van Westen CJ et al (2011) Segment optimization and data-driven thresholding for knowledge-based landslide detection by object-based image analysis. IEEE Trans Geosci Remote Sens 49:4928–4943. https://doi.org/10.1109/TGRS.2011.2151866

    Article  Google Scholar 

  • Nefeslioglu HA, Gokceoglu C, Sonmez H, Gorum T (2011) Medium-scale hazard mapping for shallow landslide initiation: the Buyukkoy catchment area (Cayeli, Rize, Turkey). Landslides 8:459–483. https://doi.org/10.1007/s10346-011-0267-7

    Article  Google Scholar 

  • Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22:1345–1359. https://doi.org/10.1109/TKDE.2009.191

    Article  Google Scholar 

  • Prakash N, Manconi A, Loew S (2020) Mapping landslides on EO data: performance of deep learning models vs. traditional machine learning models. Remote Sens 12:346. https://doi.org/10.3390/rs12030346

    Article  Google Scholar 

  • Qi W, Wei M, Yang W et al (2020) Automatic mapping of landslides by the ResU-Net. Remote Sens 12:2487. https://doi.org/10.3390/rs12152487

    Article  Google Scholar 

  • Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39:1137–1149. https://doi.org/10.1109/TPAMI.2016.2577031

    Article  Google Scholar 

  • Ronneberger O, Fischer P, Brox T (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation. In: Navab N., Hornegger J., Wells W., Frangi A. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. MICCAI 2015. Lecture Notes in Computer Science, vol 9351. Springer, Cham. https://doi.org/10.1007/978-3-319-24574-4_28

  • Rosi A, Tofani V, Tanteri L et al (2018) The new landslide inventory of Tuscany (Italy) updated with PS-InSAR: geomorphological features and landslide distribution. Landslides 15:5–19. https://doi.org/10.1007/s10346-017-0861-4

    Article  Google Scholar 

  • Salman H, Grover J, Shankar T (2018) Hierarchical reinforcement learning for sequencing behaviors. 2733:2709–2733. https://arxiv.org/pdf/1803.01446v1.pdf

  • Sameen MI, Pradhan B (2019) Landslide detection using residual networks and the fusion of spectral and topographic information. IEEE Access 7:114363–114373. https://doi.org/10.1109/ACCESS.2019.2935761

    Article  Google Scholar 

  • Selvaraju RR, Cogswell M, Das A et al (2020) Grad-CAM: visual explanations from deep networks via gradient-based localization. Int J Comput vis 128:336–359. https://doi.org/10.1007/s11263-019-01228-7

    Article  Google Scholar 

  • Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd International Conference on Learning Representations, ICLR 2015—Conference Track Proceedings. pp 1–14

  • Sun Q, Zhang L, Ding XL et al (2015) Slope deformation prior to Zhouqu, China landslide from InSAR time series analysis. Remote Sens Environ 156:45–57. https://doi.org/10.1016/j.rse.2014.09.029

    Article  Google Scholar 

  • Szegedy C, Vanhoucke V, Ioffe S, et al (2016) Rethinking the Inception Architecture for Computer Vision. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Computer Society, pp 2818–2826

  • Tavakkoli Piralilou S, Shahabi H, Jarihani B et al (2019) Landslide detection using multi-scale image segmentation and different machine learning models in the higher himalayas. Remote Sens 11:2575. https://doi.org/10.3390/rs11212575

    Article  Google Scholar 

  • Ullo SL, Addabbo P, Di MD et al (2019a) Application of DInSAR technique to high coherence Sentinel-1 images for dam monitoring and result validation through in situ measurements. IEEE J Sel Top Appl Earth Obs Remote Sens 12:875–890. https://doi.org/10.1109/JSTARS.2019.2896989

    Article  Google Scholar 

  • Ullo SL, Langenkamp MS, Oikarinen TP, et al (2019b) Landslide Geohazard Assessment With Convolutional Neural Networks Using Sentinel-2 Imagery Data. Int Geosci Remote Sens Symp. 9646–9649

  • Ullo SL, Mohan A, Sebastianelli A, et al (2020a) A New Mask R-CNN Based Method for Improved Landslide Detection. IEEE J Sel Top Appl Earth Obs Remote Sens 14: 3799-3810

  • Ullo SL, Zarro C, Wojtowicz K et al (2020b) LiDAR-based system and optical VHR data for building detection and mapping. Sensors 20:1285. https://doi.org/10.3390/s20051285

    Article  Google Scholar 

  • Wang H, Wang Z, Du M, et al (2020) Score-CAM: Score-weighted visual explanations for convolutional neural networks. IEEE Comput Soc Conf Comput Vis Pattern Recognit Work 2020-June:111–119. https://doi.org/10.1109/CVPRW50498.2020.00020

  • Yu H, Ma Y, Wang L, et al (2017) A landslide intelligent detection method based on CNN and RSG-R. In: 2017 IEEE International Conference on Mechatronics and Automation, ICMA 2017. Institute of Electrical and Electronics Engineers Inc., pp 40–44

  • Zhong C, Liu Y, Gao P et al (2020) Landslide mapping with remote sensing: challenges and opportunities. Int J Remote Sens 41:1555–1581. https://doi.org/10.1080/01431161.2019.1672904

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank Trabzon Provincial Disaster and Emergency Directorate for their continuous support, especially in the provision of data for carrying out the research.

Author information

Authors and Affiliations

  1. Department of Civil Engineering, Karadeniz Technical University, 61080, Trabzon, Turkey

    Kemal Hacıefendioğlu & Hasan Basri Başağa

  2. Department of Civil Engineering, Ondokuz Mayıs University, 55270, Samsun, Turkey

    Gökhan Demir

Authors
  1. Kemal Hacıefendioğlu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gökhan Demir
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hasan Basri Başağa
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All of the authors have been actively involved in the research and write-up of this paper and, accordingly, acknowledge full responsibility for its content.

Corresponding author

Correspondence to Kemal Hacıefendioğlu.

Ethics declarations

Conflicts of interest

The authors declare that they have no conflicts of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hacıefendioğlu, K., Demir, G. & Başağa, H.B. Landslide detection using visualization techniques for deep convolutional neural network models. Nat Hazards 109, 329–350 (2021). https://doi.org/10.1007/s11069-021-04838-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11069-021-04838-y

Keywords

Search

Navigation