Skip to main content
SpringerLink
Log in

Automatic Landslide Segmentation Using a Combination of Grad-CAM Visualization and K-Means Clustering Techniques

  • Research Paper
  • Published:
Iranian Journal of Science and Technology, Transactions of Civil Engineering Aims and scope Submit manuscript

Abstract

Rapid detection and accurate mapping of landslides are crucial for damage detection and subsequent prevention of secondary damage. In this study, a deep learning-based segmentation model called CAM-K-SEG was proposed, which combined Grad-CAM visualization and K-Mean clustering methods to automatically detect landslide areas using satellite images. The methodology involved applying the CAM-K-SEG model to satellite images in the Bijou region of China and comparing its performance with that of K-Mean clustering and U-Net segmentation models. The optimum K value was determined by the elbow method to determine the effective color number. The weighted object was detected by removing small objects from the image, and the convolution process was performed with the mean Kernel method to remove noise or improve features. The performance of the CAM-K-SEG model was evaluated based on Intersection-Over-Union (IoU), the most used metric in semantic segmentation. The results demonstrated that the CAM-K-SEG model performed comparably to the U-Net model in segmenting landslide areas and could help improve the rapid detection of landslide areas after an event. Overall, the study contributed to the development of a new model for landslide image segmentation, which could more precisely and sensitively distinguish landslide regions. The CAM-K-SEG model was identified as a promising tool for automatic landslide detection and could be used in various applications that required accurate detection of landslide areas.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

Data availability

Data is available at http://study.rsgis.whu.edu.cn/pages/download/

Code availability

Name of the code/library Contact: kemalheo@gmail.com.Hardware requirements: NA. Program language: Python. Software required: NA. Program size: about 300 lines. The source codes for developed code are available for downloading at the link: https://www.kaggle.com/code/databeru/fish-classifier-grad-cam-viz-acc-99-89https://www.kaggle.com/code/masatomurakawamm/uwmgi-pspnet-u-net-deeplabv3-swin-unet

References

  • Akca S, Gungor O (2022) Semantic segmentation of soil salinity using in-situ EC measurements and deep learning based U-NET architecture. Catena (Amst) 218:106529. https://doi.org/10.1016/J.CATENA.2022.106529

    Article  Google Scholar 

  • Ao M, Zhu J, Wang C, Yu X (2014) Identification of landslide region based on topographic and change information. Int J Signal Proc Image Proces Pattern Recognit 7:121–134. https://doi.org/10.14257/IJSIP.2014.7.1.12

    Article  Google Scholar 

  • Ball JE, Anderson DT, Chan CS (2017) Comprehensive survey of deep learning in remote sensing: theories, tools, and challenges for the community. J Appl Remote Sens 11:1. https://doi.org/10.1117/1.JRS.11.042609

    Article  Google Scholar 

  • Cai H, Chen T, Niu R, Plaza A (2021) Landslide detection using densely connected convolutional networks and environmental conditions. IEEE J Sel Top Appl Earth Obs Remote Sens 14:5235–5247. https://doi.org/10.1109/JSTARS.2021.3079196

    Article  Google Scholar 

  • Chattopadhay A, Sarkar A, Howlader P, Balasubramanian VN (2018) Grad-CAM++: Generalized gradient-based visual explanations for deep convolutional networks. In: Proceedings - 2018 IEEE Winter Conference on Applications of Computer Vision, WACV 2018 2018-Janua:839–847. https://doi.org/10.1109/WACV.2018.00097

  • Chen S, Xiang C, Kang Q et al (2020) Accurate landslide detection leveraging UAVbased aerial remote sensing. IET Commun 14:2434–2441. https://doi.org/10.1049/IET-COM.2019.1115/CITE/REFWORKS

    Article  Google Scholar 

  • Chen Y, Ming D, Yu J et al (2023) Susceptibility-guided landslide detection using fully convolutional neural network. IEEE J Sel Top Appl Earth Obs Remote Sens 16:998–1018. https://doi.org/10.1109/JSTARS.2022.3233043

    Article  Google Scholar 

  • Cheng G, Guo L, Zhao T, Han J, Li H, Fang J (2012) Automatic landslide detection from remote-sensing imagery using a scene classification method based on BoVW and pLSA. Int J Remote Sens 34(1):45–59. https://doi.org/10.1080/01431161.2012.705443

    Article  Google Scholar 

  • Chollet F (2017) Xception: Deep learning with depthwise separable convolutions. In: Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017. Institute of Electrical and Electronics Engineers Inc., pp 1800–1807

  • Danneels G, Pirard E, Havenith HB (2007) Automatic landslide detection from remote sensing images using supervised classification methods. In: International Geoscience and Remote Sensing Symposium (IGARSS). pp 3014–3017

  • Ding A, Zhang Q, Zhou X, Dai B (2017) Automatic recognition of landslide based on CNN and texture change detection. In: Proceedings - 2016 31st Youth Academic Annual Conference of Chinese Association of Automation, YAC 2016 444–448https://doi.org/10.1109/YAC.2016.7804935

  • Ghorbanzadeh O, Blaschke T, Gholamnia K et al (2019) Evaluation of different machine learning methods and deep-learning convolutional neural networks for landslide detection. Remote Sens (basel) 11:196. https://doi.org/10.3390/rs11020196

    Article  Google Scholar 

  • Ghorbanzadeh O, Shahabi H, Crivellari A et al (2022) Landslide detection using deep learning and object-based image analysis. Landslides 19:929–939. https://doi.org/10.1007/S10346-021-01843-X

    Article  Google Scholar 

  • Hacıefendioğlu K, Demir G, Başağa HB (2021) Landslide detection using visualization techniques for deep convolutional neural network models. Nat Hazards. https://doi.org/10.1007/s11069-021-04838-y

    Article  Google Scholar 

  • He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Computer Society, pp 770–778

  • Höppner F, Klawonn F, Kruse R, Runkler T (2000) Fuzzy cluster analysis: methods for classification, data analysis, and image. John Wiley and Sons, New York

    Google Scholar 

  • Huang G, Liu Z, van der Maaten L, Weinberger KQ (2017) Densely Connected Convolutional Networks. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). pp 2261–2269

  • Jebur MN (2015) Multi remote sensing data in landslide detection and modelling. Doctoral thesis, Universiti Putra Malaysia. Universiti Putra Malaysia

  • Ji S, Yu D, Shen C et al (2020) Landslide detection from an open satellite imagery and digital elevation model dataset using attention boosted convolutional neural networks. Landslides 17:1337–1352. https://doi.org/10.1007/S10346-020-01353-2/TABLES/9

    Article  Google Scholar 

  • Lissak C, Bartsch A, De Michele M et al (2020) Remote sensing for assessing landslides and associated hazards. Surv Geophys 41:1391–1435. https://doi.org/10.1007/S10712-020-09609-1

    Article  Google Scholar 

  • Liu L, Cheng J, Quan Q et al (2020) A survey on U-shaped networks in medical image segmentations. Neurocomputing 409:244–258. https://doi.org/10.1016/J.NEUCOM.2020.05.070

    Article  Google Scholar 

  • Liu D, Li J, Fan F (2021a) Classification of landslides on the southeastern Tibet Plateau based on transfer learning and limited labelled datasets. Remote Sens Lett 12:286–295. https://doi.org/10.1080/2150704X.2021.1890263

    Article  Google Scholar 

  • Liu J, Guo F, Gao H et al (2021b) Image classification method on class imbalance datasets using multi-scale CNN and two-stage transfer learning. Neural Comput Appl. https://doi.org/10.1007/s00521-021-06066-8

    Article  Google Scholar 

  • Liu Y, Zhang W, Chen X, et al (2021c) Landslide Detection of High-Resolution Satellite Images using Asymmetric Dual-Channel Network. In: 2021c IEEE International Geoscience and Remote Sensing Symposium IGARSS. Institute of Electrical and Electronics Engineers (IEEE), pp 4091–4094

  • Mezaal MR, Pradhan B, Sameen MI et al (2017) Optimized neural architecture for automatic landslide detection from high-resolution airborne laser scanning data. Appl Sci 7:730. https://doi.org/10.3390/APP7070730

    Article  Google Scholar 

  • Mohan A, Singh AK, Kumar B, Dwivedi R (2020) Review on remote sensing methods for landslide detection using machine and deep learning. Trans Emerg Telecommun Technol. https://doi.org/10.1002/ett.3998

    Article  Google Scholar 

  • Nava L, Monserrat O, Catani F (2022) Improving landslide detection on SAR data through deep learning. IEEE Geosci Remote Sens Lett. https://doi.org/10.1109/LGRS.2021.3127073

    Article  Google Scholar 

  • Pham H, Guan MY, Zoph B, et al (2018) Efficient Neural Architecture Search via Parameters Sharing. In: Proceedings of the 35th International Conference on Machine Learning. PMLR, pp 4095–4104

  • Rajaraman S, Kim I, Antani SK (2020) Detection and visualization of abnormality in chest radiographs using modality-specific convolutional neural network ensembles. PeerJ. https://doi.org/10.7717/PEERJ.8693/FIG-11

    Article  Google Scholar 

  • Roessner S, Behling R, Segl K, et al (2014) Automated remote sensing based landslide detection for dynamic landslide inventories. Landslide Science for a Safer Geoenvironment: Volume 2: Methods of Landslide Studies 345–350. https://doi.org/10.1007/978-3-319-05050-8_54

  • Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Springer Verlag, pp 234–241

  • Sameen MI, Pradhan B (2019) Landslide detection using residual networks and the fusion of spectral and topographic information. IEEE Access 7:114363–114373. https://doi.org/10.1109/ACCESS.2019.2935761

    Article  Google Scholar 

  • Sandler M, Howard A, Zhu M, et al (2018) MobileNetV2: Inverted Residuals and Linear Bottlenecks. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 4510–4520

  • Selvaraju RR, Cogswell M, Das A et al (2016) Grad-CAM: visual explanations from deep networks via gradient-based localization. Int J Comput vis 128:336–359. https://doi.org/10.1007/s11263-019-01228-7

    Article  Google Scholar 

  • Shahabi H, Rahimzad M, Ghorbanzadeh O, et al (2022) Rapid Mapping of Landslides from Sentinel-2 Data Using Unsupervised Deep Learning. In: 2022 IEEE Mediterranean and Middle-East Geoscience and Remote Sensing Symposium, M2GARSS 2022 - Proceedings 17–20. https://doi.org/10.1109/M2GARSS52314.2022.9840273

  • Shi W, Zhang M, Ke H et al (2021) Landslide recognition by deep convolutional neural network and change detection. IEEE Trans Geosci Remote Sens 59:4654–4672. https://doi.org/10.1109/TGRS.2020.3015826

    Article  Google Scholar 

  • Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings. pp 1–14

  • Singhroy V (2009) Satellite remote sensing applications for landslide detection and monitoring. Landslides - Disaster Risk Reduction 143–158. https://doi.org/10.1007/978-3-540-69970-5_7/COVER

  • Soares LP, Dias HC, Garcia GPB, Grohmann CH (2022) Landslide segmentation with deep learning: evaluating model generalization in rainfall-induced landslides in Brazil. Remote Sens (Basel). https://doi.org/10.3390/RS14092237

    Article  Google Scholar 

  • Szegedy C, Vanhoucke V, Ioffe S, et al (2016) Rethinking the Inception Architecture for Computer Vision. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Computer Society, pp 2818–2826

  • Tan B, Zhang Y, Pan SJ, Yang Q (2017) Distant domain transfer learning. Proc AAAI Conf Artif Intell 31:2604–2610. https://doi.org/10.1609/AAAI.V31I1.10826

    Article  Google Scholar 

  • Tan B, Song Y, Zhong E, Yang Q (2015) Transitive transfer learning. In: Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 1155–1164. https://doi.org/10.1145/2783258.2783295

  • Tanatipuknon A, Aimmanee P, Watanabe Y et al (2021) Study on combining two faster R-CNN models for landslide detection with a classification decision tree to improve the detection performance. J Dis Res 16:588–595. https://doi.org/10.20965/JDR.2021.P0588

    Article  Google Scholar 

  • Tang X, Liu M, Zhong H et al (2021) MILL: channel attention–based deep multiple instance learning for landslide recognition. ACM Trans Multimed Comput Commun Appl. https://doi.org/10.1145/3454009

    Article  Google Scholar 

  • Uehara TDT, Corrêa SPLP, Quevedo RP et al (2020) Landslide scars detection using remote sensing and pattern recognition techniques: comparison among artificial neural networks, gaussian maximum likelihood, random forest, and support vector machine classifiers. Rev Bras Cartogr 72(4):665–680. https://doi.org/10.14393/RBCV72N4-54037

    Article  Google Scholar 

  • Varangaonkar P, Rode SV (2023) Lightweight deep learning model for automatic landslide prediction and localization. Multimed Tools Appl. https://doi.org/10.1007/S11042-023-15049-X

    Article  Google Scholar 

  • Wang W, Motagh M, Plank S et al (2022) Application of sar time-series and deep learning for estimating landslide occurrence time. Int Arch Photogr Remote Sens Spatial Inform Sci - ISPRS Arch 43:1181–1187. https://doi.org/10.5194/ISPRS-ARCHIVES-XLIII-B3-2022-1181-2022

    Article  Google Scholar 

  • Wang H, Wang Z, Du M, et al (2020) Score-CAM: score-weighted visual explanations for convolutional neural networks. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops 2020-June:111–119. https://doi.org/10.1109/CVPRW50498.2020.00020

  • Wang K, Han L, Liao J, Zhao J (2023) A study of high-resolution remote sensing image landslide detection with optimized anchor boxes and edge enhancement. https://doi.org/10.21203/RS.3.RS-2675801/V1

  • Wikipedia Bijie - Wikipedia. https://en.wikipedia.org/wiki/Bijie. Accessed 23 May 2023

  • Xia W et al (2021) Landslide extraction from high-resolution remote sensing imagery using fully convolutional spectral–topographic fusion network. Remote Sens 13(24):5116. https://doi.org/10.3390/RS13245116

    Article  Google Scholar 

  • Ye C, Li Y, Cui P et al (2019) Landslide detection of hyperspectral remote sensing data based on deep learning with constrains. IEEE J Sel Top Appl Earth Obs Remote Sens 12:5047–5060. https://doi.org/10.1109/JSTARS.2019.2951725

    Article  Google Scholar 

  • Yi Y, Zhang W (2020) A new deep-learning-based approach for earthquake-triggered landslide detection from singleoral rapideye satellite imagery. IEEE J Sel Top Appl Earth Obs Remote Sens 13:6166–6176. https://doi.org/10.1109/JSTARS.2020.3028855

    Article  Google Scholar 

  • Yu H, Ma Y, Wang L, et al (2017) A landslide intelligent detection method based on CNN and RSG_R. In: 2017 IEEE International Conference on Mechatronics and Automation (ICMA). Institute of Electrical and Electronics Engineers Inc., pp 40–44

  • Zhang M, Shi W, Chen S et al (2021) Deep multiple instance learning for landslide mapping. IEEE Geosci Remote Sens Lett 18:1711–1715. https://doi.org/10.1109/LGRS.2020.3007183

    Article  Google Scholar 

  • Zhao J, Liu S, Wan J et al (2020) Change detection method of high resolution remote sensing image based on D–S evidence theory feature fusion. IEEE Access. https://doi.org/10.1109/ACCESS.2020.3047915

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Civil Engineering, Karadeniz Technical University, 61080, Trabzon, Turkey

    Kemal Hacıefendioğlu & Süleyman Adanur

  2. Department of Civil Engineering, Ondokuz Mayıs University, 55139, Samsun, Turkey

    Gökhan Demir

Authors
  1. Kemal Hacıefendioğlu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Süleyman Adanur
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gökhan Demir
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All of the authors have been actively involved in the research and write-up of this paper and, accordingly, acknowledge full responsibility for its content.

Corresponding author

Correspondence to Kemal Hacıefendioğlu.

Ethics declarations

Conflicts of interest

The authors declare that they have no conflicts of interest.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hacıefendioğlu, K., Adanur, S. & Demir, G. Automatic Landslide Segmentation Using a Combination of Grad-CAM Visualization and K-Means Clustering Techniques. Iran J Sci Technol Trans Civ Eng 48, 943–959 (2024). https://doi.org/10.1007/s40996-023-01193-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40996-023-01193-9

Keywords

Search

Navigation