Skip to main content
SpringerLink
Log in

Deep convolutional neural network–based pixel-wise landslide inventory mapping

  • Original paper
  • Published:
Landslides Aims and scope Submit manuscript

Abstract

This paper reports a feasible alternative to compile a landslide inventory map (LIM) from remote sensing datasets using the application of an artificial intelligence–driven methodology. A deep convolutional neural network model, called LanDCNN, was developed to generate segmentation maps of landslides, and its performance was compared with the benchmark model, named U-Net, and other conventional object-based methods. The landslides that occurred in Lantau Island, Hong Kong, were taken as the case study, in which the pre- and post-landslide aerial images, and a rasterized digital terrain model (DTM) were used. The assessment reveals that LanDCNN trained with bitemporal images and DTM yields the smoothest and most semantically meaningfully LIM, compared to other methods. This LIM is the most balanced segmentation results, represented by the highest F1 measure among all analyzed cases. With the encoding capability of LanDCNN, the application of DTM as the input renders better LIM production, especially when the landslide signatures are relatively subtle. With the computational setup used in this study, LanDCNN requires ~ 3 min to map landslides from the datasets of approximately 25 km2 in area and with a resolution of 0.5 m. In short, the proposed landslide mapping framework, featured LanDCNN, is scalable to handle the vast amount of remote sensing data from different types of measurements within a short processing period.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  • Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Devin M, Ghemawat S, Irving G, Isard M, Kudlur M, Levenberg J, Monga R, Moore S, Murray DG, Steiner B, Tucker P, Vasudevan V, Warden P, Wicke M, Yu Y, Zheng X (2016) TensorFlow: a system for large-scale machine learning, in 12th {USENIX} Symposium on Operating System Design and Implementation, pp 265-283

  • Aleotti P, Chowdury R (1999) Landslide hazard assessment: summary review and new perspectives. Bull Eng Geol Environ 58(1):21–44

    Google Scholar 

  • Antonini G, Ardizzone F, Cardinali M, Galli M, Guzzetti F, Reichenbach P (2002) Surface deposits and landslide inventory map of the area affected by the 1997 Umbria– Marche earthquakes. Boll Soc Geol Ital 121(2):843–853

    Google Scholar 

  • Ardizzone F, Cardinali M, Carrara A, Guzzetti F, Reichenbach P (2002) Impact of mapping errors on the reliability of landslide hazard maps. Nat Hazards Earth Syst Sci 2(1/2):3–14

    Google Scholar 

  • Ardizzone F, Cardinali M, Galli M, Guzzetti F, Reichenbach P (2007) Identification and mapping of recent rainfall-induced landslides using elevation data collected by airborne LiDAR. Nat Hazards Earth Syst Sci 7(6):637–650

    Google Scholar 

  • Atkinson PM, Massari R (1998) Generalised linear modelling of susceptibility to landsliding in the central Apennines, Italy. Comput Geosci 24(4):373–385

    Google Scholar 

  • Behling R, Roessner S, Golovko D, Kleinschmit B (2016) Derivation of long-term spatiotemporal landslide activity – a multi-sensor time series approach. Remote Sens Environ 186(1):88–104

    Google Scholar 

  • Benz UC, Hofmann P, Willhauck G, Lingenfelder I, Heynen M (2004) Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information. ISPRS J Photogramm Remote Sens 58(3):239–258

    Google Scholar 

  • Blaschke T (2010) Object based image analysis for remote sensing. ISPRS J Photogramm Remote Sens 65(1):2–16

    Google Scholar 

  • Blaschke T, Strobl J (2001) What’s wrong with pixels? Some recent developments interfacing remote sensing and GIS. Zeitschrift für Geoinformationssysteme:12–17

  • Blaschke T, Lang S, Lorup E, Strobl J, Zeil P (2000) Object-oriented image processing in an integrated GIS/remote sensing environment and perspectives for environmental applications. Environmental information for planning, politics and the public 2:555–570

    Google Scholar 

  • Blaschke T, Hay GJ, Kelly M, Lang S, Hofmann P, Addink E, Feitosa RQ, Fvd M, Hvd W, Fv C, Tiede D (2014) Geographic object-based image analysis-towards a new paradigm. ISPRS J Photogramm Remote Sens 87:180–191

    Google Scholar 

  • Burnett C, Blaschke T (2003) A multi-scale segmentation/object relationship modelling methodology for landscape analysis. Ecol Model 168(3):233–249

    Google Scholar 

  • Cai K, Shao W, Yin X, Liu G (2012) Co-segmentation of aircrafts from high-resolution satellite images. In Proceedings of 2012 IEEE 11th International Conference on Signal Processing (ICSP), Beijing, China, vol. 2, pp 993-996

  • Can R, Kocaman S, Gokceoglu C (2019) A convolutional neural network architecture for auto-detection of landslide photographs to assess citizen science and volunteered geographic information data quality. ISPRS Int J Geo Inf 8(7):300

    Google Scholar 

  • Cardinali M, Guzzetti F, Brabb EE (1990) Preliminary map showing landslide deposits and related features in New Mexico. U.S. Geological Survey, Reston

    Google Scholar 

  • Chen X, Xiang S, Liu C-L, Pan, C-H (2013) Vehicle detection in satellite images by parallel deep convolutional neural networks. In Proceedings of 2013 2nd IAPR Asian Conference on Pattern Recognition (ACPR), Naha, Japan, pp. 181–185

  • Chen T, Tinder JC, Niu R (2017) Object-oriented landslide mapping using ZY-3 satellite imagery, random forest and mathematical morphology, for the Three-Gorges Reservoir, China. Remote Sens 9(4):333

    Google Scholar 

  • Chen LC, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2018a) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848

    Google Scholar 

  • Chen Z, Zhang Y, Ouyang C, Zhang F, Ma J (2018b) Automated landslides detection for mountain cities using multi-temporal remote sensing imagery. Sensors 18(3):821

    Google Scholar 

  • Cheng K, Wei C, Chang S (2004) Locating landslides using multi-temporal satellite images. Adv Space Res 33(3):296–301

    Google Scholar 

  • Cheng G, Guo L, Zhao T, Han J, Li H, Fang J (2013) Automatic landslide detection from remote-sensing imagery using a scene classification method based on BoVW and pLSA. Int J Remote Sens 34(1):45–59

    Google Scholar 

  • Choi KY, Cheung RW (2013) Landslide disaster prevention and mitigation through works in Hong Kong. J Rock Mech Geotech Eng 5(5):354–365

    Google Scholar 

  • Dai FC, Lee CF, Ngai YY (2008) Landslide risk assessment and management: an overview. Eng Geol 64(1):65–87

    Google Scholar 

  • Derron MH, Jaboyedoff M (2010) Preface to the special issue: LIDAR and DEM techniques for landslides monitoring and characterization. Nat Hazards Earth Syst Sci 10(9):1877–1879

    Google Scholar 

  • Ding A, Zhang Q, Zhou X, Dai B (2016) Automatic recognition of landslide based on CNN and texture change detection. In Proceedings of the 31st Youth Academic Annual Conference of Chinese Association of Automation, Wuhan, China, pp. 444–448

  • Đurić D, Mladenović A, Pešić-Georgiadis M, Marjanović M, Abolmasov B (2017) Using multiresolution and multitemporal satellite data for post-disaster landslide inventory in the Republic of Serbia. Landslides 14(4):1467–1482

    Google Scholar 

  • Flanders D, Hall-Beyer M, Pereverzoff J (2003) Preliminary evaluation of eCognition object-based software for cut block delineation and feature extraction. Can J Remote Sens 29(4):441–452

    Google Scholar 

  • Galli M, Ardizzone F, Cardinali M, Guzzetti F, Reichenbach P (2008) Comparing landslide inventory maps. Geomorphology 94(3):268–289

    Google Scholar 

  • Géron A (2017) Hands-on machine learning with Scikit-Learn & TensorFlow. O’Reilly Media, USA

    Google Scholar 

  • Ghorbanzadeh O, Blaschke T, Gholamnia K, Meena SR, Tiede D, Aryal J (2019a) Evaluation of different machine learning methods and deep-learning convolutional neural networks for landslide detection. Remote Sens 11:196

    Google Scholar 

  • Ghorbanzadeh O, Meena SR, Blaschke T, Aryal J (2019b) UAV-based slope failure detection using deep-learning convolutional neural networks. Remote Sens 11(17):2046

    Google Scholar 

  • Goodfellow I, Bengio Y, Courville A (2016) Deep learning. 1st edition. The MIT Press, London

  • Guzzetti F, Mondini AC, Cardinali M, Fiorucci F, Santangelo M, Chang KT (2012) Landslide inventory maps: new tools for an old problem. Earth Sci Rev 112(1):42–66

    Google Scholar 

  • Haneberg WC, Cole WF, Kasali G (2009) High-resolution Lidar-based landslide hazard mapping and modeling, UCSF Parnassus Campus, San Francisco, USA. Bull Eng Geol Environ 68(2):263–276

    Google Scholar 

  • Hay GJ, Blaschke T, Marceau DJ, Bouchard A (2003) A comparison of three image-object methods for the multiscale analysis of landscape structure. ISPRS J Photogramm Remote Sens 57(5–6):327–345

    Google Scholar 

  • He K, Zhang X, Ren S, Sun J. (2016) Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition pp. 770-778

  • Hervás J, Bobrowsky P (2009) Mapping: inventories, susceptibility, hazard and risk. In: Sassa K, Canuti P (eds) Landslides – disaster risk reduction. Springer, Berlin, pp 321–349

    Google Scholar 

  • Hölbling D, Friedl B, Eisank C (2015) An object-based approach for semi-automated landslide change detection and attribution of changes to landslide classes in northern Taiwan. Earth Sci Inf 8(2):327–335

    Google Scholar 

  • Huang W, Liang X, Wei Z, Liu H, Tang S (2015) A new pan-sharpening method with deep neural networks. IEEE Geosci Remote Sens Lett 12(5):1037–1041

    Google Scholar 

  • Huang F, Zhang J, Zhou C, Wang Y, Huang J, Zhu L (2019) A deep learning algorithm using a fully connected sparse autoencoder neural network for landslide susceptibility prediction. Landslides:1–3

  • Hungr O, Leroueil S, Picarelli L (2014) The Varnes classification of landslide types, an update. Landslides 11(2):167–194

    Google Scholar 

  • Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. In proceedings of the 3rd international conference for learning representations, San Diego

  • Konečný J, Liu J, Richtárik P, Takáč M (2016) Mini-batch semi-stochastic gradient descent in the proximal setting. IEEE Journal of Selected Topics in Signal Processing 10(2):242–255

    Google Scholar 

  • Lee CF, Huang WK, Huang CM, Chi CC (2017) Deep-seated landslide mapping and geomorphic characteristic using high resolution DTM in northern Taiwan. In: Mikos M, Tiwari B, Yin Y, Sassa K (eds) Advancing culture of living with landslides. Workshop on World Landslide Forum. Springer, Cham, pp 767–777

    Google Scholar 

  • Lei T, Zhang Y, Lv Z, Li S, Liu S, Nandi AK (2019) Landslide inventory mapping from bitemporal images using deep convolutional neural networks. IEEE Geosci Remote Sens Lett 16(6):982–986

    Google Scholar 

  • Li Z, Shi W, Myint SW, Lu P, Wang Q (2016a) Semi-automated landslide inventory mapping from bitemporal aerial photographs using change detection and level set method. Remote Sens Environ 175:215–230

    Google Scholar 

  • Li Z, Shi W, Lu P, Yan L, Wang Q, Miao Z (2016b) Landslide mapping from aerial photographs using change detection-based Markov random field. Remote Sens Environ 187:76–90

    Google Scholar 

  • Liu Y, Wu Y (2016) Geological disaster recognition on optical remote sensing images using deep learning. Procedia Computer Science 91:566–575

    Google Scholar 

  • Liu Y, Wu L (2018) High performance geological disaster recognition using deep learning. Procedia computer science 139:529–536

    Google Scholar 

  • Liu Y, Li M, Mao L, Xu F, Huang S (2006) Review of remotely sensed imagery classification patterns based on object-oriented image analysis. Chin Geogr Sci 16(3):282–288

    Google Scholar 

  • Lu P, Stumpf A, Kerle N, Casagli N (2011) Object-oriented change detection for landslide rapid mapping. IEEE Geosci Remote Sens Lett 8(4):701–705

    Google Scholar 

  • Lv ZY, Shi W, Zhang X, Benediktsson JA (2018) Landslide inventory mapping from bitemporal high-resoution remote sensing images using change detection and multiscale segmentation. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11(5):1520–1532

    Google Scholar 

  • Martha TR, Kerle N, Jetten V, van Westen CJ, Kumar KV (2010) Characterising spectral, spatial and morphometric properties of landslides for semi-automatic detection using object-oriented methods. Geomorphology 116(1):24–36

    Google Scholar 

  • Martha TR, Kerle N, van Westen CJ, Jetten V, Kumar KV (2012) Object-oriented analysis of multi-temporal panchromatic images for creation of historical landslide inventories. ISPRS J Photogramm Remote Sens 67:105–119

    Google Scholar 

  • Milletari F, Navab N, Ahmadi SA (2016) V-net: fully convolutional neural networks for volumetric medical image segmentation. In Proceedings of the 2016 Fourth International Conference on 3D Vision, Standford, pp 565-571

  • Nichol EJ, Shaker A, Wong M-S (2006) Application of high-resolution stereo satellite images to detailed landslide hazard assessment. Geomorphology 76:68–75

    Google Scholar 

  • Otukei JR, Blaschke T (2010) Land cover change assessment using decision trees, support vector machines and maximum likelihood classification algorithms. Int J Appl Earth Obs Geoinf 12:S27–S31

    Google Scholar 

  • Parker RN, Densmore AL, Rosser NJ, De Michele M, Li Y, Huang R, Whadcoat S, Petley DN (2011) Mass wasting triggered by the 2008 Wenchuan earthquake is greater than orogenic growth. Nat Geosci 4(7):449–452

    Google Scholar 

  • Pašek J (1975) Landslide inventory. Bull Int Assoc Eng Geol 12(1):73–74

    Google Scholar 

  • Rau JY, Jhan JP, Rau RJ (2014) Semiautomatic object-oriented landslide recognition scheme from multisensor optical imagery and DEM. IEEE Trans Geosci Remote Sens 52(2):1336–1349

    Google Scholar 

  • Razak KA, Straatsma MW, Van Westen CJ, Malet JP, De Jong SM (2011) Airborne laser scanning of forested landslides characterization: terrain model quality and visualization. Geomorphology 126(1):186–200

    Google Scholar 

  • Rib HT, Liang T (1978) Recognition and identification. In: Dchuster RL, Krizek RJ (eds) Landslide analysis and control: Transportation Research Board special report 176. National Academy of Sciences, Washington, pp 64–80

    Google Scholar 

  • Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, pp 234–241

    Google Scholar 

  • Schiewe J (2002) Segmentation of high-resolution remotely sensed data-concepts, applications and problems. Int Arch Photogramm Remote Sens Spat Inf Sci 34(4):380–385

    Google Scholar 

  • Siti NK, Shiraishi S, Inoshita T, Aoki Y (2016) Analysis of satellite images for disaster detection. In Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium, Beijing, China pp 5189–5192

  • Soeters R, van Westen CJ (1996) Slope instability recognition, analysis and zonation. In: Turner AK, Schuster RL (eds) Landslides investigation and mitigation, Transportation Research Board special report, vol 247. Transportation Research Board, Washington, pp 129–177

    Google Scholar 

  • Speight JG (1977) Landform pattern description from aerial photographs. Photogrammetry 32:161–182

    Google Scholar 

  • Stumpf A, Kerle N (2011) Object-oriented mapping of landslides using random forests. Remote Sens Environ 115(10):2564–2577

    Google Scholar 

  • Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-ResNet and the impact of residual connections on learning. In: Proceedings of the 31st AAAI Conference on Artifical Intelligence AAAI. California, San Francisco, pp 4278–4284

    Google Scholar 

  • Tanoli JI, Ningsheng C, Regmi AD, Jun L (2017) Spatial distribution analysis and susceptibility mapping of landslides triggered before and after Mw7. 8 Gorkha earthquake along Upper Bhote Koshi, Nepal. Arabian Journal of Geosciences 10:277

    Google Scholar 

  • Tarolli P, Sofia G, Dalla Fontana G (2012) Geomorphic features extraction from high-resolution topography: landslide crowns and bank erosion. Nat Hazards 61(1):65–83

    Google Scholar 

  • Travelletti J, Malet J-P, Delacourt C (2014) Image-based correlation of laser scanning point cloud time series for landslide monitoring. Int J Appl Earth Obs Geoinf 32:1–18

    Google Scholar 

  • Van Westen CJ, Castellanos Abella EA, Sekhar LK (2008) Spatial data for landslide susceptibility, hazards and vulnerability assessment: an overview. Eng Geol 102(3–4):112–131

    Google Scholar 

  • van Zuidam RA (1985) Aerial photo-interpretation in terrain analysis and geomorphologic mapping. International Institute for Aerospace Survey and Earth Sciences (ITC). Smits Publishers, The Hague

    Google Scholar 

  • Wang Y, Fang Z, Hong H (2019) Comparison of convolutional neural networks for landslide susceptibility mapping in Yanshan County, China. Sci Total Environ 666:975–993

    Google Scholar 

  • Xiao L, Zhang Y, Peng G (2018) Landslide susceptibility assessment using integrated deep learning algorithm along the China-Nepal Highway. Sensors 18(12):4436

    Google Scholar 

  • Xie J, Xu L, Chen E (2012) Image denoising and inpainting with deep neural networks. In: Proceedings of the advances in neural information processing systems (NIPS). Lake Tahoe, Nevada, pp 341–349

    Google Scholar 

  • Xu C, Xu X, Shyu JBH (2015) Database and spatial distribution of landslides triggered by the Lushan, China Mw 6.6 earthquake of 20 April 2013. Geomorphology 248:77–92

    Google Scholar 

  • Yang X, Chen L (2010) Using multi-temporal remote sensor imagery to detect earth- quake triggered landslides. Int J Appl Earth Obs Geoinf 12(6):487–495

    Google Scholar 

  • Yang B, Yin K, Lacasse S, Liu Z (2019) Time series analysis and long short-term memory neural network to predict landslide displacement. Landslides 16(4):677–694

    Google Scholar 

  • Zhan Q, Molenaar M, Tempfli K, Shi W (2005) Quality assessment for geo-spatial objects derived from remotely sensed data. Int J Remote Sens 26(14):2953–2974

    Google Scholar 

Download references

Acknowledgments

The authors are grateful to the reviewers for their valuable comments.

Funding

This research was supported by the Hong Kong Research Grants Council (project no. T22-603/15N) and the Hong Kong PhD Fellowship Scheme. The authors also would like to thank the support from the Geotechnical Engineering Office, Civil Engineering and Development Department and Lands Department of HKSAR.

Author information

Authors and Affiliations

  1. Department of Civil and Environmental Engineering, The Hong Kong University of Science and Technology, Hong Kong Special Administrative Region, China

    Zhaoyu Su, Jun Kang Chow, Pin Siang Tan, Jimmy Wu & Yu-Hsing Wang

  2. Development Bureau, Hong Kong Special Administrative Region, China

    Ying Kit Ho

Authors
  1. Zhaoyu Su
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jun Kang Chow
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pin Siang Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jimmy Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ying Kit Ho
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yu-Hsing Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the study conception, experimental design, and data analysis. All authors also contributed to the manuscript preparation and approved the submitted version.

Corresponding author

Correspondence to Yu-Hsing Wang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Su, Z., Chow, J.K., Tan, P.S. et al. Deep convolutional neural network–based pixel-wise landslide inventory mapping. Landslides 18, 1421–1443 (2021). https://doi.org/10.1007/s10346-020-01557-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10346-020-01557-6

Keywords

Search

Navigation