Abstract
The assessment of railway safety hazards is a long-term and difficult task, and developing efficient assessment models has made significant contributions to preventing and controlling these hazards. This paper aims to demonstrate that the Linformer model based on self-attention performs better than other typical qualitative, machine learning, and deep learning models in hazard susceptibility assessment. The models are used to evaluate the susceptibility of the southwest railway. And 13 conditional factors that affect geological hazards are selected based on the geological features, geomorphometric features, hydrological features, and environmental features of the southwest railway hazard research area. A data set of 80% of the 1474 hazard and non-hazard points in the study area is randomly selected to train the susceptibility model, and the remaining 20% is used to verify the newly established model. The LR, SVM, LSTM, and Linformer models are tested using the accuracy, precision, recall rate, F1 score calculation, and AUC assessment indicators to confirm different variability. Based on the Jenks method, the susceptibility evaluation results of the southwest railway in the study area are divided into five groups from high to low. The geo-hazard susceptibility map shows that while the central and northeastern railways are less impacted by hazards, the susceptibility is higher in the southwest of the study area.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
Datasets used in this study are available from the corresponding author on reasonable request.
References
Aditian A, Kubota T, Shinohara Y (2018) Comparison of GIS-based landslide susceptibility models using frequency ratio, logistic regression, and artificial neural network in a tertiary region of Ambon, Indonesia. Geomorphology 318:101–111. https://doi.org/10.1016/j.geomorph.2018.06.006
Azarafza M, Azarafza M, Akgün H, Atkinson PM, Derakhshani R (2021) Deep learning-based landslide susceptibility mapping. Sci Rep 11(1):24112. https://doi.org/10.1038/s41598-021-03585-1
Bălteanu D, Chendeş V, Sima M, Enciu P (2010) A country-wide spatial assessment of landslide susceptibility in Romania. Geomorphology 124(3–4):102–112
Basharat M, Shah HR, Hameed N (2016) Landslide susceptibility mapping using GIS and weighted overlay method: a case study from NW Himalayas, Pakistan. Arab J Geosci 9(4):292. https://doi.org/10.1007/s12517-016-2308-y
Bui DT, Tsangaratos P, Nguyen VT, Liem NV, Trinh PT (2020) Comparing the prediction performance of a deep learning neural network model with conventional machine learning models in landslide susceptibility assessment. CATENA 188:104426. https://doi.org/10.1016/j.catena.2019.104426
Chang KT, Merghadi A, Yunus AP, Pham BT, Dou J (2019) Evaluating scale effects of topographic variables in landslide susceptibility models using GIS-based machine learning techniques. Sci Rep 9(1):12296. https://doi.org/10.1038/s41598-019-48773-2
Chen W-P, Molnar P (1977) Seismic moments of major earthquakes and the average rate of slip in central Asia. J Geophys Res 82(20):2945–2969. https://doi.org/10.1029/jb082i020p02945
Chen W, Panahi M, Pourghasemi HR (2017) Performance evaluation of GIS-based new ensemble data mining techniques of adaptive neuro-fuzzy inference system (ANFIS) with genetic algorithm (GA), differential evolution (DE), and particle swarm optimization (PSO) for landslide spatial modelling. CATENA 157:310–324. https://doi.org/10.1016/j.catena.2017.05.034
Chen W, Zhang S, Li R, Shahabi H (2018) Performance evaluation of the GIS-based data mining techniques of best-first decision tree, random forest, and naïve Bayes tree for landslide susceptibility modeling. Sci Total Environ 644:1006–1018. https://doi.org/10.1016/j.scitotenv.2018.06.389
Choubin B, Moradi E, Golshan M, Adamowski J, Sajedi-Hosseini F, Mosavi A (2019) An ensemble prediction of flood susceptibility using multivariate discriminant analysis, classification and regression trees, and support vector machines. Sci Total Environ 651:2087–2096. https://doi.org/10.1016/j.scitotenv.2018.10.064
Coco L, Macrini D, Piacentini T, Buccolini M (2021) Landslide susceptibility mapping by comparing gis-based bivariate methods: a focus on the geomorphological implication of the statistical results. Remote Sens 13(21):4280. https://doi.org/10.3390/rs13214280
Corominas J, van Westen C, Frattini P, Cascini L, Malet JP, Fotopoulou S, Catani F, Van Den Eeckhaut M, Mavrouli O, Agliardi F, Pitilakis K, Winter MG, Pastor M, Ferlisi S, Tofani V, Hervás J, Smith JT (2014) Recommendations for the quantitative analysis of landslide risk. Bull Eng Geol Environ 73(2):209–263. https://doi.org/10.1007/s10064-013-0538-8
Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20: 273–297. https://doi.org/10.1007/BF00994018
Dormann CF, Elith J, Bacher S, Buchmann C, Carl G, Carré G, Marquéz JRG, Gruber B, Lafourcade B, Leitão PJ, Münkemüller T, Mcclean C, Osborne PE, Reineking B, Schröder B, Skidmore AK, Zurell D, Lautenbach S (2013) Collinearity: a review of methods to deal with it and a simulation study evaluating their performance. Ecography 36(1):27–46. https://doi.org/10.1111/j.1600-0587.2012.07348.x
Dou J, Yunus AP, Tien Bui D, Merghadi A, Sahana M, Zhu Z, Chen CW, Khosravi K, Yang Y, Pham BT (2019a) Assessment of advanced random forest and decision tree algorithms for modeling rainfall-induced landslide susceptibility in the Izu-Oshima Volcanic Island, Japan. Sci Total Environ 662:332–346. https://doi.org/10.1016/j.scitotenv.2019.01.221
Dou J, Yunus AP, Xu Y, Zhu Z, Chen CW, Sahana M, Khosravi K, Yang Y, Pham BT (2019b) Torrential rainfall-triggered shallow landslide characteristics and susceptibility assessment using ensemble data-driven models in the Dongjiang Reservoir Watershed, China. Nat Hazards 97(2):579–609. https://doi.org/10.1007/s11069-019-03659-4
Dou J, Yunus AP, Bui DT, Merghadi A, Sahana M, Zhu Z, Chen CW, Han Z, Pham BT (2020) Improved landslide assessment using support vector machine with bagging, boosting, and stacking ensemble machine learning framework in a mountainous watershed, Japan. Landslides 17(3):641–658. https://doi.org/10.1007/s10346-019-01286-5
Du J, Glade T, Woldai T, Chai B, Zeng B (2020) Landslide susceptibility assessment based on an incomplete landslide inventory in the Jilong Valley, Tibet, Chinese Himalayas. Eng Geol 270:105572. https://doi.org/10.1016/j.enggeo.2020.105572
Fan X, Yunus AP, Scaringi G, Catani F, Siva Subramanian S, Xu Q, Huang R (2021) Rapidly evolving controls of landslides after a strong earthquake and implications for hazard assessments. Geophys Res Lett 48(1):1–12. https://doi.org/10.1029/2020GL090509
Fang Z, Wang Y, Peng L, Hong H (2021) Predicting flood susceptibility using LSTM neural networks. J Hydrol 594:125734. https://doi.org/10.1016/j.jhydrol.2020.125734
García CB, García J, López Martín MM, Salmerón R (2015) Collinearity: revisiting the variance inflation factor in ridge regression. J Appl Stat 42(3):648–661. https://doi.org/10.1080/02664763.2014.980789
Graves A, Mohamed AR, Hinton G (2013) Speech recognition with deep recurrent neural networks. IEEE Int Conf Acoust Speech Signal Process Proc 1:6645–6649. https://doi.org/10.1109/ICASSP.2013.6638947
Hakim WL, Rezaie F, Nur AS, Panahi M, Khosravi K, Lee CW, Lee S (2022) Convolutional neural network (CNN) with metaheuristic optimization algorithms for landslide susceptibility mapping in Icheon, South Korea. J Environ Manag 305:114367. https://doi.org/10.1016/j.jenvman.2021.114367
Hamedi H, Alesheikh AA, Panahi M, Lee S (2022) Landslide susceptibility mapping using deep learning models in Ardabil province, Iran. Stoch Environ Res Risk Assess 36(12):4287–4310. https://doi.org/10.1007/s00477-022-02263-6
Han Z, Li Y, Du Y, Wang W, Chen G (2019) Noncontact detection of earthquake-induced landslides by an enhanced image binarization method incorporating with Monte-Carlo simulation. Geomat Nat Hazard Risk 10(1):219–241. https://doi.org/10.1080/19475705.2018.1520745
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780
Hong H, Pourghasemi HR, Pourtaghi ZS (2016) Landslide susceptibility assessment in Lianhua County (China): a comparison between a random forest data mining technique and bivariate and multivariate statistical models. Geomorphology 259:105–118. https://doi.org/10.1016/j.geomorph.2016.02.012
Kadavi PR, Lee CW, Lee S (2018) Application of ensemble-based machine learning models to landslide susceptibility mapping. Remote Sens 10(8):1252. https://doi.org/10.3390/rs10081252
Khosravi K, Pourghasemi HR, Chapi K, Bahri M (2016) Flash flood susceptibility analysis and its mapping using different bivariate models in Iran: a comparison between Shannon’s entropy, statistical index, and weighting factor models. Environ Monit Assess 188(12):656. https://doi.org/10.1007/s10661-016-5665-9
Kim HI, Kim BH (2020) Flood hazard rating prediction for urban areas using random forest and LSTM. KSCE J Civil Eng 24(12):3884–3896. https://doi.org/10.1007/s12205-020-0951-z
Li YG, Yang JM, Han Z, Li JY, Wang WD, Chen NS, Hu GS, Huang JL (2023) An ensemble deep-learning framework for landslide susceptibility assessment using multiple blocks: a case study of Wenchuan area, China. Geomatics Nat Hazards Risks 14(1):2221771. https://doi.org/10.1080/19475705.2023.2221771
Liu Y, Deng H, Xiong Q (2017) AHP-based evaluation of slope geo-hazard susceptibility of Maoxian county, Sichuan, China. J Yangtze River Sci Res Inst 34(5):31 (in Chinese)
Liu M, Lü H, Lindenschmidt KE, Xü K, Zhu Y, He C, Wang X, Xie B (2022) Hazard assessment and prediction of ice-jam flooding for a river regulated by reservoirs using an integrated probabilistic modelling approach. J Hydrol 615:128611. https://doi.org/10.1016/j.jhydrol.2022.128611
Małka A (2021) Landslide susceptibility mapping of Gdynia using geographic information system-based statistical models. Nat Hazards 107(1):639–674. https://doi.org/10.1007/s11069-021-04599-8
Merghadi A, Abderrahmane B, Tien Bui D (2018) Landslide susceptibility assessment at Mila basin (Algeria): a comparative assessment of prediction capability of advanced machine learning methods. ISPRS Int J Geo Inf 7(7):268. https://doi.org/10.3390/ijgi7070268
Merghadi A, Yunus AP, Dou J, Whiteley J, ThaiPham B, Bui DT, Avtar R, Abderrahmane B (2020) Machine learning methods for landslide susceptibility studies: a comparative overview of algorithm performance. Earth-Sci Rev 207:103225. https://doi.org/10.1016/j.earscirev.2020.103225
Mokhtari M, Abedian S (2019) Spatial prediction of landslide susceptibility in Taleghan basin, Iran. Stoch Environ Res Risk Assess 33(7):1297–1325. https://doi.org/10.1007/s00477-019-01696-w
Nhu VH, Zandi D, Shahabi H, Chapi K, Shirzadi A, Al-Ansari N, Singh SK, Dou J, Nguyen H (2020) Comparison of support vector machine, Bayesian logistic regression, and alternating decision tree algorithms for shallow landslide susceptibility mapping along a mountainous road in the west of Iran. Appl Sci (switzerland) 10(15):5047. https://doi.org/10.3390/app10155047
Park S, Choi C, Kim B, Kim J (2013) Landslide susceptibility mapping using frequency ratio, analytic hierarchy process, logistic regression, and artificial neural network methods at the Inje area, Korea. Environ Earth Sci 68(5):1443–1464. https://doi.org/10.1007/s12665-012-1842-5
Phillips SJ, Anderson RP, Schapire RE (2006) Maximum entropy modeling of species geographic distributions. Ecol Model 190(3–4):231–259. https://doi.org/10.1016/j.ecolmodel.2005.03.026
Phong TV, Phan TT, Prakash I, Singh SK, Shirzadi A, Chapi K, Ly HB, Ho LS, Quoc NK, Pham BT (2021) Landslide susceptibility modeling using different artificial intelligence methods: a case study at Muong Lay district, Vietnam. Geocarto Int 36(15):1685–1708. https://doi.org/10.1080/10106049.2019.1665715
Pourghasemi HR, Pradhan B, Gokceoglu C (2012) Application of fuzzy logic and analytical hierarchy process (AHP) to landslide susceptibility mapping at Haraz watershed, Iran. Natl Hazards 63(2):965–996. https://doi.org/10.1007/s11069-012-0217-2
Pourghasemi HR, Yousefi S, Kornejady A, Cerdà A (2017) Performance assessment of individual and ensemble data-mining techniques for gully erosion modeling. Sci Total Environ 609:764–775. https://doi.org/10.1016/j.scitotenv.2017.07.198
Pourghasemi HR, Teimoori Yansari Z, Panagos P, Pradhan B (2018) Analysis and evaluation of landslide susceptibility: a review on articles published during 2005–2016 (periods of 2005–2012 and 2013–2016). Arab J Geosci 11(9):193. https://doi.org/10.1007/s12517-018-3531-5
Pourghasemi HR, Kariminejad N, Amiri M, Edalat M, Zarafshar M, Blaschke T, Cerda A (2020) Assessing and mapping multi-hazard risk susceptibility using a machine learning technique. Sci Rep 10(1):3203. https://doi.org/10.1038/s41598-020-60191-3
Rozos D, Pyrgiotis L, Skias S, Tsagaratos P (2008) An implementation of rock engineering system for ranking the instability potential of natural slopes in Greek territory. An Application in Karditsa County. Landslides 5(3):261–270. https://doi.org/10.1007/s10346-008-0117-4
Shirzadi A, Bui DT, Pham BT, Solaimani K, Chapi K, Kavian A, Shahabi H, Revhaug I (2017) Shallow landslide susceptibility assessment using a novel hybrid intelligence approach. Environ Earth Sci 76(2):60. https://doi.org/10.1007/s12665-016-6374-y
Song Y, Niu R, Xu S, Ye R, Peng L, Guo T, Li S, Chen T (2019) Landslide susceptibility mapping based on weighted gradient boosting decision tree in Wanzhou section of the three gorges reservoir area (China). ISPRS Int J Geo Inf 8(1):4. https://doi.org/10.3390/ijgi8010004
Thi Ngo PT, Panahi M, Khosravi K, Ghorbanzadeh O, Kariminejad N, Cerda A, Lee S (2021) Evaluation of deep learning algorithms for national scale landslide susceptibility mapping of Iran. Geosci Front 12(2):505–519. https://doi.org/10.1016/j.gsf.2020.06.013
Thiery Y, Terrier M, Colas B, Fressard M, Maquaire O, Grandjean G, Gourdier S (2020) Improvement of landslide hazard assessments for regulatory zoning in France: STATE–OF–THE-ART perspectives and considerations. Int J Disaster Risk Reduct 47:101562. https://doi.org/10.1016/j.ijdrr.2020.101562
Tien Bui D, Tuan TA, Klempe H, Pradhan B, Revhaug I (2016) Spatial prediction models for shallow landslide hazards: a comparative assessment of the efficacy of support vector machines, artificial neural networks, kernel logistic regression, and logistic model tree. Landslides 13(2):361–378. https://doi.org/10.1007/s10346-015-0557-6
Vahidnia MH, Alesheikh AA, Alimohammadi A, Hosseinali F (2010) A GIS-based neuro-fuzzy procedure for integrating knowledge and data in landslide susceptibility mapping. Comput Geosci 36(9):1101–1114. https://doi.org/10.1016/j.cageo.2010.04.004
Van Den Eeckhaut M, Marre A, Poesen J (2010) Comparison of two landslide susceptibility assessments in the Champagne-Ardenne region (France). Geomorphology 115(1–2):141–155. https://doi.org/10.1016/j.geomorph.2009.09.042
Vapnik VN (2000) The nature of statistical learning theory. Springer Verlag, New York, pp 93–224. https://doi.org/10.1007/978-1-4757-3264-1
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. Adv Neural Inf Process Syst 30:5998–6008
Wang LJ, Guo M, Sawada K, Lin J, Zhang J (2015) Landslide susceptibility mapping in Mizunami City, Japan: a comparison between logistic regression, bivariate statistical analysis and multivariate adaptive regression spline models. CATENA. https://doi.org/10.1016/j.catena.2015.08.007
Wang WD, Li J, Han Z (2020) Comprehensive assessment of geological hazard safety along railway engineering using a novel method: a case study of the Sichuan-Tibet railway, China. Geomat Nat Haz Risk 11(1):1–21. https://doi.org/10.1080/19475705.2019.1699606
Wang D, Hao M, Chen S, Meng Z, Jiang D, Ding F (2021a) Assessment of landslide susceptibility and risk factors in China. Nat Hazards 108(3):3045–3059. https://doi.org/10.1007/s11069-021-04812-8
Wang H, Zhang L, Luo H, He J, Cheung RWM (2021b) AI-powered landslide susceptibility assessment in Hong Kong. Eng Geol 288:106103. https://doi.org/10.1016/j.enggeo.2021.106103
Wang SB, Zhuang JQ, Zheng J, Mou JQ, Wang Y, Fu YT (2022) landslide susceptibility evaluation based on deep learning along Kangding-Litang section of CZ railway. J Eng Geol 003:30 (in Chinese)
Wu R, Zhang Y, Guo C, Yang Z, Tang J, Su F (2020) Landslide susceptibility assessment in mountainous area: a case study of Sichuan-Tibet railway, China. Environ Earth Sci 79(6):157. https://doi.org/10.1007/s12665-020-8878-8
Xi C, Han M, Hu X, Liu B, He K, Luo G, Cao X (2022) Effectiveness of Newmark-based sampling strategy for coseismic landslide susceptibility mapping using deep learning, support vector machine, and logistic regression. Bull Eng Geol Environ 81(5):174. https://doi.org/10.1007/s10064-022-02664-5
Xiao L, Zhang Y, Peng G (2018) Landslide susceptibility assessment using integrated deep learning algorithm along the China-Nepal highway. Sensors (switzerland) 18(12):4436. https://doi.org/10.3390/s18124436
Xie W, Nie W, Saffari P, Robledo LF, Descote PY, Jian W (2021) Landslide hazard assessment based on Bayesian optimization–support vector machine in Nanping City, China. Natl Hazards 109(1):931–948. https://doi.org/10.1007/s11069-021-04862-y
Xu C, Dai F, Yao X, Chen J, Tu X, Sun Y, Wang Z (2009) GIS-based landslide susceptibility assessment using analytical hierarchy process in Wenchuan earthquake region. Chin J Rock Mech Eng 28:2 (in Chinese)
Xu ZX, Zhang LG, Jiang LW, Wang K, Zhang GZ (2021) Engineering geological environment and main engineering geological problems of Ya’an Linzhi section of Sichuan Tibet railway. Eng Sci Technol 53(03):29–42 (in Chinese)
Yang DH (2019) Analysis of main engineering geological problems in Changdu Linzhi section of Sichuan Tibet railway. Railw Stand Des 63(09):16–22 (in Chinese)
Youssef AM, Mahdi AM, Pourghasemi HR (2022) Landslides and flood multi-hazard assessment using machine learning techniques. Bull Eng Geol Environ 81(9):370. https://doi.org/10.1007/s10064-022-02874-x
Zabihi M, Mirchooli F, Motevalli A, Khaledi Darvishan A, Pourghasemi HR, Zakeri MA, Sadighi F (2018) Spatial modelling of gully erosion in Mazandaran Province, northern Iran. CATENA 161:1–13. https://doi.org/10.1016/j.catena.2017.10.010
Zeitler PK, Meltzer AS, Brown L, Kidd WSF, Lim C, Enkelmann E (2014) Tectonics and topographic evolution of Namche Barwa and the easternmost Lhasa block. Tibet Spec Pap Geol Soc Am 507:23–58. https://doi.org/10.1130/2014.2507(02)
Zhang H, Song Y, Xu S, He Y, Li Z, Yu X, Liang Y, Wu W, Wang Y (2022) Combining a class-weighted algorithm and machine learning models in landslide susceptibility mapping: a case study of Wanzhou section of the Three Gorges Reservoir, China. Comput Geosci 158:104966. https://doi.org/10.1016/j.cageo.2021.104966
Zhu CH, Zhang JJ, Ma DH, Liu Y, Xiang B (2020) Study on comprehensive assessment of regional landslide risk after earthquake based on DInSAR-BP neural network. J Eng Geol 28(3):11 (in Chinese)
Acknowledgements
This study was financially supported by the National Natural Science Foundation of China (Grant No. 52078493); the National Natural Science Foundation of Hunan province (Grant No. 2022JJ30700); the Natural Science Foundation for Excellent Young Scholars of Hunan (Grant No. 2021JJ20057); the Innovation Provincial Program of Hunan Province (Grant No. 2020RC3002); the Science and Technology Plan Project of Changsha (Grant No. kq2206014); the Innovation Driven Program of Central South University (Grant No. 2023CXQD033); and the Doctoral research initiation project of Xiangtan University (Grant No. 2023113201502). These financial supports are gratefully acknowledged.
Funding
This research was funded by National Natural Science Foundation of China, Grant no [52078493], Natural Science Foundation of Hunan Province, Grant no [2022JJ30700], Natural Science Foundation for Excellent Young Scholars of Hunan, Grant no [2021JJ20057], Innovation Provincial Program of Hunan Province, Grant no [2020RC3002], Science and Technology Plan Project of Changsha, Grant no [kq2206014], Innovation Driven Program of Central South University, Grant no [2023CXQD033], Doctoral research initiation project of Xiangtan University, Grant no [2023113201502].
Author information
Authors and Affiliations
Contributions
Nan JIANG performed the data analyses and wrote the manuscript; Yange LI contributed to the conception of the study; Zheng HAN revised the manuscript; Jiaying LI analyzed data and revised the manuscript; Bangjie FU and Jiaming YANG helped perform the analysis. All authors reviewed the manuscript.
Corresponding authors
Ethics declarations
Conflict of interest
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Jiang, N., Li, Y., Han, Z. et al. A dataset-enhanced Linformer model for geo-hazards susceptibility assessment: a case study of the railway in Southwest China. Environ Earth Sci 82, 397 (2023). https://doi.org/10.1007/s12665-023-11080-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s12665-023-11080-1