Abstract
The simulation of geophysical mass flows, including debris flows, rock and snow avalanches, has become an important tool in engineering hazard assessment. Especially the runout and deposition behaviour of observed and expected mass flows are of interest. When being confronted with the evaluation of model performance and sensitivity, there are no standard, objective approaches. In this contribution, we review methods that have been used in literature and outline a new approach to quantitatively compare 2D simulations of observed and simulated deposition pattern. Our proposed method is based on the comparison of normalized partial areas which can be plotted in a ternary diagram to visualize the degree of over- and under-estimation. Results can be summed up by a single metric between -1 (no fit) and 1 (perfect fit). This study shall help developers and end-users of simulation models to better understand model behaviour and provides a possibility for comparison of model results, independent of simulation platform and type of mass flow.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Armstrong, J.S.: Principles of forecasting: a handbook for researchers and practitioners, vol. 30 Springer Science & Business Media (2001)
Barbolini, M., Gruber, U., Keylock, C., Naaim, M., Savi, F.: Application of statistical and hydraulic-continuum dense-snow avalanche models to five real european sites. Cold Reg. Sci. Technol. 31(2), 133–149 (2000). doi:10.1016/S0165-232X(00)00008-2
Barpi, F., Borri-Brunetto, M., Veneri, L.D.: Cellular-automata model for dense-snow avalanches. J. Cold Reg. Eng. 21(4), 121–140 (2007)
Bayarri, M.J., Berger, J.O., Paulo, R., Sacks, J., Cafeo, J.A., Cavendish, J., Lin, C.H., Tu, J.: A framework for validation of computer models Technometrics (2012)
Berti, M., Simoni, A.: Dflowz: a free program to evaluate the area potentially inundated by a debris flow. Comput. Geosci. 67, 14–23 (2014)
Bossi, G., Cavalli, M., Crema, S., Frigerio, S., Luna, B.Q., Mantovani, M., Marcato, G., Schenato, L., Pasuto, A.: Multi-temporal LiDAR-DTMs as a tool for modelling a complex landslide: a case study in the rotolon catchment (eastern italian alps). Nat. Hazards Earth Syst. Sci. 15(4), 715–722 (2015). doi:10.5194/nhess-15-715-2015
Bremer, M., Sass, O.: Combining airborne and terrestrial laser scanning for quantifying erosion and deposition by a debris flow event. Geomorphology 138(1), 49–60 (2012). doi:10.1016/j.geomorph.2011.08.024
Carranza, E.J.M., Castro, O.T.: Predicting lahar-inundation zones: case study in west mount pinatubo, Philippines. Nat. Hazards 37(3), 331–372 (2006)
Ċetina, M., Rajar, R., Hojnik, T., Zakrajṡek, M., Krzyk, M., Mikoṡ, M.: Case study: numerical simulations of debris flow below stoŻe, Slovenia. J. Hydraul. Eng. 132(2), 121–130 (2006)
Chiari, M., Scheidl, C.: Application of a new cellular model for bedload transporting extreme events at steep slopes. Geomorphology 246, 413–419 (2015)
Christen, M., Kowalski, J., Bartelt, P.: Ramms: Numerical simulation of dense snow avalanches in three-dimensional terrain. Cold Reg. Sci. Technol. 63(1), 1–14 (2010)
Clarke, K.C., Hoppen, S., Gaydos, L.: Methods and Techniques for Rigorous Calibration of a Cellular Automaton Model of Urban Growth. In: Third International Conference/Workshop on Integrating GIS and Environmental Modeling, Santa Fe, New Mexico. Citeseer (1996)
D’Ambrosio, D., Spataro, W., Iovine, G.: Parallel genetic algorithms for optimising cellular automata models of natural complex phenomena: an application to debris flows. Comput. Geosci. 32(7), 861–875 (2006). doi:10.1016/j.cageo.2005.10.027
Ebert, E.E.: Fuzzy verification of high-resolution gridded forecasts: a review and proposed framework. Meteorol. Appl. 15(1), 51–64 (2008)
Evans, S., Guthrie, R., Roberts, N., Bishop, N.: The disastrous 17 february 2006 rockslide-debris avalanche on leyte island, Philippines: a catastrophic landslide in tropical mountain terrain. Nat. Hazards Earth Syst. Sci. 7(1), 89–101 (2007)
Fraccarollo, L., Papa, M.: Numerical simulation of real debris-flow events. Phys. Chem. Earth Part B 25 (9), 757–763 (2000)
Fidej, G., Mikoš, M., Rugani, T., Jež, J., Kumelj, Š., Diaci, J.: Assessment of the protective function of forests against debris flows in a gorge of the slovenian alps iForest - Biogeosciences and Forestry (1), 73–81. doi:10.3832/ifor0994-007 (2015)
Granig, M., Sampl, P., Tollinger, C., Jörg, P.: Experiences in Avalanche Assessment with the Powder Snow Avalanche Model Samosat. In: International Snow Science Workshop Proceedings, Davos, Switzerland, pp. 514–518 (2009)
Gruber, U., Bartelt, P.: Snow avalanche hazard modelling of large areas using shallow water numerical methods and gis. Environ. Model Softw. 22(10), 1472–1481 (2007)
Haas, F., Heckmann, T., Wichmann, V., Becht, M.: Runout analysis of a large rockfall in the dolomites/italian alps using LIDAR derived particle sizes and shapes. Earth Surf. Process. Landforms 37(13), 1444–1455 (2012). doi:10.1002/esp.3295
Han, Z., Chen, G., Li, Y., Zhang, H., He, Y.: Elementary analysis on the bed-sediment entrainment by debris flow and its application using the topflowdf model. Geomat. Nat. Haz. Risk 7(2), 764–785 (2016)
Heckmann, T., Bimbse, M., Krautblatter, M., Haas, F., Becht, M., Morche, D.: From geotechnical analysis to quantification and modelling using LiDAR data: a study on rockfall in the reintal catchment, bavarian alps, Germany. Earth Surf. Process. Landforms 37(1), 119–133 (2011). doi:10.1002/esp.2250
Heim, A.: Bergsturz Und Menschenleben. Fretz und Wasmuth, Zürich (1932)
Hsu, S., Chiou, L., Lin, G., Chao, C., Wen, H., Ku, C.: Applications of simulation technique on debris-flow hazard zone delineation: a case study in hualien county, Taiwan. Nat. Hazards Earth Syst. Sci. 10(3), 535–545 (2010)
Hungr, O.: A model for the runout analysis of rapid flow slides, debris flows, and avalanches. Can. Geotech. J. 32(4), 610–623 (1995)
Hungr, O., McDougall, S.: Two numerical models for landslide dynamic analysis. Comput. Geosci. 35(5), 978–992 (2009)
Iovine, G., D’Ambrosio, D., Gregorio, S.D.: Applying genetic algorithms for calibrating a hexagonal cellular automata model for the simulation of debris flows characterised by strong inertial effects. Geomorphology 66, 287–303 (2005). doi:10.1016/j.geomorph.2004.09.017
Iverson, R.M.: The physics of debris flows. Rev. Geophys. 35(3), 245–296 (1997)
Iverson, R.M., Schilling, S.P., Vallance, J.W.: Objective delineation of lahar-inundation hazard zones. Geol. Soc. Am. Bull. 110(8), 972–984 (1998)
Jakob, M., Anderson, D., Fuller, T., Hungr, O., Ayotte, D.: An unusually large debris flow at hummingbird creek, mara lake, british columbia. Can. Geotech. J. 37(5), 1109–1125 (2000)
Jun, B.H.: Numerical simulation of the topographical change in korea mountain area by intense rainfall and consequential debris flow. Adv. Meteorol. 2016, 1–11 (2016). doi:10.1155/2016/9363675
Kim, H., Lee, S.W., Yune, C.Y., Kim, G.: Volume estimation of small scale debris flows based on observations of topographic changes using airborne LiDAR DEMs. J. Mt. Sci. 11(3), 578–591 (2014). doi:10.1007/s11629-013-2829-8
Lee, D.R., Sallee, G.T.: Theoretical patterns of farm shape and central place location. J. Reg. Sci. 14(3), 423–430 (1974)
Lin, J.Y., Yang, M.D., Lin, B.R., Lin, P.S.: Risk assessment of debris flows in songhe stream, Taiwan. Eng. Geol. 123(1), 100–112 (2011)
Medina, V., Hrlimann, M., Bateman, A.: Application of flatmodel, a 2d finite volume code, to debris flows in the northeastern part of the iberian peninsula. Landslides 5, 127–142 (2008)
Mergili, M., Schratz, K., Ostermann, A., Fellin, W.: Physically-based modelling of granular flows with open source gis. Nat. Hazards Earth Syst. Sci. 12(1), 187–200 (2012). doi:10.5194/nhess-12-187-2012
Naef, D., Rickenmann, D., Rutschmann, P., McArdell, B.: Comparison of flow resistance relations for debris flows using a one-dimensional finite element simulation model. Nat. Hazards Earth Syst. Sci. 6(1), 155–165 (2006)
Nagelisen, J., Moore, J.R., Vockenhuber, C., Ivy-Ochs, S.: Post-glacial rock avalanches in the obersee valley, glarner alps, Switzerland. Geomorphology 238, 94–111 (2015)
O’Brien, J.S., Julien, P.Y., Fullerton, W.: Two-dimensional water flood and mudflood simulation. J. Hydraul. Eng. 119, 244–260 (1993)
Oramas Dorta, D., Toyos, G., Oppenheimer, C., Pareschi, M., Zanchetta, G.: Empirical modelling of the may 1998 small debris flows in sarno (italy) using laharz. Nat. Hazards 40, 381–396 (2007). doi:10.1007/s11069-006-0035-5
Pirulli, M.: On the use of the calibration-based approach for debris-flow forward-analyses. Nat. Hazards Earth Syst. Sci. 10, 1009–1019 (2010)
Preuth, T., Bartelt, P., Korup, O., McArdell, B.: A random kinetic energy model for rock avalanches: eight case studies. J. Geophys. Res. Earth Surf. (2003–2012) 115(F3), 1–22 (2010)
Procter, J.N., Cronin, S.J., Platz, T., Patra, A., Dalbey, K., Sheridan, M., Neall, V.: Mapping block-and-ash flow hazards based on titan 2d simulations: a case study from mt. taranaki, nz. Nat. Hazards 53(3), 483–501 (2010)
Prokop, A., Panholzer, H.: Assessing the capability of terrestrial laser scanning for monitoring slow moving landslides. Nat. Hazards Earth Syst. Sci. 9(6), 1921–1928 (2009). doi:10.5194/nhess-9-1921-2009
Reid, M.E., Coe, J.A., Brien, D.L.: Forecasting inundation from debris flows that grow volumetrically during travel, with application to the Oregon Coast Range, USA. Geomorphology (2016). doi:10.1016/j.geomorph.2016.07.039 (2016)
Rickenmann, D., Scheidl, C.: Modelle zur Abschätzung des Ablagerungsverhaltens von Murgängen. Wasser Energie Luft 1, 17–26 (2010)
Sampl, P., Zwinger, T.: Avalanche simulation with samos. Ann. Glaciol. 38(1), 393–398 (2004)
Scaioni, M., Longoni, L., Melillo, V., Papini, M.: Remote sensing for landslide investigations: an overview of recent achievements and perspectives. Remote Sens. 6(10), 9600–9652 (2014). doi:10.3390/rs6109600
Scheidl, C., Rickenmann, D.: Empirical prediction of debris-flow mobility and deposition on fans. Earth Surf. Process. Landf. 35(2), 157–173 (2010)
Scheidl, C., Rickenmann, D.: TopflowDF - a Simple Gis Based Model to Simulate Debris-Flow Runout on the Fan. In: Genevois, D.P.A., Hamilton, R. (eds.) 5Th International Conference on Debris-Flow Hazards: Mitigation, Mechanics, Prediction and Assessment (2011)
Scheidl, C., Rickenmann, D., Chiari, M.: The use of airborne LiDAR data for the analysis of debris flow events in Switzerland. Nat. Hazards Earth Syst. Sci. 8(5), 1113–1127 (2008). doi:10.5194/nhess-8-1113-2008
Schraml, K., Thomschitz, B., McArdell, B., Graf, C., Kaitna, R.: Modeling debris-flow runout patterns on two alpine fans with different dynamic simulation models. Nat. Hazards Earth Syst. Sci. Discuss. 3(2), 1397–1425 (2015)
Sosio, R., Crosta, G., Frattini, P.: Field observations, rheological testing and numerical modelling of a debris-flow event. Earth Surf. Process. Landf. 32(2), 290–306 (2007)
Vasiliou, A., Maris, F., Varsami, G.: Estimation of Sedimentation to the Torrential Sedimentation Fan of the Dadia Stream with the Use of the ToprunDF and the GIS Models, pp 207–214. Springer, Berlin (2011)
Westoby, M., Brasington, J., Glasser, N., Hambrey, M., Reynolds, J.: structure-from-motion photogrammetry: a low-cost, effective tool for geoscience applications. Geomorphology 179, 300–314 (2012). doi:10.1016/j.geomorph.2012.08.021
Acknowledgments
Open access funding provided by University of Natural Resources and Life Sciences Vienna (BOKU).
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Heiser, M., Scheidl, C. & Kaitna, R. Evaluation concepts to compare observed and simulated deposition areas of mass movements. Comput Geosci 21, 335–343 (2017). https://doi.org/10.1007/s10596-016-9609-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10596-016-9609-9