Abstract
To date there is no International standard on the verification and validation (V&V) of building fire evacuation models, i.e., model testers adopt inconsistent procedures or tests designed for other model uses. For instance, the tests presented within the MSC/Circ.1238 Guidelines for evacuation analysis for new and existing passenger ships provided by the International Maritime Organization are often employed for the V&V of models outside their original context of use (building fires instead of maritime applications). This paper presents a list of verification tests for component testing and the analysis of emergent behaviours together with examples of experimental data-sets suitable for the analysis of different core components. The capabilities of building fire evacuation models are evaluated by studying their five main core components, namely (1) pre-evacuation time, (2) movement and navigation, (3) exit usage, (4) route availability and (5) flow constraints. This paper discusses the tests which are included in a freely available Technical Note developed at the National Institute of Standards and Technology. This work is intended to open a discussion on the main issues associated with the definition of a standard procedure for the V&V of building fire evacuation models, including the definition of the acceptance criteria of a standard V&V protocol.
Similar content being viewed by others
References
Averill JD (2011) Five grand challenges in pedestrian and evacuation dynamics, in: Peacock RD, Kuligowski ED, Averill JD (eds) Pedestrian and evacuation dynamics. Springer US, Boston, pp. 1–11
Bayer K, Rejnö T (1999) Optimering genom fullskaleförsök [Evacuation alarm – Optimizing through full-scale experiments] (No. 5053). Department of Fire Safety Engineering, Lund University, Lund, Sweden
Boyce KE, Purser DA, Shields TJ (2012) Experimental studies to investigate merging behaviour in a staircase. Fire Mater 36:383–398. doi:10.1002/fam.1091
Bryan JL (2002) a selected historical review of human behavior in fire. Fire Prot Eng 16:4–10
Canter DV (1990) Fires and human behaviour. Fulton, London
Chooramun N (2011) Implementing a hybrid spatial discretisation within an agent based evacuation model. University of Greenwich, London
Deutsch M, Gerard HB (1955) A study of normative and informational social influences upon individual judgment. J. Abnorm. Soc. Psychol. 51:629–636. doi:10.1037/h0046408
Fang Z-M, Song W-G, Li Z-J, Tian W, Lv W, Ma J, Xiao X (2012) Experimental study on evacuation process in a stairwell of a high-rise building. Build. Environ 47:316–321. doi:10.1016/j.buildenv.2011.07.009
Frantzich H, Nilsson D, Eriksson O (2007) Utvärdering och validering av utrymningsprogram [Evaluation and validation of evacuation programs] (No. 3143). Department of Fire Safety Engineering and Systems Safety, Lund University, Lund, Sweden
Galea ER, Deere S, Brown R, Filippidis L (2012a) An Evacuation Validation Data Set for Large Passenger Ships. Presented at the Pedestrian and Evacuation Dynamics 2012 Conference, ETH, Zurich (Switzerland)
Galea ER, Deere S, Brown R, Nicholls I, Hifi Y, Bresnard N (2012b) The SAFEGUARD validation data-set and recommendations to IMO to update MSC Circ 1238. Presented at the SAFEGUARD Passenger Evacuation Seminar, The Royal Institution of Naval Architects, London, UK, pp. 41–60
Galea ER (1997) University of greenwich, centre for numerical modelling and process analysis, validation of evacuation models. CMS Press
Grosshandler WL, Bryner NP, Madrzykowski D, Kuntz K (2005) Report of the Technical Investigation of The Station Nightclub Fire (No. NIST NCSTAR 2: Volume 1). National Institute of Standards and Technology, Gaithersburg, MD
Gwynne SMV, Kuligowski ED, Spearpoint M, Ronchi E (2014) Bounding defaults in egress models. Fire and Materials. Special Issue on the Fifth International Symposium on Human Behaviour in Fire. doi:10.1002/fam.2212
Gwynne S, Kuligowski E, Nilsson D (2012) Representing evacuation behavior in engineering terms. Journal of Fire Protection Engineering 22:133–150. doi:10.1177/1042391512436788
Gwynne SMV, Rosenbaum E (2008) Employing the Hydraulic Model in Assessing Emergency Movement, in: SFPE Hanbook of Fire Protection Engineering. Di Nenno P. J., National Fire Protection Association, Quincy
Hamins A, McGrattan K (2007) Verification and Validation of Selected Fire Models for Nuclear Power Plant Applications (No. NUREG-1824). National Institute of Standards and Technology, Gaithersburg
Hewstone M, Martin R (2008) Social Influence, in: Introduction to Social Psychology. Blackwell Publishing, London
Hokugo A, Kubo K, Murozaki Y (1985) An Experimental study on confluence of two foot traffic flows in staircase. J Archit Plan Environ Eng 358:37–43
Hoogendoorn SP, Daamen W (2005) Pedestrian behavior at bottlenecks. Transp Sci 39:147–159. doi:10.1287/trsc.1040.0102
International Code Council (2012) International Building Code 2012
International Maritime Organization (2007) Guidelines for evacuation analyses for new and existing passenger Ships, MSC/Circ.1238
International Standards Organization (2008) Fire safety engineering – assessment, verification and validation of calculation methods. ISO 16730
Kinateder M (2013) Social influence in emergency situations–studies in virtual reality. Phd Dissertation
Klüpfel H, Meyer-König T (2003) Characteristics of the pedgo software for crowd movement and egress simulation. In Proceedings of the 2nd International Conference in Pedestrian and Evacuation Dynamics. London UK: University of Greenwich 331-340
Korhonen T, Hostikka S, Heliovaara S, Ethamo H (2010) FDS+Evac: an agent based fire evacuation model. Pedestriand and Evacuation Dynamics 2008. Springer, Wuppertal, Germany, pp. 109–120
Kuligowski E (2011) Predicting human behavior during fires. Fire Technol 49:101–120. doi:10.1007/s10694-011-0245-6
Kuligowski ED, Peacock RD (2010) Building Occupant Egress Data, Report of Test FR 4024. National Institute of Standards and Technology, Gaithersburg
Kuligowski ED, Peacock RD, Hoskins BL (2010) A Review of Building Evacuation Models, 2nd Edition, NIST Technical Note 1680
Latané B, Darley JM (1970) The unresponsive bystander: why doesn’t he help? Appleton-Century Crofts, New York
Lord J, Meacham B, Moore A, Fahy R, Proulx G (2005) Guide for evaluating the predictive capabilities of computer egress models NIST GCR 06-886
Melly M, Lennon P, Lennon R (2009) Who defers to whom? Deference behaviour on stairs. Presented at the Human Behaviour in Fire 2009 Symposium, Interscience Communications, pp. 135–146
Meyer-König T, Waldau N, Klüpfel H (2007) The RiMEA project — development of a new regulation, in: Waldau N, Gattermann P, Knoflacher H, Schreckenberg M (eds) Pedestrian and evacuation dynamics 2005. Springer Berlin Heidelberg, pp. 309–313
Nilsson D (2009) Exit choice in fire emergencies: influencing choice of exit with flashing lights. Dept. of fire safety engineering and systems safety, Lund University, Lund, Sweden
Nilsson D, Johansson A (2009) Social influence during the initial phase of a fire evacuation—Analysis of evacuation experiments in a cinema theatre. Fire Saf. J. 44:71–79. doi:10.1016/j.firesaf.2008.03.008
Peacock RD, Reneke PA, D Davis W, Jones WW (1999) Quantifying fire model evaluation using functional analysis. Fire Saf. J. 33:167–184. doi:10.1016/S0379-7112(99)00029-6
Purser DA, Bensilum M (2001) Quantification of behaviour for engineering design standards and escape time calculations. Saf. Sci. 38:157–182. doi:10.1016/S0925-7535(00)00066-7
Ronchi E, Kinsey M (2011) Evacuation models of the future: Insights from an online survey on user’s experiences and needs. Presented at the Advanced Research Workshop Evacuation and Human Behaviour in Emergency Situations EVAC11, Capote J. et al, Santander, Spain, pp. 145–155
Ronchi E, Nilsson D (2013) Fire evacuation in high-rise buildings: a review of human behaviour and modelling research. Fire Science Reviews 2:7. doi:10.1186/2193-0414-2-7
Ronchi E, Kuligowski ED, Reneke PA, Peacock RD, Nilsson D (2013a) The process of verification and validation of building fire evacuation models. Technical Note 1822. Retrieved from: http://www.nist.gov/customcf/get_pdf.cfm?pub_id=913642
Ronchi E, Nilsson D, Zechlin O, Klein W, Mayer H (2013b) Employing validation and verification tests as an integral part of evacuation model development. Presented at the 13th International Conference and Exhibition on Fire Science and Engineering, Interscience Communications, Royal Holloway College, University of London, UK, pp. 979–990
Ronchi E, Reneke PA, Peacock RD (2013c) A method for the analysis of behavioural uncertainty in evacuation modelling. fire technol. doi:10.1007/s10694-013-0352-7
Rykiel EJ (1996) Testing ecological models: the meaning of validation. Ecol. Model 90:229–244
Seyfried A, Rupprecht T, Winkens A, Passon O, Steffen B, Klingsch WWF, Boltes M (2007) Capacity Estimation for Emergency Exits and Bottlenecks. Presented at the 11th International Fire Science and Engineering Conference Interflam 2007, Royal Holloway College, University of London, UK
Sime JD (1985) Movement toward the familiar: person and place affiliation in a fire entrapment setting. Environ. Behav. 17:697–724. doi:10.1177/0013916585176003
Thompson P, Marchant W (1995) Testing and application of the computer model ‘SIMULEX’. Fire Safety Journal 24(2):149–66
Acknowledgments
The authors wish to acknowledge Jason Averill, Thomas Cleary, Anthony Hamins, and Steve Gwynne for a comprehensive review of the tests presented in this paper.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ronchi, E., Kuligowski, E.D., Nilsson, D. et al. Assessing the Verification and Validation of Building Fire Evacuation Models. Fire Technol 52, 197–219 (2016). https://doi.org/10.1007/s10694-014-0432-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10694-014-0432-3