Abstract
This chapter is intended to provide guidance for egress model users regarding:
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
And therefore the model itself.
- 2.
In reality, every time a user configures a model s/he is effectively developing a new model; however, the distinction between model user and developer is maintained here for simplicity.
- 3.
Or establish that these questions have already been asked.
- 4.
Typically called agents.
- 5.
It should be noted in real-incidents some evacuees may not be exposed to fire effluent and therefore may be similarly reliant upon notification as are evacuees during an egress drill.
- 6.
Might be expanded to the more formal Delphi Method.
- 7.
Importance of independence within each sample – different runs, summary stat comparison.
- 8.
Statistical hypothesis tests mentioned above (e.g. chi-square and t-test) typically often employ a null hypothesis that make comparisons based on the assumption that the simulated and benchmark data sets are from the same population – the alternative hypothesis would then state that they are different in some way. As the simulation can only ever be a simplification of the real-world conditions, this null hypothesis is, by definition, false should real-world data be part of the comparison.
References
R. Lovreglio, E. Ronchi and D. Borri, “The Validation of Evacuation Simulation Models through the Analysis of Behavioural Uncertainty,” Reliability Engineering and System Safety, vol. 46, no. 37, pp. 166–174, 2014.
K. E. Boyce, T. J. Shields and W. H. Silcock, “Toward the Characterization of Building Occupancies for Fire Safety Engineering: Capabilites of Disabled People Moving Horizontally and on an Incline,” Fire Techology, vol. 35, no. 1, pp. 51–67, Feburary 1999.
E. R. Galea, M. Sauter, S. Deere and L. Filippidis, “Investigating the Impact of Culture on Evacuation Behavior - A Turkish Data-Set,” Fire Safety Science, pp. 709–722, 2011.
J. D. Averill, D. S. Mileti, R. D. Peacock, E. D. Kuligowski, N. Groner, G. Proulx, P. A. Reneke and H. E. Nelson, “Occupant Behavior, Egress, and Emergency Communication. Federal Building and Fire Safety Investigation of the World Trade Center Disaster,” National Institute of Standards and Technology, 2005.
S. M. V. Gwynne, “Optimizing Fire Alarm Notification for High Risk Groups: Notification Effectiveness for Large Groups,” prepared for The Fire Protection Research Foundation, Quincy, MA, 2007.
J. L. Bryan, “An Examination and Analysis of the Dynamics of the Human Behavior in the MGM Grand Hotel Fire,” National Fire Protection Assoication, Quincy, MA, 1983.
W. Grosshandler, N. Bryner, D. Madrzykowski and K. Kuntz, “Report of the Technical Investigation of the Station Nightclub Fire,” National Insititute of Standards and Technology, 2005.
E. D. Kuligowski, “Terror Defeated: Occupant Sensemaking, Decision-making and Protective Action in the 2001 World Trade Center Disaster,” University of Colorado at Boulder, Boulder, CO, 2011.
S. M. V. Gwynne, E. D. Kuligowski and D. Nilsson, “Representing Evacuation Behaviour in Engineering Terms,” Journal of Fire Protection Engineering, vol. 22, no. 2, pp. 133–150, 2012.
S. M. V. Gwynne and E. R. Rosenbaum, “Employing the Hydraulic Model in Assessing Emergency Movement,” in SFPE Handbook of Fire Protection Engineering, 5th edition, Chapter 59, Gaithersburg, Maryland: Society of Fire Protection Engineers, 2016, pp. 2115–2151.
G. Proulx, “Evacuation Time and Movement in Apartment Buildings,” Fire Safety Journal, vol. 24, no. 3, pp. 229–246, December 1994.
E. D. Kuligowski and S. M. V. Gwynne, “What a User Should Know When Selecting an Evacuation Model,” Fire Protection Engineering, no. 28, pp. 30–35, 2005.
The American Institute of Aeronautics and Astronautics, “AIAA Guide for the Verification and Validation of Computational Fluid Dynamics Simulations,” Reston, VA, 1998.
J. Lord, B. J. Meacham and A. Moore, “Guide for Evaluating the Predictive Capabilities of Computer Egress Models,” National Institute of Standards and Technology, Gaithersburg, MD, 2005.
G. K. Bharathy and B. G. Silverman, “Validating Agent Based Social Systems Models,” in 2010 Winter Simulation Conference, Baltimore, MD, 2010.
R. G. Sargent, “Verification and Validation of Simulation Models,” in Proceedings of the 2010 Winter Simulation Conference, Baltimore, MD, 2010.
R. G. Sargent, “A New Statistical Procedure for Validation of Simulation and Stochastic Models,” Syracuse University, Syracuse, NY, 2010.
R. G. Sargent, “Some Approaches and Paradigms for Verifying and Validating Simulation Models,” in Proceedings of the 2001 Winter Simulation Conference, 2001.
J. P. Kleijnen, “Theory and Methodology: Verification and Validation of Simulation Models,” European Journal of Operation Research, vol. 82, pp. 145–162, 1995.
M. D. Petty, “Calculating and Using Confidence Intervals for Model Validation,” in Proceedings of the Fall 2012 Simulation Interoperability Workshop, Orlando, FL, 2012.
W. J. White, A. Rassweiler, J. F. Samhouri, A. C. Stier and C. White, “Ecologists Should Not Use Statistical Significance Tests to Interpret Simulation Model Results,” Oikos, 2013.
M. D. Petty, “Advanced Topics in Calculating and Using Confidence Intervals for Model Validation,” in Proceedings of the Spring 2013 Simulation Interoperability Workshop, San Diego, CA, 2013.
M. D. Petty, “Verification, Validation, and Accreditation,” in Modeling and Simulation Fundamentals: Theoretical Underpinnings and Practical Domains, J. A. Sokolowski and C. M. Banks, Eds., Hoboken, NJ: John Wiley & Sons, Inc., 2010, pp. 325–372.
W. E. Baker and M. S. Taylor, “A Nonparametric Statistical Approach to the Validation of Computer Simulation Models,” US Army Ballistic Research Laboratory, Aberdeen Proving Ground, MD, 1985.
M. K. Dey, “Lessons Learned in the ICFMP Project for Verification and Validation of Computer Models for Nuclear Plant Fire Safety Analysis,” in Ninth International Conference on Performance-Based Codes and Fire Safety Design Methods, Hong Kong, 2012.
W. K. Mok and W. K. Chow, “"Verification and Validation" in Modeling Fire by Computational Fluid Dynamics,” International Journal on Architectural Science, vol. 5, no. 3, pp. 58–67, 2004.
G. Rein, E. Abecassis and R. Carvel, Eds., The Dalmarnock Fire Tests: Experiments and Modelling, University of Edinburgh: School of Engineering and Electronics, 2007.
C. Abecassis-Empis, P. Reszka, A. Cowlard, H. Biteau, S. Welch, G. Rein and J. L. Torero, “Characterization of Dalmarnock Fire Test One,” Experimental Thermal and Fluid Science, vol. 32, no. 7, pp. 1334–1343, 2008.
G. Rein, J. L. Torero, W. Jajn, J. Stern-Gottfried, N. L. Ryder, S. Desanghere, M. Làzaro, F. Mowrer, A. Coles, D. Joyeux, D. Alvear, J. A. Capote, A. Jowsey, C. Abecassis-Empis and P. Reszka, “Round-Robin Study of a Prior Modelling Predictions of The Dalmarnock Fire Test One,” Fire Safety Journal, vol. 44, no. 4, pp. 590–602, 2009.
E. Ronchi, E. D. Kuligowski, P. A. Reneke, R. D. Peacock and D. Nilsson, “The Process of Verification and Validation of Building Fire Evacuation Models,” National Institute of Standards and Technology, Gaithersburg, MD, 2013.
E. R. Galea, The Validation of Evacuation Models, CMS Press, 1997.
M. Kinsey, G. Walker, N. Swailes and N. Butterworth, “MassMotion: The Verification and Validation of MassMotion for Evacuation Modelling,” Arup, 2015.
International Maritime Organization, “Guidelines for Evacuation Analysis for New and Existing Passenger Ships,” London, U.K., 2007.
W. Radax and B. Rengs, “Prospects and Pitfalls of Statistical Testing: Insights from Replicating the Demographic Prisoner's Dilemma,” Journal of Artificial Societies and Social Simulation, vol. 13, no. 4, p. 1, 2010.
International Standards Organization, “Fire Safety Engineering - Assessment, Verification and Validation of Calculation Methods,” Geneva, Switzerland, 2008.
R. L. Best, “Tragedy in Kentucky,” Fire Journal, vol. 72, no. 1, pp. 41–44, 1978.
J. L. Bryan, “Human Behavior in the Westchase Hilton Hotel Fire,” Fire Journal, vol. 77, pp. 78–85, 1983.
J. Parke, S. M. V. Gwynne, E. R. Galea and P. Lawrence, “Validating the Building EXODUS Evacuation Model using Data from a Unannounced Trial Evacuation,” in Proceeding of the Second International Conference on Pedestrian and Evacuation Dynamics, University of Greenwich, U.K., 2003.
S. Schmidt and E. Galea, Behaviour - Security - Culture Human Behaviour in Emergencies and Disasters: A Cross-Cultural Investigation, Pabst Science Publishers, 2013, p. 256.
J. P. A. Loannidis, “Why Most Published Research Findings are False,” PLoS Medicine, vol. 2, no. 8, pp. 696–701, August 2005.
I. I. Sandra, “Model's Validation for Complex Real-Time Systems,” Department of Computer Science and Engineering, Västerås, Sweden, 2004.
E. R. Galea, L. Filippidis, S. Deere, R. Brown, I. Nicholls, Y. Hifi and N. Besnard, “The SAFEGUARD Validation Data-Set and Recommendations to IMO to Update MSC/Circ. 1238,” in Safeguard Passenger Evacuation Seminar, London, UK, 2012.
R. D. Peacock, P. A. Reneke, W. D. Davis and W. W. Jones, “Quantifying Fire Model Evaluation using Functional Analysis,” Fire Safety Journal, vol. 33, pp. 167–184, 1999.
E. R. Galea, S. Deere, R. Brown and L. Filippidis, “An Experimental Validation of an Evacuation Model using Data Sets Generated from Two Large Passenger Ships,” in Pedestrian and Evacuation Dynamics 2012, U. Weidmann, U. Kirsch and M. Schreckenberg, Eds., Springer International Publishing, 2013, pp. 109–123.
A. M. Law, “How to Build Valid and Credible Simulation Models,” in Proceedings of the 2009 Winder Simulation Conference, 2009.
D. A. Cook and J. A. Skinner, “How to Perform Credible Verification, Validation, and Accreditation for Modeling and Simulation,” The Journal of Defense Software Engineering, pp. 20–24, 2005.
Society of Fire Protection Engineers, Guidelines for Substantiating a Fire Model for a Given Application, Bethesda, Maryland, 2010.
M. Richiardi, R. Leombruni, N. Saam and M. Sonnessa, “A Common Protocol for Agent-Based Social Simulation,” Journal of Artificial Societies and Social Simulation, vol. 9, no. 1, January 2006.
R. J. Malak and C. J. Paredis, “Foundations of Validating Reusable Behavioral Models in Engineering Design Problems,” in Proceedings of the 2004 Winter Simulation Conference, 2004.
O. Balci, R. E. Nance, J. D. Arthur and W. F. Ormsby, “Expanding our Horizons in Verification, Validation and Accreditation Research and Practice,” in Winter Simulation Conference, Blacksburg, VA, 2002.
R. G. Sargent, “Some Subjective Validation Methods using Graphical Displays of Data,” in Proceedings of the 1996 Winter Simulation Conference, 1996.
R. G. Sargent, “A Tutorial on Verification and Validation of Simulation Models,” in Proceedings of the 1984 Winter Simulation Conference, 1984.
M. D. Petty, “Modeling and Validation Challenges for Complex Systems,” in The Proceedings of the Spring 2012 Simulation Interoperability Workshop, Orlando, FL, 2012.
G. Proulx, “Occupant Behavior and Evacuation during the Chicago Cook County Administration Building Fire,” Journal of Fire Protection Engineering, vol. 16, no. 4, pp. 283–309, 2006.
H. Jiang, S. M. V. Gwynne, E. Galea, P. Lawrence, F. Jia and I. H, “The Use of Evacuation Simulation, Fire Simulation and Experimental Fire Data in Forensic Fire Analysis,” in Second Conference on Pedestrian and Evacuation Dynamics, University of Greenwich, U.K., 2003.
D. A. Purser, “Fire Safety and Evacuation Implications from Behaviours and Hazard Development in Two Fatal Care Home Incidents,” Fire and Materials, vol. 39, no. 4, pp. 430–452, June 2015.
S. M. V. Gwynne and D. L. Boswell, “Pre-Evacuation Data Collected from a Mid-Rise Evacuation Exercise,” Journal of Fire Protection Engineering, vol. 19, no. 1, pp. 5–29, 2009.
G. Proulx, “Lessons Learned On Occupants' Movement Times and Behaviour During Evacuation Drills,” in Proceedings from the Seventh International Interflam Conference, London, U.K., 1996.
J. A. Kopec, P. Finès, D. G. Manuel, D. L. Buckeridge, W. M. Flanagan, J. Oderkirk, M. Abrahamowicz, S. Harper, B. Sharif, A. Okhmatovskaia, E. C. Sayre, M. M. Rahman and M. C. Wolfson, “Validation of Population-Based Disease Simulation Models: A Review of Concepts and Methods,” BMC Public Health, 2010.
A. H. Feinstein and H. M. Cannon, “Fidelity, Verifiability, and Validity of Simulation: Constructs for Evaluation,” Developments in Business Simulation and Experiential Learning, vol. 28, pp. 57–67, 2001.
E. McCrum-Gardner, “Which is the Correct Statistical Test to Use?,” British Journal of Oral and Maxillofacial Surgery, vol. 46, no. 1, pp. 38–41, 2008.
O. Balci and R. G. Sargent, “A Methodology for Cost-risk Analysis in the Statistical Validation of Simulation Models,” Communications of the ACM, vol. 24, no. 4, pp. 190–197, 1 April 1981.
W. Jahn, G. Rein and J. L. Torero, “The Effect of Model Parameters on the Simulation of Fire Dynamics,” Fire Safety Science, vol. 9, pp. 1341–1352, 2008.
Author information
Authors and Affiliations
Consortia
Rights and permissions
Copyright information
© 2019 Society of Fire Protection Engineers
About this chapter
Cite this chapter
Society of Fire Protection Engineers. (2019). Egress Model Testing. In: SFPE Guide to Human Behavior in Fire. Springer, Cham. https://doi.org/10.1007/978-3-319-94697-9_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-94697-9_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-94696-2
Online ISBN: 978-3-319-94697-9
eBook Packages: EngineeringEngineering (R0)