Advertisement

Assessing Operational Preparedness in Incident Commanders

  • Sophie WardEmail author
  • Gail Steptoe-Warren
  • Thomas Rhys Evans
Chapter

Abstract

This chapter focuses on operational preparedness in incident commanders, and in particular, the assessment of such within tactical incident commanders within a Fire Service in the United Kingdom. This chapter provides an overview of some of the recent incidents within the Fire Service which have raised concerns over the Operational Preparedness of incident commanders, such as Atherstone on Stour in 2007, as well as a theoretical framework of Operational Preparedness developed in relation to the Fire Service, focusing in detail on the five theoretical constructs of trust, information gathering, skills, experience and incident learning. The contrast between analytical and intuitive decision making in the context of the Fire Service practice is explored. Recent research undertaken by the authors surround the initial development and validation of a situational judgement test to assess whether tactical incident commanders within a Fire Service are operationally prepared to deal with unusual and complex incidents. The methodology, results, conclusions, as well as recommendations for future development of the situational judgement test and implications for practice are presented. This chapter then concludes by looking at future development and validation opportunities.

References

  1. APS Group Scotland. (2012). A report to Scottish Ministers: The 2008 Galston Mine incident [online]. Available from http://www.gov.scot/Resource/0039/00390756.pdf [2 February 2015].
  2. Ash, J. S., & Smallman, C. (2010). A case study of decision-making in emergencies. Risk Management, 12(3), 185–207.CrossRefGoogle Scholar
  3. Ben-Nun, P. (2008). Respondent fatigue. In P. J. Lavrakas (Eds.), Encyclopedia of survey research methods (pp. 743–744). Thousand Oaks, CA: Sage.Google Scholar
  4. Bergman, M. E., Drasgow, F., Donovan, M. A., Henning, J. B., & Juraska, S. E. (2006). Scoring situational judgment tests: Once you get the data, your troubles begin. International Journal of Selection and Assessment, 14(3), 223–235.CrossRefGoogle Scholar
  5. Brisard, J. C. (2015). The Paris attacks and the evolving Islamic state threat to France. CTC Sentinel [online], 8(11), 5–8. Available from https://ctc.usma.edu/app/uploads/2015/12/CTCSentinel-Vol8Iss113.pdf [21 June 2018].
  6. British Psychological Society. (2009). Code of ethics and conduct [online]. Available from http://www.bps.org.uk/sites/default/files/documents/code_of_ethics_and_conduct.pdf [31 January 2014].
  7. Bryman, A. (2006). Integrating quantitative and qualitative research: How is it done? Qualitative Research [online], 6, 97–113. Available from http://www.sagepub.com/bjohnsonstudy/articles/Bryman.pdf [8 February 2015].
  8. Bureau of Counterterrorism. (2016). Country reports on terrorism 2016 [online]. Available from https://www.state.gov/documents/organization/272488.pdf [23 July 2018].
  9. CFRA. (2012). Fire and rescue service: Operational guidance incidents involving hazardous materials. Norwich: TSO Information and Publishing.Google Scholar
  10. Chamorro-Premuzic, T., & Furnham, A. (2010). The psychology of personnel selection. New York: Cambridge University Press.CrossRefGoogle Scholar
  11. Cheung, M. W. L., & Chan, W. (2002). Reducing uniform response bias with ipsative measurement in multiple-group confirmatory factor analysis. Structural Equation Modeling: A Multidisciplinary Journal, 9(1), 55–77.CrossRefGoogle Scholar
  12. Christian, M. S., Edwards, B. D., & Bradley, J. C. (2010). Situational judgement tests: Constructs assessed and a meta-analysis of their criterion-related validates. Personnel Psychology [online], 63, 83–117. Available from https://www.researchgate.net/profile/Michael_Christian4/publication/229890585_SITUATIONAL_JUDGMENT_TESTS_CONSTRUCTS_ASSESSED_AND_A_METAANALYSIS_OF_THEIR_CRITERIONRELATED_VALIDITIES/links/0c9605350a3356fc0d000000.pdf [10 August 2015].
  13. Clevenger, J., Pereira, G. M., Wiechmann, D., Schmitt, N., & Harvey, V. S. (2001). Incremental validity of situational judgement tests. Journal of Applied Psychology [online], 86(3), 410–417. Available from http://web.a.ebscohost.com/ehost/pdfviewer/pdfviewer?sid=3ca072b3-051b-4cd7-93d4-9a3dcb87e308%40sessionmgr4002&vid=0&hid=4201 [8 August 2015].
  14. Cohen-Hatton, S. R., Butler, P. C., & Honey, R. C. (2015). An investigation of operational decision-making in situ: Incident command in the U.K. fire and rescue service. Human Factors, 57(5), 793–804.CrossRefGoogle Scholar
  15. Coolican, H. (2009). Research methods and statistics in psychology (5th ed.). London: Hodder Education.Google Scholar
  16. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.CrossRefGoogle Scholar
  17. CTIF. (2017). World fire statistics report (Vol. 22) [online]. Available from https://www.ctif.org/sites/default/files/ctif_report22_world_fire_statistics_2017.pdf.
  18. Cutler, A. (2014). Leadership psychology: How the best leaders inspire their people. London: Kogan Page Publishers.Google Scholar
  19. Duncker, K. (1945). On problem-solving. In J. F. Dashiell (Ed.), Psychological monographs (pp. 1–114). Washington, DC: American Psychological Association.CrossRefGoogle Scholar
  20. Euronews. (2017). Over 30 dead’ as wildfires rage in Portugal and Spain [online]. http://www.euronews.com/2017/10/16/over-30-dead-as-wildfires-rage-in-portugal-and-spain [21 June 2018].
  21. Fahy, R. F., LeBlanc, P. R., & Molis, J. L. (2014). Firefighter fatalities in the United States—2013. National Fire Protection Association [online]. Available from https://www.nfpa.org/-/media/Files/News-and-Research/Fire-statistics/Fire-service/2014fff.ashx?as=1&iar=1&la=en&hash=2B34314EAAC4BD6529B8AF2933F00DC6FCB714E8 [13 October 2015].
  22. Fahy, R. F., LeBlanc, P. R., & Molis, J. L. (2017). Firefighter fatalities in the United States—2016. National Fire Protection Association [online]. Available from https://www.nfpa.org/-/media/Files/News-and-Research/Fire-statistics/Fire-service/2017FFF.ashx?la=en [21 June 2018].
  23. FBU. (2007). Fatal accident investigation: Summary report [online]. Available from http://www.highrisefire.co.uk/docs/FBU%20Warwickshire%20Report.pdf [31 January 2015].
  24. FBU. (2008) In the line of duty: Firefighter deaths in the UK since 1978 [online]. Available from http://www.fbu.org.uk/wp-content/uploads/2011/01/fbu_fatalities_report.pdf [2 February 2015].
  25. FBU. (2015). More fire fatalities if lessons not learned, Fire Brigades Union says [online]. Available from http://www.fbu.org.uk/news/2015/04/more-fire-fatalities-if-lessons-not-learned-fire-brigades-union-says/ [5 August 2015].
  26. Field, A. (2013). Discovering statistics using IBM SPSS statistics (4th ed.). London: Sage.Google Scholar
  27. FitzGerald, K., Searle, S. N., Kerins, C. A., & McElvaney, R. (2008). The critical incident technique: A useful tool for conducting qualitative research. Journal of Dental Education [online], 72(3), 299–304. Available from http://www.jdentaled.org/content/72/3/299.full [10 September 2015].
  28. Fitzpatrick, J. J., & Kazer, M. (2011). Encyclopedia of nursing research (3rd ed.). New York: Springer.Google Scholar
  29. Flanagan, J. C. (1954). The critical incident technique. Psychological Bulletin, 51(4), 327–358.CrossRefGoogle Scholar
  30. Fredholm, L. (1997). Decision-making patterns in major fire-fighting and rescue operations. In R. H. Flin, E. Salas, M. Stub, & L. Martin (Eds.), Decision-making under stress: Emerging themes and applications (pp. 107–115). England: Ashgate.Google Scholar
  31. Gatewood, R., Field, H., & Barrick, M. (2011). Human resource selection (7th ed.). South-Western: Cengage Learning.Google Scholar
  32. Gigerenzer, G., & Gaissmaier, W. (2011). Heuristic decision-making. The Annual Review of Psychology, 62, 451–482.CrossRefGoogle Scholar
  33. GOV.UK. (2017). Grenfell Tower: Information relating to the fire at Grenfell Tower [online]. Available from https://www.gov.uk/government/collections/grenfell-tower [21 June 2018].
  34. Greene, J. C., Caracelli, V. J., & Graham, W. F. (1989). Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 11(3), 255–274. Available from http://epa.sagepub.com/content/11/3/255.short?rss=1&ssource=mfc [1 February 2015].
  35. Health and Care Professions Council. (2012). Standards of conduct, performance and ethics [online]. Available from http://www.hcpc-uk.org.uk/assets/documents/10003B6EStandardsofconduct,performanceandethics.pdf [9 November 2014].
  36. Health and Safety Executive [HSE]. (2010). Striking the balance between operational and health and safety duties in the fire and rescue service [online]. Available from http://www.hse.gov.uk/services/fire/duties.pdf [19 August 2015].
  37. HM Government. (2008). Fire service operations: Incident command. In Fire and rescue manual (Vol. 2) [online]. Available from https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/7643/incidentcommand.pdf [10 July 2015].
  38. Home Office. (2016a). Fire and rescue authorities: Operational statistics bulletin for England 2015 to 2016 [online]. Available from https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/563118/fire-rescue-operational-statistics-201516-hosb1216.pdf [23 July 2018].
  39. Home Office. (2016b). Fire statistics data tables: FIRE0102: Incidents attended by fire and rescue services [online]. Available from https://www.gov.uk/government/statistical-data-sets/fire-statistics-data-tables#incidents-attended [23 July 2018].
  40. Husbands, A., Rodgerson, M. J., Dowell, J., & Patterson, F. (2015). Evaluating the validity of an integrity-based situational judgement test for medical school admissions. BMC Medical Education [online]. Available from http://www.biomedcentral.com/content/pdf/s12909-015-0424-0.pdf [25 September 2015].
  41. International Test Commission [ITC]. (2005). ITC guidelines on computer-based and internet delivered testing [online]. Available from http://www.intestcom.org/files/guideline_computer_based_testing.pdf [15 April 2015].
  42. Klein, G. A. (1993). A recognition-primed decision (RPD) model of rapid decision-making. In G. A. Klein, J. Orasanu, R. Calderwood, & C. E. Zsambok (Eds.), Decision-making in action: Models and methods (pp. 138–147). Westport, CT, US: Ablex Publishing. Google Scholar
  43. Kline, P. (1999). The handbook of psychological testing (2nd ed.). London: Routledge.Google Scholar
  44. Koch, A., Strobel, A., Kici, G., & Westhoff, K. (2009). Quality of the critical incident technique in practice: Interrater reliability and users’ acceptance under real conditions. Psychology Science Quarterly [online], 51(1), 3–15. Available from http://p16277.typo3server.info/fileadmin/download/PschologyScience/1-2009/01_Koch.pdf [10 February 2015].
  45. Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology [online], 28(4), 563–575. Available from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.460.9380&rep=rep1&type=pdf [10 May 2015].
  46. Lievens, F., & Coetsier, P. (2002). Situational tests in student selection: An examination of predictive validity, adverse impact, and construct validity. International Journal of Selection and Assessment, 10(4), 245–257.CrossRefGoogle Scholar
  47. Lievens, F., Buyse, T., & Sackett, P. R. (2005). The operational validity of a video-based situational judgment test for medical college admissions: Illustrating the importance of matching predictor and criterion construct domains. Journal of Applied Psychology [online], 90(3), 442–452. Available from http://users.ugent.be/~flievens/sjt.pdf [31 August 2015].
  48. Lievens, F., Peeters, H., & Schollaert, E. (2008). Situational judgement tests: A review of recent research. Personnel Review, 37(4), 426–441.CrossRefGoogle Scholar
  49. Lindorff, M. (2007). The ethical impact of business and organisational research: The forgotten methodological issue? The Electronic Journal of Business Research Methods [online], 5(1), 21–28. Available from www.ejbrm.com/issue/download.html?idArticle=168 [10 September 2015].
  50. Lipshitz, R., & Bar-Ilan, O. (1996). How problems are solved: Reconsidering the phase theorem. Organisational Behaviour and Human Decision Processes [online], 65(1), 48–60. Available from http://ac.els-cdn.com/S0749597896900047/1-s2.0-S0749597896900047-main.pdf?_tid=46a4ce8c-54bf-11e5-ae28-00000aab0f26&acdnat=1441561800_f10b273fb8f897be1e4e9078d43f6c34 [10 August 2015].
  51. Lissitz, R. W., & Jiao, H. (2012). Computers and their impact on state assessments: Recent history and predictions for the future. Charlotte, NC: Information Age Publishing, Inc. Google Scholar
  52. McDaniel, M. A., Morgeson, F. P., Finnegan, E. B., Campion, M. A., & Braverman, E. P. (2001). Use of situational judgment tests to predict job performance: A clarification of the literature. Journal of Applied Psychology [online], 86(4), 730–740. Available from http://www.krannert.purdue.edu/faculty/campionm/Situational_Judgement_Tests.pdf [1 September 2015].
  53. McDaniel, M. A., & Nguyen, N. T. (2001). Situational judgement tests: A review of practice and constructs assessed. International Journal of Selection and Assessment, 9(1–2), 103–113.Google Scholar
  54. Meachin, J. (2015). Scoring situational judgement tests: Evolving approaches. OP Matters, 7(1), 2–5.Google Scholar
  55. Mishra, J. L., Allen, D. K., & Pearman, A. D. (2013). Information use, support and decision-making in complex, uncertain environments. Proceedings of the American Society for Information Science and Technology [online], 50(1), 1–10. Available from http://onlinelibrary.wiley.com/doi/10.1002/meet.14505001045/abstract [10 February 2015].
  56. Mishra, J. L., Allen, D. K., & Pearman, A. D. (2015). Understanding decision-making during emergencies: A key contributor to resilience. EURO Journal on Decision Processes, 3(3), 397–424.Google Scholar
  57. Motowildo, S., Dunnette, M. D., & Carter, G. W. (1990). An alternative selection procedure: The low-fidelity simulation. Journal of Applied Psychology, 75(6), 640–647.CrossRefGoogle Scholar
  58. Motowildo, S. J., Borman, W. C., & Schmit, M. J. (1997). A theory of individual differences in task and contextual performance. Human Performance, 10(2), 71–83.CrossRefGoogle Scholar
  59. Mumford, S. (2015) The situational judgement test: Cognition, constructs and criterion validity. Unpublished Ph.D. thesis, University of Sheffield, Sheffield.Google Scholar
  60. National Operational guidance Programme. (2015). The foundation for incident command [online]. Available from http://www.ukfrs.com/Pages/Guidance-Catalogue.aspx?guidanceid=121 [1 August 2015].
  61. Nemeth, C. J. (2012). The psychological basis of quality decision-making. In M. Augier & D. J. Teece (Eds.), The Palgrave encyclopaedia of strategic management. Basingstoke, UK: Palgrave Macmillan.Google Scholar
  62. Nielsen, J., Clemmensen, T., & Yssing, C. (2002). Getting access to what goes on in people’s heads?—Reflections on the think-aloud technique. Proceedings of the Second Nordic Conference on Human-Computer Interaction [online], 101–110. Available from http://ammonwiemers.com/IdetPortfolio/articles/Assessment/Getting%20Access%20to%20What%20Goes%20on%20in%20peoples%20heads%20–%20Reflections%20on%20the%20Think-aloud%20Technique.pdf [1 August 2015].
  63. Nunnally, J. C. (1978). Psychometric theory. New York: McGraw-Hill.Google Scholar
  64. Owen, C. (2014). Human factors challenges in emergency management: Enhancing individual and team performance in fire and emergency services. Surrey: Ashgate.Google Scholar
  65. Patterson, F., Ashworth, V., Zibarras, L., Coan P., Kerrin, M., & O’Neill, P. (2012). Evaluations of situational judgement tests to assess non-academic attributes in selection. Medical Education [online], 46(9), 850–868. Available from http://www.ncbi.nlm.nih.gov/pubmed/22891906 [8 February 2015].
  66. Peus, C., Braun, S., & Frey, D. (2013). Situational-based measurement of the full range of leadership model—Development and validation of a situational judgement test. The Leadership Quarterly, 24, 777–795.CrossRefGoogle Scholar
  67. Ployhart, R. E., Weekley, J. A., Holtz, B. C., & Kemp, C. (2003). Web-based and paper-and-pencil testing of applicants in a proctored setting: Are personality, biodata, and situational judgement tests comparable? Personnel Psychology, 56(3), 733–752.Google Scholar
  68. Robertson, I. T., & Kandola, R. S. (1982). Work sample tests: Validity, adverse impact and applicant reaction. Journal of Occupational Psychology, 55, 171–183.CrossRefGoogle Scholar
  69. Rosen, N. A. (1961). How Supervise?—1943–1960. Personnel Psychology, 14, 87–99.CrossRefGoogle Scholar
  70. Rosenthal, U., Boin, A., & Comfort, L. K. (2001). Managing crises: Threats, dilemmas, opportunities. Springfield, IL: Charles C Thomas.Google Scholar
  71. Rothmann, I., & Cooper, C. L. (2015). Work and organisational psychology (2nd ed.). East Sussex: Routledge.Google Scholar
  72. Schmitt, N. (2012). The Oxford handbook of personnel assessment and selection. Oxford: Oxford University Press.CrossRefGoogle Scholar
  73. Scott, J. C., & Reynolds, D. H. (2010). Handbook of workplace assessment: Evidence-based practices for selecting and developing organizational talent. San Francisco: Wiley.Google Scholar
  74. Sharma, S., Gangopadhyay, M., Austin, E., & Mandal, M. K. (2013). Development and validation of a situational judgment test of emotional intelligence. International Journal of Selection and Assessment, 21(1), 57–73.CrossRefGoogle Scholar
  75. Simpson, D. M. (2002). Earthquake drills and simulations in community-based training and preparedness programmes. Disasters, 26(1), 55–69.CrossRefGoogle Scholar
  76. Sina (2016) Tianjin Port explosion accident investigation report released [online]. Available from http://news.sina.com.cn/c/nd/2016-02-05/doc-ifxpfhzq2524615.shtml [21 June 2018].
  77. Stangor, C. (2014). Research methods for the behavioural sciences. Thousand Oaks, CA: Cengage Learning.Google Scholar
  78. Steptoe-Warren, G. (2010). The development of a situational judgment test to assess managers’ strategic decision-making competencies. Unpublished Ph.D. thesis, Coventry University, Coventry.Google Scholar
  79. Steptoe-Warren, G. (2013). Occupational psychology: An applied approach. Harlow: Pearson Education Limited.Google Scholar
  80. Steptoe-Warren, G., & Evans, T. (2014). Situational judgement test to assess operational preparedness in bronze commanders within West Midlands fire service. Unpublished measure. Coventry: Coventry University.Google Scholar
  81. Steptoe-Warren, G., & Grant, C. (2013). Assessment of operational preparedness in West Midlands fire service. Unpublished Report. Coventry: Coventry University.Google Scholar
  82. Todd, P. M., & Gigerenzer, G. (2011). Ecological rationality: Intelligence in the world. New York: Oxford University Press.Google Scholar
  83. Turnock, B. J. (2003). Roadmap for public health workforce preparedness. Journal of Public Health Management Practice, 9(6), 471–480.CrossRefGoogle Scholar
  84. Van Den Heuvel, C., Alison, L., & Crego, J. (2012). How uncertainty and accountability can derail strategic ‘save life’ decisions in counter-terrorism simulations: A descriptive model of choice deferral and omission bias. Journal of Behavioural Decision-Making [online], 25(2), 165–187. Available from http://web.b.ebscohost.com/ehost/pdfviewer/pdfviewer?sid=9d2bc054-739b-4b44-87e2-5b19a2f5bf65%40sessionmgr114&vid=0&hid=101 [10 August 2015].
  85. Van Den Heuvel, C., Alison, L., & Power, N. (2014). Coping with uncertainty: Police strategies for resilient decision-making and action implementation. Cognition Technology and Work [online], 16(1), 25–45. Available from https://www.researchgate.net/publication/257480359_Coping_with_uncertainty_police_strategies_for_resilient_decision-making_and_action_implementation [10 August 2015].
  86. Watterson, A. (2015). Firefighter fatalities at fires in the UK: 2004–2013: Voices from the fireground [online]. Available from http://www.fbu.org.uk/resources/firefighter-fatalities-fires-uk-2004-2013-voices-fireground/ [14 February 2015].
  87. Weekly, J. A., & Jones, C. (1997). Video-based situational testing. Personnel Psychology, 50(1), 25–49.CrossRefGoogle Scholar
  88. Weekley, J. A., & Ployhart, R. E. (2006). Situational judgement tests: Theory, measurement, and application. Mahwah, NJ, US: Lawrence Erlbaum Associates Publishers. Google Scholar
  89. Whetzel, D. L., & McDaniel, M. A. (2009). Situational judgment tests: An overview of current research. Human Resource Management Review, 19(3), 188–202.Google Scholar
  90. Wood, C. P., Giles, D., & Percy, C. (2009). Your psychology project handbook: Becoming a researcher. Harlow: Pearson Educated Limited.Google Scholar
  91. Wyatt, M. R. R., Pathak, S. B., & Zibarras, L. D. (2010). Advancing selection in an SME: Is best practice methodology applicable? International Small Business Journal [online], 28(3), 258–273. Available from https://kar.kent.ac.uk/29194/1/Wyatt,%20Pathak%20%26%20Zibarras,%202010.pdf [1 September 2015].

Copyright information

© The Author(s) 2019

Authors and Affiliations

  • Sophie Ward
    • 1
    Email author
  • Gail Steptoe-Warren
    • 1
  • Thomas Rhys Evans
    • 1
  1. 1.School of Psychological, Social and Behavioural SciencesCoventry UniversityCoventryUK

Personalised recommendations