Abstract
Determining if military or civilian personnel are cognitively ready to perform their jobs poses a considerable challenge to the research community both in terms of understanding what is meant by being cognitively ready and in terms of developing methods to actually assess it. Accordingly, as part of a government-sponsored research program, we set out to gain a better understanding of what is meant by being “cognitively ready” for military medical combat teams as well as develop a tool for assessing 12 essential factors underlying cognitive readiness. In this chapter, we present the theoretical foundation that guided our research project, highlighting the multidimensional nature of the cognitive readiness construct and focusing more specifically on one important element of cognitive readiness, namely situation awareness. We then describe our approach to assessing cognitive readiness as well as offer recommendations for how to incorporate measures of situation awareness into cognitive readiness assessment. We conclude with implications for future research and development.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice-Hall.
Blandford, A., & Wong, W. (2004). Situation awareness in emergency medical dispatch. International Journal of Human Computer Studies, 61, 421–452.
Bolstad, C. A., Babbitt, B. A., & Semple, C. A. (2004). Predicting cognitive performance of deploying health teams (Final Report prepared for the U.S. Army Medical Research and Material Command, under Contract No. W91XWH-C-004). Marietta, GA: SA Technologies.
Bolstad, C. A., Cuevas, H. M., Babbitt, B. A., Semple, C. A., & Vestewig, R. E. (2006). Predicting cognitive readiness of military health teams. In Proceedings of the International Ergonomics Association 16th World Congress on Ergonomics [CD-ROM], Maastricht, The Netherlands, July 10–14, 2006. Amsterdam: Elsevier.
Bolstad, C. A., Cuevas, H. M., Costello, A., Babbitt, B. A., Semple, C. A., & Vestewig, R. E. (2007). Final report for SBIR Phase II: Predicting cognitive performance of deploying health teams (Technical Report for the Office of the Secretary of Defense (OSD), prepared under Contract No. W81XWH-04-C-0014). Marietta, GA: SA Technologies.
Bolstad, C. A., Cuevas, H. M., Costello, A. M., & Babbitt, B. A. (2008). Predicting cognitive readiness of deploying military medical teams. In Proceedings of the Human Factors and Ergonomics Society 52nd Annual Meeting (pp. 970–974). Santa Monica, CA: Human Factors and Ergonomics Society.
Bowman, E. K., & Thomas, J. A. (2008). C2 of unmanned systems in distributed ISR operations. In Proceedings of the 13th International Command and Control Research and Technology Symposia (ICCRTS 2008), June 17–19, 2008, Seattle, WA.
Cammann, C., Fichman, M., Jenkins, G. D., & Klesh, J. R. (1983). Assessing the attitudes and perceptions of organization members. In S. E. Seashore, E. E. Lawler III, P. H. Mirvis, & C. Cammann (Eds.), Assessing organizational change: A guide to methods, measures, and practices (pp. 71–138). New York: Wiley.
Cannon-Bowers, J. A., Burns, J. J., Salas, E., & Pruitt, J. S. (1998). Advanced technology in scenario based training. In J. A. Cannon-Bowers & E. Salas (Eds.), Making decisions under stress: Implications for individual and team training (pp. 365–374). Washington, DC: American Psychological Association.
Cannon-Bowers, J. A., Tannenbaum, S. I., Salas, E., & Volpe, C. E. (1995). Defining competencies and establishing team training requirements. In R. A. Guzzo & E. Salas (Eds.), Team effectiveness and decision making in organizations (pp. 333–380). San Francisco, CA: Jossey-Bass.
Connors, E. S., Endsley, M. R., & Jones, L. (2007). Situation awareness in the power transmission and distribution industry. In Proceedings of the Human Factors and Ergonomics Society 51st Annual Meeting (pp. 215–219). Santa Monica, CA: Human Factors and Ergonomics Society.
Cornelius, E. T. (2009). Leadership styles for dealing with people. Part 1: Identifying your personal style in dealing with others. Cornelius and Associates. Retrieved March 18, 2011, from http://www.corneliusassoc.com/library.html
Endsley, M. R. (1995a). Measurement of situation awareness in dynamic systems. Human Factors, 37(1), 65–84.
Endsley, M. R. (1995b). Toward a theory of situation awareness in dynamic systems. Human Factors, 37(1), 32–64.
Endsley, M. R. (1997). The role of situation awareness in naturalistic decision making. In C. E. Zsambok & G. Klein (Eds.), Naturalistic decision making (pp. 269–283). Mahwah, NJ: Lawrence Erlbaum.
Endsley, M. R. (2006). Expertise and situation awareness. In K. A. Ericsson, N. Charness, R. R. Hoffman, & P. J. Feltovich (Eds.), The Cambridge handbook of expertise and expert performance (pp. 633–651). New York, NY: Cambridge University Press.
Endsley, M. R. (2009). Situation awareness in aviation. In J. A. Wise, V. D. Hopkin, & D. J. Garland (Eds.), Handbook of aviation human factors (2nd ed., pp. 12-1–12-21). Boca Raton, FL: CRC Press—Taylor & Francis.
Endsley, M. R., & Bolstad, C. A. (1994). Individual differences in pilot situation awareness. The International Journal of Aviation Psychology, 4(3), 241–264.
Endsley, M. R., & Garland, D. J. (Eds.). (2000). Situation awareness analysis and measurement. Mahwah, NJ: Lawrence Erlbaum Associates.
Feltovich, P. J., Prietula, M. J., & Ericsson, K. A. (2006). Studies of expertise from psychological perspectives. In K. A. Ericsson, N. Charness, R. R. Hoffman, & P. J. Feltovich (Eds.), The Cambridge handbook of expertise and expert performance (pp. 41–67). New York, NY: Cambridge University Press.
Fiore, S. M., Salas, E., Cuevas, H. M., & Bowers, C. A. (2003). Distributed coordination space: Toward a theory of distributed team process and performance. Theoretical Issues in Ergonomics Science, 4, 340–363.
Flin, R., & O’Connor, P. (2001). Applying crew resource management in offshore oil platforms. In E. Salas, C. A. Bowers, & E. Edens (Eds.), Improving teamwork in organization: Applications of resource management training (pp. 217–233). Mahwah, NJ: Erlbaum.
Fracker, M. L. (1991a). Measures of situation awareness: An experimental evaluation (Report No. AL-TR-1991-0127). Wright-Patterson Air Force Base, OH: Armstrong Laboratories.
Fracker, M. L. (1991b). Measures of situation awareness: Review and future directions (Report No. AL-TR-1991-0128). Wright-Patterson Air Force Base, OH: Armstrong Laboratories.
Garrett, S. K., & Caldwell, B. S. (2009). Human factors aspects of planning and response to pandemic events. In Proceedings of the 2009 Industrial Engineering Research Conference, May 30–June 3, 2009, Miami, FL.
Glaser, R. (1989). Expertise and learning: How do we think about instructional processes now that we have discovered knowledge structures? In D. Klahr & K. Kotovsky (Eds.), Complex information processing: The impact of Herbert A. Simon (pp. 269–282). Hillsdale, NJ: Erlbaum.
Golightly, D., Wilson, J. R., Lowe, E., & Sharples, S. (2010). The role of situation awareness for understanding signalling and control in rail operations. Theoretical Issues in Ergonomics Science, 11(1), 84–98.
Gorman, J. C., Cooke, N. J., & Winner, J. L. (2006). Measuring team situation awareness in decentralized command and control environments. Ergonomics, 49(12–13), 1312–1325.
Graham, S. E., & Matthews, M. D. (2000). Modeling and measuring situation awareness. In J. H. Hiller & R. L. Wampler (Eds.), Workshop on assessing and measuring training performance effectiveness (Tech. Rep. 1116) (pp. 14–24). Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences.
Guerlain, S., O’Hargan, K., Lander, E., Gibson, W., Chang, J., Donohue, S., et al. (2004). Predicting the cognitive readiness of Army search and rescue teams. In Proceedings of the International Conference on Systems, Man and Cybernetics (IEEE SMC 2004), October 10–13, 2004, The Hague, Netherlands.
Gugerty, L., Brooks, J. O., & Treadaway, C. A. (2004). Individual differences in situation awareness for transportation tasks. In S. Banbury & S. Tremblay (Eds.), A cognitive approach to situation awareness: Theory and application (pp. 193–212). Aldershot, England: Ashgate.
Gugerty, L., & Tirre, W. (1997). Situation awareness: A validation study and investigation of individual differences. In Proceedings of the Human Factors and Ergonomics Society 40th Annual Meeting (pp. 544–568). Santa Monica, CA: Human Factors and Ergonomics Society.
Hartel, C. E. J., Smith, K., & Prince, C. (1991, April). Defining aircrew coordination: Searching mishaps for meaning. Paper presented at the 6th International Symposium on Aviation Psychology, Columbus, OH.
Heppner, P. P. (1988). The Problem Solving Inventory (PSI): Manual. Palo Alto, CA: Consulting Psychologists Press.
Jones, D. G., & Endsley, M. R. (2000). Examining the validity of real-time probes as a metric of situation awareness. In Proceedings of the International Ergonomics Association 14th World Congress on Ergonomics and the Human Factors and Ergonomics Society 44th Annual Meeting. Santa Monica, CA: Human Factors and Ergonomics Society.
Kauses, J. M., & Posner, B. Z. (2001). Leadership practices inventory. San Francisco, CA: Jossey-Bass/Pfeiffer.
Kelley, C., & Meyers, J. (1995). The Cross-Cultural Adaptability Inventory (manual). Minneapolis, MN: National Computer Systems.
Merket, D. C., Bergondy, M., & Cuevas-Mesa, H. (1997, March). Making sense out of teamwork errors in complex environments. Paper presented at the 18th Annual Industrial/Organizational-Organizational Behavior Graduate Student Conference, Roanoke, VA.
Morrison, J. E., & Fletcher, J. D. (2002). Cognitive readiness (IDA Paper P-3735). Alexandria, VA: Institute for Defense Analyses.
Mullen, B., & Copper, C. (1994). The relation between group cohesiveness and performance: An integration. Psychological Bulletin, 115, 210–227.
Nullmeyer, R. T., Stella, D., Montijo, G. A., & Harden, S. W. (2005). Human factors in Air Force flight mishaps: Implications for change. In Proceedings of the 27th Annual Interservice/Industry Training, Simulation, and Education Conference (paper no. 2260). Arlington, VA: National Training Systems Association.
O’Neil, H. F., Jr., & Abedi, J. (1996). Reliability and validity of a State Metacognitive Inventory: Potential for alternative assessment. The Journal of Educational Research, 89(4), 234–245.
Pethe, S. (2002). Collective efficacy: Development of a measure. Decision, 29(1), 25–35.
Rosen, M. A., Salas, E., Wilson, K. A., King, H. B., Salisbury, M., Augenstein, J. S., et al. (2008). Measuring team performance in simulation-based training: Adopting best practices for healthcare. Simulation in Healthcare, 3(1), 33–41.
Roth, E. M., Multer, J., & Raslear, T. (2006). Shared situation awareness as a contributor to high reliability performance in railroad operations. Organization Studies, 27(7), 967–987.
Salas, E., & Cannon-Bowers, J. A. (2000). The anatomy of team training. In S. Tobias & J. D. Fletcher (Eds.), Training and retraining: A handbook for business, industry, government, and the military (pp. 312–335). New York, NY: Macmillan.
Salmon, P., Stanton, N., Walker, G., & Green, D. (2006). Situation awareness measurement: A review of applicability for C4I environments. Applied Ergonomics, 37(2), 225–238.
Salmon, P. M., Stanton, N. A., Walker, G. H., Jenkins, D. P., Baber, C., & McMaster, R. (2008). Representing situation awareness in collaborative systems: A case study in the energy distribution domain. Ergonomics, 51(3), 367–384.
Serfaty D., MacMillan J., Entin, E. E., & Entin E. B. (1997). The decision-making expertise of battle commanders. In C. E. Zsambok and G. Klein (Eds.), Naturalistic decision-making (pp. 233–246). New York: Lawrence Erlbaum.
Schmorrow, D., Cohn, J., & Nicholson, D. (Eds.). (2009). The PSI handbook of virtual environments for training and education: Developments for the military and beyond. Westport, CT: Praeger Security International.
Smith, E. M., Ford, J. K., & Kozlowski, S. W. J. (1997). Building adaptive expertise: Implications for training design strategies. In M. A. Quinones & A. Ehrenstein (Eds.), Training for a rapidly changing workplace: Applications of psychological research (pp. 89–118). Washington, DC: American Psychological Association.
Sohn, Y. W., & Doane, S. M. (2004). Memory processes of flight situation awareness: Interactive roles of working memory capacity, long-term working memory, and expertise. Human Factors, 46(3), 461–475.
Stanton, N. A., Chambers, P. R. G., & Piggott, J. (2001). Situational awareness and safety. Safety Science, 39, 189–204.
Stevens, M. J., & Campion, M. A. (1994). The knowledge, skill, and ability requirements for teamwork: Implications for human resource management. Journal of Management, 20(2), 503–530.
Strater, L. D., Endsley, M. R., Pleban, R. J., & Matthews, M. D. (2001). Measures of platoon leader situation awareness in virtual decision making exercises (Research Report No. 1770). Alexandria, VA: Army Research Institute.
Vincenzi, D. A., Wise, J. A., Mouloua, M., & Hancock, P. A. (Eds.). (2008). Human factors in simulation and training. Boca Raton, FL: CRC Press.
Voith, M. R. (2001). Military readiness. The Army Doctrine and Training Bulletin, 4(2), 41–48.
Wright, M. C., Taekman, J. M., & Endsley, M. R. (2004). Objective measures of situation awareness in a simulated medical environment. Quality & Safety in Health Care, 13(Suppl 1), i65–i71.
Acknowledgements
Work on the research reported in this chapter was partially supported by a Phase I and Phase II Small Business Innovative Research Contract (W81XWH-04-C-0014) awarded to the first author from the Office of the Secretary of Defense (OSD). The views and conclusions contained herein, however, are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the OSD, U.S. Army, Department of Defense, U.S. Government, or the organizations with which the authors are affiliated. We wish to express special thanks to Anthony M. Costello, Bettina Babbitt, Clarence Semple, and Richard Vestewig for their vital contributions to this project. Portions of this chapter were presented at: the International Ergonomics Association 16th World Congress on Ergonomics, Maastricht, The Netherlands; the Human Factors and Ergonomics Society 52nd Annual Meeting, New York, NY; and the 2009 Teaching and Measuring Cognitive Readiness Workshop, Los Angeles, CA, which was partially supported by a grant from the Office of Naval Research (ONR), Award Number N000140810126; however, the findings and opinions expressed here do not necessarily reflect the positions or policies of the ONR.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer Science+Business Media New York
About this chapter
Cite this chapter
Bolstad, C.A., Endsley, M.R., Cuevas, H.M. (2014). A Theoretically Based Approach to Cognitive Readiness and Situation Awareness Assessment. In: O'Neil, H., Perez, R., Baker, E. (eds) Teaching and Measuring Cognitive Readiness. Springer, Boston, MA. https://doi.org/10.1007/978-1-4614-7579-8_9
Download citation
DOI: https://doi.org/10.1007/978-1-4614-7579-8_9
Published:
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4614-7578-1
Online ISBN: 978-1-4614-7579-8
eBook Packages: Humanities, Social Sciences and LawEducation (R0)