Abstract
In this book there are multiple views of cognitive readiness. The purpose of this chapter is to review the various definitions of cognitive readiness. The construct of cognitive readiness will also be briefly compared and contrasted with twenty-first century skills. Cognitive readiness denotes the mental preparation for effective changes in response to altered or unpredictable situations in this fast-changing world. The key constructs in our model are knowledge, skills, and attributes. Knowledge includes domain-specific knowledge for developing cognitive readiness in specific content/process domains as well as prerequisite skills. There are five skills—adaptability, adaptive problem solving, communication, decision making, and situation awareness—and four attributes, i.e., adaptive expertise, creative thinking, metacognition, and teamwork. This chapter will also offer the reader a window into the recent literature regarding these constructs. Several training strategies are proposed to teach cognitive readiness, as well as several strategies to assess cognitive readiness. A feasibility study is presented to show how we investigated the goal of teaching and assessing selected cognitive readiness skills in the context of a Navy simulation. The chapter closes with implications for future research.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abedi, J. (2002). A latent-variable modeling approach to assessing reliability and validity of a creativity instrument. Journal of Creativity, 14(2), 267–276.
Abrami, P. C., Bernard, R. M., Borokhovski, E., Wade, A., Surkes, M. A., Tamim, R., et al. (2008). Instructional interventions affecting critical thinking skills and dispositions: A stage 1 meta-analysis. Review of Educational Research, 78, 1102–1134.
Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., et al. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives. New York: Longman.
Andrews, D. H., Nullmeyer, R. T., Good, J., & Fitzgerald, P. C. (2008). Measurement of learning processes in pilot simulation. In E. Baker, J. Dickieson, W. Wulfeck, & H. F. O’Neil (Eds.), Assessment of problem solving using simulations (pp. 273–288). New York: Erlbaum.
Azevedo, R., Johnson, A., Chauncey, A., & Burkett, C. (2010). Self-regulated learning with MetaTutor: Advancing the science of learning with metacognitive tools. In M. S. Khine & I. M. Saleh (Eds.), New science of learning: Computers, cognition, and collaboration in education. New York: Springer.
Baker, E. L. (2008). Learning and assessment in an accountability context. In K. E. Ryan & L. A. Shepard (Eds.), The future of test-based educational accountability (pp. 277–291). New York: Routledge.
Baker, E. L. (2012). The chimera of validity. Paper prepared for the Educational Assessment, Accountability, and Equity: Conversations on Validity Around the World Conference, Teachers College, Columbia University, New York. Los Angeles: University of California, National Center for Research on Evaluation, Standards, and Student Testing (CRESST).
Baker, E. L., & Mayer, R. E. (1999). Computer-based assessment of problem solving. Computers in Human Behavior, 15, 269–282.
Baker, E. L., & O’Neil, H. F. (2003, February). Assessment of distance learning. Presentation at the ONR/NSF-sponsored workshop “Technology Assessment of Web-Based Learning,” Redondo Beach, CA.
Banks, D., Bader, P. K., Fleming, P. J., Zaccaro, S. J., & Barber, H. F. (2001, April). Leader adaptability: The role of work experiences and individual differences. Paper presented at the 16th Annual Conference of the Society for Industrial and Organizational Psychology, San Diego, CA.
Bell, B. S., & Kozlowski, S. W. J. (2002). Adaptive guidance: Enhancing self-regulation, knowledge, and performance in technology-based training. Personnel Psychology, 55, 267–306.
Bennis, W. G. (2003). On becoming a leader. New York: Basic Books.
Bolstad, C. A., Cuevas, H. M., Babbitt, B. A., Semple, C. A., & Vestewig, R. E. (2006). Predicting cognitive readiness of military health teams. Proceedings of the International Ergonomics Association 16th World Congress on Ergonomics [CD-ROM], Maastricht, The Netherlands. Amsterdam: Elsevier.
Bowers, C. A., Braun, C. C., & Morgan, B. B. (1997). Team workload: Its meaning and measurement. In M. T. Brannick, E. Salas, & C. Prince (Eds.), Team performance assessment and measurement: Theory, methods, and applications (pp. 85–108). Mahwah, NJ: Erlbaum.
Brooks, H., DeKeyser, T., Jaskot, D., Sibert, D., Sledd, R., Stilwell, W., et al. (2004). Using agent-based simulation to reduce collateral damage during military operations. In M. H. Jones, S. D. Patek, & B. E. Tawney (Eds.), Proceedings of the 2004 Systems and Information Engineering Design Symposium (pp. 71–77). Charlottesville: Department of Systems and Information Engineering, University of Virginia.
Carnevale, A. P., Jayasundera, T., & Cheah, B. (2012). The college advantage: Weathering the economic storm. Washington, DC: Center on Education and the Workforce, Georgetown Public Policy Institute, Georgetown University.
Cohen, M. S., Thompson, B. B., Adelman, L., Bresnick, T. A., Shastri, L., & Riedel, S. L. (2000). Training critical thinking for the battlefield: Volume I: Basis in cognitive theory and research. Cognitive Technologies Technical Report 00-2. Arlington, VA.
De Jong, T. (2011). Instruction based on computer simulations. In R. E. Mayer & P. A. Alexander (Eds.), Handbook of research on learning and instruction (pp. 446–466). New York: Routledge.
DoD Directive 5000.70, DoD Modeling and Simulation (M&S) Management. (2012).
Eldar, O., Eylon, B., & Romen, M. (2012). A metacognitive teaching strategy for preservice teachers: Collaborative diagnosis of conceptual understanding in science. In A. Zohar & J. Dori (Eds.), Metacognition in science education: Trends in current research (pp. 225–250). Berkeley, CA: Springer.
Endsley, M. R. (1988). Design and evaluation for situation awareness enhancement. In Proceedings of Human Factors Society 32nd Annual Meeting (pp. 97–101). Santa Monica, CA: Human Factors Society.
Endsley, M. R. (1995). Toward a theory of situation awareness in dynamic systems. Human Factors, 37, 32–64.
Endsley, M. R., & Garland, D. J. (Eds.). (2000). Situation awareness analysis and measurement. Mahwah, NJ: Erlbaum.
Etter, D. M., Foster, R. E., & Steele, T. P. (2000). Cognitive readiness and advanced distributed learning. Crosstalk: The Journal of Defense Software Engineering, 13, 5–6.
Finucane, M. L., & Lees, N. B. (2005). Decision-making competence of older adults: Models and methods. Paper presented at the National Research Council Workshop on Decision Making by Older Adults, Washington, DC.
Finucane, M. L., Mertz, C. K., Slovic, P., & Schmidt, E. S. (2005). Task complexity and older adults’ decision-making competence. Psychology and Aging, 20(1), 71–84.
Fletcher, J. D. (2004). Cognitive readiness: Preparing for the unexpected (IDA Document D-3061). Alexandria, VA: Institute for Defense Analyses.
Fletcher, J. D. (2009). Education and training technology in the military. Science, 323, 72–75.
Fonseca, B. A., & Chi, M. (2011). Instruction based on self-explanation. In R. E. Mayer & P. A. Alexander (Eds.), Handbook of research on learning and instruction (pp. 296–321). New York: Routledge.
Furtak, E. M., Seidel, T., Iverson, H., & Briggs, D. C. (2012). Experimental and quasi-experimental studies of inquiry-based science teaching: A meta-analysis. Review of Educational Research, 82(3), 300–329.
Goldberg, S. L. (2012). Psychology’s contribution to military training. In J. H. Laurence & M. D. Matthews (Eds.), The Oxford handbook of military psychology (pp. 241–261). New York: Oxford University Press.
Graesser, A. C., D’Mello, S., & Cade, W. (2011). Instruction based on tutoring. In R. E. Mayer & P. A. Alexander (Eds.), Handbook of research on learning and instruction (pp. 408–426). New York: Routledge.
Griffin, P., McGaw, B., & Care, E. (Eds.). (2012). Assessment and teaching of 21st century skills. Dordrecht, Netherlands: Springer.
Hatano, G., & Oura, Y. (2003). Commentary: Reconceptualizing school learning using insight from expertise research. Educational Researcher, 32(8), 26–29.
Hattie, J., & Gan, M. (2011). Instruction based on feedback. In R. E. Mayer & P. A. Alexander (Eds.), Handbook of research on learning and instruction. New York: Routledge.
Hong, E., & Milgram, R. M. (2008). Preventing talent loss. New York: Routledge.
Hong, E., O’Neil, H. F., & Feldon, D. (2005). Gender effects on mathematics achievement: Mediating role of state and trait self-regulation. In A. M. Gallagher & J. C. Kaufman (Eds.), Gender differences in mathematics (pp. 264–293). Cambridge: Cambridge University Press.
Ivancic, K., & Hesketh, B. (2000). Learning from errors in a driving simulation: Effects on driving skill and self-confidence. Ergonomics, 43, 1966–1984.
Jackson, J., Thoemmes, F., Jonkmann, K., Ludtke, O., & Trautwein, U. (2012). Military training and personality trait development: Does the military make the man, or does the man make the military? Psychological Science, 23(3), 270–277.
Johnson, W. L., Friedland, L., Watson, A. M., & Surface, E. A. (2012). The art and science of developing intercultural competence. In P. J. Durlach & A. M. Lesgold (Eds.), Adaptive technologies for training and education (pp. 261–286). New York: Cambridge.
Johnson, D. W., & Johnson, R. T. (2009). An educational psychology success story: Social interdependence theory and cooperative learning. Educational Researcher, 38, 365–379.
Jones, D. G., & Endsley, M. R. (2000). Overcoming representational errors in complex environments. Human Factors, 42, 367–378.
Keren, G., & Bruine de Bruin, W. (2003). On the assessment of decision quality: Considerations regarding utility, conflict, and accountability. In D. Hardma & L. Macchi (Eds.), Thinking: Psychological perspectives on reasoning, judgment, and decision making (pp. 347–363). New York: Wiley.
Kirkpatrick, D. L., & Kirkpatrick, J. D. (2006). Evaluating training programs (3rd ed.). San Francisco: Berrett-Koehler.
Kirschner, P. A., Sweller, J., & Clark, R. E. (2006). Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experimental, and inquiry-based teaching. Educational Psychologist, 41(2), 75–86.
Klein, G. (2008). Naturalistic decision making. Human Factors, 50(3), 456–460.
Klieme, E., Hartig, J., & Rauch, D. (2008). The concept of competence in educational contexts. In J. Hartig, E. Klieme, & D. Leutner (Eds.), Assessment of competencies in educational contexts (pp. 3–22). Cambridge, MA: Hogrefe & Huber.
Kozlowski, S. W. J., Gully, S. M., Salas, E., & Cannon-Bowers, J. A. (1996). Team leadership and development: Theory, principles, and guidelines for training leaders and teams. In M. Beyerlein, S. Beyerlein, & D. Johnson (Eds.), Advances in interdisciplinary studies of work teams: Team leadership (Vol. 3, pp. 251–289). Greenwich, CT: JAI Press.
Laurence, J. H., & Matthews, M. D. (2012). The Oxford handbook of military psychology. New York: Oxford University Press.
Marsh, H. W., Hau, K.-T., Artelt, C., Baumert, J., & Peschar, J. L. (2006). OECD’s brief self-report measure of educational psychology’s most useful affective constructs: Cross-cultural, psychometric comparisons across 25 countries. International Journal of Testing, 6(4), 311–360.
Marshall, L., O’Neil, H. F., Chen, A., Kuehl, M., Hsieh, I.-L., & Abedi, J. (2005). Teamwork skills: Assessment and instruction. In J. M. Spector, C. Ohrazda, A. Van Schaack, & D. A. Wiley (Eds.), Innovations in instructional technology: Essays in honor of M. David Merrill (pp. 131–149). Mahwah, NJ: Erlbaum.
Matthews, M. D., Eid, J., Johnsen, B. H., & Boe, O. C. (2011). A comparison of expert ratings and self-assessments of situation awareness during a combat fatigue course. Military Psychology, 23(2), 125–136.
Mayer, R. E. (1998). Cognitive, metacognitive, and motivational aspects of problem solving. Instructional Science, 26(1), 49–63.
Mayer, R. E. (2002). A taxonomy for computer-based assessment of problem solving. Computers in Human Behavior, 18(6), 623–632.
Mayrath, M. C., Clarke-Midura, J., & Robinson, D. H. (2012). Introduction to technology-based assessments for 21st century skills. In M. C. Mayrath, J. Clarke-Midura, D. H. Robinson, & G. Schraw (Eds.), Technology-based assessments for 21st century skills: Theoretical and practical implications from modern research (pp. 1–12). Charlotte, NC: Information Age.
McLagan, P. A. (1997). Competencies: The next generation. Training & Development, 51(5), 40–47.
Miller, T. M., & Geraci, L. (2011). Training metacognition in the classroom: The influence of incentives and feedback on exam predictions. Metacognition Learning, 6, 303–314.
Morrison, J. E., & Fletcher, J. D. (2001). Cognitive readiness (IDA Paper P-3735). Alexandria, VA: Institute for Defense Analyses.
Mueller-Hanson, R. A., White, S. S., Dorsey, D. W., & Pulakos, E. D. (2005). Training adaptable leaders: Lessons from research and practice (Army Project Number 633007A792). Arlington, VA: U.S. Army Research Institute for the Behavioral and Social Sciences.
Mumford, M. D., Scott, G. M., Gaddis, B., & Strange, J. M. (2002). Leading creative people: Orchestrating expertise and relationships. The Leadership Quarterly, 13, 705–750.
Neal, A., Kirkpatrick, T., Dewsnap, G., Godley, S. T., Joung, W., & Hesketh, B. (2006). An examination of learning processes during critical incident training: Implications for the development of adaptable trainees. Journal of Applied Psychology, 91(6), 1276–1291.
O’Neil, H. F., Jr. (1999). Perspectives on computer-based performance assessment of problem solving: Editor’s introduction. Computers in Human Behavior, 15, 255–268.
O’Neil, H. F., Jr., & Abedi, J. (1996). Reliability and validity of a state metacognitive inventory: Potential for alternative assessment. The Journal of Educational Research, 89, 234–245.
O’Neil, H. F., Jr., Abedi, J., & Spielberger, C. (1994). The measurement and teaching of creativity. In H. F. O’Neil Jr. & M. Drillings (Eds.), Motivation: Theory and research (pp. 245–263). Hillsdale, NJ: Erlbaum.
O’Neil, H. F., & Chuang, S.-H. (2008). Measuring collaborative problem solving in low-stakes tests. In E. L. Baker, J. Dickieson, W. Wulfeck, & H. F. O’Neil (Eds.), Assessment of problem solving using simulations (pp. 177–199). Mahwah, NJ: Erlbaum.
O’Neil, H. F., & Perez, R. S. (Eds.). (2008). Computer games and team and individual learning. Oxford, UK: Elsevier.
O’Neil, H. F., Jr., Wang, S., Lee, C., Mulkey, J., & Baker, E. L. (2003). Assessment of teamwork skills via a teamwork questionnaire. In H. F. O’Neil Jr. & R. S. Perez (Eds.), Technology applications in education: A learning view (pp. 283–303). Mahwah, NJ: Erlbaum.
OECD. (2012). Equity and quality in education: Supporting disadvantaged students and schools. OECD Publishing. Retrieved from http://dx.doi.org/10.1787/9789264130852-en
Pausch, R., Crea, T., & Conway, M. (1992). A literature survey for virtual environments-military flight simulator visual systems and simulator sickness. Presence: Teleoperators and Virtual Environments, 1(3), 344–363.
Pintrich, P. R., & Schunk, D. H. (2002). Motivation in education: Theory, research, and applications (2nd ed.). Upper Saddle River, NJ: Pearson Education.
Pulakos, E. D., Arad, S., Donovan, M. A., & Plamondon, K. E. (2000). Adaptability in the workplace: Development of a taxonomy of adaptive performance. Journal of Applied Psychology, 85(4), 612–624.
Pulakos, E. D., Schmitt, N., Dorsey, D. W., Arad, S., Hedge, J. W., & Borman, W. C. (2002). Predicting adaptive performance: Further tests of a model of adaptability. Human Performance, 15, 299–323.
Schleicher, A. (2006). The economics of knowledge: Why education is key for Europe’s success. Brussels: Lisbon Council. Retrieved from http://www.oecd.org/dataoecd/43/11/36278531.pdf
Schneider, B. (1994). HRM: A service perspective—Toward a customer-focused HRM. International Journal of Service Industry Management, 5, 64–76.
Shen, C.-Y. D., & O’Neil, H. F. (2008). Role of worked examples to stimulate learning in a game. In H. F. O’Neil & R. S. Perez (Eds.), Computer games and team and individual learning (pp. 185–204). Oxford, UK: Elsevier.
Simonton, D. K. (2012). Teaching creativity: Current findings, trends, and controversies in the psychology of creativity. Teaching of Psychology, 39, 203–208.
Sitzmann, T., & Ely, K. (2011). A meta-analysis of self-regulated learning in work-related training and educational attainment: What we know and where we need to go. Psychological Bulletin, 137, 421–442.
Slavin, R. (2011). Instruction based on cooperative learning. In R. E. Mayer & P. A. Alexander (Eds.), Handbook of research on learning and instruction (pp. 344–360). New York: Routledge.
Spielberger, C. D. (1980). Test anxiety inventory. Palo Alto, CA: Consulting Psychologists Press.
Spiering, B. A., Walker, L. A., Hendrickson, N. R., Simpson, K., Harman, E. A., Allison, S. C., et al. (2012). Reliability of military-relevant tests designed to assess soldier readiness for occupational and combat-related duties. Military Medicine, 177(6), 663–668.
Sternberg, R. J., & Lubart, T. I. (1995). Defying the crowd: Cultivating creativity in a culture of conformity. New York: Free Press.
Sweller, J., Ayres, P., & Kalyuga, S. (2011). Cognitive load theory. New York: Springer.
Torrance, E. P. (1999). Torrance test of creative thinking: Norms and technical manual. Beaconville, IL: Scholastic Testing Services.
TRADOC Pam 525-8-2. (2011, January 20). The US Army Learning Concept for 2015.
Tucker, J., & Gunther, K. (2009). The application of a model of adaptive performance to Army leader behaviors. Military Psychology, 21(3), 315–333.
U.S. Navy, Surface Warfare Officers School Command. (2012). Multi-Mission Tactical Trainer (MMTT), Tactical Action Officer (TAO) Intelligent Tutoring System (ITS). Retrieved from https://www.netc.navy.mil/centers/swos/Simulators.aspx?ID=2
West, R. F., Toplak, M. E., & Stanovich, K. E. (2008). Heuristics and biases as measures of critical thinking: Associations with cognitive ability and thinking dispositions. Journal of Educational Psychology, 100(4), 930–941.
Wong, L. (2004). Developing adaptive leaders: The crucible experience of operation IRAQI freedom. Carlisle, PA: Strategic Studies Institute, U.S. Army War College.
Wood, J., Lugg, D. J., Hysong, S. J., & Harm, D. L. (1999). Psychological changes in hundred-day remote Antarctic field groups. Environment and Behavior, 31(3), 299–337.
Worthy, D. A., Gorlick, M. A., Pacheco, J. L., Schnyer, D. M., & Maddox, W. T. (2011). With age comes wisdom: Decision making in younger and older adults. Psychological Science, 22(11), 1375–1380.
Yardley, R. J., Thie, H. J., Schank, J. F., Galegher, J., & Riposo, J. L. (2003). Use of simulation for training in the U.S. Navy surface force. Santa Monica, CA: Rand Corporation.
Zaccaro, S. J., & Banks, D. (2004). Leader visioning and adaptability: Bridging the gap between research and practice on developing the ability to manage change. Human Resource Management, 43(4), 367.
Acknowledgements
The work reported herein was supported at the University of Southern California by the Office of Naval Research under Award No. N00014-08-0126 at UCLA (TMT2) and ONR Award No. N00014-09-C-0813. The work was supported by subcontract from UCLA. The opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not reflect the views of the Office of Naval Research. We would like to thank Rear Admiral Thomas S. Rowden, USN, Captain Jeffery S. Jones, USN, Captain David Monroe, USN (Ret), Captain George Ponselle, USN (Ret), Captain David Davis, USN (Ret), Captain Carol Hottenrott, USN, Dr. William Bewley, and Dr. John Lee of CRESST. In addition we would like to thank Ms. Joanne Michiuye, Mr. Rob Sitter, and Ms. Laquita Stewart for their excellent preparation of this manuscript.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer Science+Business Media New York
About this chapter
Cite this chapter
O’Neil, H.F., Lang, J.(C., Perez, R.S., Escalante, D., Fox, F.S. (2014). What Is Cognitive Readiness?. In: O'Neil, H., Perez, R., Baker, E. (eds) Teaching and Measuring Cognitive Readiness. Springer, Boston, MA. https://doi.org/10.1007/978-1-4614-7579-8_1
Download citation
DOI: https://doi.org/10.1007/978-1-4614-7579-8_1
Published:
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4614-7578-1
Online ISBN: 978-1-4614-7579-8
eBook Packages: Humanities, Social Sciences and LawEducation (R0)