Skip to main content

Cognitive skills training: lessons learned


This paper describes lessons we have learned about presenting cognitive skills training. We have used ShadowBox as our training approach (Klein and Borders in J Cogn Eng Decis Mak 10:268–280, 2016), but the lessons apply regardless of specific techniques employed. We analyze key takeaways and lessons learned throughout the course of multiple ShadowBox projects. We explain how the original ShadowBox mission statement has evolved based on these lessons learned. Recommendations are offered for others who are engaged in cognitive skills training.

This is a preview of subscription content, access via your institution.


  1. Borders J, Klein G (2017) The critical decision audit: blending the critical decision method and the knowledge audit. In: Paper presented at the 13th international conference on naturalistic decision making, Bath, UK

  2. Gore J, Banks AP, McDowall A (2018) Developing cognitive task analysis and the importance of socio-cognitive competence/insight for professional practice. Cogn Technol Work 9:1–9

    Google Scholar 

  3. Hall EP, Gott SP, Pokorny RA (1995) A procedural guide to cognitive task analysis: the PARI methodology (AL/HR-TR-1995-0108). Armstrong Laboratory, Brooks Air Force Base, San Antonio

    Book  Google Scholar 

  4. Hintze NR (2008) First responder problem solving and decision making in today’s asymmetrical environment. Master’s thesis, Naval Postgraduate School Monterey, CA

  5. Jepsen RMHG, Østergaard D, Dieckmann P (2015) Development of instruments for assessment of individuals’ and teams’ non-technical skills in healthcare: a critical review. Cogn Technol Work 17:63–77

    Article  Google Scholar 

  6. Klein G (2017) The cognitive audit: a guide to cognitizing training programs. Accessed 10 June 2018

  7. Klein G, Borders J (2016) The ShadowBox approach to cognitive skills training: an empirical evaluation. J Cogn Eng Decis Mak 10:268–280

    Article  Google Scholar 

  8. Klein G, Militello L (2004) The knowledge audit as a method for cognitive task analysis. In: Montgomery H, Lipshitz R, Brehmer B (eds) How professionals make decisions. Erlbaum, Mahwah, pp 335–342

    Google Scholar 

  9. Klein G, Klein HA, Borders J, Whitacre JC (2015) Police and military as good strangers. J Occup Organ Psychol 88:231–250

    Article  Google Scholar 

  10. Kontogiannis T (1999) Training effective human performance in the management of stressful emergencies. Cogn Technol Work 1:7–24

    Article  Google Scholar 

  11. Means B, Gott S (1988) Cognitive task analysis as a basis for tutor development: articulating abstract knowledge representations. In: Psotka J, Massey LD, Mutter SA (eds) Intelligent tutoring systems: lessons learned. Erlbaum, Mahwah, pp 35–37

    Google Scholar 

  12. Militello LG, Hutton RJ (1998) Applied cognitive task analysis (ACTA): a practitioner’s toolkit for understanding cognitive task demands. Ergonomics 41:1618–1641

    Article  Google Scholar 

  13. Newsome E, Klein G (2017) Cognitive skills training for frontline social workers: a pilot study. In: Paper presented at the 13th international conference on naturalistic decision Making, Bath, UK

  14. Vanderhaegen F, Carsten O (2017) Can dissonance engineering improve risk analysis of human–machine systems? Cogn Technol Work 19:1–12

    Article  Google Scholar 

Download references


We thank our project sponsors highlighted in this article: Defense Advanced Research Projects Agency, California Peace Officer Standards and Training, The Center for Operator Performance, the Annie E. Casey Foundation, and Stottler-Henke Associates, Inc. The views expressed in this article are those of the authors alone, and do not necessarily reflect the views of our project sponsors.

Author information



Corresponding author

Correspondence to Gary Klein.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Klein, G., Borders, J., Newsome, E. et al. Cognitive skills training: lessons learned. Cogn Tech Work 20, 681–687 (2018).

Download citation


  • Training
  • Lessons learned
  • Expertise
  • Naturalistic decision making