Skip to main content

The Assessment of Team Performance: Observations and Needs

  • Chapter
  • First Online:
Innovative Assessment of Collaboration

Abstract

The abundance of teams within organizations illustrates the importance of team performance measurement—tools that measure teamwork. Taking into account the inherently complex nature of teams, this chapter presents a few insights and a picture of the research and practice on teamwork measurement over time. We define what makes a team and identify the characteristics of an effective team. Then, we present critical observations to team performance measurement that reflect the 30 years of experience of the first author, at observing, measuring, and assessing team performance in various domains. These observations provide insight into what attitudes, behaviors, and cognitions—how teams feel, act, and think—play an integral role in performance assessment, while taking situational factors and construct considerations into account. Support is presented from the literature on teams and performance measurement, and we provide major contributions from a sample of team performance measurement literature in the past 30 years. We conclude with a discussion on needs for developing future team-based measurement approaches. In this discussion of the future, emphasis is placed on our need, as a field, to continue closing the gap between research and practice through designing and validating effective performance-based measures that target practitioner needs.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  • Anders, S., Heinzle, J., Weiskopf, N., Ethofer, T., & Haynes, J. (2011). Flow of affective information between communicating brains. Neuroimage, 54, 439–446.

    Article  Google Scholar 

  • Awwal, N., Griffin, P., & Scalise, S. (2015). Platforms for delivery of collaborative tasks. In P. Griffin & E. Care (Eds.), Assessment and teaching of 21st century skills: methods and approach (pp. 105–113). Dordrecht, Netherlands: Springer.

    Google Scholar 

  • Brannick, M. T., & Prince, C. W. (1997). An overview of team performance measurement. In M. T. Brannick, E. Salas, & C. W. Prince (Eds.), Team performance assessment and measurement: Theory, methods, and applications (pp. 3–18). Mahwah, NJ, USA: Lawrence Erlbaum.

    Google Scholar 

  • Campion, M. A., Medsker, G. J., & Higgs, A. C. (1993). Relations between work group characteristics and effectiveness: Implications for designing effective work groups. Personnel Psychology, 46, 823–847.

    Article  Google Scholar 

  • Cannon-Bowers, J. A., & Salas, E. (1997). A framework for developing team performance measures in training. In M. T. Brannick, E. Salas, & C. W. Prince (Eds.), Team performance assessment and measurement: Theory, methods, and applications (pp. 45–62). Mahwah, NJ, USA: Lawrence Erlbaum.

    Google Scholar 

  • Cannon-Bowers, J. A., Tannenbaum, S. I., Salas, E., & Volpe, C. E. (1995). Defining competencies and establishing team training requirements. In R. A. Guzzo & E. Salas (Eds.), Team effectiveness and decision making in organizations (pp. 333–380). New York, NY, USA: Wiley.

    Google Scholar 

  • Cooke, N. J. (2015). Team cognition as interaction. Current directions in psychological science, 24(6), 415–419.

    Article  Google Scholar 

  • Cooke, N. J., Kiekel, P. A., & Helm, E. E. (2001). Measuring team knowledge during skill acquisition of a complex task. International Journal of Cognitive Ergonomics, 5(3), 297–315.

    Article  Google Scholar 

  • Cooke, N. J., Salas, E., Cannon-Bowers, J. A., & Stout, R. J. (2000). Measuring team knowledge. Human Factors, 42(1), 151–173.

    Article  Google Scholar 

  • DeChurch, L. A., & Mesmer-Magnus, J. R. (2010). The cognitive underpinnings of effective teamwork: A meta-analysis. Journal of Applied Psychology, 95(1), 32–53.

    Article  Google Scholar 

  • Dickinson, T. L., & McIntyre, R. M. (1997). A conceptual framework for teamwork measurement. In M. T. Brannick, E. Salas, & C. W. Prince (Eds.), Team performance assessment and measurement: Theory, methods, and applications (pp. 19–43). Mahwah, NJ, USA: Lawrence Erlbaum.

    Google Scholar 

  • Driskell, J. E., Salas, E., & Hughes, S. (2010). Collective orientation and team performance: development of an individual differences measure. Human Factors, 52(2), 316–328.

    Article  Google Scholar 

  • Dyer, J. L. (1984). Team research and team training: A state of the art review. In F. A. Muckler (Ed.), Human factors review (pp. 285–323). Santa Monica, CA, USA: Human Factors Society.

    Google Scholar 

  • Entin, E. E., & Serfaty, D. (1999). Adaptive team coordination. Human Factors, 41(2), 312–325.

    Article  Google Scholar 

  • Fiore, S. M., Cuevas, H. M., Scielzo, S., & Salas, E. (2002). Training individuals for distributed teams: Problem solving assessment for distributed mission research. Computers in Human Behavior, 18(6), 729–744.

    Article  Google Scholar 

  • Flin, R., & Martin, L. (2001). Behavioral markers for crew resource management: A review of current practice. The International Journal of Aviation Psychology, 11(1), 95–118.

    Article  Google Scholar 

  • Fowlkes, J. E., Lane, N. E., Salas, E., Franz, T., & Oser, R. (1994). Improving the measurement of team performance: The TARGETs methodology. Military Psychology, 6(1), 47–61.

    Article  Google Scholar 

  • Hackman, J. R. (1987). The design of work teams. In J. Lorsch (Ed.), Handbook of organizational behavior (pp. 315–342). New York, NY, USA: Prentice Hall.

    Google Scholar 

  • Hackman, J. R. (1990). Groups that work (and those that don’t). San Francisco, CA: Jossey-Bass.

    Google Scholar 

  • Hao, J., Liu, L., von Davier, A. A., & Kyllonen, P. (2015). Assessing collaborative problem solving with simulation based tasks. International Society of the Learning Sciences Proceedings.

    Google Scholar 

  • He, Q., von Davier, M., Greiff, S., Steinhauer, E. W., & Borysewicz, P. B. (2015). Collaborative problem solving measures in the programme for international student assessment (PISA).

    Google Scholar 

  • Kendall, D. L., & Salas, E. (2004). Measuring team performance: Review of current methods and consideration of future needs. In J. W. Ness, V. Tepe, & D. R. Ritzer (Eds.), The science and simulation of human performance (Vol. 5, pp. 307–326). Bingley, UK: Emerald Group Publishing.

    Chapter  Google Scholar 

  • Kozlowski, S. W. J., & Bell, B. S. (2003). Work groups and teams in organizations. In W. C. Borman, D. R. Ilgen, & R. J. Klimoski (Eds.), Handbook of psychology: Industrial and organizational psychology (Vol. 12, pp. 333–375). London, UK: Wiley.

    Google Scholar 

  • Langan-Fox, J., Wirth, A., Code, S., Langfield-Smith, K., & Wirth, A. (2001). Analyzing shared and team mental models. International Journal of Industrial Ergonomics, 28(2), 99–112.

    Article  Google Scholar 

  • Latham, G. P., & Wexley, K. N. (1977). Behavioral observation scales for performance appraisal purposes. Personnel Psychology, 30, 255–268.

    Article  Google Scholar 

  • LePine, J. A., Piccolo, R. F., Jackson, C. L., Mathieu, J. E., & Saul, J. R. (2008). A meta-analysis of teamwork processes: Tests of a multidimensional model and relationships with team effectiveness criteria. Personnel Psychology, 61(2), 273–307.

    Article  Google Scholar 

  • Liu, L., Hao, J., von Davier, A. A., Kyllonen, P., & Zapata-Rivera, D. (2015). A tough nut to crack: Measuring collaborative problem solving. In Y. Rosen & S. Ferrara (Eds.), Handbook of research on technology tools for real-world skill development (pp. 344–359). Hershey, PA, USA: Information Science Reference.

    Google Scholar 

  • Marks, M. A., Mathieu, J. E., & Zaccaro, S. J. (2001). A temporally based framework and taxonomy of team processes. Academy of Management Review, 26, 356–376.

    Google Scholar 

  • Mathieu, J. E., Heffner, T. S., Goodwin, G. F., Salas, E., & Cannon-Bowers, J. A. (2000). The influence of shared mental models on team process and performance. Journal of Applied Psychology, 85(2), 273–283.

    Article  Google Scholar 

  • McGrath, J. E. (1984). Groups: Interaction and performance. Upper Saddle River, NJ, USA: Prentice Hall.

    Google Scholar 

  • Meister, D. (1985). Behavioral analysis and measurement methods. New York, NY, USA: Wiley.

    Google Scholar 

  • Morgan, B. B., Jr., Glickman, A. S., Woodard, E. A., Blaiwes, A. S., & Salas E. (1986). Measurement of team behaviors in a Navy environment (Technical Report No. NTSC TR-86-014). Orlando, FL, USA: Naval Training Systems Center.

    Google Scholar 

  • Nieva, V. F., Fleishman, E. A., & Reick, A. (1978). Team dimensions: Their identity, their measurement, and relationships (Final Tech. Rep., Contract DAH19-78-C-0001). Washington, DC, USA: Advanced Resources Research Center.

    Google Scholar 

  • Patterson, D. G. (1922). The Scott Company graphic rating scale. Journal of Personnel Research, 1, 361–376.

    Google Scholar 

  • Peterson, E., Mitchell, T. R., Thompson, L., & Burr, R. (2000). Collective efficacy and aspects of shared mental models as predictors of performance over time in work groups. Group Processes & Intergroup Relations, 3(3), 296–316.

    Article  Google Scholar 

  • Rosen, M. A., Salas, E., Wilson, K. A., King, H. B., Salisbury, M., Augenstein, J. S. … Birnbach, D. J. (2008). Measuring team performance in simulation-based training: Adopting best practices for healthcare. Simulation in Healthcare, 3(1), 33–41.

    Google Scholar 

  • Rosen, M. A., Schiebel, N., Salas, E., Wu, T., Silvestri, S., & King, H. (2013). How can team performance be measured, assessed, and diagnosed. In E. Salas & K. Frush (Eds.), Improving patient safety through teamwork and team training (pp. 59–79). New York, NY, USA: Oxford University Press.

    Google Scholar 

  • Rosen, M. A., Wildman, J. L., Salas, E., & Rayne, S. (2012). Measuring team dynamics in the wild. In A. Hollingshead & M. S. Poole (Eds.), Research methods for studying groups: A guide to approaches, tools, and technologies (pp. 386–417). New York, NY, USA: Taylor & Francis.

    Google Scholar 

  • Rousseau, V., Aube, C., & Savoie, A. (2006). Teamwork behaviors: A review and an integration of frameworks. Small Group Research, 37(5), 540–570.

    Article  Google Scholar 

  • Salas, E., Benishek, L., Coultas, C., Dietz, A., Grossman, R., Lazzara, E., et al. (2015). Team training essentials: A research-based guide. New York, NY, USA: Routledge.

    Google Scholar 

  • Salas, E., Burke, C. S., & Fowlkes, J. E. (2005). Measuring team performance “in the wild:” Challenges and tips. In W. Bennet Jr., C. E. Lance, & D. J. Woehr (Eds.), Performance measurement: Current perspectives and future challenges (pp. 245–272). Mahwah, NJ, USA: Erlbaum.

    Google Scholar 

  • Salas, E., Burke, C. S., Fowlkes, J. E., & Priest, H. A. (2004). On measuring teamwork skills. In J. C. Thomas & M. Hersen (Eds.), Comprehensive handbook of psychological assessment (Vol. 4, pp. 427–442). Hoboken, NJ, USA: Wiley.

    Google Scholar 

  • Salas, E., Dickinson, T., Converse, S. A., & Tannenbaum, S. I. (1992). Toward an understanding of team performance and training. In R. W. Swezey & E. Salas (Eds.), Teams: Their training and performance (pp. 3–29). Norwood, NJ, USA: Ablex.

    Google Scholar 

  • Salas, E., Priest, H. A., & Burke, C. S. (2005b). Teamwork and team performance measurement. In J. R. Wilson & N. Corlett (Eds.), Evaluation of human work (3rd ed., pp. 793–808). Boca Raton, FL, USA: CRC Press.

    Chapter  Google Scholar 

  • Salas, E., Sims, D. E., & Burke, C. S. (2005c). Is there a “big five” in teamwork? Small Group Research, 36(5), 555–599.

    Article  Google Scholar 

  • Salas, E., Stagl, K. C., Burke, C. S., & Goodwin, G. F. (2007). Fostering team effectiveness in organizations: Toward an integrative theoretical framework. Nebraska Symposium on Motivation, 52, 185–243.

    Google Scholar 

  • Schippers, M., Roebroeck, A., Renken, R., Nanetti, L., & Keysers, C. (2010). Mapping the information flows from one brain to another during gestural communication. Proceedings of the National Academy of Sciences USA, 107, 9388–9393.

    Article  Google Scholar 

  • Shockley, K., Santana, M.-V., & Fowler, C. A. (2003). Mutual interpersonal postural constraints are involved in cooperative conversation. Journal of Experimental Psychology: Human Perception and Performance, 29(2), 326–332.

    Google Scholar 

  • Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420–428.

    Article  Google Scholar 

  • Smith-Jentsch, K. A., Zeisig, R. L., Acton, B., & McPherson, J. A. (1998). Team dimensional training: A strategy for guided team self-correction. In J. A. Cannon-Bowers & E. Salas (Eds.), Making decisions under stress: Implications for individual and team training (pp. 271–297). Washington, DC, USA: American Psychological Association.

    Chapter  Google Scholar 

  • Smith, P. C., & Kendall, L. M. (1963). Retranslation of expectations: An approach to the construction of unambiguous anchors for rating scales. Journal of Applied Psychology, 47(2), 149–155.

    Article  Google Scholar 

  • Stevens, R., Galloway, T., Lamb, J., Steed, R., & Lamb, C. (2017). Linking team neurodynamic organizations with observational ratings of team performance. In A. A. von Davier, M. Zhu, & P. C. Kyllonen (Eds.), Innovative assessment of collaboration. New York, NY, USA: Springer.

    Google Scholar 

  • Sundstrom, E., De Meuse, K. P., & Futrell, D. (1990). Work teams: Applications and effectiveness. American Psychologist, 45(2), 120–133.

    Article  Google Scholar 

  • Tannenbaum, S. I., Beard, R. L., & Salas, E. (1992). Team building and its influence on team effectiveness: An examination of conceptual and empirical developments. Advances in Psychology, 82, 117–153.

    Article  Google Scholar 

  • von Davier, A. A., & Halpin, P. F. (2013). Collaborative problem solving and the assessment of cognitive skills: Psychometric considerations (ETS Research Report No RR-13-41). Princeton, NJ, USA: Educational Testing Service.

    Google Scholar 

  • Wildman, J. L., Thayer, A. L., Pavlas, D., Salas, E., Stewart, J. E., & Howse, W. R. (2012). Team knowledge research: Emerging trends and critical needs. Human Factors, 54(1), 84–111.

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported in part by contract NNX16AB08G with the National Aeronautics and Space Administration (NASA) and contract NBPF03402 with the National Space Biomedical Research Institute (NSBRI) with Rice University. The views expressed in this work are those of the authors and do not necessarily reflect the organizations with which they are affiliated or their sponsoring institutions or agencies.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eduardo Salas .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Salas, E., Reyes, D.L., Woods, A.L. (2017). The Assessment of Team Performance: Observations and Needs. In: von Davier, A., Zhu, M., Kyllonen, P. (eds) Innovative Assessment of Collaboration. Methodology of Educational Measurement and Assessment. Springer, Cham. https://doi.org/10.1007/978-3-319-33261-1_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-33261-1_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-33259-8

  • Online ISBN: 978-3-319-33261-1

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics