Abstract
The abundance of teams within organizations illustrates the importance of team performance measurement—tools that measure teamwork. Taking into account the inherently complex nature of teams, this chapter presents a few insights and a picture of the research and practice on teamwork measurement over time. We define what makes a team and identify the characteristics of an effective team. Then, we present critical observations to team performance measurement that reflect the 30 years of experience of the first author, at observing, measuring, and assessing team performance in various domains. These observations provide insight into what attitudes, behaviors, and cognitions—how teams feel, act, and think—play an integral role in performance assessment, while taking situational factors and construct considerations into account. Support is presented from the literature on teams and performance measurement, and we provide major contributions from a sample of team performance measurement literature in the past 30 years. We conclude with a discussion on needs for developing future team-based measurement approaches. In this discussion of the future, emphasis is placed on our need, as a field, to continue closing the gap between research and practice through designing and validating effective performance-based measures that target practitioner needs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Anders, S., Heinzle, J., Weiskopf, N., Ethofer, T., & Haynes, J. (2011). Flow of affective information between communicating brains. Neuroimage, 54, 439–446.
Awwal, N., Griffin, P., & Scalise, S. (2015). Platforms for delivery of collaborative tasks. In P. Griffin & E. Care (Eds.), Assessment and teaching of 21st century skills: methods and approach (pp. 105–113). Dordrecht, Netherlands: Springer.
Brannick, M. T., & Prince, C. W. (1997). An overview of team performance measurement. In M. T. Brannick, E. Salas, & C. W. Prince (Eds.), Team performance assessment and measurement: Theory, methods, and applications (pp. 3–18). Mahwah, NJ, USA: Lawrence Erlbaum.
Campion, M. A., Medsker, G. J., & Higgs, A. C. (1993). Relations between work group characteristics and effectiveness: Implications for designing effective work groups. Personnel Psychology, 46, 823–847.
Cannon-Bowers, J. A., & Salas, E. (1997). A framework for developing team performance measures in training. In M. T. Brannick, E. Salas, & C. W. Prince (Eds.), Team performance assessment and measurement: Theory, methods, and applications (pp. 45–62). Mahwah, NJ, USA: Lawrence Erlbaum.
Cannon-Bowers, J. A., Tannenbaum, S. I., Salas, E., & Volpe, C. E. (1995). Defining competencies and establishing team training requirements. In R. A. Guzzo & E. Salas (Eds.), Team effectiveness and decision making in organizations (pp. 333–380). New York, NY, USA: Wiley.
Cooke, N. J. (2015). Team cognition as interaction. Current directions in psychological science, 24(6), 415–419.
Cooke, N. J., Kiekel, P. A., & Helm, E. E. (2001). Measuring team knowledge during skill acquisition of a complex task. International Journal of Cognitive Ergonomics, 5(3), 297–315.
Cooke, N. J., Salas, E., Cannon-Bowers, J. A., & Stout, R. J. (2000). Measuring team knowledge. Human Factors, 42(1), 151–173.
DeChurch, L. A., & Mesmer-Magnus, J. R. (2010). The cognitive underpinnings of effective teamwork: A meta-analysis. Journal of Applied Psychology, 95(1), 32–53.
Dickinson, T. L., & McIntyre, R. M. (1997). A conceptual framework for teamwork measurement. In M. T. Brannick, E. Salas, & C. W. Prince (Eds.), Team performance assessment and measurement: Theory, methods, and applications (pp. 19–43). Mahwah, NJ, USA: Lawrence Erlbaum.
Driskell, J. E., Salas, E., & Hughes, S. (2010). Collective orientation and team performance: development of an individual differences measure. Human Factors, 52(2), 316–328.
Dyer, J. L. (1984). Team research and team training: A state of the art review. In F. A. Muckler (Ed.), Human factors review (pp. 285–323). Santa Monica, CA, USA: Human Factors Society.
Entin, E. E., & Serfaty, D. (1999). Adaptive team coordination. Human Factors, 41(2), 312–325.
Fiore, S. M., Cuevas, H. M., Scielzo, S., & Salas, E. (2002). Training individuals for distributed teams: Problem solving assessment for distributed mission research. Computers in Human Behavior, 18(6), 729–744.
Flin, R., & Martin, L. (2001). Behavioral markers for crew resource management: A review of current practice. The International Journal of Aviation Psychology, 11(1), 95–118.
Fowlkes, J. E., Lane, N. E., Salas, E., Franz, T., & Oser, R. (1994). Improving the measurement of team performance: The TARGETs methodology. Military Psychology, 6(1), 47–61.
Hackman, J. R. (1987). The design of work teams. In J. Lorsch (Ed.), Handbook of organizational behavior (pp. 315–342). New York, NY, USA: Prentice Hall.
Hackman, J. R. (1990). Groups that work (and those that don’t). San Francisco, CA: Jossey-Bass.
Hao, J., Liu, L., von Davier, A. A., & Kyllonen, P. (2015). Assessing collaborative problem solving with simulation based tasks. International Society of the Learning Sciences Proceedings.
He, Q., von Davier, M., Greiff, S., Steinhauer, E. W., & Borysewicz, P. B. (2015). Collaborative problem solving measures in the programme for international student assessment (PISA).
Kendall, D. L., & Salas, E. (2004). Measuring team performance: Review of current methods and consideration of future needs. In J. W. Ness, V. Tepe, & D. R. Ritzer (Eds.), The science and simulation of human performance (Vol. 5, pp. 307–326). Bingley, UK: Emerald Group Publishing.
Kozlowski, S. W. J., & Bell, B. S. (2003). Work groups and teams in organizations. In W. C. Borman, D. R. Ilgen, & R. J. Klimoski (Eds.), Handbook of psychology: Industrial and organizational psychology (Vol. 12, pp. 333–375). London, UK: Wiley.
Langan-Fox, J., Wirth, A., Code, S., Langfield-Smith, K., & Wirth, A. (2001). Analyzing shared and team mental models. International Journal of Industrial Ergonomics, 28(2), 99–112.
Latham, G. P., & Wexley, K. N. (1977). Behavioral observation scales for performance appraisal purposes. Personnel Psychology, 30, 255–268.
LePine, J. A., Piccolo, R. F., Jackson, C. L., Mathieu, J. E., & Saul, J. R. (2008). A meta-analysis of teamwork processes: Tests of a multidimensional model and relationships with team effectiveness criteria. Personnel Psychology, 61(2), 273–307.
Liu, L., Hao, J., von Davier, A. A., Kyllonen, P., & Zapata-Rivera, D. (2015). A tough nut to crack: Measuring collaborative problem solving. In Y. Rosen & S. Ferrara (Eds.), Handbook of research on technology tools for real-world skill development (pp. 344–359). Hershey, PA, USA: Information Science Reference.
Marks, M. A., Mathieu, J. E., & Zaccaro, S. J. (2001). A temporally based framework and taxonomy of team processes. Academy of Management Review, 26, 356–376.
Mathieu, J. E., Heffner, T. S., Goodwin, G. F., Salas, E., & Cannon-Bowers, J. A. (2000). The influence of shared mental models on team process and performance. Journal of Applied Psychology, 85(2), 273–283.
McGrath, J. E. (1984). Groups: Interaction and performance. Upper Saddle River, NJ, USA: Prentice Hall.
Meister, D. (1985). Behavioral analysis and measurement methods. New York, NY, USA: Wiley.
Morgan, B. B., Jr., Glickman, A. S., Woodard, E. A., Blaiwes, A. S., & Salas E. (1986). Measurement of team behaviors in a Navy environment (Technical Report No. NTSC TR-86-014). Orlando, FL, USA: Naval Training Systems Center.
Nieva, V. F., Fleishman, E. A., & Reick, A. (1978). Team dimensions: Their identity, their measurement, and relationships (Final Tech. Rep., Contract DAH19-78-C-0001). Washington, DC, USA: Advanced Resources Research Center.
Patterson, D. G. (1922). The Scott Company graphic rating scale. Journal of Personnel Research, 1, 361–376.
Peterson, E., Mitchell, T. R., Thompson, L., & Burr, R. (2000). Collective efficacy and aspects of shared mental models as predictors of performance over time in work groups. Group Processes & Intergroup Relations, 3(3), 296–316.
Rosen, M. A., Salas, E., Wilson, K. A., King, H. B., Salisbury, M., Augenstein, J. S. … Birnbach, D. J. (2008). Measuring team performance in simulation-based training: Adopting best practices for healthcare. Simulation in Healthcare, 3(1), 33–41.
Rosen, M. A., Schiebel, N., Salas, E., Wu, T., Silvestri, S., & King, H. (2013). How can team performance be measured, assessed, and diagnosed. In E. Salas & K. Frush (Eds.), Improving patient safety through teamwork and team training (pp. 59–79). New York, NY, USA: Oxford University Press.
Rosen, M. A., Wildman, J. L., Salas, E., & Rayne, S. (2012). Measuring team dynamics in the wild. In A. Hollingshead & M. S. Poole (Eds.), Research methods for studying groups: A guide to approaches, tools, and technologies (pp. 386–417). New York, NY, USA: Taylor & Francis.
Rousseau, V., Aube, C., & Savoie, A. (2006). Teamwork behaviors: A review and an integration of frameworks. Small Group Research, 37(5), 540–570.
Salas, E., Benishek, L., Coultas, C., Dietz, A., Grossman, R., Lazzara, E., et al. (2015). Team training essentials: A research-based guide. New York, NY, USA: Routledge.
Salas, E., Burke, C. S., & Fowlkes, J. E. (2005). Measuring team performance “in the wild:” Challenges and tips. In W. Bennet Jr., C. E. Lance, & D. J. Woehr (Eds.), Performance measurement: Current perspectives and future challenges (pp. 245–272). Mahwah, NJ, USA: Erlbaum.
Salas, E., Burke, C. S., Fowlkes, J. E., & Priest, H. A. (2004). On measuring teamwork skills. In J. C. Thomas & M. Hersen (Eds.), Comprehensive handbook of psychological assessment (Vol. 4, pp. 427–442). Hoboken, NJ, USA: Wiley.
Salas, E., Dickinson, T., Converse, S. A., & Tannenbaum, S. I. (1992). Toward an understanding of team performance and training. In R. W. Swezey & E. Salas (Eds.), Teams: Their training and performance (pp. 3–29). Norwood, NJ, USA: Ablex.
Salas, E., Priest, H. A., & Burke, C. S. (2005b). Teamwork and team performance measurement. In J. R. Wilson & N. Corlett (Eds.), Evaluation of human work (3rd ed., pp. 793–808). Boca Raton, FL, USA: CRC Press.
Salas, E., Sims, D. E., & Burke, C. S. (2005c). Is there a “big five” in teamwork? Small Group Research, 36(5), 555–599.
Salas, E., Stagl, K. C., Burke, C. S., & Goodwin, G. F. (2007). Fostering team effectiveness in organizations: Toward an integrative theoretical framework. Nebraska Symposium on Motivation, 52, 185–243.
Schippers, M., Roebroeck, A., Renken, R., Nanetti, L., & Keysers, C. (2010). Mapping the information flows from one brain to another during gestural communication. Proceedings of the National Academy of Sciences USA, 107, 9388–9393.
Shockley, K., Santana, M.-V., & Fowler, C. A. (2003). Mutual interpersonal postural constraints are involved in cooperative conversation. Journal of Experimental Psychology: Human Perception and Performance, 29(2), 326–332.
Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420–428.
Smith-Jentsch, K. A., Zeisig, R. L., Acton, B., & McPherson, J. A. (1998). Team dimensional training: A strategy for guided team self-correction. In J. A. Cannon-Bowers & E. Salas (Eds.), Making decisions under stress: Implications for individual and team training (pp. 271–297). Washington, DC, USA: American Psychological Association.
Smith, P. C., & Kendall, L. M. (1963). Retranslation of expectations: An approach to the construction of unambiguous anchors for rating scales. Journal of Applied Psychology, 47(2), 149–155.
Stevens, R., Galloway, T., Lamb, J., Steed, R., & Lamb, C. (2017). Linking team neurodynamic organizations with observational ratings of team performance. In A. A. von Davier, M. Zhu, & P. C. Kyllonen (Eds.), Innovative assessment of collaboration. New York, NY, USA: Springer.
Sundstrom, E., De Meuse, K. P., & Futrell, D. (1990). Work teams: Applications and effectiveness. American Psychologist, 45(2), 120–133.
Tannenbaum, S. I., Beard, R. L., & Salas, E. (1992). Team building and its influence on team effectiveness: An examination of conceptual and empirical developments. Advances in Psychology, 82, 117–153.
von Davier, A. A., & Halpin, P. F. (2013). Collaborative problem solving and the assessment of cognitive skills: Psychometric considerations (ETS Research Report No RR-13-41). Princeton, NJ, USA: Educational Testing Service.
Wildman, J. L., Thayer, A. L., Pavlas, D., Salas, E., Stewart, J. E., & Howse, W. R. (2012). Team knowledge research: Emerging trends and critical needs. Human Factors, 54(1), 84–111.
Acknowledgements
This work was supported in part by contract NNX16AB08G with the National Aeronautics and Space Administration (NASA) and contract NBPF03402 with the National Space Biomedical Research Institute (NSBRI) with Rice University. The views expressed in this work are those of the authors and do not necessarily reflect the organizations with which they are affiliated or their sponsoring institutions or agencies.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Salas, E., Reyes, D.L., Woods, A.L. (2017). The Assessment of Team Performance: Observations and Needs. In: von Davier, A., Zhu, M., Kyllonen, P. (eds) Innovative Assessment of Collaboration. Methodology of Educational Measurement and Assessment. Springer, Cham. https://doi.org/10.1007/978-3-319-33261-1_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-33261-1_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-33259-8
Online ISBN: 978-3-319-33261-1
eBook Packages: EducationEducation (R0)