Skip to main content
SpringerLink
Log in

How video informs cognitive systems engineering: making experience count

  • Original Article
  • Published:
Cognition, Technology & Work Aims and scope Submit manuscript

Abstract

Cognitive systems engineering (CSE) requires perspectives that demand users and teams be understood in relation to the context they act in. Situated problems that emerge in the context of use are frequently distributed across people, information and artefacts (distributed cognition) that characterise the temporal emergence of activities. Current tools and capabilities within the digital video revolution make it possible to actively capture, record, explore and analyse video streams to assist in understanding distributed cognition and the implications it has for envisioned designs. Yet, there are research issues and questions to address. The Living Laboratory Framework is described and posited as one way to systematically integrate video into CSE to enhance the reliability and validity of design artefacts in practice. Case examples (Jasper and NeoCITIES simulations) are explored to provide specific ways of understanding different kinds of video representation and analysis within CSE.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Bransford JD, Sherwood RS, Vye NJ, Rieser J (1986) Teaching thinking and problem solving: research foundations. Am Psychol 41:1078–1089

    Article  Google Scholar 

  • CTGV (Cognition and Technology Group at Vanderbilt) (1997) The Jasper project: lessons in curriculum, instruction, assessment, and professional development. Erlbaum, Mahwah, NJ

    Google Scholar 

  • Dowell J, Long J (1998) Conception of the cognitive engineering design problem. Ergonomics 41(2):126–139

    Article  Google Scholar 

  • Eggleston RG (2002) Cognitive systems engineering at 20-something: Where do we stand? In: McNeese MD, Vidulich MA (eds) Cognitive systems engineering in military aviation environments: avoiding cogminutia fragmentosa. Human Systems Information Analysis Center, Wright-Patterson Air Force Base, OH, pp 15–78

  • Ericsson KA, Simon HA (1984) Protocol analysis: verbal reports as data. MIT Press, Cambridge, MA

    Google Scholar 

  • Gomes ME, Lind S, Snyder DE (1993) A human factors evaluation using tools for automated knowledge engineering. In: Proceedings of the IEEE National Aerospace and Electronics Conference (NAECON), vol 2. IEEE, Aerospace and Electronic Systems Society, Dayton, pp 661–664

  • Hollnagel E, Woods DD (1983) Cognitive systems engineering: new wine in new bottles. Int J Man Mach Stud 18:583–600

    Google Scholar 

  • Kimble C, McNeese MD (1987) Emergent leadership and team effectiveness on a team resource allocation task. AAMRL-87-TR-064. Armstrong Aerospace Medical Research Laboratory, Wright-Patterson Air Force Base, OH

  • McNeese MD (1996) An ecological perspective applied to multi-operator systems. In: Brown O, Hendrick HL (eds) Human factors in organizational design and management, vol VI. Elsevier, Amsterdam, The Netherlands, pp 365–370

  • McNeese MD (2002) Discovering how cognitive systems should be engineered for aviation domains: a developmental look at work, research, and practice. In: McNeese MD, Vidulich MA (eds) Cognitive systems engineering in military aviation environments: avoiding cogminutia fragmentosa. Human Systems Information Analysis Center, Wright-Patterson Air Force Base, OH, pp 79–119

  • McNeese MD, Rentsch JR (2001) Identifying the social and cognitive requirements of teamwork using collaborating task analysis. In: McNeese MD, Salas E, Endsley M (eds) New trends in collaborative activities: system dynamics in complex environments, Human Factors and Ergonomics Society Press, Santa Monica, CA, pp 96–113

  • McNeese MD and the MINDS Group (2003) Acquiring, accessing, assessing and sharing knowledge in distributed cognition: a cognitive science perspective. In: Presentation for the 2003 ONR review. Penn State University, University Park, State College, PA

  • McNeese MD, Zaff BS, Citera M, Brown CE, Whitaker R (1995) AKADAM: Eliciting user knowledge to support participatory ergonomics. Int J Ind Ergon 15(5):345–363

    Article  Google Scholar 

  • McNeese MD, Bautsch H, Narayanan S (1999a) A framework for cognitive field studies. Int J Cogn Ergon 3(4):307–331

    Google Scholar 

  • McNeese MD, Perusich K, Rentsch JR (1999b) What is command and control coming to? examining socio-cognitive mediators that expand the common ground of teamwork. In: Proceedings of the 43rd annual meeting of the Human Factors and Ergonomic Society, Human Factors and Ergonomics Society, Santa Monica, CA, pp 209–212

  • McNeese MD, Perusich K, Rentsch JR (2000) Advancing socio-technical systems design via the living laboratory. In: Proceedings of the Industrial Ergonomics Association/Human Factors and Ergonomics Society (IEA/HFES) 2000 Congress. Human Factors and Ergonomics Society, Santa Monica, CA, pp 2-610–2-613

  • McNeese MD, Theodorou E, Ferzandi L, Jefferson T Jr, Ge X (2002) Distributed cognition in shared information spaces. In: Proceedings of the 46th Annual Meeting of the Human Factors and Ergonomics Society, Human Factors and Ergonomics Society, Santa Monica, CA, pp 556–560

  • Naikar N, Lintern G, Sanderson P (2002) Cognitive work analysis for air defense applications in Australia. In: McNeese MD, Vidulich MA (eds) Cognitive systems engineering in military aviation environments: avoiding cogminutia fragmentosa. Human Systems Information Analysis Center, Wright-Patterson Air Force Base, OH, pp 169–200

  • Perusich K, McNeese MD (1997) Using fuzzy cognitive maps to define the search space in problem solving. In: Salvendy G, Smith M, Koubek R (eds) Design of computing systems: cognitive considerations, Elsevier, Amsterdam, The Netherlands, pp 805–809

  • Perusich K, McNeese MD, Rentsch J (1999) Qualitative modeling of complex systems for cognitive engineering. In: Sisti AF (ed) Proceedings of the SPIE, 3996:240–249

  • Picard RW (1997) Affective computing. MIT Press, Cambridge, MA

  • Rasmussen J, Pejtersen AM, Goodstein LP (1994) Cognitive engineering: concepts and applications. Wiley, New York

    Google Scholar 

  • Rentsch JR, McNeese MD, Pape LJ, Burnett DD, Menard DM, Anesgart M (1998) Testing the effects of team processes on team member schema similarity and task performance: examination of the team member schema similarity model. AFRL-TR-98-0070. Air Force Research Laboratory, Wright-Patterson Air Force Base, OH

    Google Scholar 

  • Resnick LB (1991) Shared cognition: thinking as social practice. In: Resnick LB, Levine JM, Teasley SD (eds) Perspectives on socially shared cognition, APA Books, Washington, DC

  • Sanderson PM, Scott JPP, Johnston P, Mainzer J, Watanabe LM, James JM (1994a) MacSHAPA and the enterprise of exploratory sequential data analysis (ESDA). Int J Hum Comput Stud 41:633–668

    Article  Google Scholar 

  • Sanderson PM, McNeese MD, Zaff BS (1994b) Handling complex real world problems with two cognitive engineering tools: COGENT and MacSHAPA. Behav Res Methods Instrum Comput 17(2):117–124

    Google Scholar 

  • Schmidt K (1997) Cooperative work: towards a conceptual foundation of CSCW systems design. In: Proceedings of HCI International ’97, The Seventh International Conference on Human–Computer Interaction, San Francisco, CA, August 1997, pp 57–60

  • Stasser G (1992) Information salience and the discovery of hidden profiles by decision making groups: a “thought” experiment. Organ Behav Hum Decis Process 52:156–181

    Google Scholar 

  • Suchman LA (1987) Plans and situated actions–the problem of human–machine communication. Cambridge University Press, New York

  • Suchman LA, Trigg RH (1986) A framework for studying research collaboration. In: Proceedings of the conference on computer-supported cooperative work. ACM, New York, pp 221–228

  • Vicente KJ (1999) Cognitive work analysis. Erlbaum, Mahwah, NJ

  • Wellens AR (1989) Effects of telecommunications media upon information sharing and team performance: some theoretical and empirical observations. IEEE Aerospace Electronic Syst 4:13–19

    Google Scholar 

  • Whitaker RD, Longinow NE, McNeese MD (1995a) Group interfaces: a profile and a prototype. AL/CF-TR-1995-0069. Armstrong Laboratory, Wright-Patterson Air Force Base, OH

  • Whitaker RD, Selvaraj JA, Brown CE, McNeese MD (1995b) Collaborative design technology: tools and techniques for improving collaborative design. AL/CF-TR-1995-0086. Armstrong Laboratory, Wright-Patterson Air Force Base, OH

  • Woods DD (1998) Designs are hypotheses about how artifacts shape cognition and collaboration. Ergonomics 41:168–173

    Article  Google Scholar 

  • Zaff BS, McNeese MD, Snyder DE (1993) Capturing multiple perspectives: a user-centered approach to knowledge acquisition. Knowl Acquisition 5(1):79–116

    Article  Google Scholar 

Download references

Acknowledgements

This research was partially supported by the Office of Naval Research, Division of Cognitive Science, Collaborative and Knowledge Management Program Grant, Dr. Michael Letsky, Program Manager (Grant No. N00140210570). I would like to thank Ms. Lori Ferzandi, PhD student, Industrial and Organization Psychology and Mr. Patrick L. Craven, PhD candidate, Developmental Psychology, of The Pennsylvania State University for their expert editing/comments on the manuscript. I would like to also thank the MINDS Research Group, School of Information Sciences and Technology, The Pennsylvania State University for their help and support on the efforts related to the NeoCITIES simulation.

Author information

Authors and Affiliations

  1. School of Information Sciences and Technology, The Pennsylvania State University, 301E IST Building, University Park, PA, 16802, USA

    Michael D. McNeese

Authors
  1. Michael D. McNeese
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Michael D. McNeese.

Rights and permissions

Reprints and permissions

About this article

Cite this article

McNeese, M.D. How video informs cognitive systems engineering: making experience count. Cogn Tech Work 6, 186–196 (2004). https://doi.org/10.1007/s10111-004-0160-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10111-004-0160-4

Keywords

Search

Navigation