Abstract
The ultimate concern of cognitive engineering is how complex sociotechnical systems might be designed so that humans can work within them and control them safely and effectively. Because of this, large amounts of observational data analysis and knowledge elicitation are incorporated in cognitive engineering. At many points, these two methodologies coalesce. In this paper, we describe two complementary cognitive engineering software tools—MacSHAPA and COGENT—that are being developed alongside each other. MacSHAPA is designed for observational data analysis, and COGENT is designed for knowledge elicitation and cognitive engineering, but both sup-port requirements gathering. We first outline current trends in cognitive engineering that have given rise to the need for tools like MacSHAPA and COGENT. We then describe the two tools in more detail, and point to their similarities and differences. Finally, we show how the two tools are complementary, and how they can be used together in engineering psychology research.
Article PDF
Similar content being viewed by others
References
Bereiter, C., &Scardamalia, M. (1989). Intentional learning as a goal of instruction. In L. B. Resnick (Ed.),Knowing, learning, and instruction: Essays in honor of Robert Gloser (pp. 361–392). Hillsdale, NJ: Erlbaum.
Charniak, E., &McDermott, D. (1986).Introduction to artificial intelligence. Reading. MA: Addison-Wesley.
Collins, A., Brown, J. S., &Newman, S. E. (1989). Cognitive apprenticeship: Teaching the crafts of reading, writing, and mathematics, In L. B. Resnich (Ed.),Knowing, learning, and instruction: Essays in honor of Roger Glaser (pp. 453–494). Hillsdale, NJ: Erlbaum.
Faraone, S. V., &Dorfman, D. D. (1987). Lag sequential analysis: Robust statistical methods.Psychological Bulletin,101, 312–323.
Fisher, C. (1991).Protocol analyst’s workbench: Design and evaluation of computer-aided protocol analysis. Unpublished doctoral dissertation, Carnegie-Mellon University, Pittsburgh, PA.
Fisher, K. M.,Faletti, J., &Quinn, C. (1990).Exploring cognitive structure with semantic networks. Available from K. M. Fisher, CRMSE, 6475 Alvarado Road, San Diego State University, San Diego, CA 92182.
Gomes, M. E., Lind, S., &Snyder, D. E. (1993). A human factors evaluation using tools for automated knowledge engineering. InProceedings of the IEEE National Aerospace and Electronics Conference (NAECON) (pp. 661–664), Dayton, OH: IEEE, Aerospace & Electronic Systems Society.
James, J. M., &Sanderson, P. M. (1991). Heuristic and statistical support for protocol analysis with SHAPA Version 2.01.Behavior Research Methods, Instruments, & Computers,23, 449–460.
Jordan, B., & Henderson, A. (in press). Interaction analysis: Foundations and practice.Journal of the Learning Sciences.
MacKav, W. E. (1989). EVA: An experimental video annotator for symbolic analysis of video data.SIGCHI Bulletin,21, 68–71.
McFarren, M. R. (1987).Using concept mapping to define problems and identify key kernels during the development of a decision support system. Master’s thesis (AFTT/GST/ENS/S7J-12), Air Force Institute of Technology, Wright-Patterson Air Force Base, Ohio.
McNeese, M. D., Zaff, B. S., Brown, C. E., Cftera, M., &Wellens, A. R. (1992). The role of a group-centered approach in the development of computer-supported collaborative design technologies. InProceedings of the 36th Annual Meeting of the Human Factors Society,2, 867–871. Santa Monica, CA: Human Factors Society.
McNeese, M. D.,Zaff, B. S.,Citera, M.,Brown, C. E., &Whitaker, R. (in press). AKADAM: Eliciting user knowledge to support participatory ergonomics.International Journal of Industrial Ergonomics.
McNeese, M. D., Zaff, B. S., Peio, K. J., Snyder, D. E., Duncan, J. C., &McFarren, M. R. (1990).An advanced knowledge and design acquisition methodology: Application for the pilot’s associate (Report No. AAMRL-TR-90-060). Wright-Patterson Air Force Base, OH: Armstrong Aerospace Medical Research Laboratory.
Novax, J. D., &Gowtn, D. B. (1984).Learning how to team. Cambridge: Cambridge University Press.
Olson, G. M., Olson, J. S., &Kraut, R. E. (1992). Introduction to this special issue on computer-supported cooperative work.Human-Computer Interaction,7, 251–256.
Rasmussen, J.,Pejtersen, A. M., &Goodstein, L. P. (in press).Cognitive engineering: Concepts and applications. New York: Wiley.
Sanderson, P. M. (1993). Designing for simplicity of inference in ob-servational studies of process control: ESDA and MacSHAPA. In E. Hollnaget & M. Lind (Eds.),Proceedings of the Fourth Cognitive Science Approaches to Process Control Conference (CSAPC93) (pp. 20–47). Birkerod, Denmark: CRI A/S.
Sanderson, P. M., &Fisher, C. (in press). Exploratory sequential data analysis: Foundations.Human-Computer Interaction.
Sanderson, P. M., James, J. M., Watanabe, L. M., &Holden, J. (1990). Human operator behavior in complex worlds: Rendering sequential records analytically tractable. In P. C. Caccibue & G. Mancrni (Eds.),Proceedings of the Ninth European Annual Conference on Human Decision Making and Manual Control (pp. 123–132). Ispra, Italv: CRC JRC.
Sanderson, P. M.,Scott. J. J. P.,Johnston, T.,Mainzer. J.,Watanabe, L. M., &James, J. M. (in press). MacSHAPA and the enterprise of exploratory sequential data analysis.International Journal of Human-Computer Studies.
Snyder, D. E., McNeese, M. D., &Zaff, B. S. (1991). Identifying design requirements using integrated analysis structures. InProceedings of the IEEE National Aerospace and Electronics Conference (NAE-CON) (pp. 786–791). Dayton, OH: IEEE, Aerospace & Electronic Systems Society.
Suchman, L. (1987).Plans and situated actions: The problem of human-machine communication. New York: Cambridge University Press.
Vygotsky, L. S. (1978).Mind in society, Cambridge, MA: Harvard University Press.
Woods, D. D. (1987). Commentary: Cognitive engineering in complex and dynamic worlds.International Journal of Man-Machine Studies,27, 571–585.
Woods, D. D. (1993). Process tracing methods for the study of cognition outside of the experimental psychology laboratory. In G. Klein, J. Orasami, R. Calderwood, & C. E. Zsambok (Eds.),Decision making in action: Models and methods. Norwood, NJ: Ablex.
Woods, D. D., &Roth, E. M. (1988). Cognitive systems engineering. In M. Heiander (Ed.),Handbook of human-computer interaction (pp. 3–43). Amsterdam: Elsevier.
Young, M. F., &McNeese, M. D. (1993). A situated cognition approach to problem solving with implications for computer-based learning and assessment. In G. Salvendy & M. Smith (Eds.),Human-computer interaction: Software and hardware inter/aces (pp. 825–830). Amsterdam: Elsevier.
Zaff, B. S., Hughes, E. R., McNeese, M. D., Brown, C. E., &Citera, M. (1993). Diagnosing macro-ergonomic problems: A case study in the use of concept mapping for TQM initiatives. InProceedings of the 37th Annual Meeting of the Human Factors and Ergonomics Society (pp. 873–877). Santa Monica, CA: Human Factors Society.
Zaff, B. S., McNeese, M. D., Brown, C. E., Citera, M., &Selvaraj, J. A. (1993). Empowering designers with user-centered knowledge: Issues, methods, and solutions. InProceedings of the Interface 93 (pp. 231–235). Santa Monica, CA: Human Factors Society.
Zaff, B. S., McNeese, M. D., &Snyder, D. E. (1993). Capturing multiple perspectives: A user-centered approach to knowledge acquisition.Knowledge Acquisition,5, 79–116.
Author information
Authors and Affiliations
Corresponding author
Additional information
COGENT (Cognitive Engineering Network Technologies) represents confluences from two interrelated streams of research: (1) the Advanced Knowledge And Design Acquisition Methodology (AKADAM; see McNeese. Zaff, Citera. Brown. & Whitaker, in press; McNeese et al., 1990; Snyder. McNeese, & Zaff, 1991 ; Zaff, McNeese. & Snyder. 1993) and (2) Tools for Automated Knowledge Engineering (TAKE; see Gomes, Lind. & Snyder. 1993). Both arc ongoing projects at the Arm-strong Laboratory/Human Engineering Division, Wright-Patterson AFB. Further developments and research in TAKE may be obtained by contacting Stephanie Lind. AL/CFHI. Wright-Patterson AFB. OH. CO-GENT includes the total suite of tools under development in AKADAM and TAKE, spanning across the last 4 years. MacSHAPA is being developed at the Engineering Psychology Research Laboratory, Department of Mechanical and Industrial Engineering, University of Illinois at Urbana-Champaign, with support from NASA-Ames Research Center. Wright-Patterson AFB. through Logicon Technical Services Inc., the Aeronautical Research Laboratory (DSTO. Australia), and the University of Illinois Research Board.
Rights and permissions
About this article
Cite this article
Sanderson, P.M., McNeese, M.D. & Zaff, B.S. Handling complex real-world data with two cognitive engineering tools: COGENT and MacSHAPA. Behavior Research Methods, Instruments, & Computers 26, 117–124 (1994). https://doi.org/10.3758/BF03204603
Issue Date:
DOI: https://doi.org/10.3758/BF03204603