Abstract
This paper describes how Cognitive Work Analysis (CWA) can be utilized to support a system-level usability analysis. Overall, we suggest that CWA-derived work tasks should be considered as useful in guiding the development of scenario-based usability questions. We also suggest that usability practitioners be mindful of the importance of time consistencies in developing scenarios and in the appropriate timing of questions throughout the scenario. When evaluating the results of a system level usability experiment it is useful to view the results in light of cognitive and attentional biases.
Chapter PDF
Similar content being viewed by others
References
Zelik, D.J., Patterson, E.S., Woods, D.D.: Measuring attributes of rigor in information analysis. In: Patterson, E., Miller, J.E. (eds.) Macrocognition Metrics and Scenarios: Design and Evaluation for Real-World Teams, pp. 65–83. Ashgate, Aldershot (2010)
Chalmers, B.A.: Developing an Information Integration Display for Submarine Command and Control. Presented at Undersea Human Systems Integration Symposium 2011. American Society of Naval Engineers (2011)
Xiao, T., Sanderson, P.M.: Developing and evaluating the organizational constraints analysis (OCA) approach to analysing work coordination via resource allocation case studies. Presented at the Human Factors and Ergonomics Society 56th Annual Meeting, pp. 373-377 (2012)
Vicente, K.J.: Cognitive Work Analysis: Toward Safe, Productive, and Health Computer-Based Work (eds). Lawrence Erlbaum Associates Inc., Mahwah (1999)
Read, G., Salmon, P., Lenne, M.: From Work Analysis to Work Design: A review of Cognitive Work Analysis Design Applications. Presented at the Human Factors and Ergonomics Society 56th Annual Meeting, pp. 368–372 (2012)
Rehak, L., Karthaus, C., Lee, B., Matthews, M., Taylor, T.: Human Systems Integration (HSI) Personal Communication
Roth, E.M., Eggleston, R.G.: Forging new evaluation paradigms: Beyond statistical generalization. In: Patterson, E.S., Miller, J. (eds.) Macrocognition Metrics and Scenarios: Design and Evaluation for Real-World Teams, pp. 203–219. Ashgate Publishing (2010)
O’Hara, J.: A quasi-experimental model of complex human machine system validation. International Journal of Cognition, Technology, and Work 1, 37–46 (1999)
Redish, G.: Expanding Usability Testing to Evaluate Complex Systems. Journal of Usability Studies 2, 102–111 (2007)
Pfautz, J., Roth, E.: Using cognitive engineering for system design and evaluation: A visualization aid for stability and support operations. International Journal of Industrial Ergonomics 5, 389–407 (2006)
Patterson, E.S., Roth, E.M., Woods, D.D.: Facets of complexity in situated work. In: Patterson, E.S., Miller, J. (eds.) Macrocognition Metrics and Scenarios: Design and Evaluation for Real-World Teams, pp. 1–10. Ashgate Publishing (2010)
Rousseau, R., Tremblay, S., Lafond, D., Vachon, F., Breton, R.: Assessing temporal support for dynamic decision making in C2. Presented at the 51st Annual Meeting of the Human Factors and Ergonomics Society Baltimore, MD, pp. 1259–1262 (2007)
Bryant, D.J., Webb, R.D.G., McCann, C.: Synthesizing two approaches to decision making in command and control. Canadian Military Journal 4, 29–34 (2003)
Bellenkes, A.H., Wickens, C.D., Kramer, A.F.: Visual scanning and pilot expertise: The role of attentional flexibility and mental model development. Aviation, Space, and Environmental Medicine 68, 569–579 (1997)
Freyd, J.J.: Dynamic Mental Representations. Psychological Review 94, 427–438 (1987)
Lamoureux, T., Pasma, D., Kersten, C.: CAE PS Personal Communication
Wickens, C., Hollands, J.: Engineering Psychology and Human Performance. Prentice Hall, Upper Saddle River (2000)
Donk, M.: Human Monitoring behavior in a multiple-instrument setting: Independent sampling, sequential sampling or arrangement-dependent sampling. Acta Psychologica 86, 31–55 (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hunter, A., Randall, T. (2013). Using Cognitive Work Analysis to Drive Usability Evaluations in Complex Systems. In: Harris, D. (eds) Engineering Psychology and Cognitive Ergonomics. Understanding Human Cognition. EPCE 2013. Lecture Notes in Computer Science(), vol 8019. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39360-0_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-39360-0_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39359-4
Online ISBN: 978-3-642-39360-0
eBook Packages: Computer ScienceComputer Science (R0)