Abstract
We present results from a study on constructing and evaluating a support tool for the extraction of patterns in distributed decision -making processes, based on design criteria elicited from a study on the work process involved in studying such decision-making. Specifically, we devised and evaluated an analysis tool for C2 researchers who study simulated decision-making scenarios for command teams. The analysis tool used text clustering as an underlying pattern extraction technique and was evaluated together with C2 researchers in a workshop to establish whether the design criteria were valid and the approach taken with the analysis tool was sound. Design criteria elicited from an earlier study with researchers (open-endedness and transparency) were highly consistent with the results from the workshop. Specifically, evaluation results indicate that successful deployment of advanced analysis tools requires that tools can treat multiple data sources and offer rich opportunities for manipulation and interaction (open-endedness) and careful design of visual presentations and explanations of the techniques used (transparency). Finally, the results point to the high relevance and promise of using text clustering as a support for analysis of C2 data.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alberts D, Hayes R (2003) Power to the edge: command, control in the information age. CCRP Publication Series, Washington, DC
Albinsson P-A, Morin M (2002) Visual exploration of communication in command and control. In: Proceedings of the sixth international conference on information visualisation, London, UK
Andriole SJ (1989) Handbook of decision support systems. TAB Books Inc, Blue Ridge Summit
Argyle M (1972) The social psychology of work. The Penguin Press, London
Brown R (1993) Group processes—dynamics within and between groups. Blackwell, Cambridge
Cannon-Bowers JA, Salas E, Pruitt JS (1996) Establishing the boundaries of a paradigm for decision-making research. Hum Factors 38(2):193–205
Cutting DR, Karger DR, Pedersen JO, Tukey JW (1992) Scatter/gather: a cluster-based approach to browsing large document collections. In: Proceedings of the 15th annual international ACM SIGIR conference on research and development in information retrieval
Hollnagel E, Bye A (2000) Principles for modelling function allocation. Int J Hum Comput Stud 52:253–265
Hollnagel E, Woods DA (2005) Joint cognitive systems: foundations of cognitive systems engineering. CRC Press, Boca Raton
Johansson B, Persson M, Granlund R, Mattsson P (2003) C3fire in command and control research. Cogn Technol Work 5(3):191–196
Lazar J, Feng JH, Hochheiser H (2010) Research methods in human-computer interaction. Wiley, London
Leifler O (2008) Combining technical and human-centered strategies for decision support in command and control—the ComPlan approach. In: Proceedings of the 5th international conference on information systems for crisis response and management
Leifler O, Eriksson H (2010a) Analysis tools for studying in decision-making—a meta-study of command and control research. Manuscript
Leifler O, Eriksson H (2010b) Message classification as a basis for studying command and control communications—an evaluation of machine learning approaches (submitted)
Miles MB, Huberman AM (1994) Qualitative data analysis: an expanded sourcebook. SAGE, Thousand Oaks
Morin M (2002) Multimedia representations of distributed tactical operations. PhD thesis, Institute of Technology, Linköpings universitet
Orasanu J, Conolly T (1993) The reinvention of decision making. In: Klein GA, Orasanu J, Calderwood R, Zsambok CE (eds) Decision making in action. Ablex Publishing corporation, Norwood
Rasmussen J (1993) Deciding and doing: decision-making in natural contexts. In: Klein GA, Orasanu J, Calderwood R, Zsambok CE (eds) Decision making in action: models and methods. Ablex Publishing corporation, New York
Rosell M (2009) Text clustering exploration—Swedish text representation and clustering results unraveled. PhD thesis, KTH School of Science and Communication
Rosell M, Velupillai S (2008) Revealing relations between open and closed answers in questionnaires through text clustering evaluation. In: Proceedings of LREC 2008, Marrakesh, Morocco
Rubel RC (2001) War-gaming network-centric warfare. Naval War College Rev 54(2):61–74
Sanderson P, Fisher C (1994) Exploratory sequential data analysis: foundations. Hum Comput Interact 9:251–317
Shattuck LG, Woods DD (2000) Communication of intent in military command and control systems. In: McCann C, Pigeau R (eds) The Human in command: exploring the modern military experience. Kluwer/Plenum, London, pp 279–292
Thorstensson M, Axelsson M, Morin M, Jenvald J (2001) Monitoring and analysis of command post communication in rescue operations. Saf Sci 39:51–60
van der Aalst W, van Hee KM (2002) Workflow management: models, methods, and systems. MIT Press, Cambridge
Wærn Y, Cañas JJ (2003) Microworld task environments for conducting research on command and control. Cogn Technol Work 5(3):181–182. doi:10.1007/s10111-003-0126-y
Acknowledgments
This work was supported by the Swedish National Defense College. We would like to thank the participants at the Swedish Defense Research Agency and VSL Systems AB for participating in this study and generously providing material used for the scenarios in this article.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Leifler, O., Eriksson, H. Automated text-based analysis for decision-making research. Cogn Tech Work 14, 129–142 (2012). https://doi.org/10.1007/s10111-010-0170-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10111-010-0170-3