Abstract
This paper discusses two studies testing the effects of agent transparency in joint cognitive systems involving supervisory control and decision-making. Specifically, we examine the impact of agent transparency on operator performance (decision accuracy), response time, perceived workload, perceived usability of the agent, and operator trust in the agent. Transparency has a positive impact on operator performance, usability, and trust, yet the depiction of uncertainty has potentially negative effects on usability and trust. Guidelines and considerations for displaying transparency in joint cognitive systems are discussed.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chen, J.Y.C., Barnes, M.J.: Human-agent teaming for multi-robot control: a review of human factors issues. IEEE Trans. Hum. Mach. Syst. 44, 13–29 (2014)
Linegang, M.P., Stoner, H.A., Patterson, M.J., Seppelt, B.D., Hoffman, J.D., Crittendon, Z.B., Lee, J.D.: Human-automation collaboration in dynamic mission planning: a challenge requiring an ecological approach. In: Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting, pp. 2482–2486. SAGE Publications, California (2006)
Hollnagel, E., Woods, D.D.: Joint Cognitive Systems: Foundations of Cognitive Systems Engineering. CRC Press, Boca Raton (2005)
Boy, G.A.: Cognitive Function Analysis. Ablex Publishing Corporation, Stamford (1998)
Kasdaglis, N., Newton, O., Lakhmani, S.: system state awareness: a human centered design approach to awareness in a complex world. In: Proceedings of the Human Factors and Ergonomics Society 58th Annual Meeting, pp. 305–309, SAGE Publications, California (2014)
Hollnagel, E., Woods, D., Leveson, N.: Resilience Engineering: Concepts and Precepts. Ashgate, Surrey (2006)
Boy, G.: Theories of human cognition: to better understand the co-adaptation of people and technology. In: Kiel, LD (ed.) Knowledge Management, Organizational Intelligence and Learning, and Complexity, vol. 3, Developed under the Auspices of the UNESCO, pp. 204–238. Eolss Publishers Co Ltd, Oxford (2009)
Parasuraman, R., Cosenzo, K.A.De, Visser, E.: Adaptive automation for human supervision of multiple uninhabited vehicles: effects on change detection, situation awareness, and mental workload. Mil. Psychol. 21, 270–297 (2009)
Lee, J.D., See, K.A.: Trust in automation: designing for appropriate reliance. Hum. Factors 46, 50–80 (2004)
Chen, J.Y.C., Procci, K., Boyce, M., Wright, J., Garcia, A., Barnes, M.: Situation awareness-based agent transparency (ARL-TR-6905). Technical Report, US Army Research Laboratory, Aberdeen Proving Ground (2014)
Endsley, M.R.: Toward a theory of situation awareness in dynamic systems. Hum. Factors 37, 32–64 (1995)
Smith, K., Hancock, P.: Situation awareness is adaptive, externally directed consciousness. Hum. Factors 37, 137–148 (1995)
Endsley, M.R., Jones, D.G.: Designing for Situation Awareness: An Approach to User-Centered Design. CRC Press, Boca Raton (2012)
Stanton, N.A., Chambers, P.R., Piggott, J.: Situational awareness and safety. Saf. Sci. 39, 189–204 (2001)
Woods, D.D.: Cognitive technologies: the design of joint human-machine cognitive systems. AI Mag. 6, 86–92 (1985)
Hollnagel, E., Woods, D.D.: Joint Cognitive Systems: Patterns in Cognitive Systems Engineering. CRC Press, Boca Raton (2006)
Cook, M.B., Smallman, H.S.: Human factors of the confirmation bias in intelligence analysis: decision support from graphical evidence landscapes. Hum. Factors 50, 745–754 (2008)
Neyedli, H.F., Hollands, J.G., Jamieson, G.A.: Beyond identity incorporating system reliability information into an automated combat identification system. Hum. Factors 53, 338–355 (2011)
Gao, J., Lee, J.: Extending the decision field theory to model operator’s reliance on automation in supervisory control systems. IEEE Trans. Syst. Man Cybern. A. Syst. Humans 36, 943–959 (2006)
Parasuraman, R., Riley, V.: Humans and automation: use, misuse, disuse. Abuse. Hum. Factors 39, 230–253 (1997)
Bratman, M.: Intention, Plans, and Practical reason. CSLI Publications, Stanford (1987)
Behymer, K.J., Mersch, E.M., Ruff, H.A., Calhoun, G.L., Spriggs, S.E.: unmanned vehicle plan comparison visualization for effective human-autonomy teaming. In: Proceedings of 6th international conference on ahfe and the affiliated conference, pp. 1022–1029. Elsevier B. V, Netherlands (2015)
U.S. Department of Defense—Research & Engineering Enterprise. Autonomy Research Pilot Initiative. http://www.acq.osd.mil/chieftechnologist/arpi.html
Draper, M.: Realizing autonomy via intelligent adaptive hybrid control: adaptable autonomy for achieving UxV RSTA team decision superiority—year 1 report. US Air Force Research Laboratory, Dayton (in press)
Fern, L., Shively, R.J.: A comparison of varying levels of automation on the supervisory control of multiple UASs. In: Proceedings of AUVSIs Unmanned Systems North America, pp. 10–13. Curran Associates Inc., New York (2009)
Miller, C.A., Parasuraman, R.: Designing for flexible interaction between humans and automation: delegation interfaces for supervisory control. Hum. Factors 49, 57–75 (2007)
Rowe, A., Spriggs, S., Hooper, D.: Fusion: a framework for human interaction with flexible-adaptive automation across multiple unmanned systems. In: Proceedings of 18th symposium on aviation psychology, pp. 464–469. Curran Associates Inc., New York (2015)
Mercado, J., Rupp, M., Chen, J., Barber, D., Procci, K., Barnes, M.: Intelligent agent transparency in human-agent teaming for multi-UxV management. Human Factors (in press)
Stowers, K., Chen, J.Y.C., Kasdaglis, N., Newton, O., Rupp, M., Barnes, M.: Effects of situation awareness-based agent transparency information on human agent teaming for multi-UxV management (in press)
Lyons, J.B., Havig, P.R.: Transparency in a human-machine context: approaches for fostering shared awareness/intent. In: Shumaker, R., Lackey, S. (eds.) Virtual, Augmented and Mixed Reality: Designing and Developing Virtual and Augmented Environments, pp. 181–190. Springer, Berlin (2014)
Wang, L., Jamieson, G.A., Hollands, J.G.: Trust and reliance on an automated combat identification system. Hum. Factors 51, 281–291 (2009)
Merritt, S.M., Heimbaugh, H., LaChapell, J., Lee, D.: I trust it, but i don’t know why effects of implicit attitudes toward automation on trust in an automated system. Hum. Factors 55, 520–534 (2012)
Stowers, K., Kasdaglis, N., Newton, O., Lakhmani, S., Wohleber, R., Chen, J.: Intelligent agent transparency: the design and evaluation of an interface to facilitate human and artificial agent collaboration. In: Proceedings of the Human Factors and Ergonomics 60th Annual Meeting (submitted)
Endsley, Mica R.: Designing for Situation Awareness: An Approach to User-Centered Design. CRC Press, Boca Raton (2011)
Stowers, K., Oglesby, J., Leyva, K., Iwig, C., Shimono, M., Hughes, A., Salas, E.: A framework to guide the assessment of human-machine systems. Human Factors (submitted)
Acknowledgments
This research was supported by the U.S. Department of Defense Autonomy Research Pilot Initiative, under the Intelligent Multi-UxV Planner With Adaptive Collaborative/Control Technologies (IMPACT) project. We wish to thank Joseph Mercado, Katelyn Procci, Isacc Yi, Erica Valiente, Shan Lakhmani, and Jonathan Harris for their contribution to this project. We would also like to thank Gloria Calhoun and Mark Draper for their input.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing Switzerland
About this paper
Cite this paper
Stowers, K., Kasdaglis, N., Rupp, M., Chen, J., Barber, D., Barnes, M. (2017). Insights into Human-Agent Teaming: Intelligent Agent Transparency and Uncertainty. In: Savage-Knepshield, P., Chen, J. (eds) Advances in Human Factors in Robots and Unmanned Systems. Advances in Intelligent Systems and Computing, vol 499. Springer, Cham. https://doi.org/10.1007/978-3-319-41959-6_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-41959-6_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-41958-9
Online ISBN: 978-3-319-41959-6
eBook Packages: EngineeringEngineering (R0)