Closed-Loop Adaptive Decision Support Based on Automated Trust Assessment
This paper argues that it is important to study issues concerning trust and reliance when developing systems that are intended to augment cognition. Operators often under-rely on the help of a support system that provides advice or that performs certain cognitive tasks autonomously. The decision to rely on support seems to be largely determined by the notion of relative trust. However, this decision to rely on support is not always appropriate, especially when support systems are not perfectly reliable. Because the operator’s reliability estimations are typically imperfectly aligned or calibrated with the support system’s true capabilities, we propose that the aid makes an estimation of the extent of this calibration (under different circumstances) and intervenes accordingly. This system is intended to improve overall performance of the operator-support system as a whole. The possibilities in terms of application of these ideas are explored and an implementation of this concept in an abstract task environment has been used as a case study.
KeywordsAdaptive System Task Allocation Reliance Decision Relative Trust Adaptive Support
Unable to display preview. Download preview PDF.
- 2.Lee, J.D., Moray, N.: Trust, control strategies and allocation of function in human machine systems. Ergonomics 22, 671–691 (1992)Google Scholar
- 5.van Maanen, P.-P., van Dongen, K.: Towards task allocation decision support by means of cognitive modeling of trust. In: Proceedings of the Eighth International Workshop on Trust in Agent Societies (Trust 2005), pp. 168–77. Utrecht, The Netherlands (July 2005)Google Scholar
- 6.van Dongen, K., van Maanen, P.-P.: Under-reliance on the decision aid: A difference in calibration and attribution between self and aid. In: Proceedings of the Human Factors and Ergonomics Society’s 50th Annual Meeting, San Francisco, USA (2006)Google Scholar
- 7.Parasuraman, R., Mouloua, M., Hilburn, B.: Adaptive aiding and adaptive task allocation enhance human-machine interaction. Automation Technology and Human Performance: Current Research and Trends 22, 119–123 (1999)Google Scholar
- 11.van Dongen, K., van Maanen, P.-P.: Designing for dynamic task allocation. In: Proceedings of the Seventh International Naturalistic Decision Making Conference (NDM7), Amsterdam, The Netherlands (2005)Google Scholar
- 13.Gelman, A., Carlin, J.B., Stern, H.S., Rubin, D.B.: Bayesian Data Analysis. 2nd edn. Chapman & Hall/CRC (2004)Google Scholar