Abstract
As a result of the exponential growth in technology and computing in recent years, autonomous systems are becoming more relevant in our daily lives. As these systems evolve and become more complex, the notion of trust in human-autonomy interaction becomes a prominent issue that affects the performance of human-autonomy teaming. Prior studies indicate that humans have low levels of trust in semi and fully autonomous systems. In this survey, we review a wide range of technical papers and articles and go over the related experimental techniques in the literature of trust. We also explain limitations that are present in existing research works, and discuss open problems in this domain. It’s apparent that trust management is critical for the development of future artificial intelligence technologies.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Beer, J., Fisk, A.D., Rogers, W.A.: Toward a framework for levels of robot autonomy in human-robot interaction. J. Hum. Robot. Interact. 3(2), 74 (2014)
Parasuraman, R., Riley, V.: Humans and automation: use, misuse, disuse, abuse. Hum. Factors J. Hum. Factors Ergon. Soc. 39(2), 230–253 (1997)
Lee, J.D., See, K.A.: Trust in automation: designing for appropriate reliance. Hum. Factors J. Hum. Factors Ergon. Soc. 46(1), 50–80 (2004)
Schaefer, K.E.: The perception and measurement of human-robot trust, Ph.D. dissertation, University of Central Florida Orlando, Florida (2013)
Autonomy. Full Definition of autonomy. Merriam-Webster (2016)
Bekey, G.A.: Autonomous Robots: From Biological Inspiration to Implementation and Control (Intelligent Robotics and Autonomous Agents). The MIT Press, Cambridge (2005)
Robinson, M.: Science and Technology in the Industrial Revolution. University of Toronto Press, Toronto (1969)
Adams, B.D., Bruyn, L.E., Houde, S.: Trust in Automated Systems. Literature Review. Human Systems Incorporated, Guelph (2003)
Nojoumian, M., Lethbridge, T.C.: A new approach for the trust calculation in social networks. In: E-business and Telecommunication Networks: 3rd International Conference on E-Business, Best Papers. CCIS, vol. 9, pp. 64–77. Springer (2008)
Nojoumian, M.: Trust, influence and reputation management based on human reasoning. In: 4th AAAI Workshop on Incentives and Trust in E-Communities, WIT-EC 2015, pp. 21–24 (2015)
Nojoumian, M., Stinson, D.R.: Social secret sharing in cloud computing using a new trust function. In: 10th IEEE Annual International Conference on Privacy, Security and Trust (PST), pp. 161–167 (2012)
Trust: Definition of trust in English. Oxford-dictionaries (2016)
Muir, B.M.: Trust between humans and machines, and the design of decision aids. Int. J. Man Mach. Stud. 27(5–6), 527–539 (1987)
Power, D.: Types of Decision Support Systems. gdrc.org (2016)
Madhavan, P., Wiegmann, D.A.: Similarities and differences between human-human and human-automation trust: an integrative review. Theor. Issues Ergon. Sci. 8(4), 277–301 (2007)
Lee, J., Moray, N.: Trust, control strategies and allocation of function in human-machine systems. Ergonomics 35(10), 1243–1270 (1992)
Muir, B.M.: Trust in automation: Part I. Theoretical issues in the study of trust and human intervention in automated systems. Ergonomics 37(11), 1905–1922 (1994)
Muir, B.M., Moray, N.: Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. Ergonomics 39(3), 429–460 (1996)
Dassonville, I., Jolly, D., Desodt, A.: Trust between man and machine in a teleoperation system. Reliab. Eng. Syst. Saf. 53(3), 319–325 (1996)
Moray, N., Inagaki, T.: Laboratory studies of trust between humans and machines in automated systems. Trans. Inst. Meas. Control. 21(4–5), 203–211 (1999)
Itoh, M., Abe, G., Tanaka, K.: Trust in and use of automation: their dependence on occurrence patterns of malfunctions. In: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, SMC 1999, vol. 3, pp. 715–720. IEEE (1999)
Dzindolet, M.T., Peterson, S.A., Pomranky, R.A., Pierce, L.G., Beck, H.P.: The role of trust in automation reliance. Int. J. Hum. Comput. Stud. 58(6), 697–718 (2003)
Merritt, S.M., Ilgen, D.R.: Not all trust is created equal: dispositional and history-based trust in human-automation interactions. Hum. Factors J. Hum. Factors Ergon. Soc. 50(2), 194–210 (2008)
Murphy, R.R., Riddle, D., Rasmussen, E.: Robot-assisted medical reachback: a survey of how medical personnel expect to interact with rescue robots. In: 13th IEEE International Workshop on Robot and Human Interactive Communication, ROMAN 2004, pp. 301–306. IEEE (2004)
Carlson, J., Murphy, R.R.: An investigation of MML methods for fault diagnosis in mobile robots. In: Proceedings of the 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2004), vol. 1, pp. 180–186. IEEE (2004)
Parasuraman, R., Miller, C.A.: Trust and etiquette in high-criticality automated systems. Commun. ACM 47(4), 51–55 (2004)
Stormont, D.P.: Analyzing human trust of autonomous systems in hazardous environments. In: Proceedings of the Human Implications of Human-Robot Interaction workshop at AAAI, pp. 27–32 (2008)
Article 36, Ban-autonomous-armed-robots, Article 36 (2012)
Li, D., Rau, P.P., Li, Y.: A cross-cultural study: effect of robot appearance and task. Int. J. Soc. Robot. 2(2), 175–186 (2010)
Hancock, P.A., Billings, D.R., Schaefer, K.E., Chen, J.Y., De Visser, E.J., Parasuraman, R.: A meta-analysis of factors affecting trust in human-robot interaction. J. Hum. Factors Ergon. Soc. 53(5), 517–527 (2011)
Yagoda, R.E., Gillan, D.J.: You want me to trust a robot? The development of a human-robot interaction trust scale. Int. J. Soc. Robot. 4(3), 235–248 (2012)
Penders, J., Jones, P., Ranasinghe, A., Nanayakara, T.: Enhancing trust and confidence in human robot interaction, Technical report (2013)
Castelfranchi, C., Falcone, R.: Trust and control: a dialectic link. Appl. Artif. Intell. 14(8), 799–823 (2000)
Wang, Y., Shi, Z., Wang, C., Zhang, F.: Human-robot mutual trust in (semi) autonomous underwater robots. In: Cooperative Robots and Sensor Networks, pp. 115–137. Springer (2014)
Hu, W.-L., Akash, K., Jain, N., Reid, T.: Real-time sensing of trust in human-machine interactions. IFAC-PapersOnLine 49(32), 48–53 (2016)
Abd, M., Gonzalez, I., Nojoumian, M., Engeberg, E.: Impacts of robot assistant performance on human trust, satisfaction, and frustration. In: To appear in RSS: Morality and Social Trust in Autonomous Robots (2017)
Abd, M., Gonzalez, I., Nojoumian, M., Engeberg, E.: Trust, satisfaction and frustration measurements for real-time human-robot interaction. In: 30th Florida Conference on Recent Advances in Robotics, pp. 89–93 (2017)
Driverless future, Forecasts (2016). http://www.driverless-future.com/6
Uggirala, A., Gramopadhye, A.K., Melloy, B.J., Toler, J.E.: Measurement of trust in complex and dynamic systems using a quantitative approach. Int. J. Ind. Ergon. 34(3), 175–186 (2004)
Helldin, T., Falkman, G., Riveiro, M., Davidsson, S.: Presenting system uncertainty in automotive UIs for supporting trust calibration in autonomous driving. In: Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 210–217. ACM (2013)
Howard, D., Dai, D.: Public perceptions of self-driving cars: the case of Berkeley, California. In: Transportation Research Board 93rd Annual Meeting (2014)
Carlson, M.S., Desai, M., Drury, J.L., Kwak, H., Yanco, H.A.: Identifying factors that influence trust in automated cars and medical diagnosis systems. In: AAAI Symposium on The Intersection of Robust Intelligence and Trust in Autonomous Systems, pp. 20–27 (2014)
Kyriakidis, M., Happee, R., De Winter, J.: Public opinion on automated driving: results of an international questionnaire among 5000 respondents. Transp. Res. Part F Traffic Psychol. Behav. 32, 127–140 (2015)
Wagner, M., Koopman, P.: A philosophy for developing trust in self-driving cars. In: Road Vehicle Automation, vol. 2, pp. 163–171. Springer (2015)
Butakov, V., Ioannou, P.: Driving autopilot with personalization feature for improved safety and comfort. In: 18th International Conference on Intelligent Transportation Systems, pp. 387–393. IEEE (2015)
Payre, W., Cestac, J., Delhomme, P.: Fully automated driving impact of trust and practice on manual control recovery. Hum. Factors J. Hum. Factors Ergon. Soc. 58(2), 229–241 (2016)
Akash, K., Hu, W.-L., Reid, T., Jain, N.: Dynamic modeling of trust in human-machine interactions. In: American Control Conference (ACC), pp. 1542–1548. IEEE (2017)
Daziano, R.A., Sarrias, M., Leard, B.: Are consumers willing to pay to let cars drive for them? Analyzing response to autonomous vehicles. Transp. Res. Part C Emerg. Technol. 78, 150–164 (2017). http://www.sciencedirect.com/science/article/pii/S0968090X17300682
de Vries, P., Midden, C., Bouwhuis, D.: The effects of errors on system trust, self-confidence, and the allocation of control in route planning. Int. J. Hum. Comput. Stud. 58(6), 719–735 (2003)
Kelly, C.: Guidelines for trust in future ATM systems-principles, Technical report (2003)
Jiang, X., Khasawneh, M.T., Master, R., Bowling, S.R., Gramopadhye, A.K., Melloy, B.J., Grimes, L.: Measurement of human trust in a hybrid inspection system based on signal detection theory measures. Int. J. Ind. Ergon. 34(5), 407–419 (2004)
Seong, Y., Bisantz, A.M.: The impact of cognitive feedback on judgment performance and trust with decision aids. Int. J. Ind. Ergon. 38(7), 608–625 (2008)
Winter, S.R., Rice, S., Mehta, R., Cremer, I., Reid, K.M., Rosser, T.G., Moore, J.C.: Indian and american consumer perceptions of cockpit configuration policy. J. Air Transp. Manag. 42, 226–231 (2015)
Acknowledgment
We would like to thank FAU for supporting this project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Shahrdar, S., Menezes, L., Nojoumian, M. (2019). A Survey on Trust in Autonomous Systems. In: Arai, K., Kapoor, S., Bhatia, R. (eds) Intelligent Computing. SAI 2018. Advances in Intelligent Systems and Computing, vol 857. Springer, Cham. https://doi.org/10.1007/978-3-030-01177-2_27
Download citation
DOI: https://doi.org/10.1007/978-3-030-01177-2_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-01176-5
Online ISBN: 978-3-030-01177-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)