Abstract
System performance is the central determinant of user trust in human–machine communication; however, performance failure is inevitable. This study develops a three-fold typology of performance failures (i.e., logic, semantic, and syntax) commonly observed in human-robot interactions based on the differences between the expected and actual outcomes. Herein, 1027 observations are collected from an online experiment to elucidate how the three types of failure and four repair methods (namely, internal attribution apology, external attribution apology, denial, and no repair) impact user trust while examining blame attributions as an underlying mechanism. The results reveal that despite some similarities, the interactions between trust violation types and repair methods differ in robot-to-human trust repair from those in human-to-human trust repair, which contradicts previous findings. Logic failures are found to be the most detrimental category of performance failures, and the internal-attribution apology is the optimal repair strategy. Notably, participants report greater levels of competence-based trust beliefs if they believe that the situation is jointly controlled by the human interactant and robot.
Similar content being viewed by others
Notes
\(\hbox {CVR} = (\hbox {n}_e - N/2) / (N/2) \hbox {n}_e\) = number of subject matter experts (SMEs) indicating that an item is “extremely important to include in the scale”; N = total number of SMEs.
References
Don L (2021) As covid-19 wanes, employers are accelerating the use of robots. Where does that leave workers? Los Angeles Times, El Segundo
Peterson ER, Toland T, Huddart G (2021) Robots vs. covid-19: how the pandemic is accelerating automation. Kearney, Chicago
Goodrich MA, Schultz AC (2008) Human-robot interaction: a survey. Now Publishers Inc, Hanover
Sanders T, Kaplan A, Koch R, Schwartz M, Hancock PA (2019) The relationship between trust and use choice in human-robot interaction. Hum Factors 61(4):614–626
Baker AL, Phillips EK, Ullman D, Keebler JR (2018) Toward an understanding of trust repair in human-robot interaction: current research and future directions. ACM Trans Interact Intell Syst (TiiS) 8(4):1–30
Hancock PA, Kessler TT, Kaplan AD, Brill JC, Szalma JL (2021) Evolving trust in robots: specification through sequential and comparative meta-analyses. Hum Factors 63(7):1196–1229
Hancock PA, Billings DR, Schaefer KE, Chen JYC, De Visser EJ, Parasuraman R (2011) A meta-analysis of factors affecting trust in human-robot interaction. Hum Factors 53(5):517–527
Desai M, Medvedev M, Vázquez M, McSheehy S, Gadea-Omelchenko S, Bruggeman C, Steinfeld A, Yanco H (2012) Effects of changing reliability on trust of robot systems. In: 2012 7th ACM/IEEE international conference on human-robot interaction (HRI), pp 73–80. IEEE
Desai M, Kaniarasu P, Medvedev M, Steinfeld A, Yanco H (2013) Impact of robot failures and feedback on real-time trust. In: 2013 8th ACM/IEEE international conference on human-robot interaction (HRI), pp 251–258. IEEE
Salem M, Lakatos G, Amirabdollahian F, Dautenhahn K (2015) Would you trust a (faulty) robot? Effects of error, task type and personality on human-robot cooperation and trust. In: 2015 10th ACM/IEEE international conference on human-robot interaction (HRI), pp 1–8. IEEE
Kim PH, Ferrin DL, Cooper CD, Dirks KT (2004) Removing the shadow of suspicion: the effects of apology versus denial for repairing competence-versus integrity-based trust violations. J Appl Psychol 89(1):104
Kim PH, Dirks KT, Cooper CD, Ferrin DL (2006) When more blame is better than less: the implications of internal vs. external attributions for the repair of trust after a competence-vs. integrity-based trust violation. Organ Behav Hum Decis Process 99(1):49–65
Robinette P, Howard AM, Wagner AR (2017) Effect of robot performance on human–robot trust in time-critical situations. IEEE Trans Hum-Mach Syst 47(4):425–436
Atkinson D, Hancock P, Hoffman RR, Lee JD, Rovira E, Stokes C, Wagner AR (2012) Trust in computers and robots: the uses and boundaries of the analogy to interpersonal trust. In: Proceedings of the human factors and ergonomics society annual meeting, vol. 56, pp 303–307. SAGE Publications Sage CA, Los Angeles
Schaefer, K. (2013). The perception and measurement of human-robot trust. Electronic Theses and Dissertations (No. 2688). University of Central Florida
Sanders TL, Kaplan AD, MacArthur K, Volante WG, Hancock PA (2021) Trust and human factors. In F Krueger (ed.) The neurobiology of trust, pp 77-93 Cambridge University Press
Lankton NK, McKnight DH (2011) What does it mean to trust facebook? Examining technology and interpersonal trust beliefs. ACM SIGMIS Database DATABASE Adv Inf Syst 42(2):32–54
Lee JD, See KA (2004) Trust in automation: designing for appropriate reliance. Hum Factors 46(1):50–80
Mayer RC, Davis JH, Schoorman FD (1995) An integrative model of organizational trust. Acad Manag Rev 20(3):709–734
Malle, B. F., & Ullman, D. (2021). A multi-dimensional conception and measure of human-robot trust. In C. S. Nam and J. B. Lyons (eds.), Trust in human-robot interaction: research and applications (pp. 3-25). Elsevier
Bies, R. J., & Tripp, T. M. (1996). Beyond distrust: "Getting even" and the need for revenge. In R. M. Kramer & T. R. Tyler (Eds.), Trust in organizations: Frontiers of theory and research (pp. 246–260). Sage Publications, Inc. urlhttps://doi.org/10.4135/9781452243610.n12
Srinivasan Rao V, Lee SJ (2007) Responses to trust violation: a theoretical framework. J Comput Inf Syst 48(1):76–87
Kramer RM, Lewicki RJ (2010) Repairing and enhancing trust: approaches to reducing organizational trust deficits. Acad Manag Ann 4(1):245–277
Reeder GD, Brewer MB (1979) A schematic model of dispositional attribution in interpersonal perception. Psychol Rev 86(1):61
Rusconi P, Sacchi S, Capellini R, Brambilla M, Cherubini P (2017) You are fair, but i expect you to also behave unfairly: positive asymmetry in trait-behavior relations for moderate morality information. PLoS ONE 12(7):e0180686
Ferrin DL, Kim PH, Cooper CD, Dirks KT (2007) Silence speaks volumes: the effectiveness of reticence in comparison to apology and denial for responding to integrity-and competence-based trust violations. J Appl Psychol 92(4):893
Kim PH, Cooper CD, Dirks KT, Ferrin DL (2013) Repairing trust with individuals vs. groups. Organ Behav Hum Decis Process 120(1):1–14
Bachmann R, Gillespie N, Priem R (2015) Repairing trust in organizations and institutions: toward a conceptual framework. Organ Stud 36(9):1123–1142
Eberl P, Geiger D, Aßländer MS (2015) Repairing trust in an organization after integrity violations: the ambivalence of organizational rule adjustments. Organ Stud 36(9):1205–1235
Fuoli M, van de Weijer J, Paradis C (2017) Denial outperforms apology in repairing organizational trust despite strong evidence of guilt. Public Relat Rev 43(4):645–660
Gillespie N, Dietz G (2009) Trust repair after an organization-level failure. Acad Manag Rev 34(1):127–145
Janowicz-Panjaitan M, Krishnan R (2009) Measures for dealing with competence and integrity violations of interorganizational trust at the corporate and operating levels of organizational hierarchy. J Manag Stud 46(2):245–268
Poppo L, Schepker DJ (2010) Repairing public trust in organizations. Corp Reput Rev 13(2):124–141
Utz S, Matzat U, Snijders C (2009) On-line reputation systems: the effects of feedback comments and reactions on building and rebuilding trust in on-line auctions. Int J Electron Commer 13(3):95–118
Bansal G, Zahedi FM (2015) Trust violation and repair: the information privacy perspective. Decis Support Syst 71:62–77
Groom V, Chen J, Johnson T, Kara FA, Nass C (2010) Critic, compatriot, or chump?: Responses to robot blame attribution. In: 2010 5th ACM/IEEE international conference on human-robot interaction (HRI), pp 211–217. IEEE
Kaniarasu P, Steinfeld AM (2014) Effects of blame on trust in human robot interaction. In: The 23rd IEEE international symposium on robot and human interactive communication, pp 850–855. IEEE
De Visser EJ, Monfort SS, McKendrick R, Smith MAB, McKnight PE, Krueger F, Parasuraman R (2016) Almost human: Anthropomorphism increases trust resilience in cognitive agents. J Exp Psychol Appl 22(3):331
Kohn SC, Quinn D, Pak R, de Visser EJ, Shaw TH (2018) Trust repair strategies with self-driving vehicles: an exploratory study. In: Proceedings of the human factors and ergonomics society annual meeting, vol. 62, pp 1108–1112. Sage Publications Sage CA, Los Angeles
Lee MK, Kiesler S, Forlizzi J, Srinivasa S, Rybski P (2010) Gracefully mitigating breakdowns in robotic services. In: 2010 5th ACM/IEEE international conference on human-robot interaction (HRI), pp 203–210. IEEE
Quinn DB (2018) Exploring the efficacy of social trust repair in humanautomation interactions. PhD thesis, Clemson University
Robinette P, Howard AM, Wagner AR (2015) Timing is key for robot trust repair. In: International conference on social robotics, pp 574–583. Springer
Sebo SS, Krishnamurthi P, Scassellati B (2019) “i don’t believe you”: investigating the effects of robot trust violation and repair. In: 2019 14th ACM/IEEE international conference on human-robot interaction (HRI), pp 57–65. IEEE
Tzeng J-Y (2004) Toward a more civilized design: studying the effects of computers that apologize. Int J Hum Comput Stud 61(3):319–345
Wagner AR (2016) Trust and trustworthiness in human-robot interaction: a formal conceptualization. Technical report, Georgia Tech Research Institute Atlanta, United States
Albayram Y, Jensen T, Khan MMH, Fahim MAA, Buck R, Coman E (2020) Investigating the effects of (empty) promises on human-automation interaction and trust repair. In: Proceedings of the 8th international conference on human-agent interaction, pp 6–14
Correia F, Guerra C, Mascarenhas S, Melo FS, Paiva A (2018) Exploring the impact of fault justification in human-robot trust. In: Proceedings of the 17th international conference on autonomous agents and multiagent systems, pp 507–513
Lucas GM, Boberg J, Traum D, Artstein R, Gratch J, Gainer A, Johnson E, Leuski A, Nakano M (2018) Getting to know each other: the role of social dialogue in recovery from errors in social robots. In: Proceedings of the 2018 ACM/IEEE international conference on human-robot interaction, pp 344–351
Brooks DJ (2017) A human-centric approach to autonomous robot failures. PhD thesis, University of Massachusetts Lowell
Parasuraman R, Sheridan TB, Wickens CD (2000) A model for types and levels of human interaction with automation. IEEE Trans Syst Man Cybern Part A: Syst Hum 30(3):286–297
Carlson J, Murphy RR (2005) How UGVs physically fail in the field. IEEE Trans Rob 21(3):423–437
Giuliani M, Mirnig N, Stollnberger G, Stadler S, Buchner R, Tscheligi M (2015) Systematic analysis of video data from different human-robot interaction studies: a categorization of social signals during error situations. Front Psychol 6:931
Davenport RB, Bustamante EA (2010) Effects of false-alarm vs. miss-prone automation and likelihood alarm technology on trust, reliance, and compliance in a miss-prone task. In: Proceedings of the human factors and ergonomics society annual meeting, vol. 54, pp 1513–1517. SAGE Publications Sage CA, Los Angeles
Johnson JD, Sanchez J, Fisk AD, Rogers WA (2004) Type of automation failure: the effects on trust and reliance in automation. In: Proceedings of the human factors and ergonomics society annual meeting, vol. 48, pp 2163–2167. SAGE Publications Sage CA, Los Angeles
Madhavan P, Wiegmann DA, Lacson FC (2006) Automation failures on tasks easily performed by operators undermine trust in automated aids. Hum Factors 48(2):241–256
Rovira E, Parasuraman R (2010) Transitioning to future air traffic management: effects of imperfect automation on controller attention and performance. Hum Factors 52(3):411–425
Ferrell C (1994) Failure recognition and fault tolerance of an autonomous robot. Adapt Behav 2(4):375–398
Ross R, Collier R, O’Hare Greg MP (2004) Demonstrating social error recovery with agentfactory. In: 3rd international joint conference on autonomous agents and multi agent systems (AAMAS04), New York. IEEE
Honig S, Oron-Gilad T (2018) Understanding and resolving failures in human-robot interaction: literature review and model development. Front Psychol 9:861
McCall D, Kölling M (2014) Meaningful categorisation of novice programmer errors. In: 2014 IEEE frontiers in education conference (FIE) proceedings, pp 1–8. IEEE
Lewicki RJ, Brinsfield C (2017) Trust repair. Annu Rev Organ Psych Organ Behav 4:287–313
Tomlinson EC, Mryer RC (2009) The role of causal attribution dimensions in trust repair. Acad Manag Rev 34(1):85–104
Goles T, Rao SV, Lee S, Warren J (2009) Trust violation in electronic commerce: customer concerns and reactions. J Comput Inf Syst 49(4):1–9
Weiner B (1985) An attributional theory of achievement motivation and emotion. Psychol Rev 92(4):548
Audrey Krosgaard M, Brodt SE, Whitener EM (2002) Trust in the face of conflict: the role of managerial trustworthy behavior and organizational context. J Appl Psychol 87(2):312
Shaw JC, Wild E, Colquitt JA (2003) To justify or excuse?: A meta-analytic review of the effects of explanations. J Appl Psychol 88(3):444
Stouten J, De Cremer D, Van Dijk E (2006) Violating equality in social dilemmas: emotional and retributive reactions as a function of trust, attribution, and honesty. Pers Soc Psychol Bull 32(7):894–906
Takaku S (2001) The effects of apology and perspective taking on interpersonal forgiveness: a dissonance-attribution model of interpersonal forgiveness. J Soc Psychol 141(4):494–508
Crant JM, Bateman TS (1993) Assignment of credit and blame for performance outcomes. Acad Manag J 36(1):7–27
Schlenker BR, Pontari BA, Christopher AN (2001) Excuses and character: personal and social implications of excuses. Pers Soc Psychol Rev 5(1):15–32
Tomlinson EC, Dineen BR, Lewicki RJ (2004) The road to reconciliation: antecedents of victim willingness to reconcile following a broken promise. J Manag 30(2):165–187
Wijnen L, Coenen J, Grzyb B (2017) “It’s not my Fault!” Investigating the Effects of the Deceptive Behaviour of a Humanoid Robot. In: Proceedings of the companion of the 2017 ACM/IEEE international conference on human-robot interaction, pp 321–322 (2017)
Chiu C, Dweck CS, Yuk-yue Tong J, Ho-ying Fu J (1997) Implicit theories and conceptions of morality. J Pers Soc Psychol 73(5):923
Dweck CS, Chiu C, Hong Y (1995) Implicit theories and their role in judgments and reactions: a word from two perspectives. Psychol Inq 6(4):267–285
Gervey BM, Chiu C, Hong Y-Y, Dweck CS (1999) Differential use of person information in decisions about guilt versus innocence: the role of implicit theories. Pers Soc Psychol Bull 25(1):17–27
Kam TK (2009) Implicit theories and the trust repair process. In: 22nd annual IACM conference paper
Zhang X, Lee SK, Kim W, Hahn S (2023) “Sorry, it was my fault": repairing trust in human-robot interactions. Int J Hum-Comput Stud 175:103031
Field AP, Wilcox RR (2017) Robust statistical methods: a primer for clinical psychology and experimental psychopathology researchers. Behav Res Ther 98:19–38
Hoff KA, Bashir M (2015) Trust in automation: integrating empirical evidence on factors that influence trust. Hum Factors 57(3):407–434
Jessup SA, Schneider TR, Alarcon GM, Ryan TJ, Capiola A (2019) The measurement of the propensity to trust automation. In: International conference on human-computer interaction, pp 476–489. Springer
Hayes AF, Coutts JJ (2020) Use omega rather than cronbach’s alpha for estimating reliability. but.... Commun Methods Meas 14(1):1–24
Lance CE, Butts MM, Michels LC (2006) The sources of four commonly reported cutoff criteria: what did they really say? Organ Res Methods 9(2):202–220
Hu L, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model 6(1):1–55
Jian J-Y, Bisantz AM, Drury CG (2000) Foundations for an empirically determined scale of trust in automated systems. Int J Cogn Ergon 4(1):53–71
Weun S, Beatty SE, Jones MA (2004) The impact of service failure severity on service recovery evaluations and post-recovery relationships. J Serv Mark 18:133–146
McAuley E, Duncan TE, Russell DW (1992) Measuring causal attributions: the revised causal dimension scale (CDSII). Pers Soc Psychol Bull 18(5):566–573
Kline P (2014) An easy guide to factor analysis. Routledge, Abingdon
Browne MW, Cudeck R (1989) Alternative ways of assessing model fit. In: KA Bollen, JS Long (eds.) Testing structural equation models. Sage, Newbury Park
Osborne JW (2013) Best practices in data cleaning: a complete guide to everything you need to do before and after collecting your data. Sage, Thousand Oaks
Tabachnick BG, Fidell LS, Ullman JB (2007) Using multivariate statistics, vol 5. Pearson, Boston
Rogers K, Howard A (2022) When a robot tells you that it can lie. In: 2022 IEEE international conference on advanced robotics and its social impacts (ARSO), pp. 1–7. IEEE
Anjomshoae S, Najjar A, Calvaresi D, Främling K (2019) Explainable agents and robots: results from a systematic literature review. In: 18th international conference on autonomous agents and multiagent systems (AAMAS 2019), Montreal, Canada, pp 1078–1088. International Foundation for Autonomous Agents and Multiagent Systems
Qianli X, Ng J, Tan O, Huang Z, Tay B, Park T (2015) Methodological issues in scenario-based evaluation of human-robot interaction. Int J Soc Robot 7(2):279–291
Bell RA, McGlone MS, Dragojevic M (2014) Bacteria as bullies: effects of linguistic agency assignment in health message. J Health Commun 19(3):340–358
Coeckelbergh M (2012) Can we trust robots? Ethics Inf Technol 14(1):53–60
Siau K, Wang W (2018) Building trust in artificial intelligence, machine learning, and robotics. Cut Bus Technol J 31(2):47–53
Funding
This study was funded by Korea University (K2119471).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interests
The authors declare that they have no other conflict of interest. The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Data collection for this study was funded by the new faculty research grant of School of Media & communication at Korea University (K2119471).
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Zhang, X., Lee, S.K., Maeng, H. et al. Effects of Failure Types on Trust Repairs in Human–Robot Interactions. Int J of Soc Robotics 15, 1619–1635 (2023). https://doi.org/10.1007/s12369-023-01059-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12369-023-01059-0