Advertisement

Cognition, Technology & Work

, Volume 21, Issue 1, pp 41–54 | Cite as

The effect of reliability on drivers’ trust and behavior in conditional automation

  • Chris SchwarzEmail author
  • John Gaspar
  • Timothy Brown
Original Article

Abstract

The development of automated vehicles continues unabated. The human factor challenges of designing safe automated driving systems are critical as the first several generations of automated vehicles are expected to be semi-autonomous, requiring frequent transfers of control between the driver and vehicle. Conditional automation raises particular concerns about drivers being out of the loop. A driving simulator study was performed with 20 participants to study driving with conditional automation. We observed driver performance and measured comfort as an indicator of the development of trust in the system. One scenario used a more capable automation system that was able to respond to most events by slowing or changing lanes on its own. The other scenario used a less capable automation system that issued takeover requests for all events. Participants drove both scenarios in counterbalanced order and experienced the different capabilities as changes in reliability. The automation would behave one way in the first work zone and a different way in the second. We observed three types of comfort profiles over the course of the drives. Several behavioral measures, notably gaze, showed effects of reliability variations. Trust calibrated during the first-driven scenario was seen to affect behavior during the second one, and this effect was more pronounced in the older age group, and most pronounced for women in that group.

Keywords

Trust in automation Conditional automation Automated vehicles Reliability 

Notes

Acknowledgements

This research was funded by the Safer-Sim University Transportation Center.

References

  1. Bates D, Mächler M, Bolker B, Walker S (2015) Fitting linear mixed-effects models using lme4. J Stat Softw 67(1):48.  https://doi.org/10.18637/jss.v067.i01 CrossRefGoogle Scholar
  2. Bellem H, Schönenberg T, Krems JF, Schrauf M (2016) Objective metrics of comfort: developing a driving style for highly automated vehicles. Transp Res Part F Traffic Psychol Behav 41:45–54.  https://doi.org/10.1016/j.trf.2016.05.005 CrossRefGoogle Scholar
  3. Blanco M, Atwood J, Vasquez HM, Trimble TE, Fitchett V, Radlbeck J, Fitch GM, Russell SM, Green CA, Cullinane B, Morgan JF (2015) Human factors evaluation of level 2 and level 3 automated driving concepts. Report DOT HS 812 182, Washington, D.CGoogle Scholar
  4. Burnham KP, Anderson DR (2004) Multimodel inference: understanding AIC and BIC in model selection. Sociol Methods Res 33(2):261–304MathSciNetCrossRefGoogle Scholar
  5. Degani A, Goldman CV, Deutsch O, Tsimhoni O (2017) On human–machine relations. Cogn Technol Work 19(2):211–231.  https://doi.org/10.1007/s10111-017-0417-3 CrossRefGoogle Scholar
  6. Flemisch F, Heesen M, Hesse T, Kelsch J, Schieben A, Beller J (2012) Towards a dynamic balance between humans and automation: authority, ability, responsibility and control in shared and cooperative control situations. Cogn Technol Work 14(1):3–18.  https://doi.org/10.1007/s10111-011-0191-6 CrossRefGoogle Scholar
  7. Gold C, Körber M, Hohenberger C, Lechner D, Bengler K (2015) Trust in automation—before and after the experience of take-over scenarios in a highly automated vehicle. Procedia Manuf 3:3025–3032.  https://doi.org/10.1016/j.promfg.2015.07.847 CrossRefGoogle Scholar
  8. Hergeth S (2016) Automation trust in conditional automated driving systems: approaches to operationalization and design. Ph.D. Thesis. Saint Mary’s University, Technische Universitat ChemnitzGoogle Scholar
  9. Hoff KA, Bashir M (2015) Trust in automation: integrating empirical evidence on factors that influence trust. Hum Factors 57(3):407–434.  https://doi.org/10.1177/0018720814547570 CrossRefGoogle Scholar
  10. Inagaki T (2010) Traffic systems as joint cognitive systems: issues to be solved for realizing human-technology coagency. Cogn Technol Work 12(2):153–162.  https://doi.org/10.1007/s10111-010-0143-6 CrossRefGoogle Scholar
  11. Inagaki T, Sheridan TB (2018) A critique of the SAE conditional driving automation definition, and analyses of options for improvement. Cogn Technol Work.  https://doi.org/10.1007/s10111-018-0471-5 Google Scholar
  12. Johnson PC (2014) Extension of Nakagawa & Schielzeth’s R2GLMM to random slopes models. Methods Ecol Evol 5(9):944–946CrossRefGoogle Scholar
  13. Körber M, Baseler E, Bengler K (2018) Introduction matters: manipulating trust in automation and reliance in automated driving. Appl Ergon 66:18–31CrossRefGoogle Scholar
  14. Lee JD, See KA (2004) Trust in automation: designing for appropriate reliance. Hum Factors 46(1):50–80.  https://doi.org/10.1518/hfes.46.1.50_30392 CrossRefGoogle Scholar
  15. Lee JD, Moeckli J, Brown TL, Roberts SC, Schwarz C, Yekhshatyan L, Nadler E, Liang Y, Victor T, Marshall D, Davis C (2013) Distraction detection and mitigation through driver feedback. Report DOT HS 811 547A, Washington, D.CGoogle Scholar
  16. Merat N, Jamson AH, Lai FCH, Daly M, Carsten OMJ (2014) Transition to manual: driver behaviour when resuming control from a highly automated vehicle. Transp Res Part F Traffic Psychol Behav 27:274–282.  https://doi.org/10.1016/j.trf.2014.09.005 CrossRefGoogle Scholar
  17. Millot P (2015) Situation awareness: is the glass half empty or half full? Cogn Technol Work 17(2):169–177.  https://doi.org/10.1007/s10111-015-0322-6 CrossRefGoogle Scholar
  18. Mirman D, Dixon JA, Magnuson JS (2008) Statistical and computational models of the visual world paradigm: growth curves and individual differences. J Mem Lang 59(4):475–494CrossRefGoogle Scholar
  19. Muir BM, Moray N (1996) Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. Ergonomics 39(3):429–460.  https://doi.org/10.1080/00140139608964474 CrossRefGoogle Scholar
  20. Nakagawa S, Schielzeth H (2013) A general and simple method for obtaining R 2 from generalized linear mixed-effects models. Methods Ecol Evol 4(2):133–142CrossRefGoogle Scholar
  21. NHTSA (2017) Automated driving systems 2.0. Retrieved from https://www.nhtsa.gov/sites/nhtsa.dot.gov/files/documents/13069a-ads2.0_090617_v9a_tag.pdf.. Accessed 10 Sept 2018
  22. Parasuraman R, Riley V (1997) Humans and automation: use, misuse, disuse, abuse. Hum Factors J Hum Factors Ergon Soc 39(2):230–253.  https://doi.org/10.1518/001872097778543886 CrossRefGoogle Scholar
  23. Payre W, Cestac J, Delhomme P (2016) Fully automated driving: impact of trust and practice on manual control recovery. Hum Factors 58(2):229–241.  https://doi.org/10.1177/0018720815612319 CrossRefGoogle Scholar
  24. Price MA, Venkatraman V, Gibson M, Lee J, Mutlu B (2016) Psychophysics of trust in vehicle control algorithms. Paper presented at the SAE Technical Paper SeriesGoogle Scholar
  25. R Core Team (2017) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/
  26. SAE (2016) Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles (surface vehicle recommended practice: superseding J3016 Jan 2014). In: J3016Google Scholar
  27. Sanders T, Oleson KE, Billings DR, Chen JYC, Hancock PA (2011) A model of human–robot trust: theoretical model development. Proc Hum Factors Ergon Soc Annu Meet 55(1):1432–1436.  https://doi.org/10.1177/1071181311551298 CrossRefGoogle Scholar
  28. Schwarz C, Keum C, Brown T, Gaspar J (2016) Transfer from highly automated to manual control: performance & trust. Retrieved from Iowa City, IA. http://safersim.nads-sc.uiowa.edu/final_reports/UI_4_Y2_FinalReport.pdf. Accessed 10 Sept 2018
  29. Schwarz C, Brown TL, Gaspar JG, Keum C (2017) Transfer from highly automated to manual control: performance and trust. Paper presented at the Enhanced Safety of VehiclesGoogle Scholar
  30. Victor TW, Harbluk JL, Engström JA (2005) Sensitivity of eye-movement measures to in-vehicle task difficulty. Transp Res Part F Traffic Psychol Behav 8(2):167–190.  https://doi.org/10.1016/j.trf.2005.04.014 CrossRefGoogle Scholar
  31. Wickens CD, Xu X (2002) Automation trust, reliability and attention. Technical Report AHFD-02-14/MAAD-02-2, Urbana-ChampaignGoogle Scholar
  32. Wickens CD, Hollands JG, Banbury S, Parasuraman R (2015) Engineering psychology & human performance. Psychology Press, HoveGoogle Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2018

Authors and Affiliations

  1. 1.National Advanced Driving SimulatorThe University of IowaIowa CityUSA

Personalised recommendations