Skip to main content
SpringerLink
Log in

Human Factor Considerations on Timing of Driver Taking Over in Automated Driving Systems: A Literature Review

  • Conference paper
  • First Online:
HCI in Mobility, Transport, and Automotive Systems. Automated Driving and In-Vehicle Experience Design (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12212))

Included in the following conference series:

  • 2271 Accesses

Abstract

Driving automation leads to meaningful changes of driver roles, from the primary party responsible for execution of all dynamic driving tasks to supervision of selective tasks in automated driving systems with varying levels of automation. In partially automated systems, drivers are required to resume control occasionally, either voluntarily or involuntarily. This paper aims at exploring human factors influencing the course of take-over. Through a review of a large body of literature and a summary of observations, some particularly influential driver-related issues are identified. These issues include mental workload and distraction, situation awareness, and trust. Based on the consideration of these issues, the timing and the efficiency of take-over are analyzed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Arditi, R.: Advanced analysis of user’s behavior when facing traffic information through Variable Message Signs. In: Brussels: 39th ASECAP Study and Inform Days (2011)

    Google Scholar 

  • Bao, S., LeBlanc, D.J., Sayer, J.R., Flannagan, C.: Heavy-truck drivers’ following behavior with intervention of an integrated, in-vehicle crash warning system: a field evaluation. Hum. Factors 54, 687–697 (2012)

    Article  Google Scholar 

  • Beggiato, M., Hartwich, F., Schleinitz, K., Krems, J.F., Othersen, I., Petermann-Stock, I.: What would drivers like to know during automated driving? Information needs at different levels of automation. In: 7th Conference on Driver Assistance, Munich, German (2015)

    Google Scholar 

  • Beller, J., Heesen, M., Vollrath, M.: Improving the driver- automation interaction: an approach using automation uncertainty. Hum. Factors 55(6), 1130–1141 (2013)

    Article  Google Scholar 

  • Carsten, O., Lai, F., Barnard, Y., Jamson, A.H., Merat, N.: Control task substitution in semi-automated driving: does it matter what aspects are automated? Hum. Factors 54, 747–761 (2012)

    Article  Google Scholar 

  • Cho, J.H., Nam, H.K., Lee, W.S.: Driver behaviour with adaptive cruise control. Int. J. Automot. Technol. 7(5), 603–608 (2006). Korean Society of Automotive Engineers, Seoul, Korea

    Google Scholar 

  • Cristea, M., Delhomme, P.: Factors influencing drivers’ reading and comprehension of on-board traffic messages. Euro. Rev. Appl. Psychol. 65(5), 211–219 (2015)

    Article  Google Scholar 

  • Cunningham, M., Regan, M.A.: Automatous vehicles: human factors issues and future research. In: Proceedings of the 2015 Australasian Road Safety Conference, October, Gold Coast, Australia (2015)

    Google Scholar 

  • Dingus, T.A., Klauer, S.G., Neale, V.L., Petersen, A., Lee, S.E., et al.: The 100-car naturalistic driving study, Phase II-Results of the 100-car field experiment (Report No. HS-810 593). Washington, DC: National Highway Traffic Safety Administration (2006)

    Google Scholar 

  • Endsley, M.R.: Toward a Theory of Situation Awareness in Dynamic Systems. Human Factors, vol. 37, no. 1, pp. 32–64, Human Factors and Ergonomics Society, Santa Monica, CA (1995)

    Google Scholar 

  • Endsley, M.R.: Automation and situation awareness. In: Parasuraman, R., Mouloua, M. (eds.) Automation and Human Performance: Theory and Applications, pp. 163–181. Lawrence Erlbaum, Mahwah (1996)

    Google Scholar 

  • Endsley, M.R.: Situation awareness misconceptions and misunderstandings. J. Cognit. Eng. Decis. Mak. 9, 4–32 (2015)

    Article  Google Scholar 

  • Endsley, M.R., Kaber, D.: Level of automation effects on performance, situation awareness and workload in a dynamic control task. Ergonomics 42(3), 462–492 (1999)

    Article  Google Scholar 

  • Fancher, P., Ervin, R., Sayer, J., Hagan, M., Bogard, S., et al.: Intelligent Cruise Control Field Operational Test, Report No. DOT-HS-808-849, National Highway Traffic Safety Administration, Washington, DC (1998)

    Google Scholar 

  • Fitch, G.M., Hankey, J.M., Kleiner, B.M., Dingus, T.A.: Driver comprehension of multiple haptic seat alerts intended for use in an integrated collision avoidance system. Transport. Res. Part F: Traffic Psychol. Behav. 14(4), 278–290 (2011)

    Article  Google Scholar 

  • Fisher, D.L., Strayer, D.L.: Modeling situation awareness and crash risk. Ann. Adv. Automot. Med. 5, 33–39 (2014)

    Google Scholar 

  • Flemisch, F.O., Bengler, K., Bubb, H., Winner, H., Bruder, R.: Towards cooperative guidance and control of highly automated vehicles: H-Mode and conduct-by-wire. Ergonomics 57(3), 343–360 (2014)

    Article  Google Scholar 

  • Gertner, R.: The Effects of Multimedia Technology on Learning. Abilene Christian University, Texas (2012)

    Google Scholar 

  • Gold, C., Bengler, K.: Taking over control from highly automated vehicles. In: Proceedings of the 5th International Conference on Applied Human Factors and Ergonomics AHFE 2014, Kraków, Poland (2014)

    Google Scholar 

  • Gold, C., Körber, M., Lechner, D., Bengler, K.: Taking over control from highly automated vehicles in complex traffic situations – the role of traffic density. Hum. Factors 58(4), 642–652 (2016)

    Article  Google Scholar 

  • Gold, C., Damböck, D., Lorenz, L., Bengler, K.: “Take over!” how long does it take to get the driver back into the loop? In: Proceedings of the Human Factors and Ergonomics Society 57th Annual Meeting (pp. 1938–1942). Santa Monica, CA: Human Factors and Ergonomics Society (2013)

    Google Scholar 

  • Götze, M., Bißbort, F., Petermann-Stock, I., Bengler, K.: “A careful driver is one who looks in both directions when he passes a red light” – increased demands in urban traffic. In: Yamamoto, S. (ed.) HIMI 2014. LNCS, vol. 8522, pp. 229–240. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07863-2_23

    Chapter  Google Scholar 

  • He, J., Becic, E., Lee Y-C., McCarley, J.S.: Mind wandering behind the wheel: performance and oculomotor correlates. human factors, vol. 53, no. 1, pp. 13–21, Human Factors and Ergonomics Society, Santa Monica, CA (2011)

    Google Scholar 

  • Heenan, A., Herdman, C.M., Brown, M.S., Robert, N.: Effects of conversation on situation awareness and working memory in simulated driving. Hum. Factors 56, 1077–1092 (2014)

    Article  Google Scholar 

  • Hoedemaeker, M., Brookhuis, K.: Behavioural adaptation to driving with an adaptive cruise control (ACC). Transport. Res. Part F: Traffic Psychol. Behav. 1(2), 95–106 (1998)

    Article  Google Scholar 

  • Hoff, K.A., Bashir, M.: Trust in automation: integrating empirical evidence on factors that influence trust. Hum. Factors 57, 407–434 (2015)

    Article  Google Scholar 

  • Horrey, W.J., Wickens, C.D., Consalus, K.P.: Modeling drivers’ visual attention allocation while interacting with in-vehicle technologies. J. Experim. Psychol. Appl. 12(2), 67–78 (2006)

    Article  Google Scholar 

  • ITF (International Transport Forum): Automated and Autonomous Driving-Regulation under Uncertainty. OECD, France (2015)

    Google Scholar 

  • Jamson, H., Merat, N., Carsten, O., Lai, F.: Fully-automated driving: the road to future vehicles. In: Proceedings of the Sixth International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design, University of Iowa, Iowa City, IA (2011)

    Google Scholar 

  • Jamson, H., Merat, N., Carsten, O., Lai, F.: Behavioral changes in drivers experiencing highly-automated vehicle control in varying traffic conditions. Transport Res. Part F: Traffic Psychol. Behav. 30, 116–125 (2013)

    Google Scholar 

  • Johannsdottir, K.R., Herdman, C.M.: The role of working memory in supporting drivers’ situation awareness for surrounding traffic. Hum. Factors 52, 663–673 (2010)

    Article  Google Scholar 

  • Jones, S.: Cooperative Adaptive Cruise Control: Human Factors Analysis. (Technical Report FHWA-HRT-13-045). Mclean, VA: Federal Highway Administration, Office of Safety Research and Development (2013)

    Google Scholar 

  • Kaber, D., Endsley, M.: The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task. Theoret. Issues Ergon. Sci. 5(2), 113–153 (2004)

    Article  Google Scholar 

  • Kantowitz, B.H., Hanowski, R.J., Kantowitz, S.C.: Driver reliability requirements for traffic advisory information. In: Noy, Y.I. (ed.) Ergonomics and Safety of Intelligent Driver Interfaces, pp. 1–22. Lawrence Erlbaum Associates, Mahwah, NJ (1997)

    Google Scholar 

  • Koustanaï, A., Cavallo, V., Delhomme, P., Mas, A.: Simulator training with a forward collision warning system: effects on driver–system interactions and driver trust. Hum. Factors 54, 709–721 (2012)

    Article  Google Scholar 

  • Körber, M., Gold, C., Lechner, D., Bengler, K.: The influence of age on the take-over of vehicle control in highly automated driving. Transport. Res. Part F Traffic Psychol. Behav. 39, 19–32 (2016)

    Article  Google Scholar 

  • Lee, H.K., Suh, K.S., Benbasat, I.: Effects of task-modality fit on user performance. Decision Support Syst. 32(1), 27–40 (2001)

    Article  Google Scholar 

  • Lee, J.D., Moray, N.: Trust, control strategies and allocation of function in human machine systems. Ergonomics 22, 671–691 (1992)

    Google Scholar 

  • Lee, J.D., See, K.A.: Trust in automation: designing for appropriate reliance. Hum. Factors 46, 50–80 (2004)

    Article  Google Scholar 

  • Lees, M.N., Lee, J.D.: The influence of distraction and driving context on driver response to imperfect collision warning systems. Ergonomics 50(8), 1264–1286 (2007)

    Article  Google Scholar 

  • Louw, T., Merat, N., Jamson, H.: Engaging with highly automated driving: to be or not to be in the loop? In: 8th International Driving Symposium on Human Factors in Driver Assessment. Training and Vehicle Design, At Salt Lake City (2015)

    Google Scholar 

  • Lu, Z., Happee, R., Cabrall, C.D., Kyriakidis, M., de Winter, J.C.: Human factors of transitions in automated driving: a general framework and literature survey. Transp. Res. Part F. Traffic Psychol. Behav. 43, 183–198 (2016)

    Article  Google Scholar 

  • Ma, R.: The effect of in-vehicle automation and reliability on driver situation awareness and trust, Ph.D. dissertation, North Carolina State University, Raleigh, NC (2005)

    Google Scholar 

  • Ma, R., Kaber, D.B.: Situation awareness and workload in driving while using adaptive cruise control and a cell phone. Int. J. Ind. Ergon. 35, 939–953 (2005)

    Article  Google Scholar 

  • Madhavan, P., Wiegmann, D.A.: Similarities and differences between human-human and human-automation trust: an integrative review. Theoret. Issues Ergon. Sci. 8, 277–301 (2007)

    Article  Google Scholar 

  • Marinik, A., Bishop, R., Fitchett, V., Morgan, J.F., Trimble, T.E., Blanco, M.: Human factors evaluation of level 2 and level 3 automated driving concepts: Concepts of operation. (Report No. DOT HS 812 044). Washington, DC: National Highway Traffic Safety Administration (2014)

    Google Scholar 

  • Marsh, S., Dibben, M.R.: The role of trust in information science and technology. Ann. Rev. Inf. Sci. Technol. 37, 465–498 (2003)

    Article  Google Scholar 

  • Martens, M., van den Beukel, A.P.: The road to automated driving: dual mode and human factors considerations. In: Proceedings of the 16th International IEEE Annual Conference on Intelligent Transportation Systems (ITSC 2013), Netherlands, pp. 2262–2267 (2013)

    Google Scholar 

  • Martens, M.H., Pauwelussen, S., Flemisch, F., Caci, J.M.: Human factors’ aspects in automated and semi-automatic transport systems: State of the art (2008). http://www.citymobil-project.eu/downloadables/Deliverables/D3.2.1-PU-Human%20Factors%20aspects-CityMobil.pdf

  • Matthews, G.: Towards a transactional ergonomics for driver stress and fatigue. Theoret. Issues Ergon. Sci. 3, 195–211 (2002)

    Article  Google Scholar 

  • Matthews, G., Desmond, A.: Task-induced fatigue states and simulated driving performance. Quarterly J. Exp. Psychol. A Hum. Exper. Psychol. 55, 659–686 (2002)

    Article  Google Scholar 

  • Matthews, M.L., Bryant, D.J., Webb, R.D.G., Harbluk, J.L.: Model for Situation Awareness and Driving: Application to Analysis and Research for Intelligent Transportation Systems. Transportation Research Record, 1779, 26–32, Transportation Research Board, Washington, DC (2001)

    Google Scholar 

  • Matthews, G., Warm, J.S., Reinerman, L.E., Langheim, L., Wash-burn, D.A., Tripp, L.: Task engagement, cerebral blood flow velocity, and diagnostic monitoring for sustained attention. J. Exper. Psychol. Appl. 16, 187–203 (2010)

    Article  Google Scholar 

  • Merat, N., Jamson, A.H.: How do drivers behave in a highly automated car? In: Proceedings of the Fifth International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design, University of Iowa, Iowa City, IA (2009)

    Google Scholar 

  • Merat, N., Jamson, H., Lai, F., Carsten, O.: Automated driving, secondary task performance and situation awareness. In: Human Factors: A System View of Human, Technology and Organization, pp. 41–53. Shaker Publishing, Maastricht, Netherlands (2010)

    Google Scholar 

  • Merat, N., Jamson, H., Lai, F., Carsten, O.: Highly automated driving, secondary task performance and driver state. Hum. Factors 54, 762–771 (2012)

    Article  Google Scholar 

  • Merat, N., Jamson, A.H., Lai, F., Daly, M., Carsten, O.: Transition to manual: driver behavior when resuming control from a highly automated vehicle. In: Transportation Research Part F: Traffic Psychology and Behavior, vol. 27, Part B, 274–282 (2014)

    Google Scholar 

  • Naujoks, F., Mai, C., Neukum, A.: The effect of urgency of take-over requests during highly automated driving under distraction conditions. In: Proceedings of the 5th International Conference on Applied Human Factors and Ergonomics, Krakow, Poland July 2014, pp. 2099–2106 (2014)

    Google Scholar 

  • Neubauer, C., Matthews, G., Langheim, L., Saxby, D.: Fatigue and voluntary utilization of automation in simulated driving. Hum. Factors 54(5), 734–746 (2012)

    Article  Google Scholar 

  • NHTSA (National Highway Traffic Safety Administration) (2013). Preliminary Statement of Policy Concerning Automated Vehicles. 8 December 2015.http://www.nhtsa.gov/staticfiles/rulemaking/pdf/Automated_Vehicles_Policy.pdf

  • Parasuraman, R., Riley, V.: Humans and Automation: Use, Misuse, Disuse, Abuse. Human Factors, vol. 39, no. 2, pp. 230–253, Human Factors and Ergonomics Society, Santa Monica, CA (1997)

    Google Scholar 

  • Parasuraman, R., Sheridan, T. B., Wickens, C.D.: A model of types and levels of human interaction with automation. IEEE Trans. Syst. Man, Cybern. – Part A Syst. Hum. 30, 286–297 (2000)

    Google Scholar 

  • Radlmayr, J., Gold, C., Lorenz, L., Farid, M., Bengler, K.: How traffic situations and non-driving related tasks affect the take-over quality in highly automated driving. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 58, no. 1, pp. 2063–2067, Santa Monica, CA (2014)

    Google Scholar 

  • Rauch, N., Kaussner, A., Krüger, H. P., Boverie, S, Flemisch, F.: The importance of driver state assessment within highly automated vehicles. Conference Proceedings of the 16th World Congress on ITS, Stockholm, Sweden (2009)

    Google Scholar 

  • Regan, M.A.: New technologies in cars: human factors and safety issues. Ergon. Australia 18(3), 6–16 (2004)

    Google Scholar 

  • Regan, M.A., Strayer, D.L.: Towards an understanding of driver inattention: taxonomy and theory. Ann. Adv. Automot. Med. 58, 5–13 (2014)

    Google Scholar 

  • Rudin-Brown, C., Parker, H.: Behavioral adaptation to adaptive cruise control (ACC): implications for preventive strategies. Transportation Research Part F: Traffic Psychology and Behavior 7(2), 59–76 (2004a)

    Article  Google Scholar 

  • Rudin-Brown, C., Jamson, S.: Behavioural Adaptation and Road Safety: Theory, Evidence, and Action. CRC Press, Boca Raton (2013)

    Book  Google Scholar 

  • Rudin-Brown, C., Parker, H.: Behavioural adaptation to adaptive cruise control (ACC): implications for preventive strategies. Transport. Res. Part F: Traffic Psychol. Behav. 7(2), 59–76 (2004b)

    Article  Google Scholar 

  • Rudin-Brown, C., Parker, H.A., Malisia, A.R.: Behavioral adaptation to adaptive cruise control. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 47, no. 16, pp. 1850–1854, Human Factors and Ergonomics Society, Santa Monica, CA (2003)

    Google Scholar 

  • SAE (2014). Taxonomy and Definitions for Terms Related to On-Road Motor Vehicle Automated Driving Systems. 2 December 2015. http://standards.sae.org/j3016_201401/

  • Saffarian, M., de Winter, J., Happee, R.: Automated driving: human-factors issues and design solutions. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 56(1), 2296–2300 (2012)

    Article  Google Scholar 

  • Stanton, N.A., Dunoyer, A., Leatherland, A.: Detection of new in-path targets by drivers using stop&go adaptive cruise control. Appl. Ergon. 42(4), 592–601 (2011)

    Article  Google Scholar 

  • Saxby, D.J., Matthews, G., Warm, J.S., Hitchcock, E.M., Neubauer, C.: Active and passive fatigue in simulated driving: discriminating styles of workload regulation and their safety impacts. J. Experiment. Psychol. Appl. 19(4), 287–300 (2013)

    Article  Google Scholar 

  • Shaver, E.F., Braun, C.C.: Effects of warning symbol explicitness and warning color on behavioral compliance. In: Proceedings of the International Ergonomics Association/Human Factors and Ergonomics Society Congress (2000)

    Google Scholar 

  • Shinar, D., Vogelzang, M.: Comprehension of traffic signs with symbolic versus text displays. Transport. Res. Part F 18, 72–82 (2013)

    Article  Google Scholar 

  • Smith, B.W., Svensson, J.: Automated and Autonomous Driving- Regulation Under Uncertainty. OECD, France (2015)

    Google Scholar 

  • Son, J., Park, M.: Situation awareness and transitions in highly automated driving: a framework and mini review. J. Ergon. 7, 212 (2017)

    Google Scholar 

  • Stanton, N., Young, M.: Driver behaviour with adaptive cruise control. Ergonomics 48(10), 1294–1313 (2005)

    Article  Google Scholar 

  • Vahidi, A., Eskandarian, A.: Research advances in intelligent collision avoidance and adaptive cruise control. IEEE Trans. Intell. Transport. Syst. 4(3), 143–153 (2003)

    Article  Google Scholar 

  • Van den Beukel, A.P., Van der Voort, M.C. (2013). The influence of time-criticality on situation awareness when retrieving human control after automated driving. In: 16th International IEEE Conference on Paper Presented at the Intelligent Transportation Systems-(ITSC), 2000–2005

    Google Scholar 

  • Van den Beukel, A.P., Van der Voort, M.C., Eger, A.O.: Supporting the changing driver’s task: exploration of interface designs for supervision and intervention in automated driving. Transport. Res. Part F 43(2016), 279–301 (2016)

    Article  Google Scholar 

  • Wang, J. H., Keceli, M., Maier-Speredelozzi, V.: Effect of dynamic message sign messages on traffic slowdowns. Annual Meeting of Transportation Research Board (2009)

    Google Scholar 

  • Xiong, H., Boyle, L.N., Moeckli, J., Dow, B.R., Brown, T.L.: Use patterns among early adopters of adaptive cruise control. Hum. Factors 54, 722–733 (2012)

    Article  Google Scholar 

  • Young, M.S., Stanton. N.A.: Size matters: the role of attentional capacity in explaining the effects of mental underload in performance. In: Harris, D. (ed.) Engineering Psychology and Cognitive Ergonomics, vol. 5, Aerospace and Transportation Systems, Ashgate Publishing, Surrey (2001)

    Google Scholar 

  • Young, M.S., Stanton, N.A.: Back to the Future: Brake Reaction Times for Manual and Automated Vehicles. Ergonomics, vol. 50, no. 1, pp. 46–58, Taylor & Francis, New York, NY (2007)

    Google Scholar 

  • Zeeb, K., Buchner, A., Schrauf, M.: What determines the take-over time? An integrated model approach of driver take-over after automated driving. Accid. Anal. Prevent. 78, 212–221 (2015)

    Article  Google Scholar 

Download references

Acknowledgement

This work was supported by the Beijing Municipal Social Science Foundation [Grant numbers 19GLB029], Special Fund for Basic Scientific Research Business Expenses of Universities in Beijing [Grant numbers X18252], and Special Fund for Basic Scientific Research Business Expenses of Universities in Beijing [Grant numbers X18036].

Author information

Authors and Affiliations

  1. Department of Industrial Engineering, Beijing University of Civil, Engineering and Architecture, Beijing, 100044, China

    Hua Qin & Ran Zhang

  2. Beijing Engineering Research Center of Monitoring for Construction Safety, Beijing, 100044, China

    Hua Qin

  3. Institute of Human Factors and Ergonomics, College of Mechatronics and Control Engineering, Shenzhen University, Shenzhen, 518060, China

    Tingru Zhang

Authors
  1. Hua Qin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ran Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tingru Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Hua Qin , Ran Zhang or Tingru Zhang .

Editor information

Editors and Affiliations

  1. Institute of Media Technology, Ilmenau University of Technology, Ilmenau, Germany

    Heidi Krömker

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Qin, H., Zhang, R., Zhang, T. (2020). Human Factor Considerations on Timing of Driver Taking Over in Automated Driving Systems: A Literature Review. In: Krömker, H. (eds) HCI in Mobility, Transport, and Automotive Systems. Automated Driving and In-Vehicle Experience Design. HCII 2020. Lecture Notes in Computer Science(), vol 12212. Springer, Cham. https://doi.org/10.1007/978-3-030-50523-3_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-50523-3_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-50522-6

  • Online ISBN: 978-3-030-50523-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation