Abstract
The goal for the distant future is fully autonomous vehicles, which can handle every possible situation and change the role of the driver to that of a passenger. On the way to that goal, drivers of highly automated cars will still have to take over the control of the vehicle at the boundaries of the operational domain of the automation. However, several studies show that the driver’s ability to take over depends on his current status and activities. As for highly automated cars more activities beyond the actual driving task, like reading and writing emails, will be allowed, the driver might need of assistance from the vehicle automation during the control transition phase. Ironically, the fact that higher levels of automation result in decreased driver responsibilities makes considering the driver in the automation algorithms even more essential. Therefore, this chapter discusses how a human-centred control transition can be designed. Another aspect we also want to discuss is how to adapt the driving of highly automated cars to the passengers in the normal full autonomous driving scenario. Hence, we propose a novel concept of a human-centred highly automated car. First, we present an approach for monitoring and interpreting the driver in the interior and a systematic design of a cooperative control transfer. We further point out the crucial aspects of the implementation of such kind of adaption concepts and present results from various driving studies.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
https://www.unece.org/fileadmin/DAM/trans/doc/2019/wp29/WP29-177-19e.pdf, accessed 2020.02.03.
- 2.
- 3.
The only exception to this is overtaking, which, for technical reasons, requires the participant to initiate it by setting the direction indicator, so it was not possible for the participants to consistently deal with the secondary activity.
- 4.
In case the participant had not performed a secondary activity in at least one of the four use cases, a request for an explanation regarding the renunciation of a secondary activity was made after the drive.
References
Abbink DA, Mulder M (2010) Neuromuscular analysis as a guideline in designing shared control. Adv Haptics (IntechOpen)
Abbink DA, Mulder M, Boer ER (2012) Haptic shared control: smoothly shifting control authority? In: Cognition, technology and work, vol 14, no 1, S. 19–28
Abouelnaga Y, Eraqi HE, Moustafa MN (2018) Real-time distracted driver posture classification. Machine learning for intelligent transportation systems. In: Workshop in the conference on neural information processing systems (NeuroIPS)
Banks VA et al (2018) Is partially automated driving a bad idea? Observations from an on-road study. Appl Ergonomics 68
Brandenburg and Skottke (2014) Switching from manual to automated driving and reverse: are drivers behaving more risky after highly automated driving. ITSC
Carreira J, Zisserman A (2017) Quo vadis, action recognition? A new model and the kinetics dataset. In: Proceedings of the IEEE conference on computer vision and pattern recognition
Cao Z et al (2018) OpenPose: realtime multi-person 2D pose estimation using part affinity fields. ArXiv:1812.08008 [Cs]
Damböck D et al (2012) Übernahmezeiten Beim Hochautomatisierten Fahren. Tagung Fahrerassistenz. München 15
Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L (2009) ImageNet: a large-scale hierarchical image database
Endsley and Kris (1995) The out-of-the-loop performance problem and level of control in automation. Human Factors
Engwerda J (2005) LQ dynamic optimization and differential games. Wiley
Eriksson et al (2017) Rolling out the red (and green) carpet: supporting driver decision making in automation-to-manual transitions
Feldhütter A, Ruhl A, Feierle A, Bengler K (2019) The effect of fatigue on take-over performance in urgent situations in conditionally automated driving in 2019. In: IEEE intelligent transportation systems conference (ITSC), pp 1889–1894
Flad M, Otten J, Schwab S, Hohmann S (2014) Steering driver assistance system: a systematic cooperative shared control design approach. In: IEEE international conference on systems, man and cybernetics (SMC), S. 3585–3592
Flad M (2016) Kooperative Regelungskonzepte auf Basis der Spieltheorie und deren Anwendung auf Fahrerassistenzsysteme. KIT Scientific Publishing, Karlsruhe
Frey A (2014) Fahrsimulatorstudie im Rahmen des Verbundprojekts URBAN: Statischer und dynamischer Fahrsimulator im Vergleich: Wahrnehmung von Abstand und Geschwindigkeit. (Masterarbeit an der Heinrich-Heine-Universität Düsseldorf 2014), Bundesanstalt für Straßenwesen, Bergisch Gladbach
Gebert P et al (2019) End-to-end prediction of driver intention using 3D convolutional neural networks. In: 2019 IEEE intelligent vehicles symposium (IV). IEEE
Gold C et al (2013) ‘Take over!’ how long does it take to get the driver back into the loop? In: Proceedings of the human factors and ergonomics society annual meeting, vol 57, no 1
Hajek H (2017) Längsdynamik und Antriebsakustik von elektrifizierten Straßenfahrzeugen–Beschreibung und Gestaltung des emotionalen Erlebens. https://mediatum.ub.tum.de/doc/1343083/1343083.pdf, 30 Jan 2020
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8)
Jain A, Koppula HS, Raghavan B, Soh S, Saxena A (2015) Car that knows before you do: anticipating maneuvers via learning temporal driving models. In: Proceedings of the IEEE international conference on computer vision, pp 3182–3190
Kalb et al (2018a) What drivers make of directional maneuver information in a take-over scenario. In: IEEE international conference on systems, man, and cybernetics (SMC), pp 3859–3864
Kalb et al (2018b) Multimodal priming of drivers for a cooperative take-over. In: 21st international conference on intelligent transportation systems (ITSC), pp 1029–1034
Kalb et al (2020) Manual adaption of steering support in a take-over scenario—a technical evaluation. In: Tagungsband Uni-DAS 13. Workshop Fahrerassistenzsystem und automatisiertes Fahren, Walting im Altmühltal (2020)
Karakaya et al (2018) Cooperative approach to overcome automation effects during the transition phase of conditional automated vehicles. In: Tagungsband Uni-DAS 12. Workshop Fahrerassistenzsystem und automatisiertes Fahren, Walting im Altmühltal
Keskinen T (2015) Evaluating the user experience of interactive systems in challenging circumstances. Dissertations in Interactive Technology, no 22, Tampere
Körber (2018) Individual differences in human-automation interaction. Dissertation, Technical University of Munich, Munich
Lefèvre S et al (2015) Driver models for personalised driving assistance. Veh Syst Dyn 53(12)1705–1720
Lloyd D et al (2014) Reported road casualties Great Britain: 2014 annual report
Lorenz et al (2014) Designing take over scenarios for automated driving. How does augmented reality support the driver to get back into the loop? Proc Human Factors Ergonomics Soc Annu Meet 58(1):1681–1685
Ludwig J, Gote C, Flad M, Hohmann S (2017) Cooperative dynamic vehicle control allocation using time-variant differential games. In: IEEE international conference on systems, man and cybernetics, SMC, Banff, Alberta, Canada, pp 117–122
Ludwig J, Haas A, Flad M, Hohmann S (2018a) A comparison of concepts for control transitions from automation to human. In: IEEE international conference on systems, man and cybernetics, SMS, Miyazaki, pp 3201–3206
Ludwig J, Martin M, Horne M, Flad M, Voit M, Stiefelhagen R, Hohmann S (2018b) Driver observation and shared vehicle control: supporting the driver on the way back into the control loop. Automatisierungstechnik 66(2):146–159
Martin M et al (2018) Body pose and context information for driver secondary task detection. Intel Veh Symp (IV)
Martin M, Roitberg A et al (2019) Drive & act: a multi-modal dataset for fine-grained driver behavior recognition in autonomous vehicles. In: Proceedings of the IEEE international conference on computer vision
Merat et al (2014) Transition to manual: driver behaviour when resuming control from a highly automated vehicle. Transp Res Part F: Traffic Psychol Behav
Misra I et al (2016) Cross-stitch networks for multi-task learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition (2016)
Na X, Cole DJ (2013) Linear quadratic game and non-cooperative predictive methods for potential application to modelling driver–AFS interactive steering control. In: Vehicle system dynamics 51(2013), no 2, S. 165–198
Ohn-Bar E, Martin S, Tawari A, Trivedi MM (2014) Head, eye, and hand patterns for driver activity recognition. In: 2014 22nd international conference on pattern recognition, pp 660–665. IEEE
Petermann-Stock I et al (2013) Wie Lange Braucht Der Fahrer? Eine Analyse Zu Übernahmezeiten Aus Verschiedenen Nebentätigkeiten Während Einer Hochautomatisierten Staufahrt. 6. Tagung Fahrerassistenzsysteme. Der Weg Zum Automatischen Fahren
Petermeijer et al (2017a) Take-over again: investigating multimodal and directional TORs to get the driver back into the loop. Appl Ergonomics 62:204–215
Petermeijer et al (2017b) Comparing spatially static and dynamic vibrotactile take-over requests in the driver seat. Accid Anal Prev 99(Pt A):218–227
Qiu Z, Ting Y, Tao M (2017) Learning spatio-temporal representation with pseudo-3d residual networks. In: Proceedings of the IEEE international conference on computer vision
Radlmayr J et al (2014) How traffic situations and non-driving-related tasks affect the take-over quality in highly automated driving. In: Proceedings of the human factors and ergonomics society annual meeting, vol 58
Radlmayr J et al (2019) Take-overs in level 3 automated driving—proposal of the take-over performance score (TOPS). In: Proceedings of the 20th congress of the international ergonomics association (IEA 2018), pp 436–446
Roitberg A et al (2018) Informed democracy: voting-based novelty detection for action recognition. BMVC
Roitberg A et al (2019) Analysis of deep fusion strategies for multi-modal gesture recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops
SAE J3016 (2018) Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles
Schrepp M (2019) User experience questionnaire handbook. https://www.ueq-online.org/Material/Handbook.pdf, 30 Jan 2020
Simonyan K, Zisserman A (2014) Two-stream convolutional networks for action recognition in videos. In: Advances in neural information processing systems, pp 568–576
Singh S (2015) Critical reasons for crashes investigated in the national motor vehicle crash causation survey. No. DOT HS 812:115
Streit (2018) Ergonomic evaluation of concepts for automatic action recommendations in take-over situations during conditionally automated driving. Master’s Thesis, Technical University of Munich
Tamaddoni SH, Ahmadian M, Taheri S (2011) Optimal vehicle stability control design based on preview game theory concept. In: American control conference (ACC), S. 5249–5254
Todorov E, Jordan MI (2002) Optimal feedback control as a theory of motor coordination. In: Nature neuroscience, vol 5, no 11, S. 1226–1235
Tran D et al (2015) Learning spatiotemporal features with 3D convolutional networks. In: Proceedings of the IEEE international conference on computer vision
TUM (2020) https://www.lfe.mw.tum.de/forschung/labore/statischer-fahrsimulator/
Turunen et al (2009) SUXES—user experience evaluation method for spoken and multimodal interaction. University of Tampere, Department of Computer Sciences
Wang H and Wang L (2017) Modeling temporal dynamics and spatial configurations of actions using two-stream recurrent neural networks. E Conference on Computer Vision and Pa Ern Recognition (CVPR)
Wolf E et al (2018) Estimating mental load in passive and active tasks from pupil and gaze changes using bayesian surprise. In: Proceedings of the workshop on modelling cognitive processes from multimodal data
Yan C, Coenen F, Zhang B (2016) Driving posture recognition by convolutional neural networks. IET Comput Vision 10(2):103–114
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Flad, M. et al. (2020). Personalisation and Control Transition Between Automation and Driver in Highly Automated Cars. In: Meixner, G. (eds) Smart Automotive Mobility. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-030-45131-8_1
Download citation
DOI: https://doi.org/10.1007/978-3-030-45131-8_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-45130-1
Online ISBN: 978-3-030-45131-8
eBook Packages: Computer ScienceComputer Science (R0)