Abstract
Recent developments of information technology and mobile lifestyle have forced drivers to multitask while they drive. The in-vehicle “infotainment” technology is already taking its place in the transformation of vehicles towards more intelligent and interactive devices rather than staying as mere transportation convenience. This transformation has several advantages such as easy route navigation, real-time traffic information, and staying connected with work or people while traveling. However, it has several drawbacks concerning the impact on driver cognitive load and attention sources. Therefore, it is crucial to take advantage of state-of-the-art in-vehicle technology to produce counter-measure systems that monitor the driver status and reduce driver workload adaptively depending on the context. In recognition and analysis of the driving context together with driver status monitoring, computer vision applications supply crucial information both in the vehicle (i.e., driver head and eye tracking) and out of the vehicle (i.e., lane, pedestrian, and vehicle detection and tracking, and road sign recognition). In this chapter, we provide a broad range of computer vision applications for CA-IVS from the literature and our previous studies, and we report our current research efforts.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
*Pinar Boyraz was with the University of Texas at Dallas, CRSS UTDrive modeling group when this work was done. She has since joined Istanbul Technical University, Turkey.
References
Fletcher L, Apostoloff N, Petersson L, Zelinsky A (2003) Vision in and out of vehicles. IEEE Intelligent Systems pp 12–17
(Online). www.fmcsa.dot.gov/documents/tb98-006.pdf
Morimoto CH, Mimica MRM (2005) Eye gaze tracking techniques for interactive applications. Comp Vis Im Und 98:4–24
Hutchinson TE, White KP Jr, Reichert KC, Frey LA (1989) Human–computer interaction using eye-gaze input. IEEE Trans Syst Man Cybern 19:1527–1533
Duchowski AT (2002) A breadth-first survey of eye tracking applications. Behav Res Meth Instrum Comput (BRMIC) 34(4):455–470
Zhu Z, Ji Q (2005) Robust real-time eye detection and tracking under variable lighting conditions and various face orientations. Comp Vis Im Und 98:124–154
Hansen DW, Pece AEC (2005) Eye tracking in the wild. Comp Vis Im Und 98:155–181
Sodhi M, Reimer B, Cohen, JL, Kaars R, Vastenburg E (2004) On-road driver eye movement tracking using head mounted devices. In: Proceedings of the Eye Tracking Research and Application Symposium (ETRA 2002), New Orleans. ACM Press, New York, pp 61–68
faceLab. http://www.seeingmachines.com/
Tobii Eye tracker. http://www.tobii.com
SR-Research. http://www.sr-research.com/
Xiao J, KanadeT, Cohn J (2002) Robust full motion recovery of head motion by dynamic templates and re-registration techniques. In: IEEE 5th international conference on automatic face and gesture recognition, Washington, DC, pp 156–162
Xu G, Sugimoto T (1998) Rits eye: a software-based system for realtime face detection and tracking using Pan-Tilt-Zoom controllable camera. In: Proceedings of fourteenth international conference on pattern recognition, vol 2. Brisbane, pp 1194–1197
Bergasa LM, Nuevo J, Sotelo MA, Barea R, Lopez ME (2006) Real-time system for monitoring driver vigilance. IEEE Trans ITS 6(1):63–72
Boyraz,P, Acar M, Kerr,D (2008) Multi-sensor driver drowsiness monitoring. IMechE PartD, J Automob Eng, 222(D11):2041–2063
De Silva LC, Pei CN, (2000) Bimodal emotion recognition. In: Proceedings of 4th IEEE international conference on automatic face and gesture recognition, Grenoble, 2000
Anderson K, McOwan PW (2006) A real time automated system for the recognition of human facial expressions. IEEE Trans Syst Man Cybern B Cybern 36(1):96–105
Shan C, Gong S, McOwan PW (2006) A comprehensive empirical study on linear subspace methods for facial expression analysis. In: 2006 conference on computer vision and pattern recognition workshop, New York City, New York. 17–22 June 2006, p 153, ISBN: 0-7695-2646-2
Pantic M, Patras I (2006) Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences. IEEE Trans Syst Man Cybern B Cybern 36(2):433–449
Wierwille WW, Wreggit SS, Knipling RR (1994) Development of improved algorithms for on-line detection of driver drowsiness. In: International congress on transportation electronics (Dearborn), leading change. Warrendale, Society of Automotive Engineers
Knipling R, Rau P (2005) PERCLOS: a valid psycho-physiological measure of alertness as assessed by psychomotor vigilance. Technical Report of Federal Highway Administration, Office of Motor Crashes, USA FHWA-MCRT-98-006
Boyraz P, Yang X, Sathyanarayana A, Hansen JHL, Context-aware active vehicle safety and driver assistance, Enhanced Safety for Vehicles (ESV), 2009, 13–15 June, Stuttgart, Germany
McCall JC, Trivedi MM, Video-Based Lane Estimation and Tracking for Driver Assistance: Survey, System and Evaluation, IEEE Transactions on Intelligent Transportation Systems, vol. 7, no.1, pp. 20–37, March 2006
Kim YU, Oh, S-Y, Three-Feature Based Automatic Lane Detection Algorithm (TFALDA) for Autonomous Driving, IEEE Transactions on Intelligent Transportation Systems, vol. 4, no.4, pp. 219–225, Dec 2003
Wang Y, Teoh EK, Shen D, Lane detection and tracking using B-snake, Image and Vision Computing, vol 22, pp.269–280, 2004
Kim Z, Robust Lane Detection and Tracking in Challanging Scenarios, IEEE Transactions on Intelligent Transportation Systems, vol. 9, no.1, pp. 16–26, March 2008
Cheng HY, Jeng BS, Tseng PT, Fan, KC., ’Lane Detection with Moving Vehicles in Traffic Scenes’, IEEE Transactions on Intelligent Transportation Systems, vol. 7, no.4, pp. 16–26, Dec 2006
Perez E, Javidi B, ’Non-linear Distortion- Tolerant Filters for Detection of Road Signs in Background Noise’, IEEE Transactions on Vehicular Technology, vol. 51, no.3, pp. 567–576, May 2002
Broggi A, Cerri P, Medici P, Porta PP, Ghisio G, Real Time Road Signs Recognition , Proceedings of 2007 IEEE Intelligent Vehicles Symposium, Istanbul, Turkey, June 13–15, 2007
Jilmenez PG, Moreno G, Siegmann P, Arroyo SL, Bascon SM, ’Traffic sign shape classification based on Support Vector Machines and the FFT of the signature blobs’, Proceedings of 2007 IEEE Intelligent Vehicles Symposium, Istanbul, Turkey, June 13–15, 2007
FARS Database: http://wwwfars nhtsa.dot.gov/QueryTool/QuerySection/Report.aspx
Fatality Analysis Reporting System: http://www-fars.nhtsa.dot.gov/Main/index.aspx
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Boyraz, P., Yang, X., Hansen, J.H.L. (2012). Computer Vision Systems for “Context-Aware” Active Vehicle Safety and Driver Assistance. In: Hansen, J., Boyraz, P., Takeda, K., Abut, H. (eds) Digital Signal Processing for In-Vehicle Systems and Safety. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-9607-7_15
Download citation
DOI: https://doi.org/10.1007/978-1-4419-9607-7_15
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4419-9606-0
Online ISBN: 978-1-4419-9607-7
eBook Packages: EngineeringEngineering (R0)