Skip to main content

Computer Vision Systems for “Context-Aware” Active Vehicle Safety and Driver Assistance

  • Chapter
  • First Online:

Abstract

Recent developments of information technology and mobile lifestyle have forced drivers to multitask while they drive. The in-vehicle “infotainment” technology is already taking its place in the transformation of vehicles towards more intelligent and interactive devices rather than staying as mere transportation convenience. This transformation has several advantages such as easy route navigation, real-time traffic information, and staying connected with work or people while traveling. However, it has several drawbacks concerning the impact on driver cognitive load and attention sources. Therefore, it is crucial to take advantage of state-of-the-art in-vehicle technology to produce counter-measure systems that monitor the driver status and reduce driver workload adaptively depending on the context. In recognition and analysis of the driving context together with driver status monitoring, computer vision applications supply crucial information both in the vehicle (i.e., driver head and eye tracking) and out of the vehicle (i.e., lane, pedestrian, and vehicle detection and tracking, and road sign recognition). In this chapter, we provide a broad range of computer vision applications for CA-IVS from the literature and our previous studies, and we report our current research efforts.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    *Pinar Boyraz was with the University of Texas at Dallas, CRSS UTDrive modeling group when this work was done. She has since joined Istanbul Technical University, Turkey.

References

  1. Fletcher L, Apostoloff N, Petersson L, Zelinsky A (2003) Vision in and out of vehicles. IEEE Intelligent Systems pp 12–17

    Google Scholar 

  2. (Online). www.fmcsa.dot.gov/documents/tb98-006.pdf

  3. Morimoto CH, Mimica MRM (2005) Eye gaze tracking techniques for interactive applications. Comp Vis Im Und 98:4–24

    Article  Google Scholar 

  4. Hutchinson TE, White KP Jr, Reichert KC, Frey LA (1989) Human–computer interaction using eye-gaze input. IEEE Trans Syst Man Cybern 19:1527–1533

    Article  Google Scholar 

  5. Duchowski AT (2002) A breadth-first survey of eye tracking applications. Behav Res Meth Instrum Comput (BRMIC) 34(4):455–470

    Article  Google Scholar 

  6. Zhu Z, Ji Q (2005) Robust real-time eye detection and tracking under variable lighting conditions and various face orientations. Comp Vis Im Und 98:124–154

    Article  Google Scholar 

  7. Hansen DW, Pece AEC (2005) Eye tracking in the wild. Comp Vis Im Und 98:155–181

    Article  Google Scholar 

  8. Sodhi M, Reimer B, Cohen, JL, Kaars R, Vastenburg E (2004) On-road driver eye movement tracking using head mounted devices. In: Proceedings of the Eye Tracking Research and Application Symposium (ETRA 2002), New Orleans. ACM Press, New York, pp 61–68

    Google Scholar 

  9. faceLab. http://www.seeingmachines.com/

  10. Tobii Eye tracker. http://www.tobii.com

  11. SR-Research. http://www.sr-research.com/

  12. Xiao J, KanadeT, Cohn J (2002) Robust full motion recovery of head motion by dynamic templates and re-registration techniques. In: IEEE 5th international conference on automatic face and gesture recognition, Washington, DC, pp 156–162

    Google Scholar 

  13. Xu G, Sugimoto T (1998) Rits eye: a software-based system for realtime face detection and tracking using Pan-Tilt-Zoom controllable camera. In: Proceedings of fourteenth international conference on pattern recognition, vol 2. Brisbane, pp 1194–1197

    Google Scholar 

  14. Bergasa LM, Nuevo J, Sotelo MA, Barea R, Lopez ME (2006) Real-time system for monitoring driver vigilance. IEEE Trans ITS 6(1):63–72

    Google Scholar 

  15. Boyraz,P, Acar M, Kerr,D (2008) Multi-sensor driver drowsiness monitoring. IMechE PartD, J Automob Eng, 222(D11):2041–2063

    Google Scholar 

  16. De Silva LC, Pei CN, (2000) Bimodal emotion recognition. In: Proceedings of 4th IEEE international conference on automatic face and gesture recognition, Grenoble, 2000

    Google Scholar 

  17. Anderson K, McOwan PW (2006) A real time automated system for the recognition of human facial expressions. IEEE Trans Syst Man Cybern B Cybern 36(1):96–105

    Article  Google Scholar 

  18. Shan C, Gong S, McOwan PW (2006) A comprehensive empirical study on linear subspace methods for facial expression analysis. In: 2006 conference on computer vision and pattern recognition workshop, New York City, New York. 17–22 June 2006, p 153, ISBN: 0-7695-2646-2

    Google Scholar 

  19. Pantic M, Patras I (2006) Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences. IEEE Trans Syst Man Cybern B Cybern 36(2):433–449

    Article  Google Scholar 

  20. Wierwille WW, Wreggit SS, Knipling RR (1994) Development of improved algorithms for on-line detection of driver drowsiness. In: International congress on transportation electronics (Dearborn), leading change. Warrendale, Society of Automotive Engineers

    Google Scholar 

  21. Knipling R, Rau P (2005) PERCLOS: a valid psycho-physiological measure of alertness as assessed by psychomotor vigilance. Technical Report of Federal Highway Administration, Office of Motor Crashes, USA FHWA-MCRT-98-006

    Google Scholar 

  22. Boyraz P, Yang X, Sathyanarayana A, Hansen JHL, Context-aware active vehicle safety and driver assistance, Enhanced Safety for Vehicles (ESV), 2009, 13–15 June, Stuttgart, Germany

    Google Scholar 

  23. McCall JC, Trivedi MM, Video-Based Lane Estimation and Tracking for Driver Assistance: Survey, System and Evaluation, IEEE Transactions on Intelligent Transportation Systems, vol. 7, no.1, pp. 20–37, March 2006

    Google Scholar 

  24. Kim YU, Oh, S-Y, Three-Feature Based Automatic Lane Detection Algorithm (TFALDA) for Autonomous Driving, IEEE Transactions on Intelligent Transportation Systems, vol. 4, no.4, pp. 219–225, Dec 2003

    Google Scholar 

  25. Wang Y, Teoh EK, Shen D, Lane detection and tracking using B-snake, Image and Vision Computing, vol 22, pp.269–280, 2004

    Google Scholar 

  26. Kim Z, Robust Lane Detection and Tracking in Challanging Scenarios, IEEE Transactions on Intelligent Transportation Systems, vol. 9, no.1, pp. 16–26, March 2008

    Google Scholar 

  27. Cheng HY, Jeng BS, Tseng PT, Fan, KC., ’Lane Detection with Moving Vehicles in Traffic Scenes’, IEEE Transactions on Intelligent Transportation Systems, vol. 7, no.4, pp. 16–26, Dec 2006

    Google Scholar 

  28. Perez E, Javidi B, ’Non-linear Distortion- Tolerant Filters for Detection of Road Signs in Background Noise’, IEEE Transactions on Vehicular Technology, vol. 51, no.3, pp. 567–576, May 2002

    Google Scholar 

  29. Broggi A, Cerri P, Medici P, Porta PP, Ghisio G,  Real Time Road Signs Recognition , Proceedings of 2007 IEEE Intelligent Vehicles Symposium, Istanbul, Turkey, June 13–15, 2007

    Google Scholar 

  30. Jilmenez PG, Moreno G, Siegmann P, Arroyo SL, Bascon SM, ’Traffic sign shape classification based on Support Vector Machines and the FFT of the signature blobs’, Proceedings of 2007 IEEE Intelligent Vehicles Symposium, Istanbul, Turkey, June 13–15, 2007

    Google Scholar 

  31. FARS Database: http://wwwfars nhtsa.dot.gov/QueryTool/QuerySection/Report.aspx

  32. Fatality Analysis Reporting System: http://www-fars.nhtsa.dot.gov/Main/index.aspx

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pinar Boyraz .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Boyraz, P., Yang, X., Hansen, J.H.L. (2012). Computer Vision Systems for “Context-Aware” Active Vehicle Safety and Driver Assistance. In: Hansen, J., Boyraz, P., Takeda, K., Abut, H. (eds) Digital Signal Processing for In-Vehicle Systems and Safety. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-9607-7_15

Download citation

  • DOI: https://doi.org/10.1007/978-1-4419-9607-7_15

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4419-9606-0

  • Online ISBN: 978-1-4419-9607-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics