Development of an Advanced Driver Assistance System Using RGB-D Camera
In recent years, the automotive industry has shown increased interest in Advanced Driver Assistance Systems (ADAS), especially those based on bio-signals. Recent advances in RGB-D technologies have provided effective solutions for tracking human activity based on depth data. In this paper is presented an ADAS system based on Kinect RGB-D camera for the identification of the driver’s distraction. Using depth and colour information the proposed ADAS system is be able to identify the driver’s head orientation and eye position. Based on this data, the driver’s inattention is detected and the driver is warned by audio signals. The proposed ADAS system was evaluated using a Virtual Reality driver simulator for manual and visual distraction. The results show accurate recognition of driver’s distraction.
KeywordsDriver distraction RGB-D sensor ADAS
This paper is supported by the Romanian Government, specifically MEN – UEFISCDI authority under the program PNII “Partnerships in priority areas”, under the project number 240⁄2014 - NAVIEYES, supporting the collaboration between the company Route 66 and University Transilvania of Brasov.
- 2.Duguleana, M., Dumitru, A., Postelnicu, C., Mogan, G.: Video-based evaluation of driver’s visual attention using smartphones. In: IEEE 6th International Conference on Information, Intelligence, Systems and Applications (IISA), pp. 1–5 (2015)Google Scholar
- 3.Craye, C., Rashwan, A., Kamel, M.S., Karray, F.: A multi-modal driver fatigue and distraction assessment system. Int. J. Intell. Transp. Syst. Res. 14(3), pp. 1–22 (2015)Google Scholar
- 4.Gallahan, S.L., Golzar, G.F., Jain, A.P., Samay, A.E., Trerotola, T.J., Weisskopf, J.G., Lau, N.: Detecting and mitigating driver distraction with motion capture technology: distracted driving warning system. In: Systems and Information Engineering Design Symposium (SIEDS), pp. 76–81 (2013)Google Scholar
- 5.Hu, Z., Uchida, N., Wang, Y., Dong, Y.: Face orientation estimation for driver monitoring with a single depth camera. In: 2015 IEEE Intelligent Vehicles Symposium (IV), pp. 958–963 (2015)Google Scholar
- 8.NHTSA: Distraction.gov, official US government website for distracted driving (2016). http://www.distraction.gov
- 9.Postelnicu C.C., Machidon, O., Girbacia, M., Voinea, D., Duguleana, M.: Effects of playing mobile games while driving. In: International Conference on Distributed, Ambient, and Pervasive Interactions, pp. 291–301 (2016)Google Scholar
- 10.Selfies while driving. http://edition.cnn.com/2013/11/06/tech/mobile/selfies-while-driving/. Accessed July 2016
- 11.Logitech G29 driving force. http://gaming.logitech.com/en-roeu/product/g29-driving-force. Accesed July 2016
- 12.Kinect for Windows SDK. https://developer.microsoft.com/en-us/windows/kinect
- 13.Microsoft Kinect V2. https://developer.microsoft.com/en-us/windows/kinect/hardware
- 14.NaviEyes research project site. http://navieyes.unitbv.ro