Abstract
The driver’s drowsiness and distraction are the principal causes of traffic accidents in the world. To attack this problem, in this paper we propose a visual-based driver’s drowsiness and distraction detection system, which is based on a face detection algorithm and a CNN-based driver state classification. To be useful the proposed system, we consider that the system must be implemented in a compact mobile device with limited memory space and computational power. The proposed system in compact mobile device can be used in any type of vehicle, avoiding accident caused by lack of driver’s alert. The proposed system is evaluated using public dataset, obtaining 95.77% of global accuracy. The proposed system is compared with five finetuned off-the-shelf CNNs, in which the proposed system shows a favorable performance, providing higher operation speed and lower memory requirement compared with these five CNNs, although the detection accuracy is slightly lower compared with the best CNN. The performance of the proposed system guarantees the real-time operation in the compact mobile device.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Facts and Stats. http://drowsydriving.org/about/facts-and-atats/. Accessed 30 Jan 2022
Chacon-Murguia, M., Prieto-Resendiz, C.: Detecting driver drowsiness: a survey of system designs and technology. IEEE Consum. Electron. Mag. 4(4), 107–119 (2015)
Páez, M., Abarca, E.: Tools for security in movements, Predictive models of driver’s drowsiness. https://imt.mx/resumen-boletines.html?IdArticulo=449&IdBoletin=168. Accessed 30 Jan 2022
Wang, J., Zhu, S., Gong, Y.: Driving safety monitoring using semisupervised learning on time series data. IEEE Trans. Intell. Transp. Syst. 11(3), 728–737 (2010)
Wu, B., Chen, Y., Yeh, C., Li, Y.: Reasoning-based framework for driving safety monitoring using driving event recognition. IEEE Trans. Intell. Transp. Syst. 14(3), 1231–1241 (2013)
Kokonogi, A., Michail, E., Chouvarda, I., Maglaveras, N.: A study of heart rate and brain system complexity and their interaction in sleep-deprived subjects. In: Proceeding on Computational Cardiology, pp. 969–971 (2008)
Zhang, C., Wang, H., Fu, R.: Automated detection of driver fatigue based on entropy and complexity measures. IEEE Trans. Intell. Transp. Syst. 15(1), 168–177 (2014)
Zhao, G., He, Y., Yang, H., Tao, Y.: Research on fatigue detection based on visual features. IET Image Process. 16, 1–20 (2020)
Phan, A., Nguyen, N., Trieu, T., Phan, T.: An efficient approach for detecting driver drowsiness based on deep learning. Appl. Sci. 11, 8441 (2021)
Flores-Monroy, J., Nakano-Miyatake, M., Perez-Meana, H., Sanchez-Perez, G.: Visual-based real time driver drowsiness detection system using CNN. In: Proceedings of International Conference on Electrical Engineering, Computing Science and Automatic Control, IEEE, Mexico City, Mexico (2021)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: International Conference on Learning Representations (ICLR), San Diego (2015)
Flores, M., Armingo, J., De la Escalera, A., Elissa, K.: A. Real-time warning system for driver drowsiness detection using visual information. J. Intell. Rob. Syst. C. 69(2), 103–125 (2010)
Weng, C., Lai, Y., Lai, S.: Driver drowsiness detection via a hierarchical temporal deep belief network. In: Proceedings of the Asian Conference on Computer Vision, pp. 117–133. IEEE, Taipei, Taiwan (2016)
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., Chen, L.: MobileNetV2: inverted residuals and linear bottlenecks. In: Proceedings the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4510–4520. IEEE, Salt Lake City (2018)
He,. K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 770–778. IEEE, Las Vegas (2016)
Viola, P., Jones, M.: Robust real-time object detection. In: Proceedings of the 2nd International Workshop on Statistical and Computation Theories of Vision – Modeling, Learning, Computing and Sampling, p. 25 (2001)
Bazarevsky, V., Kartynnik, Y., Vakunov, A., Raveendran, K., Grundmann, M.: BlazeFace: sub-millisecond neural face detection on mobile GPUs. In: Proceedings of Computer Vision & Pattern Recognition (2019)
Szegedy, C., et al.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9, IEEE, Boston (2015)
Chollet, F.: Xception: deep learning with Depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1800–1807, IEEE, Honolulu (2017)
Chen, W., et al.: YOLO-face: a real-time face detector. Vis. Comput. 37(4), 805–13 (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Flores-Monroy, J., Nakano-Miyatake, M., Perez-Meana, H., Escamilla-Hernandez, E., Sanchez-Perez, G. (2022). A CNN-Based Driver’s Drowsiness and Distraction Detection System. In: Vergara-Villegas, O.O., Cruz-Sánchez, V.G., Sossa-Azuela, J.H., Carrasco-Ochoa, J.A., Martínez-Trinidad, J.F., Olvera-López, J.A. (eds) Pattern Recognition. MCPR 2022. Lecture Notes in Computer Science, vol 13264. Springer, Cham. https://doi.org/10.1007/978-3-031-07750-0_8
Download citation
DOI: https://doi.org/10.1007/978-3-031-07750-0_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-07749-4
Online ISBN: 978-3-031-07750-0
eBook Packages: Computer ScienceComputer Science (R0)
