Abstract
Drowsy and fatigued driving is a major factor in many traffic accidents. The slow onset of drowsiness or extreme fatigue in a driver can be detected, although it is more difficult to do so than it is to detect closed eyes. We propose a novel yet simple single camera-based real-time computer vision technique for detecting drowsiness and fatigue levels that solely relies on the eye blinking rate estimated from the eye aspect ratio and moving average calculation over a period of 30 s which is updated every 10 s. An alert is generated to stop the user from going into microsleep or caution the user in case of extreme fatigue if the rate of eye blinking falls below a level or is too high respectively that has been scientifically validated in the literature. The existing methods use facial expression-based detection, blink-based detection using Electrooculogram or simple eye aspect ratio-based methods or calculation of blink rate in pixels/seconds or combination of these which only results in detection of drowsiness, while the proposed method uses single camera-based detection calculating blink rate to estimate both—the drowsiness and fatigue levels in blinks/minute; thus, the proposed method is much less complicated in terms of hardware and computation, and results are repeatable over different ambient illuminance conditions.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Road safety factsheet: driver fatigue and road accidents factsheet. The Royal Society for the Prevention of Accidents, July 2020. https://www.rospa.com/media/documents/road-safety/driver-fatigue-factsheet.pdf
Driver fatigue and road accidents: a literature review and position paper. The Royal Society for the Prevention of Accidents Driver Fatigue and Road Accidents, Feb 2001
Traffic safety facts: drowsy driving. United States Department of Transportation, Drowsy Driving: Avoid Falling Asleep Behind the Wheel. NHTSA. https://www.nhtsa.gov/risky-driving/drowsy-driving
Laouz H, Ayad S, Terrissa LS (2020) Literature review on driver’s drowsiness and fatigue detection. In: 2020 international conference on intelligent systems and computer vision (ISCV), Fez, Morocco, pp 1–7. https://doi.org/10.1109/ISCV49265.2020.9204306
Furugori S, Yoshizawa N, Iname C, Miura Y (2005) Estimation of driver fatigue by pressure distribution on seat in long term driving. Rev Automot Eng 26(1):053–058
Analysis of electrocardiogram and photoplethysmogram signals to detect car driver drowsiness using the threshold method (2023). https://doi.org/10.1007/978-981-99-0248-4_43
Gupta AS, Kumari M, Shokeen S, Mishra A, Singh A (2022) EEG and ECG-based drowsiness detection: a review on state of the art. In: Gao XZ, Tiwari S, Trivedi MC, Singh PK, Mishra KK (eds) Advances in computational intelligence and communication technology. Lecture notes in networks and systems, vol 399. Springer, Singapore. https://doi.org/10.1007/978-981-16-9756-2_4
Omidyeganeh M, Javadtalab A, Shirmohammadi S (2011) Intelligent driver drowsiness detection through fusion of yawning and eye closure. In: 2011 IEEE international conference on virtual environments, human-computer interfaces and measurement systems proceedings, Ottawa, ON, Canada, pp 1–6. https://doi.org/10.1109/VECIMS.2011.6053857
Lew M, Sebe N, Huang T, Bakker E, Vural E, Cetin M, Ercil A, Littlewort G, Bartlett M, Movellan J (2007) Drowsy driver detection through facial movement analysis. In: Human computer interaction, vol 4796. Springer, Berlin, pp 6–18
Yin BC, Fan X, Sun YF (2009) Multiscale dynamic features based driver fatigue detection. Int J Pattern Recogn Artif Intell 23:575–589
Kumar V, Sharma S, Ranjeet (2022) Driver drowsiness detection using modified deep learning architecture. Evol Intel. https://doi.org/10.1007/s12065-022-00743-w
Brandt T, Stemmer R, Rakotonirainy A (2004) Affordable visual driver monitoring system for fatigue and monotony. In: IEEE international conference on systems, man and cybernetics (IEEE Cat. No. 04CH37583), vol 7, pp 6451–6456
Yusri MF, Mangat P, Wasenmüller O (2021) Detection of driver drowsiness by calculating the speed of eye blinking. https://doi.org/10.48550/arXiv.2110.11223
Kuwahara A, Nishikawa K, Hirakawa R, Kawano H, Nakatoh Y (2022) Eye fatigue estimation using blink detection based on Eye Aspect Ratio Mapping (EARM). Cogn Robot 2:50–59. ISSN 2667-2413. https://doi.org/10.1016/j.cogr.2022.01.00
Andreassi JL (2006) Psychophysiology: human behavior and physiological response, 5th ed. Psychology Press. https://doi.org/10.4324/9780203880340
Peters B, Anund A (2004) System for effective assessment of driver vigilance and warning according to traffic risk estimation—preliminary pilot plans—revision II. VTI (Swedish National Road and Transport Research Institute), Linköping
Thorslund B, Anund A, Forsman Å, Gustafsson S, Soerensen G (2004) Electrooculogram analysis and development of a system for defining stages of drowsiness. Master’s thesis project in biomedical engineering, reprint from Linkoeping University. Department Biomedical Engineering, LIU-IMT-EX-351, LINKOEPING 2003
Hargutt V, Kruger HP (2000) Eyelid movements and their predictive value for fatigue stages. In: International conference on traffic and transport psychology—ICTTP 2000, 4–7 Sept 2000, Berne, Switzerland
Singh J (2020) Learning based driver drowsiness detection model. In: 3rd international conference on intelligent sustainable systems (ICISS), Thoothukudi, India, pp 698–701. https://doi.org/10.1109/ICISS49785.2020.9316131
Chirra VRR, Uyyala SR, Kolli VKK (2019) Deep CNN: a machine learning approach for driver drowsiness detection based on eye state. Revue d'Intelligence Artificielle 33(6):461–466. https://doi.org/10.18280/ria.330609
Albadawi Y, Takruri M, Awad M (2022) A review of recent developments in driver drowsiness detection systems. Sensors 22(5):2069.https://doi.org/10.3390/s22052069 [online]
Shekari SS, Wilkinson VE, Cori JM, Westlake J, Stevens B, Downey LA, Shiferaw BA, Rajaratnam SMW, Howard ME (2019) Eye-blink parameters detect on-road track-driving impairment following severe sleep deprivation. J Clin Sleep Med 15(9):1271–1284. https://doi.org/10.5664/jcsm.7918. PMID: 31538598; PMCID: PMC6760410
Schmidt J, Laarousi R, Stolzmann W, Karrer-Gauß K (2018) Eye blink detection for different driver states in conditionally automated driving and manual driving using EOG and a driver camera. Behav Res Methods 50(3):1088–1101. https://doi.org/10.3758/s13428-017-0928-0
Soukupova T, Cech J (2016) Eye blink detection using facial landmarks. In: 21st computer vision winter workshop, Rimske Toplice, Slovenia, p 2, Feb 2016
Paul S, Mubarak S, da Vitoria Lobo N (2000) Monitoring head/eye motion for driver alertness with one camera, VL-15, Sept 2000. IEEE Xplore. https://doi.org/10.1109/ICPR.2000.902999
Pasaribu NTB, Prijono A, Ratnadewi R, Adhie RP, Felix J (2018) Drowsiness detection according to the number of blinking eyes specified from eye aspect ratio value modification. In: Advances in social science, education and humanities research, vol 203. International conference on life, innovation, change, and knowledge (ICLICK 2018). https://doi.org/10.2991/iclick-18.2019.35
Ariel G (2022) Eye-tracker in the car keeps drivers awake and alert. No Camels Weekly Newsletter, 21 Aug 2022
Feld H, Mirbach B, Katrolia J, Selim M, Wasenmüller O, Stricker D (2021) DFKI cabin simulator: a test platform for visual in-cabin monitoring functions. In: Commercial vehicle technology. Springer, 417–430
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Karar, S., Kanumuri, T. (2023). Assessment of Driver Fatigue and Drowsiness Based on Eye Blink Rate. In: Swaroop, A., Polkowski, Z., Correia, S.D., Virdee, B. (eds) Proceedings of Data Analytics and Management. ICDAM 2023. Lecture Notes in Networks and Systems, vol 787. Springer, Singapore. https://doi.org/10.1007/978-981-99-6550-2_24
Download citation
DOI: https://doi.org/10.1007/978-981-99-6550-2_24
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-6549-6
Online ISBN: 978-981-99-6550-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)