Skip to main content
SpringerLink
Log in

Open-eye detection using iris–sclera pattern analysis for driver drowsiness detection

  • Published:
Sādhanā Aims and scope Submit manuscript

Abstract

This paper proposes a novel approach for open-eye detection that can be used in driver drowsiness analysis based on computer vision techniques. The proposed method captures the driver video using a low-resolution camera. The proposed drowsiness detection system has three main stages. The first stage is face detection using elliptical approximation and template matching techniques. In the second stage, the open eye is detected using the proposed iris–sclera pattern analysis method. In the third stage, the drowsiness state of the driver is determined using PERcentage of eye CLOSure (PERCLOS) measure. The entire system is designed to be independent of any specific data sets for face or eye detection. The proposed method for open-eye detection uses basic image processing concepts of morphological and laplacian operations. The proposed system was evaluated with real-life images and videos. Open-eye detection accuracy of 93% was achieved.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21

References

  1. Klauer S G, Dingus T A, Neale V L, Sudweeks J D and Ramsey D J 2006 The impact of driver inattention on near-crash/crash risk: an analysis using the 100-car naturalistic driving study data. Washington, DC: U.S. Department of Transportation, National Highway Traffic Safety Administration, https://vtechworks.lib.vt.edu/bitstream/handle/10919/55090/DriverInattention.pdf?sequence=1. Report No. DOT HS 810 594

  2. Akerstedt T, Kecklund G and Hörte L G 2001 Night driving, season, and the risk of highway accidents. Sleep 24: 401–406. https://www.ncbi.nlm.nih.gov/pubmed/11403524

    Article  Google Scholar 

  3. Connor J, Norton R, Ameratunga S, Robinson E, Civil I, Dunn R, Bailey J and Jackson R 2002 Driver sleepiness and risk of serious injury to car occupants: population based control study. Br. Med. J. 324: 1125–1129

    Article  Google Scholar 

  4. Horne J and Reyner L 1999 Vehicle accidents related to sleep: a review. Occup. Environ. Med. 56: 189–294

    Article  Google Scholar 

  5. May J F and Baldwin C L 2009 Driver fatigue: the importance of identifying causal factors of fatigue when considering detection and countermeasure technologies. Transp. Res. Part F: Traf. Psychol. Behav. 12(3): 218–224

  6. Wright N, Stone B, Horberry T and Reed N 2007 A review of in-vehicle sleepiness detection devices. Published Project Report PPR157, TRL Limited

  7. Bergasa L M, Nuevo J, Sotelo M Á, Barea R and Guillén M E L 2006 Real-time system for monitoring driver vigilance. IEEE Trans. Intell. Transp. Syst. 7(1): 63–77

    Article  Google Scholar 

  8. Oron-Gilad T, Ronen A and Shinar D 2008 Alertness maintaining tasks (AMTs) while driving. Accid. Anal. Prev. 40(3): 851–860

    Article  Google Scholar 

  9. Papadelis C, Chen Z, Kourtidou-Papadeli C, Bamidis P, Chouvarda I, Bekiaris E and Maglaveras N 2007 Monitoring sleepiness with on-board electrophysiological recordings for preventing sleep-deprived traffic accidents. Clin. Neurophysiol. 118(9): 1906–1922

    Article  Google Scholar 

  10. Faber J 2004 Detection of different levels of vigilance by EEG pseudospectra. Neural Netw. World 14(3–4): 285–290

    Google Scholar 

  11. Lin C T, Chang C J, Lin B S, Hung S H, Chao C F and Wang I J 2010 A real-time wireless brain–computer interface system for drowsiness detection. IEEE Trans. Biomed. Circuits Syst. 4(4): 214–222

    Article  Google Scholar 

  12. Wakita T, Ozawa K, Miyajima C, Igarashi K, Itou K, Takeda K and Itakura F 2006 Driver identification using driving behavior signals. IEICE Trans. E89-D(3): 1188–1194

    Article  Google Scholar 

  13. Takei Y and Furukawa Y 2005 Estimate of drivers fatigue through steering motion. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, vol. 2, pp. 1765–1770

    Google Scholar 

  14. McCall J C, Trivedi M M, Wipf D and Rao B 2005 Lane change intent analysis using robust operators and sparse bayesian learning. In: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05). Washington, DC, USA: IEEE Computer Society, p. 59

  15. Chang T H, Hsu C S, Wang C and Yang L K 2008 Onboard measurement and warning module for irregular vehicle behavior. IEEE Trans. Intell. Transp. Syst. 9(3): 501–513

    Article  Google Scholar 

  16. D’Orazio T, Leo M, Guaragnella C and Distante A 2007 A visual approach for driver inattention detection. Pattern Recogn. 40(8): 2341–2355

    Article  MATH  Google Scholar 

  17. Suzuki M, Yamamoto N, Yamamoto O, Nakano T and Yamamoto S 2006 Measurement of driver’s consciousness by image processing – a method for presuming driver’s drowsiness by eye-blinks coping with individual differences. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, vol. 4, pp. 2891–2896

  18. Ji Q and Yang X J 2002 Real-time eye, gaze, and face pose tracking for monitoring driver vigilance. Real-Time Imag. 8(5): 357–377

    Article  MATH  Google Scholar 

  19. Bretzner L and Krantz M 2005 Towards low-cost systems for measuring visual cues of driver fatigue and inattention in automotive applications. In: Proceedings of the IEEE International Conference on Vehicular Electronics and Safety, pp. 161–164

  20. Heinzmann J, Tate D and Scott R 2008 Using technology to eliminate drowsy driving. In: Proceedings of the SPE International Conference on Health, Safety, and Environment in Oil and Gas Exploration and Production

  21. Yang M, Kriegman J and Ahuja N 2002 Detecting faces in images: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 24(1): 34–58

    Article  Google Scholar 

  22. Dowall J, Pavlidis I and Bebis G 2001 Face detection in the near-IR spectrum. Image Vis. Comput. 21: 565–578

    Article  Google Scholar 

  23. Zhu Z and Ji Q 2005 Robust real-time eye detection and tracking under variable lighting conditions and various face orientations. Comput. Vis. Image Und. 98: 124–154

    Article  Google Scholar 

  24. Perez C A, González G D, Medina L E and Galdames F J 2005 Linear vs. nonlinear neural modeling for 2-D pattern recognition. IEEE Trans. Syst. Man Cybern. Part A: Syst. Hum. 35(6): 955–964

  25. Rowley H, Baluja S and Kanade T 1998 Neural network-based face detection. IEEE Trans. Pattern Anal. Mach. Intell. 20(1): 23–38

    Article  Google Scholar 

  26. Rowley H, Baluja S and Kanade T 1998 Rotation invariant neural network based face detection. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Santa Barbara, CA, pp. 38–44

  27. Jones M and Rehg J 2002 Statistical color models with application to skin detection. Int. J. Comput. Vis. 46: 81–96

    Article  MATH  Google Scholar 

  28. Wang J G and Sung E 2002 Study on eye gaze estimation. IEEE Trans. Syst. Man Cybern. Part B: Cybern. 32(3): 332–350

  29. Chen Y W and Kubo K 2007 A robust eye detection and tracking technique using Gabor filters. In: Proceedings of the Third International Conference on Intelligent Information Hiding and Multimedia Signal Processing, vol. 1, pp. 109–112

    Article  Google Scholar 

  30. Ji Q 2002 3D face pose estimation and tracking from a monocular camera. Image Vis. Comput. 20(7): 499–511

    Article  Google Scholar 

  31. Li Y, Qi X and Wang Y 2001 Eye detection by using fuzzy template matching and feature-parameter-based judgement. Pattern Recogn. Lett. 22(10): 1111–1124

    Article  MATH  Google Scholar 

  32. Maio D and Maltoni D 2000 Real-time face location on gray-scale static images. Pattern Recogn. 33: 1525–1539

    Article  Google Scholar 

  33. Viola P and Jones M 2001 Rapid object detection using a boosted cascade of simple features. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. I-511–I-518

  34. Saradadevi M and Bajaj P 2008 Driver fatigue detection using mouth and yawning analysis. Int. J. Comput. Sci. Netw. Secur. 8: 183–188

    Google Scholar 

  35. Perez C A, Lazcano V A and Estévez P A 2007 Real-time iris detection on coronal-axis-rotated faces. IEEE Trans. Syst. Man Cybern. Part C: Appl. Rev. 37(5): 971–978

  36. Liu D, Sun P, Xiao Y and Yin Y 2010 Drowsiness detection based on eyelid movement. In: Proceedings of the Second International Workshop on Education Technology and Computer Science, vol. 2, pp. 49–52

    Google Scholar 

  37. Tabrizi P R and Zoroofi R A 2008 Open/closed eye analysis for drowsiness detection. In: Proceedings of the First Workshops on Image Processing Theory, Tools and Applications, pp. 1–7

  38. Flores M J, Armingol J M and de la Escalera A 2010 Real-time warning system for driver drowsiness detection using visual information. J. Intell. Robot. Syst. 59(2): 103–125

    Article  Google Scholar 

  39. Donahue M J and Rokhlin S I 1993 On the use of level curves in image analysis. In: Image understanding, vol. 57, pp. 185–203

    Article  Google Scholar 

  40. Gonzalez R C and Woods R E 2009 In: Digital image processing. 3rd Ed, Prentice Hall

  41. Otsu N A 1998 Threshold selection method from gray-level histograms. In: IEEE Trans. Syst. Man Cybern. 9(1): 62–66

  42. Dinges D F and Grace R 1998 PERCLOS: a valid psychophysiological measure of alertness as assessed psychometer vigilance. In: US Department of Transportation: Federal Highway Administration

Download references

Acknowledgements

The authors would like to thank the experts from Tata Elxsi, Technopark, Trivandrum, India, for the support and guidance.

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Kerala, Kariavattom, Thiruvananthapuram, 695581, India

    Arun D Panicker & Madhu S Nair

Authors
  1. Arun D Panicker
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Madhu S Nair
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Madhu S Nair.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Panicker, A.D., Nair, M.S. Open-eye detection using iris–sclera pattern analysis for driver drowsiness detection. Sādhanā 42, 1835–1849 (2017). https://doi.org/10.1007/s12046-017-0728-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12046-017-0728-3

Keywords

Search

Navigation