An Analysis of Saccadic Eye Movements and Facial Images for Assessing Vigilance Levels During Simulated Driving

  • Akinori Ueno
  • Shoyo Tei
  • Tomohide Nonomura
  • Yuichi Inoue
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5639)


The authors analyzed facial video recordings and saccadic eye movements during 1-hour simulated driving in 10 subjects. Mean cross-correlation coefficient between the visually determined facial sleepiness and the proposed index of saccade (i.e. PV/D) for 9 subjects was -0.56 and the maximum coefficient of inverse cross-correlation was 0.83. Mean cross-correlation coefficient for 6 repetitive measurements for another subject was -0.72, and the maximum was 0.84. Variation in PV/D preceded that in facial sleepiness in 13 of 15 measurements and syncronized with it in other 2 measurements. From these results, we confirmed a fair potential of the PV/D to detect decline in vigilance levels earlier than facial sleepiness. We also revealed that narrow fluctuations throughout the measurement could lead to low inverse cross-correlation below 0.60 between the two indices. Therefore experimenter should pay attention to designing the experimental procedure to ensure broad fuctuations of the subject’s vigilance levels in the measurement.


doze prevention saccade facial sleepiness advanced safety vehicle 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ueno, H., Kaneda, M., Tsukino, M.: Development of Drowsy Detection System. In: Vehicle Navigation & Information Systems, pp. 15–20 (1994) Google Scholar
  2. 2.
    Ji, Q., Yang, X.: Real Time Visual Cues Extraction for Monitoring Driver Vigilance. In: Schiele, B., Sagerer, G. (eds.) ICVS 2001. LNCS, vol. 2095, pp. 107–124. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  3. 3.
    Smith, P., Shah, M., Lobo, N.V.: Determining Driver Visual Attention with One Camera. IEEE Trans. ITS 4, 205–218 (2003)Google Scholar
  4. 4.
    Ueno, A., Ota, Y., Takase, M., Minamitani, H.: Relationship between Vigilance Levels and Characteristics of Saccadic Eye Movement. In: 17th Ann. Int. Conf. IEEE EMBS, pp. 572–573 (1995)Google Scholar
  5. 5.
    Ueno, A., Ota, Y., Takase, M., Minamitani, H.: Characteristics of Visually Triggered and Internally Guided Saccade Depending on Vigilance States. IEICE Trans. Information and Systems PT 2 J81-D-II, 1411–1420 (1998) (in Japanese) Google Scholar
  6. 6.
    Ueno, A., Ota, Y., Takase, M., Minamitani, H.: Parametric Analysis of Saccadic Eye Movement Depending on Vigilance States. In: 18th Ann. Int. Conf. IEEE EMBS, pp. 319–320 (1996)Google Scholar
  7. 7.
    Ueno, A., Hashimoto, H., Takase, M., Minamitani, H.: Diurnal Variation in Vertical Saccade Dynamics. In: 4th Asia-Pacific Conf. Medical and Biological Engineering, p. 373 (1999)Google Scholar
  8. 8.
    Ueno, A., Tateyama, T., Takase, M., Minamitani, H.: Dynamics of Saccadic Eye Movement Depending on Diurnal Variation in Human Alertness. System and Computers in Japan 33, 95–103 (2002)CrossRefGoogle Scholar
  9. 9.
    Ueno, A., Uchikawa, Y.: Relation between Human Alertness, Velocity Wave Profile of Saccade, and Performance of Visual Activities. In: 26th Ann. Int. Conf. IEEE EMBS, pp. 933–935 (2004)Google Scholar
  10. 10.
    Ueno, A., Sakamoto, S., Uchikawa, Y.: Relation between Dynamics of Saccade and Bit Rate for Visual Perception during Numerical Targets Comparing. IEICE Trans. Information and Systems PT 2 J87-D-II, 2062–2070 (2004) (in Japanese) Google Scholar
  11. 11.
    Ueno, A., Uchikawa, Y.: An Approach to Quantification of Human Alertness Using Dynamics of Saccadic Eye Movement: For an Application to Human Adaptive Mechatronics. In: 8th Int. Conf. Mechatronics. Technol., pp. 563–568 (2004)Google Scholar
  12. 12.
    Herscovitch, J., Broughton, R.: Sensitivity of the Stanford Sleepiness Scale to the Effects of Cumulative Partial Sleep Deprivation and Recovery Oversleeping. Sleep 4, 83–92 (1981)Google Scholar
  13. 13.
    Bahill, A.T., Kallman, J.S., Lieberman, J.E.: Frequency limitations of the two-point central difference differentiation algorithm. Biol. Cybern. 45, 1–4 (1982)CrossRefGoogle Scholar
  14. 14.
    Komatsu, Y., Ueno, A., Hoshino, H.: Real-time discrimination of saccade and eye blink from output signal of eye movement monitor. In: 19th Ann. Conf. The Society of Life Support Technology, p. 54 (2003) (in Japanese) Google Scholar
  15. 15.
    Ueno, A., Kokubun, S., Uchikawa, Y.: A Prototype Real-Time System for Assessing Vigilance Levels and for Alerting the Subject with Sound Stimulation. Int. J. Assist. Robotics and Mechatronics 8, 19–27 (2007)Google Scholar
  16. 16.
    Kokubun, S., Ueno, A., Uchikawa, Y.: Influence of Sound Pressure Level of Beep Stimulation on Arousal Effect: Quantitative Evaluation Based on Analysis of Saccade and Electroencephalogram. Trans. SICE 44, 871–877 (2008) (in Japanese) CrossRefGoogle Scholar
  17. 17.
    Kitajima, H., Numata, N., Yamamoto, K., Goi, Y.: Prediction of Automobile Driver Sleepiness: 1st Report, Rating of Sleepiness Based on Facial Expression and Examination of Effective Predictor Indexes of Sleepiness. Trans. JSME Series C 63, 3059–3066 (1997) (in Japanese) CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Akinori Ueno
    • 1
  • Shoyo Tei
    • 2
  • Tomohide Nonomura
    • 2
  • Yuichi Inoue
    • 3
  1. 1.Department of Electric and Electronic Engineering, School of EngineeringTokyo Denki UniversityTokyoJapan
  2. 2.Master’s Program of Electronic and Computer Engineering, Graduate School of Science and EngineeringGraduate School of Tokyo Denki UniversitySaitamaJapan
  3. 3.Japan Somnology CenterNeuropsychiatric Research InstituteTokyoJapan

Personalised recommendations