Automatic Assessment of Eye Blinking Patterns through Statistical Shape Models
Several studies have related the alertness of an individual to their eye-blinking patterns. Accurate and automatic quantification of eye-blinks can be of much use in monitoring people at jobs that require high degree of alertness, such as that of a driver of a vehicle. This paper presents a non-intrusive system based on facial biometrics techniques, to accurately detect and quantify eye-blinks. Given a video sequence from a standard camera, the proposed procedure can output blink frequencies and durations, as well as the PERCLOS metric, which is the percentage of the time the eyes are at least 80% closed. The proposed algorithm was tested on 360 videos of the AV@CAR database, which amount to approximately 95,000 frames of 20 different people. Validation of the results against manual annotations yielded very high accuracy in the estimation of blink frequency with encouraging results in the estimation of PERCLOS (average error of 0.39%) and blink duration (average error within 2 frames).
KeywordsVideo Sequence Manual Annotation Obstructive Sleep Apnoea Syndrome False Acceptance Rate Active Shape Model
Unable to display preview. Download preview PDF.
- 4.Dinges, D.: PERCLOS: A valid psychophysiological measure of alertness as assesed by psychomotor vigilance indianapolis. Technical report, Federal Highway Administration, Office of Motor Carriers, Tech. Rep. MCRT-98-006 (1998)Google Scholar
- 6.Martínez, A., Benavente, R.: The AR face database. Technical report, Computer Vision Center, Barcelona, Spain (1998)Google Scholar
- 8.Ortega, A., Sukno, F.M., Lleida, E., Frangi, A.F., Miguel, A., Buera, L., Zacur, E.: AV@CAR: A spanish multichannel multimodal corpus for in-vehicle automatic audio-visual speech recognition. In: Proc. 4th Int. Conf. on Language Resources and Evaluation, Lisbon, Portugal, vol. 3, pp. 763–767 (2004), http://www.cilab.upf.edu/ac
- 9.Papageorgiou, C.P., Oren, M., Poggio, T.: A general framework for object detection. In: ICCV 1998: Proceedings of the International Conference on Computer Vision, Washington, DC, USA, pp. 555–562 (1998)Google Scholar
- 10.Pavani, S.-K., Delgado-Gomez, D., Frangi, A.F.: Haar-like features with optimally weighted rectangles for rapid object detection. Pattern Recognition (in press, 2009)Google Scholar
- 11.Selinger, A., Socolinsky, D.: Appearance-based facial recognition using visible and thermal imagery: a comparative study. Technical report, Equinox Corporation (2002), http://www.equinoxsensors.com
- 12.Sirevaag, E.J., Stern, J.A.: Ocular Measures of Fatigue and Cognitive Factors. In: Engineering Psychophysiology: Issues and Applications, L. Erlbaum Associates Press, Mahwah (1998)Google Scholar
- 14.Stern, J.: Eye activity measures of fatigue, and napping as a countermeasure. Technical report, U.S. Department of Transportation. Technical Report FHWA-MC-99-028 (1999)Google Scholar
- 15.Stern, J.A., Beideman, L., Chen, S.C.: Effect of alcohol on visual search and motor performance during complex task performance. In: Adverse effects of environmental chemicals and psychotropic drugs: neurophysiological and behavioral tests, vol. 2, pp. 53–68. Elsevier, Amsterdam (1976)Google Scholar
- 17.Wierwille, W.W., Ellsworth, L.A., Wreggit, S.S., Fairbanks, R.J., Kirn, C.L.: Research on vehicle based driver status/performance monitoring: development, validation, and refinement of algorithms for detection of driver drowsiness. Technical report, National Highway Traffic Safety Administration Final Report: DOT HS 808 247 (1994)Google Scholar