Advertisement

Shape-Based Eye Blinking Detection and Analysis

  • Zeyd BoukhersEmail author
  • Tomasz Jarzyński
  • Florian Schmidt
  • Oliver Tiebe
  • Marcin Grzegorzek
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 403)

Abstract

Methods for automated eye blinking analysis can be applied to support people with certain disabilities in interaction with technical systems, to analyse human deceptive behaviour, in driver fatigue assessment, etc. In this paper we introduce a robust shape-based algorithm for automatic eye blinking detection in video sequences. First, all video frames are classified separately into those showing an open and those corresponding to a closed eye. Second, these classification results are cleverly combined for blinking detection so that the influence of single misclassified frames gets compensated almost completely. In addition to that, we present our investigations on the user behaviour in terms of eye blinking frequency in two different everyday life situations. The most relevant scientific contributions of this paper are (1) the introduction of a new and robust feature extraction technique for the representation of images displaying eyes, (2) a smart fusion scheme improving the results for single-frame classification and (3) the compensation of wrong classification results for single frames providing an almost perfect eye blinking detection rate.

Keywords

Eye blinking Human behaviour analysis Support vector machines 

References

  1. 1.
    Atherton, T., Kerbyson, D.: Size invariant circle detection. Image Vis. Comput. 17(1), 795–803 (1999). http://www.sciencedirect.com/science/article/pii/S0262885698001607
  2. 2.
    Choi, I., Han, S., Kim, D.: Eye detection and eye blink detection using adaboost learning and grouping. In: 2011 Proceedings of the 20th International Conference on Computer Communications and Networks (ICCCN), pp. 1–4, July 2011Google Scholar
  3. 3.
    Danisman, T., Bilasco, I., Djeraba, C., Ihaddadene, N.: Drowsy driver detection system using eye blink patterns. In: 2010 International Conference on Machine and Web Intelligence (ICMWI), pp. 230–233 (2010)Google Scholar
  4. 4.
    Fukuda, K.: Analysis of eyeblink activity during discriminative tasks. Percept. Mot. Skills 79, 1599–1608 (1994)CrossRefGoogle Scholar
  5. 5.
    Krolak, A., Strumillo, P.: Vision-based eye blink monitoring system for human-computer interfacing. In: 2008 Conference on Human System Interactions, pp. 994–998, May 2008Google Scholar
  6. 6.
    Lalonde, M., Byrns, D., Gagnon, L., Teasdale, N., Laurendeau, D.: Real-time eye blink detection with gpu-based sift tracking. In: Fourth Canadian Conference on Computer and Robot Vision, 2007, CRV ’07, pp. 481–487 (2007)Google Scholar
  7. 7.
    Leal, S., Vrij, A.: Blinking during and after lying. J. Nonverbal Behav. 32(4), 187–194 (2008)CrossRefGoogle Scholar
  8. 8.
    Li, J.W.: Eye blink detection based on multiple gabor response waves. In: International Conference on Machine Learning and Cybernetics, vol. 5, pp. 2852–2856, July 2008Google Scholar
  9. 9.
    Lindeman, R.H., Merenda, P.F., Gold, R.: Robust real-time face detection (1980)Google Scholar
  10. 10.
    Minkov, K., Zafeiriou, S., Pantic, M.: A comparison of different features for automatic eye blinking detection with an application to analysis of deceptive behavior. In: 2012 5th International Symposium on Communications Control and Signal Processing (ISCCSP), pp. 1–4, May 2012Google Scholar
  11. 11.
    Nixon, M., Aguado, A.S.: Robust real-time face detection, vol. 2 (2007)Google Scholar
  12. 12.
    Panning, A., Al-Hamadi, A., Michaelis, B.: A color based approach for eye blink detection in image sequences. In: 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA), pp. 40–45 (2011)Google Scholar
  13. 13.
    Park, I., Ahn, J.H., Byun, H.: Efficient measurement of eye blinking under various illumination conditions for drowsiness detection systems. In: 18th International Conference on Pattern Recognition, ICPR 2006, vol. 1, pp. 383–386 (2006)Google Scholar
  14. 14.
    Radlak, K., Smolka, B.: A novel approach to the eye movement analysis using a high speed camera. In: 2012 2nd International Conference on Advances in Computational Tools for Engineering Applications (ACTEA), pp. 145–150, December 2012Google Scholar
  15. 15.
    Ryu, J.B., Yang, H.S., Seo, Y.H.: Real time eye blinking detection using local ternary pattern and SVM. In: 2013 Eighth International Conference on Broadband and Wireless Computing, Communication and Applications (BWCCA), pp. 598–601 (2013)Google Scholar
  16. 16.
    Shirahama, K., Grzegorzek, M.: Towards large-scale multimedia retrieval enriched by knowledge about human interpretation -retrospective survey. Multimedia Tools and Applications (2014)Google Scholar
  17. 17.
    Tadeusiewicz, R., Ogiela, M.R.: Why automatic understanding? In: Bartlomiej, B., Dzielinski, A., Iwanowski, M., Bernerdete, R. (eds.) Adaptive and Natural Computing. Lecture Notes on Computer Science, pp. 477–491. Springer, Heidelberg (2007). http://www.springer.com
  18. 18.
    Viola, P., Jones, M.: Robust real-time face detection. In: Proceedings of the Eighth IEEE International Conference on Computer Vision, ICCV 2001, vol. 2, pp. 747–747 (2001)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Zeyd Boukhers
    • 1
    Email author
  • Tomasz Jarzyński
    • 1
  • Florian Schmidt
    • 1
  • Oliver Tiebe
    • 1
  • Marcin Grzegorzek
    • 1
  1. 1.Pattern Recognition GroupUniversity of SiegenSiegenGermany

Personalised recommendations