Skip to main content
SpringerLink
Log in

Eye gaze tracking based directional control interface for interactive applications

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper proposes an unobtrusive and calibration-free framework towards eye gaze tracking based interactive directional control interface for desktop environment using simple webcam under unconstrained settings. The proposed eye gaze tracking involved hybrid approach designed by combining two different techniques based upon both supervised and unsupervised methods wherein the unsupervised image gradients method computes the iris centers over the eye regions extracted by the supervised regression based algorithm. Experiments performed by the proposed hybrid approach to detect eye regions along with iris centers over challenging face image datasets exhibited exciting results. Similar approach for eye gaze tracking worked well in real-time by using a simple web camera. Further, PC based interactive directional control interface based upon iris position has been designed that works without needing any prior calibrations unlike other Infrared illumination based eye trackers.

The proposed work may be useful to the people with full body motor disabilities, who need interactive and unobtrusive eye gaze control based applications to live independently.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Burgos-Artizzu XP, Perona P, Dollar P (2013) Robust Face Landmark Estimation under Occlusion. Proceedings of the 2013 IEEE International Conference on Computer Vision, IEEE Computer Society: 1513–1520

  2. Chang X, Yang Y (2017) Semisupervised feature analysis by mining correlations among multiple tasks. IEEE Trans Neural Netw Learn Syst 28(10):2294–2305

    Article  MathSciNet  Google Scholar 

  3. Chang X et al (2016) Compound rank-<inline-formula><tex-math notation="LaTeX">$k$</tex-math></inline-formula>projections for bilinear analysis. IEEE Trans Neural Netw Learn Syst 27(7):1502–1513

    Article  MathSciNet  Google Scholar 

  4. Database, B.F., BioID Face Database. https://www.bioid.com/About/BioID-Face-Database

  5. Database, T.M.F., The MUCT Face Database , http://www.milbo.org/muct/

  6. Feit A et al. (2017) Toward Everyday Gaze Input: Accuracy and Precision of Eye Tracking and Implications for Design: 1118–1130

  7. Han Z et al (2014) Precise localization of eye centers with multiple cues. Multimed Tools Appl 68(3):931–945

    Article  Google Scholar 

  8. Hansen DW, Qiang J (2010) In the eye of the beholder: a survey of models for eyes and gaze. Pattern Anal Mach Intell IEEE Trans 32(3):478–500

    Article  Google Scholar 

  9. Jesorsky O, Kirchberg K, Frischholz R (2001) Robust face detection using the hausdorff distance. In: Bigun J, Smeraldi F (eds) Audio- and video-based biometric person authentication. Springer, Berlin Heidelberg, pp 90–95

    Chapter  Google Scholar 

  10. Labeled Faces in the Wild

  11. Laddi A, Prakash NR (2015) Comparative analysis of unsupervised eye center localization approaches. Signal Processing, Computing and Control (ISPCC), 2015 International Conf. IEEE

  12. Laddi A, Prakash NR (2017) An augmented image gradients based supervised regression technique for iris center localization. Multimed Tools Appl 76(5):7129–7139

    Article  Google Scholar 

  13. Laddi A, Prakash NR (2017) An accurate and simple approach to detect eye centers in low resolution face images. IETE J Res: 1–6

  14. Leo M et al (2013) Unsupervised approach for the accurate localization of the pupils in near-frontal facial images. J Electron Imag 22(3):033033–033033

    Article  Google Scholar 

  15. Leo M et al (2014) Unsupervised eye pupil localization through differential geometry and local self-similarity matching. PLoS One 9(8):e102829

    Article  Google Scholar 

  16. Li B, Fu H (2018) Real time eye detector with cascaded convolutional neural networks. Appl Comput Intell Soft Comput 2018:8

    Article  Google Scholar 

  17. Li Z et al (2017) Beyond trace ratio: weighted harmonic mean of trace ratios for multiclass discriminant analysis. IEEE Trans Knowl Data Eng 29(10):2100–2110

    Article  Google Scholar 

  18. Liu L et al. (2018) From BoW to CNN: two decades of texture representation for texture classification. Int J Comput Vis

  19. Lowe DG (2004) Distinctive image features from scale-invariant Keypoints. Int J Comput Vis 60(2):91–110

    Article  Google Scholar 

  20. Matthews I, Baker S (2004) Active appearance models revisited. Int J Comput Vis 60(2):135–164

    Article  Google Scholar 

  21. San Agustin, J., et al., (2010) Evaluation of a low-cost open-source gaze tracker. 77–80

  22. Sewell W, Komogortsev O (2010) Real-time eye gaze tracking with an unmodified commodity webcam employing a neural network, in CHI '10 Extended Abstracts on Human Factors in Computing Systems. ACM: Atlanta, Georgia, USA: 3739-3744

  23. Shaoqing R et al. (2014) Face alignment at 3000 FPS via Regressing Local Binary Features. in Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conf

  24. TalkingFacevideo, Talking Face Video Database, http://www-prima.inrialpes.fr/FGnet/data/01-TalkingFace/talking_face.html

  25. Timm F, Barth E (2011) Accurate eye centre localisation by means of gradients. Proceedings of the International Conference on Computer Vision Theory and Applications

  26. Valenti R, Gevers T (2008) Accurate eye center location and tracking using isophote curvature. Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference

  27. Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. in Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference

  28. Xu P et al. (2015) TurkerGaze: Crowdsourcing saliency with webcam based eye tracking. CoRR. abs/1504.06755

  29. Xudong C et al. (2012) Face alignment by Explicit Shape Regression. Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference

  30. Xuehan X, de la Torre F (2013) Supervised descent method and its applications to face alignment. Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference

  31. Ye L et al. (2014) Cascaded Convolutional Neural Network for Eye Detection Under Complex Scenarios. In Biometric Recognition. Cham: Springer International Publishing

    Google Scholar 

  32. Yuan-Pin L et al. (2005) Webcam Mouse Using Face and Eye Tracking in Various Illumination Environments. 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference

  33. Zafeiriou S, Zhang C, Zhang Z (2015) A survey on face detection in the wild. Comput Vis Image Underst 138(C):1–24

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Biomedical Instrumentation, CSIR- Central Scientific Instruments Organisation (CSIO), Sector 30 C, Chandigarh, 160030, India

    Amit Laddi

  2. Department of Electronics & Communication Engineering, Punjab Engineering College (Deemed to be University), Sector 12, Chandigarh, 160012, India

    Neelam Rup Prakash

Authors
  1. Amit Laddi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Neelam Rup Prakash
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Amit Laddi.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Laddi, A., Prakash, N.R. Eye gaze tracking based directional control interface for interactive applications. Multimed Tools Appl 78, 31215–31230 (2019). https://doi.org/10.1007/s11042-019-07940-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-07940-3

Keywords

Search

Navigation