Skip to main content
SpringerLink
Log in

Real Time Eye Localization and Tracking

  • Conference paper
  • First Online:
Advances in Service and Industrial Robotics (RAAD 2018)

Part of the book series: Mechanisms and Machine Science ((Mechan. Machine Science,volume 67))

Included in the following conference series:

Abstract

In this paper a reduced complexity eye tracking technique is introduced. The proposed technique is based on a recently introduced eye localization method [5]. In order to exploit its accuracy and robustness under difficult illumination conditions, the presence of occlusions, shadows and pose variations, and making possible its use in real-time applications, we drastically reduce its computational cost while in the same time its accuracy is increased, by the use of an efficient tracking scheme. We also implement the proposed method in low-level C++ programming, using the OpenCV library, thus reducing even more its computational cost. All experiments we have conducted confirm our claims.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://xanthippi.ceid.upatras.gr/people/psarakis/publications/eye-localization-code.zip.

References

  1. Ghinea, G., Djeraba, C., Gulliver, S., Coyne, K.P.: Introduction to the special issue on eye-tracking applications in multimedia systems. ACM Trans. Multimedia Comput. Commun. Appl. 3(4) (2007)

    Google Scholar 

  2. Bohme, M., Meyer, A., Martinetz, T., Barth, E.: Remote eye tracking: state of the art and directions for future development. In: Conference on Communication by Gaze Interaction (2006)

    Google Scholar 

  3. Morimoto, C.H., Koons, D., Amir, A., Flickner, M.: Pupil detection and tracking using multiple light sources. Image Video Comput. 18, 331–335 (2000)

    Article  Google Scholar 

  4. Orman, Z., Battal, A., Kemer, E.: A study on face, eye detection and gaze estimation. Int. J. Comput. Sci. Eng. 2, 29–46 (2011)

    Google Scholar 

  5. Poulopoulos, N., Psarakis, E.Z.: A new high precision eye center localization technique. In: International Conference on Image Processing (ICIP), Beijing, China, pp. 2806–2810 (2017)

    Google Scholar 

  6. Yuille, A., Hallinan, P., Cohen, D.: Feature extraction from faces using deformable templates. Int. J. Comput. Vis. 8(2), 99–111 (1992)

    Article  Google Scholar 

  7. Xie, X., Sudhakar, R., Zhuang, H.: On improving eye feature extraction using deformable templates. Pattern Recogn. 27(6), 791–799 (1994)

    Article  Google Scholar 

  8. Dobes, M., Martinek, J., Skoupil, D., Dobesova, Z., Pospisil, J.: Human eye localization using the modified Hough transform. Optik Int. J. Light Electron Opt. 117(10), 468–473 (2006)

    Article  Google Scholar 

  9. Van Huan, N., Kim, H.: A novel circle detection method for iris segmentation. In: 2008 Congress on Image and Signal Processing, CISP 2008, vol. 3, pp. 620–624. IEEE (2008)

    Google Scholar 

  10. Valenti, R., Gevers, T.: Accurate eye center location and tracking using isophote curvature. In: International Conference on Computer Vision and Pattern Recognition (CVPR 2008), pp. 1–8. IEEE (2008)

    Google Scholar 

  11. Valenti, R., Yucel, Z., Gevers, T.: Robustifying eye center localization by head pose cues. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 612–618. IEEE (2009)

    Google Scholar 

  12. Valenti, R., Gevers, T.: Accurate eye center location through invariant isocentric patterns. IEEE Trans. Pattern Anal. Mach. Intell. 34(9), 1785–1798 (2012)

    Article  Google Scholar 

  13. Loy, G., Zelinsky, A.: Fast radial symmetry for detecting points of interest. IEEE Trans. Pattern Anal. Mach. Intell. 25, 959973 (2003)

    Article  Google Scholar 

  14. Skodras, E., Fakotakis, N.: Precise localization of eye centers in low resolution color images. Image Vision Comput. J. 36, 51–60 (2015)

    Article  Google Scholar 

  15. Bai, L., Shen, L., Wang, Y.: A novel eye location algorithm based on radial symmetry transform. In: International Conference on Pattern Recognition (ICPR 2006), vol. 3, pp. 511–514. IEEE (2006)

    Google Scholar 

  16. Yang, P., Du, B., Shan, S., Gao, W.: A novel pupil localization method based on GaborEye model and radial symmetry operator. In: International Conference on Image Processing (ICIP 2004), vol. 1, pp. 67–70. IEEE (2004)

    Google Scholar 

  17. Zhu, Z., Ji, Q.: Eye and gaze tracking for interactive graphic display. Mach. Vis. Appl. 15(3), 139–148 (2004)

    Article  MathSciNet  Google Scholar 

  18. Peixoto, H.M., Guerreiro, A.M.G., Neto, A.D.D.: Image processing for eye detection and classification of the gaze direction. In: 2009 International Joint Conference on Neural Networks, pp. 2475–2480. IEEE (2009)

    Google Scholar 

  19. Everingham, M., Zisserman, A.: Regression and classification approaches to eye localization in face images. In: 2006 7th International Conference on Automatic Face and Gesture Recognition, FGR 2006, pp. 441–446. IEEE (2006)

    Google Scholar 

  20. Samaria, F., Young, S.: Hmm-based architecture for face identification. Image Vis. Comput. 12(8), 537–543 (1994)

    Article  Google Scholar 

  21. Campadelli, P., Lanzarotti, R., Lipori, G.: Precise eye localization through a general-to specific model definition. In: BMVC, vol. 1, pp. 187–196. Citeseer (2006)

    Google Scholar 

  22. Pentland, A., Moghaddam, B., Starner, T.: View-based and modular eigenspaces for face recognition. In: 1994 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Proceedings CVPR 1994, pp. 84–91. IEEE (1994)

    Google Scholar 

  23. Wang, P., Green, M.B., Ji, Q., Wayman, J.: Automatic eye detection and its validation. In: IEEE Workshop on Face Recognition Grand Challenge Experiments, p. 164 (2005)

    Google Scholar 

  24. Niu, Z., Shan, S., Yan, S., Chen, X., Gao, W.: 2D cascaded adaboost for eye localization. In: ICPR (2006)

    Google Scholar 

  25. Kim, B.S., Lee, H., Kim, W.Y.: Rapid eye detection method for non-glasses type 3D display on portable devices. IEEE Trans. Consum. Electron. 56, 2498–2505 (2010)

    Article  Google Scholar 

  26. Hansen, D.W., Nielsen, M., Hansen, J.P., Johansen, A.S., Stegmann, M.B.: Tracking eyes using shape and appearance. In: MVA, pp. 201–204 (2002)

    Google Scholar 

  27. Tian, Y.L., Kanade, T., Cohn, J.F.: Dual-state parametric eye tracking. In Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 110–115 (2000)

    Google Scholar 

  28. Hansen, D.W., Pece, A.E.: Eye tracking in the wild. Comput. Vis. Image Underst. 98, 155–181 (2005)

    Article  Google Scholar 

  29. Wu, H., Kitagawa, Y., Wada, T., Kato, T., Chen, Q.: Tracking iris contour with a 3D eye-model for gaze estimation. In: Computer Vision-ACCV, pp. 688–697 (2007)

    Google Scholar 

  30. Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)

    Article  Google Scholar 

  31. Wang, H., Li, S.Z., Wang, Y., Zhang, J.: Self quotient image for face recognition. In: ICIP, vol. 2, pp. 1397–1400 (2004)

    Google Scholar 

  32. http://gi4e.unavarra.es/databases/gi4e/

  33. Anjith, G., Routray, A.: Fast and accurate algorithm for eye localization for gaze tracking in low resolution images. arXiv preprint arXiv:1605.05272 (2016)

  34. Baek, S.-J., Choi, K.-A., Ma, C., Kim, Y.-H., Ko, S.-J.: Eyeball model-based iris center localization for visible image-based eye gaze tracking systems. IEEE Trans. Consum. Electron. 59(2), 415–421 (2013)

    Article  Google Scholar 

  35. Daugman, J.: How iris recognition works. IEEE Trans. Circ. Syst. Video Technol. 14(1), 21–30 (2004)

    Article  Google Scholar 

  36. Wang, J., Sung, E., Venkateswarlu, R.: Eye gaze estimation from a single image of one eye. In: 2003 Proceedings of the Ninth IEEE International Conference on Computer Vision, pp. 136–143. IEEE (2003)

    Google Scholar 

  37. Jesorsky, O., Kirchbergand, K.J., Frischholz, R.: Robust face detection using the Hausdorff distance. In: Audio and Video-Based Biometric Person Authentication, pp. 90–95 (1992)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering and Informatics, University of Patras, 26500, Rion Patras, Greece

    Nikolaos Poulopoulos & Emmanouil Z. Psarakis

Authors
  1. Nikolaos Poulopoulos
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Emmanouil Z. Psarakis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Emmanouil Z. Psarakis .

Editor information

Editors and Affiliations

  1. Department of Mechanical Engineering and Aeronautics, University of Patras, Patras, Greece

    Nikos A. Aspragathos

  2. Department of Mechanical Engineering and Aeronautics, University of Patras, Patras, Greece

    Panagiotis N. Koustoumpardis

  3. Department of Product and Systems Design Engineering, University of the Aegean, Syros, Greece

    Vassilis C. Moulianitis

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Poulopoulos, N., Psarakis, E.Z. (2019). Real Time Eye Localization and Tracking. In: Aspragathos, N., Koustoumpardis, P., Moulianitis, V. (eds) Advances in Service and Industrial Robotics. RAAD 2018. Mechanisms and Machine Science, vol 67. Springer, Cham. https://doi.org/10.1007/978-3-030-00232-9_59

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-00232-9_59

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-00231-2

  • Online ISBN: 978-3-030-00232-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation