Skip to main content

3D Eye-Tracking Method Using HD Face Model of Kinect v2

  • Conference paper
  • First Online:
Advanced Multimedia and Ubiquitous Engineering

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 393))

  • 1231 Accesses

Abstract

Despite the extensive research into 3D eye-tracking methods, such methods remain dependent on many additional factors such as the processing time, pose, illumination, image resolution, and calibration procedure. In this paper, we propose a 3D eye-tracking method using the HD face model of Kinect v2. Because the proposed method uses accurate 3D ocular feature positions and a 3D human eye scheme, it can track an eye gaze position more accurately and promptly than previous methods. In an image captured using a Kinect v2, the two eye-corner points of one eye are obtained using the device’s high-definition face model. The 3D rotational center of the eyeball is estimated based on these two eye-corner points. After the center of the iris is obtained, the 3D gaze vector that passes through the rotational center and the center of the iris is defined. Finally, the intersection point between the 3D gaze vector and the actual display plane is calculated and transformed into pixel coordinates as the gaze position. Angle kappa, which is the gap between the actual gaze vector and the pupillary vector, is compensated through a user-dependent calibration. Experiment results show that the gaze estimation error was an average of 47 pixels from the desired position.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Yoo DH, Chung MJ (2005) A novel non-intrusive eye gaze estimation using cross-ratio under large head motion. Comput Vis Image Underst 98(1):25–51

    Article  Google Scholar 

  2. Wang JG, Sung E (2002) Study on eye gaze estimation. IEEE Trans Syst Man Cybern B Cybern 32(3):332–350

    Google Scholar 

  3. Shih SW, Liu J (2004) A novel approach to 3-D gaze tracking using stereo cameras. IEEE Trans Syst Man Cybern B Cybern 34(1):234–245

    Article  Google Scholar 

  4. Murphy-Chutorian E et al (2007) Head pose estimation for driver assistance systems: a robust algorithm and experimental evaluation. In: Proceedings IEEE ITSC, pp 709–714

    Google Scholar 

  5. Shin SW, Liu J (2004) A novel approach to 3-D gaze tracking using stereo cameras. IEEE Trans Syst Man Cybern B Cybern 34:234–245

    Article  Google Scholar 

  6. Yang J et al (1998) Real-time face and facial feature tracking and applications. In: AVSP’98 international conference on auditory-visual speech processing, pp 79–84

    Google Scholar 

  7. Coordinates Transformation Information https://groups.google.com/forum/#!topic/open-kinect/ihfBIY56Is8

  8. Kim H et al (2014) Pointing gesture interface for large display environments based on the Kinect skeleton model. Lect Notes Electr Eng 309:509–514

    Article  Google Scholar 

  9. Lee C (1997) Three dimensional position of the eye. Psychol Issues 4:255–278

    Google Scholar 

Download references

Acknowledgments

This research was supported by the Ministry of Science, ICT and Future Planning (MSIP), Korea, under the Information Technology Research Center (ITRC) support program (IITP-2015-H8501-15-1014) supervised by the Institute for Information & Communications Technology Promotion (IITP).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eui Chul Lee .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer Science+Business Media Singapore

About this paper

Cite this paper

Kim, B.C., Lee, E.C. (2016). 3D Eye-Tracking Method Using HD Face Model of Kinect v2. In: Park, J., Jin, H., Jeong, YS., Khan, M. (eds) Advanced Multimedia and Ubiquitous Engineering. Lecture Notes in Electrical Engineering, vol 393. Springer, Singapore. https://doi.org/10.1007/978-981-10-1536-6_32

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-1536-6_32

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-1535-9

  • Online ISBN: 978-981-10-1536-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics