Abstract
Eye gaze tracking (EGT) is a common problem with many applications in various fields. While recent methods have achieved improvements in accuracy and usability, current techniques still share several limitations. A major issue is the need for external calibration between the gaze camera system and the scene, which commonly restricts to static planar surfaces and leads to parallax errors. To overcome these issues, the paper proposes a novel scheme that uses the corneal imaging technique to directly analyze reflections from a scene illuminated with structured light. This comprises two major contributions: First, an analytic solution is developed for the forward projection problem to obtain the gaze reflection point (GRP), where light from the point of gaze (PoG) in the scene reflects at the corneal surface into an eye image. We also develop a method to compensate for the individual offset between the optical axis and true visual axis. Second, introducing active coded illumination enables robust and accurate matching at the GRP to obtain the PoG in a scene image, which is the first use of this technique in EGT and corneal reflection analysis. For this purpose, we designed a special high-power IR LED-array projector. Experimental evaluation with a prototype system shows that the proposed scheme achieves considerable accuracy and successfully supports depth-varying environments.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Young, L., Sheena, D.: Survey of eye movement recording methods. Behav. Res. Meth. Instrum. 7, 397–429 (1975)
Hansen, D.W., Ji, Q.: In the eye of the beholder: A survey of models for eyes and gaze. IEEE Trans. Pattern Anal. Mach. Intell. 32, 478–500 (2010)
Guestrin, E.D., Eizenman, M.: General theory of remote gaze estimation using the pupil center and corneal reflections. IEEE Trans. Biomed. Eng. 53, 1124–1133 (2006)
Agrawal, A., Taguchi, Y., Ramalingam, S.: Beyond Alhazen’s problem: Analytical projection model for non-central catadioptric cameras with quadric mirrors. In: Proc. CVPR, pp. 2993–3000 (2011)
Backes, M., Chen, T., Dürmuth, M., Lensch, H.P.A., Welk, M.: Tempest in a teapot: Compromising reflections revisited. In: Proc. IEEE SP, pp. 315–327 (2009)
Nishino, K., Nayar, S.K.: Corneal imaging system: Environment from eyes. Int. J. Comput. Vision 70, 23–40 (2006)
Sturm, P., Ramalingam, S., Tardif, J.P., Gasparini, S., Barreto, J.: Camera models and fundamental concepts used in geometric computer vision. Found. Trends. Comput. Graph. Vis. 6, 1–183 (2011)
Kim, S.M., Sked, M., Ji, Q.: Non-intrusive eye gaze tracking under natural head movements. In: Proc. IEEE IEMBS, pp. 2271–2274 (2004)
Reale, M., Hung, T., Yin, L.: Viewing direction estimation based on 3D eyeball construction for HRI. In: Proc. CVPRW, pp. 24–31 (2010)
Sugano, Y., Matsushita, Y., Sato, Y., Koike, H.: An Incremental Learning Method for Unconstrained Gaze Estimation. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part III. LNCS, vol. 5304, pp. 656–667. Springer, Heidelberg (2008)
Sugano, Y., Matsushita, Y., Sato, Y.: Appearance-based gaze estimation using visual saliency. IEEE Trans. Pattern Anal. Mach. Intell., 1 (2012)
Salvi, J., Fernandez, S., Pribanic, T., Llado, X.: A state of the art in structured light patterns for surface profilometry. Pattern Recogn. 43, 2666–2680 (2010)
Zhang, L., Subramaniam, N., Lin, R., Raskar, R., Nayar, S.: Capturing images with sparse informational pixels using projected 3D tags. In: Proc. IEEE VR, pp. 11–18 (2008)
Lee, J.C., Hudson, S., Dietz, P.: Hybrid infrared and visible light projection for location tracking. In: Proc. ACM UIST, pp. 57–60 (2007)
Li, F., Kolakowski, S., Pelz, J.: Using structured illumination to enhance video-based eye tracking. In: Proc. IEEE ICIP, pp. 373–376 (2007)
Nitschke, C., Nakazawa, A., Takemura, H.: Display-camera calibration using eye reflections and geometry constraints. Comput. Vis. Image Underst. 115, 835–853 (2011)
Snell, R.S., Lemp, M.A.: Clinical Anatomy of the Eye, 2nd edn. Blackwell Publishing, Malden (1997)
Moon, T.K.: Error Correction Coding: Mathematical Methods and Algorithms. Wiley-Interscience (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nakazawa, A., Nitschke, C. (2012). Point of Gaze Estimation through Corneal Surface Reflection in an Active Illumination Environment. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7573. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33709-3_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-33709-3_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33708-6
Online ISBN: 978-3-642-33709-3
eBook Packages: Computer ScienceComputer Science (R0)