Application of a Strong Tracking Finite-Difference Extended Kalman Filter to Eye Tracking

  • Jiashu Zhang
  • Zutao Zhang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4113)


Non-intrusive methods for eye tracking are important for many applications of vision-based human computer interaction, such as driver fatigue detection, eye gaze replacing the hand operating mouse, eye typing instead of manually depressing keys as a virtual keyboard, eye gaze correction for video conferencing, interactive assistant application for disabled users, etc. However, due to the eye motion be the high nonlinearity, the obstacles of robustness of external interference and accuracy of eye tracking, these tend to significantly limit their scope of application. In this paper, we present a strong tracking finite-difference extended Kalman filter algorithm, and overcome the modeling of nonlinear eye tracking. In filtering calculation, strong tracking factor is introduced to modify prior covariance matrix to improve the accuracy of the filter. The filter uses finite-difference method to calculate partial derivatives of nonlinear functions to eye tracking. The last experimental results show validity of our method for eye tracking under realistic conditions.


Kalman Filter Extend Kalman Filter Kalman Filter Algorithm Pupil Center Virtual Keyboard 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ji, Q., Zhu, Z.W., Lan, P.L.: Real-Time Nonintrusive Monitoring and Prediction of Driver Fatigue. IEEE Transactions on Vehicular Technology 53(4) (2004)Google Scholar
  2. 2.
    Horng, W.B., Chen, C.Y., Chang, Y., Fan, C.H.: Driver Fatigue Detection Based On Eye Tracking and Dynamic Template Matching. In: Proceeding of the 2004 IEEE International Conference on Networking, Sensing & Control, pp. 21–23 (2004)Google Scholar
  3. 3.
    Dong, W.H., Wu, X.J.: Driver Fatigue Detection Based on the Distance of Eyelid. In: IEEE Int. Workshop VLSI Design & Video Tech Suzhou (2005)Google Scholar
  4. 4.
    Majaranta, P., Raiha, K.: Twenty Year of Eye Typing: System and Design Issues. In: ACM eye tracking research and applications symposium, New Orleans, Louisiana, USA, pp. 15–22 (2002)Google Scholar
  5. 5.
    Granka, L.A., Joachims, T.: Eye-Tracking Analysis of User Behavior in WWW Search. In: SIGIR 2004, Sheffield, South Yorkshire, UK (2004)Google Scholar
  6. 6.
    Noton, D., Stark, L.: Scanpaths in Accadic Eye Movements while Viewing and Recognizing Patterns Vision Research 11, 929–942 (1971)Google Scholar
  7. 7.
    Ohno, T., Mukawa, N., Kawato, S.: Just Blink Your Eyes: A Head-Free Gaze Tracking System. In: CHI 2003, Ft. Lauderdale, Florida, USA (2003)Google Scholar
  8. 8.
    McCarthy, J.D., Riegelsberger, J., Sasse, M.A.: Commercial Uses of Eye Tracking. In: HCI (2005)Google Scholar
  9. 9.
    Zhu, J., Yang, J.: Subpixel Eye Gaze Tracking. In: IEEE conference on Automatic Face and Gesture Recognition, pp. 124–129 (2002)Google Scholar
  10. 10.
    Ohno, T., Mukawa, N., Yoshikawa, A.: A Gaze Tracking System for Everyday Gaze Interaction. In: Eye tracking research and applications symposium, pp. 15–22 (2002)Google Scholar
  11. 11.
    Zhu, Z.W., Ji, Q., Fujimura, K.: Combining Kalman Filtering and Mean Shift for Real Time Eye Tracking under Active IR Illumination (2002)Google Scholar
  12. 12.
    Ebisawa, Y.: Unconstrained Pupil Detecting Technique Using Two Light Sources and the Image Difference Method. Visualization and Intelligent Design in engineering and architecture, 79–89 (1995)Google Scholar
  13. 13.
    Morimoto, C.H., Flickner, M.: Real-time Multiple Face Detection Using Active Illumination. In: Proc. of the 4th IEEE International Conference on Automatic Face and Gesture Recognition 2000, Grenoble, France (2000)Google Scholar
  14. 14.
    Daugman, J.: High Confidence Visual Recognition of Persons by a Test of Statistical Independence. IEEE Transactions on Pattern Analysis and Machine Intelligence 15(11), 1148–1161 (1993)CrossRefGoogle Scholar
  15. 15.
    Nishino, K., Nayar, S.: Eyes for Relighting. In: ACM SIGGRAPH 2004, vol. 23, pp. 704–711 (2004)Google Scholar
  16. 16.
    Chau, M., Betke, M.: Real Time Eye Tracking and Blink Detection with USB Cameras, Boston University Computer Science Technical Report No.12 (2005)Google Scholar
  17. 17.
    Li, D.H., Winfield, D., Parkhurst, D.J.: A Hybrid Algorithm for Video-based Eye Tracking Combining Feature-based and Model-based Approaches. In: Proceedings of the IEEE Vision for Human-Computer Interaction (2005)Google Scholar
  18. 18.
    Zhou, D.H., Xi, Y.G., Zhang, Z.J.: A Suboptimal Multiple Fading Extended Kalman Filter. To appear in Chinese J. AutomationGoogle Scholar
  19. 19.
    Zhou, D.H.: Fault Detection and Diagnostics for A Class of Nonlinear Systems, Ph.D. dissertation, Shanghai Jiao Tong Univ., P.R. China (1990)Google Scholar
  20. 20.
    Zhou, D.H., Sun, Y.X., Xi, Y.G., Zhang, Z.J.: Extension of Friedland’s Separate-Bias Estimation to Randomly Time-Varying Bias of Nonlinear Systems. IEEE Transactions On Automatic Control 38(8) (1993)Google Scholar
  21. 21.
    Fan, W.B., Liu, C.F., Zhang, S.Z.: Improved Method of Strong Tracking Extended Kalman Filter. Control and Decision (2006)Google Scholar
  22. 22.
    Zhou, D.H., Wang, Q.L.: Strong Tracking Filter of Nonlinear Systems with Colored Noise. J. of Beijing Institute of Technology, 321–326 (1997)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Jiashu Zhang
    • 1
  • Zutao Zhang
    • 1
    • 2
  1. 1.Sichuan Key Lab of Signal and Information ProcessingSouthwest Jiaotong UniversityChengduP.R. China
  2. 2.School of Mechanical Eng.Southwest Jiaotong UniversityChengduP.R. China

Personalised recommendations