Skip to main content
SpringerLink
Log in

Deep Eyedentification: Biometric Identification Using Micro-movements of the Eye

  • Conference paper
  • First Online:
Machine Learning and Knowledge Discovery in Databases (ECML PKDD 2019)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11907))

Abstract

We study involuntary micro-movements of the eye for biometric identification. While prior studies extract lower-frequency macro-movements from the output of video-based eye-tracking systems and engineer explicit features of these macro-movements, we develop a deep convolutional architecture that processes the raw eye-tracking signal. Compared to prior work, the network attains a lower error rate by one order of magnitude and is faster by two orders of magnitude: it identifies users accurately within seconds.

S. Liehr—Independent Researcher.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Abadi, M., et al.: TensorFlow: large-scale machine learning on heterogeneous systems (2015). https://www.tensorflow.org/

  2. Abdelwahab, A., Kliegl, R., Landwehr, N.: A semiparametric model for Bayesian reader identification. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP 2016, pp. 585–594 (2016)

    Google Scholar 

  3. Bargary, G., Bosten, J.M., Goodbourn, P.T., Lawrance-Owen, A.J., Hogg, R.E., Mollon, J.: Individual differences in human eye movements: an oculomotor signature? Vision. Res. 141, 157–169 (2017)

    Article  Google Scholar 

  4. Bednarik, R., Kinnunen, T., Mihaila, A., Fränti, P.: Eye-movements as a biometric. In: Kalviainen, H., Parkkinen, J., Kaarna, A. (eds.) SCIA 2005. LNCS, vol. 3540, pp. 780–789. Springer, Heidelberg (2005). https://doi.org/10.1007/11499145_79

    Chapter  Google Scholar 

  5. Cantoni, V., Galdi, C., Nappi, M., Porta, M., Riccio, D.: GANT: gaze analysis technique for human identification. Pattern Recogn. 48, 1027–1038 (2015)

    Article  Google Scholar 

  6. Cao, Q., Shen, L., Xie, W., Parkhi, O.M., Zisserman, A.: VGGFace2: a dataset for recognising faces across pose and age. In: 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018, pp. 67–74 (2018)

    Google Scholar 

  7. Chollet, F., et al.: Keras (2015). https://keras.io

  8. Cuong, N., Dinh, V., Ho, L.S.T.: Mel-frequency cepstral coefficients for eye movement identification. In: 24th International Conference on Tools with Artificial Intelligence, ICTAI 2012, pp. 253–260 (2012)

    Google Scholar 

  9. Cymek, D., Venjakob, A., Ruff, S., Lutz, O.M., Hofmann, S., Roetting, M.: Entering PIN codes by smooth pursuit eye movements. J. Eye Mov. Res. 7, 1–11 (2014)

    Google Scholar 

  10. Darwish, A., Pasquier, M.: Biometric identification using the dynamic features of the eyes. In: 6th International Conference on Biometrics: Theory, Applications and Systems, BTAS 2013, pp. 1–6 (2013)

    Google Scholar 

  11. De Luca, A., Weiss, R., Hußmann, H., An, X.: Eyepass - eye-stroke authentication for public terminals. In: Extended Abstracts on Human Factors in Computing Systems, CHI EA 2008, pp. 3003–3008 (2007)

    Google Scholar 

  12. Ditchburn, R.W., Ginsborg, B.L.: Vision with a stabilized retinal image. Nature 170, 36–37 (1952)

    Article  Google Scholar 

  13. Dunphy, P., Fitch, A., Olivier, P.: Gaze-contingent passwords at the ATM. In: 4th Conference on Communication by Gaze Interaction, COGAIN, pp. 59–62 (2008)

    Google Scholar 

  14. Engbert, R., Kliegl, R.: Microsaccades uncover the orientation of covert attention. Vision. Res. 43, 1035–1045 (2003)

    Article  Google Scholar 

  15. Engbert, R., Mergenthaler, K.: Microsaccades are triggered by low retinal image slip. Proc. Nat. Acad. Sci. USA 103, 7192–7197 (2006)

    Article  Google Scholar 

  16. Erdogmus, N., Marcel, S.: Spoofing face recognition with 3D masks. IEEE Trans. Inf. Forensics Secur. 9(7), 1084–1097 (2014)

    Article  Google Scholar 

  17. Galdi, C., Nappi, M., Riccio, D., Cantoni, V., Porta, M.: A new gaze analysis based soft biometric. In: 5th Mexican Conference on Pattern Recognition, MCPR 2013, pp. 136–144 (2013)

    Google Scholar 

  18. Graves, A., Schmidhuber, J.: Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Netw. 18(5–6), 602–610 (2005)

    Article  Google Scholar 

  19. Holland, C., Komogortsev, O.V.: Biometric identification via eye movement scanpaths in reading. In: 2011 International Joint Conference on Biometrics, IJCB 2011, pp. 1–8 (2011)

    Google Scholar 

  20. Holland, C., Komogortsev, O.: Complex eye movement pattern biometrics: Analyzing fixations and saccades. In: 2013 International Conference on Biometrics, ICB 2013 (2013)

    Google Scholar 

  21. Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J.: Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford University Press, Oxford (2011)

    Google Scholar 

  22. Kasprowski, P.: Human identification using eye movements. Ph.D. thesis, Silesian Unversity of Technology, Poland (2004)

    Google Scholar 

  23. Kasprowski, P., Ober, J.: Enhancing eye-movement-based biometric identification method by using voting classifiers. In: Proceedings of SPIE 5779: Biometric Technology for Human Identification II, pp. 314–323 (2005)

    Google Scholar 

  24. Kasprowski, P., Harkeżlak, K.: The second eye movements verification and identification competition. In: Proceedings of the International Joint Conference on Biometrics, IJCB 2014 (2014)

    Google Scholar 

  25. Kasprowski, P., Komogortsev, O.V., Karpov, A.: First eye movement verification and identification competition at BTAS 2012. In: Proceedings of the IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems, BTAS 2012, pp. 195–202 (2012)

    Google Scholar 

  26. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  27. Kinnunen, T., Sedlak, F., Bednarik, R.: Towards task-independent person authentication using eye movement signals. In: Proceedings of the 2010 Symposium on Eye-Tracking Research and Applications, ETRA 2010, pp. 187–190 (2010)

    Google Scholar 

  28. Ko, H.K., Snodderly, D.M., Poletti, M.: Eye movements between saccades: measuring ocular drift and tremor. Vision. Res. 122, 93–104 (2016)

    Article  Google Scholar 

  29. Kumar, M., Garfinkel, T., Boneh, D., Winograd, T.: Reducing shoulder-surfing by using gaze-based password entry. In: Proceedings of the 3rd Symposium on Usable Privacy and Security, SOUPS 2007, pp. 13–19 (2007)

    Google Scholar 

  30. Landwehr, N., Arzt, S., Scheffer, T., Kliegl, R.: A model of individual differences in gaze control during reading. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, pp. 1810–1815 (2014)

    Google Scholar 

  31. MaatenMaaten, L.V.D., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9, 2579–2605 (2008)

    MATH  Google Scholar 

  32. Maeder, A., Fookes, C., Sridharan, S.: Gaze based user authentication for personal computer applications. In: Proceedings of the 2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, pp. 727–730 (2004)

    Google Scholar 

  33. Makowski, S., Jäger, L.A., Abdelwahab, A., Landwehr, N., Scheffer, T.: A discriminative model for identifying readers and assessing text comprehension from eye movements. In: Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2018, pp. 209–225 (2019)

    Google Scholar 

  34. Martinez-Conde, S., Macknik, S.L., Hubel, D.H.: The role of fixational eye movements in visual perception. Nat. Rev. Neurosci. 5, 229–240 (2004)

    Article  Google Scholar 

  35. Martinez-Conde, S., Macknik, S.L., Troncoso, X.G., Dyar, T.A.: Microsaccades counteract visual fading during fixation. Neuron 49, 297–305 (2006)

    Article  Google Scholar 

  36. Martinez-Conde, S., Macknik, S.L., Troncoso, X.G., Hubel, D.H.: Microsaccades: a neurophysiological analysis. Trends Neurosci. 32, 463–475 (2009)

    Article  Google Scholar 

  37. Morales, A., Fierrez, J., Galbally, J., Gomez-Barrero, M.: Introduction to iris presentation attack detection. In: Marcel, S., Nixon, M.S., Fierrez, J., Evans, N. (eds.) Handbook of Biometric Anti-Spoofing. ACVPR, pp. 135–150. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-92627-8_6

    Chapter  Google Scholar 

  38. Nalla, P.R., Kumar, A.: Toward more accurate iris recognition using cross-spectral matching. IEEE Trans. Image Process. 26, 208–221 (2017)

    Article  MathSciNet  Google Scholar 

  39. Nyström, M., Hansen, D.W., Andersson, R., Hooge, I.: Why have microsaccades become larger? Investigating eye deformations and detection algorithms. Vision. Res. 118, 17–24 (2016)

    Article  Google Scholar 

  40. Otero-Millan, J., Troncoso, X.G., Macknik, S.L., Serrano-Pedraza, I., Martinez-Conde, S.: Saccades and microsaccades during visual fixation, exploration, and search: foundations for a common saccadic generator. J. Vis. 8(14), 21 (2008)

    Article  Google Scholar 

  41. Poynter, W., Barber, M., Inman, J., Wiggins, C.: Individuals exhibit idiosyncratic eye-movement behavior profiles across tasks. Vision. Res. 89, 32–38 (2013)

    Article  Google Scholar 

  42. Reddi, S.J., Kale, S., Kumar, S.: On the convergence of Adam and beyond. In: International Conference on Learning Representations, ICLR 2018 (2018)

    Google Scholar 

  43. Rigas, I., Economou, G., Fotopoulos, S.: Biometric identification based on the eye movements and graph matching techniques. Patt. Recogn. Lett. 33, 786–792 (2012)

    Article  Google Scholar 

  44. Rigas, I., Economou, G., Fotopoulos, S.: Human eye movements as a trait for biometrical identification. In: Fifth International Conference on Biometrics: Theory, Applications and Systems, BTAS 2012, pp. 217–222 (2012)

    Google Scholar 

  45. Rigas, I., Komogortsev, O., Shadmehr, R.: Biometric recognition via eye movements: saccadic vigor and acceleration cues. ACM Trans. Appl. Percept. 13(2), 6 (2016)

    Article  Google Scholar 

  46. Riggs, L.A., Ratliff, F.: The effects of counteracting the normal movements of the eye. J. Opt. Soc. Am. 42, 872–873 (1952)

    Google Scholar 

  47. Srivastava, N., Agrawal, U., Roy, S., Tiwary, U.S.: Human identification using linear multiclass SVM and eye movement biometrics. In: 8th International Conference on Contemporary Computing, IC3, pp. 365–369 (2015)

    Google Scholar 

  48. Weaver, J., Mock, K., Hoanca, B.: Gaze-based password authentication through automatic clustering of gaze points. In: 2011 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2011, pp. 2749–2754 (2011)

    Google Scholar 

Download references

Acknowledgments

This work was partially funded by the German Science Foundation under grant SFB1294, and by the German Federal Ministry of Research and Education under grant 16DII116-DII. We thank Shravan Vasishth for his support with the data collection.

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Potsdam, Potsdam, Germany

    Lena A. Jäger, Silvia Makowski, Paul Prasse, Maximilian Seidler & Tobias Scheffer

  2. Berlin, Germany

    Sascha Liehr

Authors
  1. Lena A. Jäger
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Silvia Makowski
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Paul Prasse
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sascha Liehr
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Maximilian Seidler
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Tobias Scheffer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lena A. Jäger .

Editor information

Editors and Affiliations

  1. Leuphana University, Lüneburg, Germany

    Ulf Brefeld

  2. IRISA/Inria, Rennes, France

    Elisa Fromont

  3. University of Würzburg, Würzburg, Germany

    Andreas Hotho

  4. Leiden University, Leiden, The Netherlands

    Arno Knobbe

  5. ETH Zurich, Zurich, Switzerland

    Marloes Maathuis

  6. Institut National des Sciences Appliquées, Villeurbanne, France

    Céline Robardet

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Jäger, L.A., Makowski, S., Prasse, P., Liehr, S., Seidler, M., Scheffer, T. (2020). Deep Eyedentification: Biometric Identification Using Micro-movements of the Eye. In: Brefeld, U., Fromont, E., Hotho, A., Knobbe, A., Maathuis, M., Robardet, C. (eds) Machine Learning and Knowledge Discovery in Databases. ECML PKDD 2019. Lecture Notes in Computer Science(), vol 11907. Springer, Cham. https://doi.org/10.1007/978-3-030-46147-8_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-46147-8_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-46146-1

  • Online ISBN: 978-3-030-46147-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation