Behavior Research Methods

, Volume 50, Issue 1, pp 107–114 | Cite as

A novel blink detection method based on pupillometry noise

Article

Abstract

Pupillometry (or the measurement of pupil size) is commonly used as an index of cognitive load and arousal. Pupil size data are recorded using eyetracking devices that provide an output containing pupil size at various points in time. During blinks the eyetracking device loses track of the pupil, resulting in missing values in the output file. The missing-sample time window is preceded and followed by a sharp change in the recorded pupil size, due to the opening and closing of the eyelids. This eyelid signal can create artificial effects if it is not removed from the data. Thus, accurate detection of the onset and the offset of blinks is necessary for pupil size analysis. Although there are several approaches to detecting and removing blinks from the data, most of these approaches do not remove the eyelid signal or can result in a relatively large amount of data loss. The present work suggests a novel blink detection algorithm based on the fluctuations that characterize pupil data. These fluctuations (“noise”) result from measurement error produced by the eyetracker device. Our algorithm finds the onset and offset of the blinks on the basis of this fluctuation pattern and its distinctiveness from the eyelid signal. By comparing our algorithm to three other common blink detection methods and to results from two independent human raters, we demonstrate the effectiveness of our algorithm in detecting blink onset and offset. The algorithm’s code and example files for processing multiple eye blinks are freely available for download (https://osf.io/jyz43).

Keywords

Blink detection Pupil Pupillometry Eyetracking 

References

  1. Beatty, J. (1982). Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological Bulletin, 91(2), 276–292.Google Scholar
  2. Bradley, M. M., Miccoli, L., Escrig, M. A., & Lang, P. J. (2008). The pupil as a measure of emotional arousal and autonomic activation. Psychophysiology, 45(4), 602–607.Google Scholar
  3. Caffier, P. P., Erdmann, U., & Ullsperger, P. (2003). Experimental evaluation of eye-blink parameters as a drowsiness measure. European Journal of Applied Physiology, 89, 319–325. doi: https://doi.org/10.1007/s00421-003-0807-5 CrossRefPubMedGoogle Scholar
  4. Charman, W. N., & Heron, G. (1988). Fluctuations in accommodation: A review. Ophthalmic and Physiological Optics, 8, 153–164. doi: https://doi.org/10.1111/j.1475-1313.1988.tb01031.x CrossRefPubMedGoogle Scholar
  5. Cohen, N., Moyal, N., & Henik, A (2015). Executive control suppresses pupillary responses to aversive stimuli. Biological Psychology, 112, 1–11.Google Scholar
  6. Cohen, N., Ben-Yakov, A., Weber, J., Edelson, M., Paz, R., & Dudai, Y. (2017). Prestimulus activity in the cingulo-opercular network predicts memory for naturalistic episodic experience. bioRxiv:176057. doi: https://doi.org/10.1101/176057
  7. de Gee, J. W., Knapen, T., & Donner, T. H. (2014). Decision-related pupil dilation reflects upcoming choice and individual bias. Proceedings of the National Academy of Sciences, 111, E618–E625. doi: https://doi.org/10.1073/pnas.1317557111 CrossRefGoogle Scholar
  8. Fukuda, K. (2001). Eye blinks: new indices for the detection of deception. International Journal of Psychophysiology, 40, 239–245. doi: https://doi.org/10.1016/S0167-8760(00)00192-6 CrossRefPubMedGoogle Scholar
  9. Graham, F. K. (1975). Presidential address, 1974: The more or less startling effects of weak prestimulation. Psychophysiology, 12, 238–248.CrossRefPubMedGoogle Scholar
  10. Gray, L. S., Winn, B., & Gilmartin, B. (1993). Accommodative microfluctuations and pupil diameter. Vision Research, 33, 2083–2090. doi: https://doi.org/10.1016/0042-6989(93)90007-J CrossRefPubMedGoogle Scholar
  11. JASP Team (2017). JASP (Version 0.8.3)[computer software]. Retrieved from https://jasp-stats.org/
  12. Jongkees, B. J., & Colzato, L. S. (2016). Spontaneous eye blink rate as predictor of dopamine-related cognitive function—A review. Neuroscience & Biobehavioral Reviews, 71, 58–82. doi: https://doi.org/10.1016/j.neubiorev.2016.08.020 CrossRefGoogle Scholar
  13. Kahneman, D., & Beatty, J. (1966). Pupil diameter and load on memory. Science, 154, 1583–1585. doi: https://doi.org/10.1126/science.154.3756.1583 CrossRefPubMedGoogle Scholar
  14. Karson, C. N. (1983). Spontaneous eye-blink rates and dopaminergic systems. Brain, 106(3, Pt 3), 643–653. doi: https://doi.org/10.1093/brain/106.3.643 CrossRefPubMedGoogle Scholar
  15. Kass, R. E., & Raftery, A. E. (1995). Bayes factors. Journal of the American Statistical Association, 90, 773–795. doi: https://doi.org/10.1080/01621459.1995.10476572 CrossRefGoogle Scholar
  16. Mathôt, S. (2013). A simple way to reconstruct pupil size during eye blinks. doi: https://doi.org/10.6084/m9.figshare.688001
  17. Merritt, S. L., Schnyders, H. C., Patel, M., Basner, R. C., & O’Neill, W. (2004). Pupil staging and EEG measurement of sleepiness. International Journal of Psychophysiology, 52, 97–112. doi: https://doi.org/10.1016/j.ijpsycho.2003.12.007 CrossRefPubMedGoogle Scholar
  18. Monster, A. W., Chan, H. C., & O’Connor, D. (1978). Long-term trends in human eye blink rate. Biotelemetry and Patient Monitoring, 5, 206–222.Google Scholar
  19. Murphy, P. R., Robertson, I. H., Balsters, J. H., & O’Connell, R. G. (2011). Pupillometry and P3 index the locus coeruleus–noradrenergic arousal function in humans. Psychophysiology, 48, 1532–1543. doi:10.1111/j.1469-8986.2011.01226.xGoogle Scholar
  20. Nowak, W., Hachoł, A., & Kasprzak, H. (2008). Time-frequency analysis of spontaneous fluctuation of the pupil size of the human eye. Optica Applicata, XXXVIII(2), 469–480. Retrieved from www.if.pwr.edu.pl/~optappl/pdf/2008/no2/optappl_3802p469.pdf
  21. Nyström, M., Hansen, D. W., Andersson, R., & Hooge, I. (2016). Why have microsaccades become larger? Investigating eye deformations and detection algorithms. Vision Research, 118, 17–24. doi: https://doi.org/10.1016/j.visres.2014.11.007 CrossRefPubMedGoogle Scholar
  22. Piquado, T., Isaacowitz, D., & Wingfield, A. (2010). Pupillometry as a measure of cognitive effort in younger and older adults. Psychophysiology, 47, 560–569. doi: https://doi.org/10.1111/j.1469-8986.2009.00947.x CrossRefPubMedPubMedCentralGoogle Scholar
  23. Satterthwaite, T. D., Green, L., Myerson, J., Parker, J., Ramaratnam, M., & Buckner, R. L. (2007). Dissociable but inter-related systems of cognitive control and reward during decision making: Evidence from pupillometry and event-related fMRI. NeuroImage, 37, 1017–1031. doi: https://doi.org/10.1016/j.neuroimage.2007.04.066 CrossRefPubMedGoogle Scholar
  24. Schiffman, & Richard, H. (1990). Sensation and perception: An integrated approach (3rd ed.). Wiley.Google Scholar
  25. Sirois, S., & Jackson, I. R. (2012). Pupil dilation and object permanence in infants. Infancy, 17, 61–78. doi: https://doi.org/10.1111/j.1532-7078.2011.00096.x CrossRefGoogle Scholar
  26. Slagter, H. A., Davidson, R. J., & Tomer, R. (2010). Eye-blink rate predicts individual differences in pseudoneglect. Neuropsychologia, 48, 1265–1268. doi: https://doi.org/10.1016/j.neuropsychologia.2009.12.027 CrossRefPubMedGoogle Scholar
  27. Slagter, H. A., Georgopoulou, K., & Frank, M. J. (2015). Spontaneous eye blink rate predicts learning from negative, but not positive, outcomes. Neuropsychologia, 71, 126–132. doi: https://doi.org/10.1016/j.neuropsychologia.2015.03.028 CrossRefPubMedGoogle Scholar
  28. Stampe, D. M. (1993). Heuristic filtering and reliable calibration methods for video-based pupil-tracking systems. Behavior Research Methods, Instruments, & Computers, 25, 137–142. doi:10.3758/BF03204486Google Scholar
  29. Stern, J. A., Walrath, L. C., & Goldstein, R. (1984). The endogenous eyeblink. Psychophysiology, 21, 22–33.CrossRefPubMedGoogle Scholar
  30. van Rijn, H., Dalenberg, J. R., Borst, J. P., Sprenger, S. A., Beatty, J., Kahneman, D., . . . Magliero, A. (2012). Pupil dilation co-varies with memory strength of individual traces in a delayed response paired-associate task. PLoS ONE, 7, e51134. doi:10.1371/journal.pone.0051134Google Scholar
  31. Weiskrantz, L., Cowey, A., & Barbur, J. L. (1999). Differential pupillary constriction and awareness in the absence of striate cortex. Brain, 122, 1533–1538. doi:10.1093/brain/122.8.1533Google Scholar

Copyright information

© Psychonomic Society, Inc. 2018

Authors and Affiliations

  1. 1.Department of Cognitive and Brain SciencesBen-Gurion University of the NegevBeer-ShevaIsrael
  2. 2.Zlotowski Center for NeuroscienceBen-Gurion University of the NegevBeer-ShevaIsrael
  3. 3.Department of PsychologyBen-Gurion University of the NegevBeer-ShevaIsrael
  4. 4.Department of PsychologyColumbia UniversityNew YorkUSA

Personalised recommendations