Abstract
To take advantage of the increasing number of in-vehicle devices, automobile drivers must divide their attention between primary (driving) and secondary (operating in-vehicle device) tasks. In dynamic environments such as driving, however, it is not easy to identify and quantify how a driver focuses on the various tasks he/she is simultaneously engaged in, including the distracting tasks. Measures derived from the driver’s scan path have been used as correlates of driver attention. This article presents a methodology for analyzing eye positions, which are discrete samples of a subject’s scan path, in order to categorize driver eye movements. Previous methods of analyzing eye positions recorded in a dynamic environment have relied completely on the manual identification of the focus of visual attention from a point of regard superimposed on a video of a recorded scene, failing to utilize information regarding movement structure in the raw recorded eye positions. Although effective, these methods are too time consuming to be easily used when the large data sets that would be required to identify subtle differences between drivers, under different road conditions, and with different levels of distraction are processed. The aim of the methods presented in this article are to extend the degree of automation in the processing of eye movement data by proposing a methodology for eye movement analysis that extends automated fixation identification to include smooth and saccadic movements. By identifying eye movements in the recorded eye positions, a method of reducing the analysis of scene video to a finite search space is presented. The implementation of a software tool for the eye movement analysis is described, including an example from an on-road test-driving sample.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Breitmeyer, B., &Braun, D. (1990). Effects of fixation and attention on saccadic reaction time. In R. Groner, G. d’Ydewalle, & R. Parham (Eds.),From eye to mind: Information acquisition in perception, search, and reading (pp. 71–79). Amsterdam: North-Holland.
Brown, I. D. (1997). Prospects for technological countermeasures against driver fatigue.Accident Analysis & Prevention,29, 525–531.
Buswell, G. T. (1935).How people look at pictures: A study of the psychology of perception in art. Chicago: University of Chicago Press.
Card, S. K., Moran, T. P., &Newell, A. (1983).The psychology of human—computer interaction. Hillsdale, NJ: Erlbaum.
Chapman, P., &Underwood, G. (1999). Looking for danger: Drivers’ eye movements in hazardous situations. In A. G. Gale, I. D. Brown, C. M. Haslegrave, & S. P. Taylor (Eds.),Vision in vehicles—VII (pp. 225–232). Amsterdam: Elsevier.
Chiang, D. P., Brooks, A. M., &Weir, D. H. (2004). On the highway measures of driver glance behavior with an example automobile navigation system.Applied Ergonomics,35, 215–223.
Dingus, T. (2000).Driver distraction: New features, new tasks, new risks (Presentation). Available at www-nrd.nhtsa.dot.gov/PDF/nrd-13/DingusT_ppt.pdf.
García-Pérez, M. A., &Peli, E. (2001). Intrasaccadic perception.Journal of Neuroscience,21, 7313–7322.
Goodman, M. [J.], Bents, F. D., Tijerina, L., Wierwille, W. W., Lerner, N., &Benel, D. (1997).An investigation of the safety implications of wireless communications in vehicles (Rep. DOT HS 808-635). Washington, DC: United States Department of Transportation, National Highway Traffic Safety Administration.
Harbluk, J. L., Noy, Y. I., &Eizenman, M. (2002).The impact of cognitive distraction on driver visual behaviour and vehicle control (Rep. TP 13889 E). Ottawa: Ergonomics Division, Road Safety Directorate and Motor Vehicle Regulation Directorate.
Healey, J., Seger, J., &Picard, R. (1999). Quantifying driver stress: Developing a system for collecting and processing bio-metric signals in natural situations.Biomedical Sciences Instrumentation,35, 193–198.
Henderson, J. M. (1993). Visual attention and saccadic eye movements. In G. d’Ydewalle & J. van Rensbergen (Eds.),Perception and cognition: Advances in eye movement research (pp. 37–50). Amsterdam: North-Holland.
Kieras, D. E., Wood, S. D., Abotel, K., &Hornof, A. (1995). GLEAN: A computer-based tool for rapid GOMS model usability evaluation of user interface designs. InProceedings of the Eighth Annual Symposium on User Interface Software and Technology (pp. 91–100). Pittsburgh: ACM SIGGRAPH.
Land, M., &Horwood, J. (1996). The relations between head and eye movements during driving. In A. G. Gale, I. D. Brown, C. M. Haslegrave, & S. P. Taylor (Eds.),Vision in vehicles—V (pp. 153–160). Amsterdam: North-Holland.
Liu, A. (1998). What the driver’s eye can tell the car’s brain. In G. Underwood (Ed.),Eye guidance in reading, driving, and scene perception (pp. 431–452). Oxford: Elsevier.
Liu, A., &Salvucci, D. (2001). Modeling and prediction of human driver behavior. In M. J. Smith, G. Salvendy, D. Harris, & R. J. Koubek (Eds.),Usability valuation and interface design: Cognitive engineering, intelligent agents, and virtual reality (pp. 1479–1483). Mahwah, NJ: Erlbaum.
Liversedge, S., &Findlay, J. (2000). Saccadic eye movements and cognition.Trends in Cognitive Sciences,4, 6–14.
McKnight, J., &McKnight, A. S. (1991).The effect of cellular phone use upon driver attention (Report). Landover, MD: National Public Services Research Institute.
Mourant, R. R., &Rockwell, T. H. (1972). Strategies of visual search by novice and experienced drivers.Human Factors,14, 325–335.
Nilsson, T., Nelson, T. M., &Carlson, D. (1997). Development of fatigue symptoms during simulated driving.Accident Analysis & Prevention,29, 479–488.
Noton, D., &Stark, L. (1971). Eye movements and visual perception.Scientific American,224, 34–43.
Nunes, L. [M.], &Recarte, M. A. (2002). Cognitive demands of hands-free-phone conversation while driving.Transportation Research Pt. F: Traffic Psychology & Behaviour,5, 133–144.
Palmer, S. E. (1999).Vision science: Photons to phenomenology. Cambridge, MA: MIT Press.
Rabiner, L. R., &Juang, B. H. (1986). An introduction to hidden Markov models.IEEE ASSP Magazine,3, 4–16.
Recarte, M. A., &Nunes, L. M. (2000). Effects of verbal and spatialimagery tasks on eye fixations while driving.Journal of Experimental Psychology: Applied,6, 31–43.
Redelmeier, D. A., &Tibshirani, R. J. (1997). Association between cellular-telephone calls and motor vehicle collisions.New England Journal of Medicine,336, 453–458.
Reimer, B. L. (2003).Automated methods of detecting driver distractions. Unpublished doctoral dissertation, University of Rhode Island.
Salvucci, D. D. (1999).Mapping eye movements to cognitive processes. Unpublished doctoral dissertation, Carnegie Mellon University.
Salvucci, D. D., &Anderson, J. R. (2001). Automated eye-movement protocol analysis.Human—Computer Interaction,16, 39–86.
Schreiner, L. M. (2000).An investigation of the effectiveness of a strobe light as an imminent rear warning signal. Unpublished master’s thesis, Virginia Polytechnic Institute and State University, Blacksburg.
Sodhi, M., Reimer, B. [L.], &Llamazares, I. (2002). Glance analysis of driver eye movements to evaluate distraction.Behavior Research Methods, Instruments, & Computers,34, 529–538.
Stutts, J. [C.], Feaganes, J., Rodgman, E., Hamlett, C., Meadows, T., Reinfurt, D., et al. (2003).Distractions in everyday driving (Report). Chapel Hill: University of North Carolina, Highway Safety Research Center.
Stutts, J. C., &Hunter, W. W. (2003). Driver inattention, driver distraction and traffic crashes.ITE Journal,73, 34–36, 43–45.
Summala, H., Nieminen, T., &Punto, M. (1996). Maintaining lane position with peripheral vision during in-vehicle tasks.Human Factors,38, 442–451.
Sussman, E. D., Bishop, H., Madnick, B., &Walter, R. (1985). Driver inattention and highway safety.Transportation Research Record,1047, 40–48.
Underwood, G., Chapman, P., Crundall, D., Cooper, S., &Wallen, R. (1999). The visual control of steering and driving: Where do we look when negotiating curves? In A. G. Gale, I. D. Brown, C. M. Haslegrave, & S. P. Taylor (Eds.),Vision in vehicles—VII (pp. 245–252). Amsterdam: Elsevier.
Unema, P., Dornhoefer, S., Steudel, S., &Velichkovsky, B. M. (1999). An attentive look at drivers’ fixation durations. In A. G. Gale, I. D. Brown, C. M. Haslegrave, & S. P. Taylor (Eds.),Vision in vehicles—VII (pp. 335–344). Amsterdam: Elsevier.
Violanti, J. M. (1998). Cellular phones and fatal traffic collisions.Accident Analysis & Prevention,30, 519–524.
Wang, J.-S., Knipling, R. R., &Goodman, M. J. (1996). The role of driver inattention in crashes: New statistics from the 1995 Crashworthiness Data System. InProceedings of 40th Annual Meeting of the Association for the Advancement of Automotive Medicine (pp. 377–392). Barrington, IL: AAAM.
Yarbus, A. L. (1967).Eye movements and vision. New York: Plenum.
Young, L. R., &Sheena, D. (1975). Survey of eye movement recording methods.Behavior Research Methods & Instrumentation,7, 397–429.
Author information
Authors and Affiliations
Corresponding author
Additional information
Support for this project was provided by Joseph Coughlin at the MIT AgeLab, the NATO Undersea Research Center (La Spezia, Italy), the United States Department of Transportation’s University of Rhode Island Transportation Center, and the United States Department of Transportation’s New England University Transportation Center at the Massachusetts Institute of Technology.
Rights and permissions
About this article
Cite this article
Reimer, B., Sodhi, M. Detecting eye movements in dynamic environments. Behavior Research Methods 38, 667–682 (2006). https://doi.org/10.3758/BF03193900
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03193900