Learning-Based Driver Workload Estimation
A popular definition of workload is given by O’Donnell and Eggmeir, which states that “The term workload refers to that portion of the operator’s limited capacity actually required to perform a particular task” . In the vehicle environment, the “particular task” refers to both the vehicle control, which is the primary task, and other secondary activities such as listening to the radio. Three major types of driver workload are usually studied, namely, visual, manual, and cognitive. Auditory workload is not treated as a major type of workload in the driving context because the auditory perception is not considered as a major requirement to perform a driving task. Even when there is an activity that involves audition, the driver is mostly affected cognitively.
Lately, the advanced computer and telecommunication technology is introducing many new in-vehicle information systems (IVISs), which give drivers more convenient and pleasant driving experiences. Active research is being conducted to provide IVISs with both high functionality and high usability. On the usability side, driver's workload is a heated topic advancing in at least two major directions. One is the offline assessment of the workload imposed by IVISs, which can be used to improve the design of IVISs. The other effort is the online workload estimation, based on which IVISs can provide appropriate service at appropriate time, which is usually termed as Workload Management. For example, the incoming phone call may be delayed if the driver is engaged in a demanding maneuver.
Among the three major types of driver workload, cognitive workload is the most difficult to measure. For example, withdrawing hands from the steering wheel to reach for a coffee cup requires extra manual workload. It also may require extra visual workload in that the position of the cup may need to be located. Both types of workload are directly measurable through such observations as hands-off-wheel and eyes-off- road time. On the other hand, engaging in thinking (the so-called minds-off-road phenomenon) is difficult to detect. Since the cognitive workload level is internal to the driver, it can only be inferred based on the information that is observable. In this chapter, we report some of our research results on driver's cognitive workload estimation.1 After the discussion of the existing practices, we propose a new methodology to design driver workload estimation systems, that is, using machine-learning techniques to derive optimized models to index workload. The advantage of this methodology will be discussed, followed by the presentation of some experimental results. This chapter concludes with discussion of future work.
KeywordsSecondary Task Vehicle Speed Pupil Diameter Intelligent Transportation System Cognitive Workload
Unable to display preview. Download preview PDF.
- 1.R.D. O’Donnel and F.T. Eggemeier, “Workload assessment methodology,” in Handbook of Perception and Human Performance, Vol II, Cognitive Processes and Performance, K.R. Boff, L. Kaufman, and J.P. Thomas, Eds. Wiley, New York, 1986.Google Scholar
- 2.C.D. Wickens and J.G. Hollands, Engineering Psychology and Human Performance, Prentice-Hall, Upper Saddle River, NJ, 3rd edition, 2000.Google Scholar
- 3.S.G. Hart and L.E. Seaveland, “Development of NASA-TLS (task load index): results of empirical and theoretical research,” in Human Mental Workload, P.A. Hancock and N. Meshkati, Eds., North Holland, Amsterdam, 1988.Google Scholar
- 4.G.B. Reid and T.E. Nygren, “The subjective workload assessment technique: a scaling procedure for measuring mental workload,” in Human Mental Workload, P.A. Hancock and N. Meshkati, Eds., North Holland, Amsterdam, 1988.Google Scholar
- 5.L.S. Angell, R.A. Young, J.M. Hankey, and T.A. Dingus, “An evaluation of alternative methods for assessing driver workload in the early development of in-vehicle information systems,” in Proceedings of SAE Government/Industry Meeting, Washington, DC, May 2002.Google Scholar
- 6.J. Hurwitz and D.J. Wheatley, “Using driver performance measures to estimate workload,” in Proceedings of the Human Factors and Ergonomics Society 46th Annual Meeting, Santa Monica, CA, pp. 1804–1808, 2002.Google Scholar
- 7.C. Mayser, W. Piechulla, K.-E. Weiss, and W. König, “Driver workload monitoring,” in Proceedings of the Internationale Ergonomie-Konferenz der GfA, ISOES und FEES, Mnchen, Germany, May 7–9, 2003.Google Scholar
- 8.O. Nakayama, T. Futami, T. Nakamura, and E.R. Boer, “Development of a steering entropy method for evaluating driver workload,” in Proceedings of SAE International Congress and Exposition Detroit, Detroit, MI, March 1999.Google Scholar
- 9.C.D. Wickens, J. Helleberg, J. Goh, X. Xu, and B. Horrey, “Pilot task management: testing an attentional expected value model of visual scanning,” Tech. Rep. ARL-01-14/NASA-01-7, University of Illinois, Aviation Research Lab, Savoy, IL, 2001.Google Scholar
- 10.S.K. Card, T.P. Moran, and A. Newell, “The model human processor: an engineering model of human performance,” in Handbook of Perception and Human Performance, Wiley, New York, pp. 1–35, 1986.Google Scholar
- 12.J.R. Anderson and C. Lebiere, The Atomic Components of Thought, Erlbaum, Mahwah, NJ, 1998.Google Scholar
- 14.J.L. Harbluk and Y.I. Noy, “The impact of cognitive distraction on driver visual behaviour and vehicle control,” Technical Report, Transport Canada, http://www.tc.gc.ca/roadsafety/tp/tp13889/en/menu.htm, February 2002.
- 17.Y. Zhang, Y. Owechko, and J. Zhang, “Machine learning-based driver workload estimation,” in Proceedings of the 7th International Symposium on Advanced Vehicle Control, Arnhem, Netherlands, August 23–27, 2004.Google Scholar
- 18.Y. Zhang, Y. Owechko, and J. Zhang, “Driver cognitive workload estimation: a data-driven perspective,” in Proceedings of 7th International IEEE Conference on Intelligent Transportation Systems, Washington D.C., October 3–6, 2004.Google Scholar
- 20.P. Bhagat, Pattern Recognition in Industry, Elsevier Science, Oxford, UK, 2005.Google Scholar
- 22.J. Forbes, T. Huang, K. Kanazawa, and S. Russell, “Batmobile: Towards a bayesian automated taxi,” in Proceedings of International Joint Conference on Artificial Intelligence, Montreal, Canada, pp. 1878–1885, 1995.Google Scholar
- 23.A.P. Pentland and A. Liu, “Modeling and prediction of human,” Behavior Neural Computation, 11(2), 1999.Google Scholar
- 24.N. Oliver and A.P. Pentland, “A graphical models for driver behavior recognition in a smartcar,” in Proceedings of Intelligent Vehicles, Detroit, Michigan, October 2000.Google Scholar
- 26.R. Simmons, B. Browning, Y. Zhang, and V. Sadekar, “Learning to predict driver route and destination intent,” in Proceedings of the 9th International IEEE Conference on Intelligent Transportation Systems, Toronto, Canada, September 17–20, 2006.Google Scholar
- 27.A. Rakotonirainy and R. Tay, “Driver inattention detection through intelligent analysis of readily available sensors,” in Proceedings of The 7th International IEEE Conference on Intelligent Transportation Systems, Washingtong DC, October 3–6, 2004.Google Scholar
- 28.A. Rakotonirainy and R. Tay, “In-vehicle ambient intelligent transport systems (i-vaits): towards an integrated research,” in Proceedings of The 7th International IEEE Conference on Intelligent Transportation Systems, Washingtong DC, October 3–6, 2004.Google Scholar
- 29.C. Brooks, A. Rakotonirainy1, and F. Maire, “Reducing driver distraction through software,” in Proceedings Australasian Road Safety Research Policing Education Conference, Wellington, New Zealand, November 2005.Google Scholar
- 30.L.M. Bergasa, J. Nuevo, M.A. Sotelo, R. Barea, and E. Lopez, “Visual monitoring of driver inattention”. Chapter 2 in this volume.Google Scholar
- 32.Applied Science Lab Inc., Eye Tracking System Instruction Manual – Model 504, Applied Science Group, Bedford, MA, 2001.Google Scholar
- 33.C.D. Wickens, S.E. Gordon, and Y. Liu, An Introduction to Human Factors Engineering, Addison–Wesley, New York, 1998.Google Scholar
- 35.J. Quinlan, C4.5: Programs for Machine Learning, Morgan Kaufmann, San Mateo, CA, 1993.Google Scholar
- 36.D. Chapman and L.P. Kaelbling, “Input generalization in delayed reinforcement learning: An algorithm and performance comparisons,” in Proceedings of the Twelfth International Joint Conference on Artificial Intelligence (IJCAI-91), Sydney, Australia, pp. 726–731, August 1991.Google Scholar
- 38.Y. Freund and R.E. Shapire, “A short introduction to boosting,” Journal of Japanese Society for Artificial Intelligence, 14(5), 771–780, 1999.Google Scholar
- 39.D.C. Montgomery and G.C. Runger, Applied Statistics and Probability for Engineers, Wiley, New York, 4th edition, 2006.Google Scholar
- 40.X.S. Zheng, G.W. McConkie, and Y.-C. Tai, “The effect of secondary tasks on drivers’ scanning behavior,” in Proceedings of the 47nd Annual Meeting of the Human Factors and Ergonomics Society, pp. 1900–1903, October 2003.Google Scholar
- 41.D. Kahneman, Attention and Effort, Prentice-Hall, Englewood Cliffs, NJ, 1973.Google Scholar