UAV Operators Workload Assessment by Optical Brain Imaging Technology (fNIR)
The use of unmanned aerial vehicles (UAVs) is expected to increase exponentially over the next few years. UAV ground operators are required to acquire skills quickly and completely, with a level of expertise that builds the operator’s confidence in his/her ability to control the UAV under adverse conditions. As UAVs are held to increasingly higher standards of efficiency and safety, operators are routinely required to perform more informationally dense and cognitively demanding tasks, resulting in increased cognitive workloads during operation. Functional brain monitoring offers the potential to help UAV operators meet these challenges. Recent research has demonstrated the utility of near- infrared-based functional brain imaging systems (fNIRs) for the purpose of monitoring frontal cortical areas that support executive functions (attention, working memory, response monitoring). This technology provides portable, safe, affordable, noninvasive, and minimally intrusive monitoring systems with rapid application times for continuous measures of cortical activity. fNIR technology allows continuous monitoring of operators during training as they develop expertise, as well as the capacity to monitor their cognitive workload under operational conditions while controlling UAVs in critical missions. This chapter discusses the utilization of fNIR in the monitoring of a cognitive workload during UAV operation, and as an objective measure of expertise development, that is, the transition from novice to expert during operator training.
KeywordsMental Workload Flight Simulator Brain Energy Metabolism Cognitive Workload Onboard Camera
The U.S. Army Medical Research Acquisition Activity, 820 Chandler Street, Fort Detrick, MD 21702-5014 is the awarding and administering acquisition office. This investigation was funded under a U.S. Army Medical Research Acquisition Activity, Cooperative Agreement W81XWH-08-2-0573 and in part by W81XWH-09-2-0104. The content of the information herein does not necessarily reflect the position or the policy of the U.S. Government or the U.S. Army, and no official endorsement should be inferred.
The authors would also like to thank Justin Menda and Adrian Curtin for conducting experiments and part of data analyses.
- A. Ames III, CNS energy metabolism as related to function. Brain Res. Rev. 34(1–2), 42–68 (2000). doi: 10.1016/s0165-0173(00)00038-2Google Scholar
- H. Ayaz, M. Izzetoglu, S.M. Platek, S. Bunce, K. Izzetoglu, K. Pourrezaei, B. Onaral, Registering fNIR data to brain surface image using MRI templates. Conference Proceedings - IEEE Engineering in Medicine and Biology Society 2671–2674 (2006). doi: 10.1109/IEMBS.2006.260835Google Scholar
- H. Ayaz, P.A. Shewokis, A. Curtin, M. Izzetoglu, K. Izzetoglu, B. Onaral, Using MazeSuite and functional near infrared spectroscopy to study learning in spatial navigation. J. Vis. Exp. (56), e3443 (2011). doi:10.3791/3443Google Scholar
- B. Cain, A review of the mental workload literature (vol. RTO-TR-HFM-121-Part-II): DTIC document (2007)Google Scholar
- J. Cooper, M.A. Goodrich, Towards combining uav and sensor operator roles in uav-enabled visual search, in Proceedings of ACM/IEEE International Conference on Human-Robot Interaction, Amsterdam, The Netherlands, 2008Google Scholar
- M. Cope, The development of a near infrared spectroscopy system and its application for non invasive monitoring of cerebral blood and tissue oxygenation in the newborn infant. Ph.D. thesis, University College London, London, 1991Google Scholar
- J.L. Drury, S.D. Scott, Awareness in unmanned aerial vehicle operations. Int. C2 J. 1, 1–10 (2008)Google Scholar
- J.L. Drury, J. Richer, N. Rackliffe, M.A. Goodrich, Comparing situation awareness for two unmanned aerial vehicle human interface approaches, in Proceedings of the Conference on Safety, Security, and Rescue Robotics (SSRR), Gaithersburg, MD, 2006Google Scholar
- P. Hancock, M.H. Chignell, Toward a theory of mental work load: stress and adaptability in human machine systems, in Proceedings of the International IEEE Conference on Systems, Man and Cybernetics, Atlanta, GA, 1986Google Scholar
- PA. Hancock, P.A. Desmond, Stress, Workload, and Fatigue (Lawrence Erlbaum, Mahwah, 2001)Google Scholar
- A.J. Hansen, M. Nedergaard, Brain ion homeostasis in cerebral ischemia. Mol. Chem. Neuropathol. 9(1), 195–209 (1988)Google Scholar
- J.T. Hing, J. Menda, K. Izzetoglu, P.Y. Oh, An indoor study to evaluate a mixed-reality interface for unmanned aerial vehicle operations in near earth environments. Int. J. Intell. Control Syst. 16(2), 132–141 (2011)Google Scholar
- J. Menda, J.T. Hing, H. Ayaz, P.A. Shewokis, K. Izzetoglu, B. Onaral, P. Oh, Optical brain imaging to enhance UAV operator training, evaluation, and interface development. J. Intell. Robot. Syst. 61(1–4), 423–443 (2010). doi:10.1007/s10846-010-9507-7Google Scholar
- N. Meshkati, P.A. Hancock, M. Rahimi, S.M. Dawes, Techniques of mental workload assessment, in Evaluation of Human Work: A Practical Ergonomics Methodology, 2nd edn., ed. by J. Wilson, E.N. Corlett (Taylor and Francis, London, 1995)Google Scholar
- R. Parasuraman, M. Rizzo, Neuroergonomics: The Brain at Work (Oxford University Press, Oxford, 2007)Google Scholar
- C. E. Rash, P.A. LeDuc, S.D. Manning, Human factors in U.S. military unmanned aerial vehicle accidents, in Human Factors of Remotely Operated Vehicles, vol. 7, ed. by N.J. Cooke, H.L. Pringle, H.K. Pedersen, O. Connor. Advances in Human Performance and Cognitive Engineering Research (Emerald Group Publishing Limited, Boston, 2006), pp. 117–131CrossRefGoogle Scholar