Supporting Multi-objective Decision Making Within a Supervisory Control Environment

  • Ciara SibleyEmail author
  • Joseph Coyne
  • Gopi Vinod Avvari
  • Manisha Mishra
  • Krishna R. Pattipati
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9744)


This paper discusses decision making challenges involved in the management of multiple unmanned vehicles within a dynamic mission environment. Given the increased likelihood of this new supervisory control paradigm, the authors developed the Supervisory Control Operations User Testbed (SCOUT). A brief overview of SCOUT will be provided, followed by a summary of initial research conducted within the testbed which demonstrates how eye tracking measurements can be utilized to assess workload and predict situation awareness. Subsequent discussion will address challenges associated with dynamic decision making under uncertainty, with respect to multiple asset allocation. Techniques for measuring the accuracy of these decisions as well as assessing operator risk throughout the mission will also be presented. The paper concludes with discussion of how these new decision making metrics can be used to drive decision aids and compares decision making performance and risk bias under varying levels of task load.


Supervisory control Decision making Risk Eye tracking Situation awareness 


  1. 1.
    Hess, E.H., Polt, J.M.: Pupil size in relation to mental activity during simple problem-solving. Science 143, 1190–1192 (1964)CrossRefGoogle Scholar
  2. 2.
    Werneke, J., Vollrath, M.: What does the driver look at? The influence of intersection characteristics on attention allocation and driving behavior. Accid. Anal. Prev. 45, 610–619 (2012)CrossRefGoogle Scholar
  3. 3.
    Hjortskov, N., Rissén, D., Blangsted, A.K., Fallentin, N., Lundberg, U., Søgaard, K.: The effect of mental stress on heart rate variability and blood pressure during computer work. Eur. J. Appl. Physiol. 92, 84–89 (2004)CrossRefGoogle Scholar
  4. 4.
    Sibley, C., Coyne, J.T., Doddi, A., Jasper, P.: pupillary response as an indicator of processing demands within a supervisory control simulation environment. In: 18th International Symposium on Aviation Psychology, pp. 506–511. Wright State University (2015)Google Scholar
  5. 5.
    Mannaru, P., Balasingam, B., Pattipati, K.R., Sibley, C., Coyne, J.T.: Cognitive context detection in UAS operators using pupillary measurements. In: 2016 SPIE Defense + Commercial Sensing (in Press)Google Scholar
  6. 6.
    Coyne, J.T., Sibley, C., Monfort, S.S.: Using eye tracking measures as a correlate of situation awareness in an unmanned vehicle control task. In: Tsang, P., Vidulich, M., Flach, J. (eds.) Advances in Aviation Psychology II. Ashgate (in Press)Google Scholar
  7. 7.
    Ahern, S., Beatty, J.: Pupillary responses during information processing vary with scholastic aptitude test scores. Science 205, 1289–1292 (1979)CrossRefGoogle Scholar
  8. 8.
    Coyne, J.T., Sibley, C.: Impact of task load and gaze on situation awareness in unmanned aerial vehicle control. In: 18th International Symposium on Aviation Psychology, pp. 458–463. Wright State University (2015)Google Scholar
  9. 9.
    Jasper, P., Sibley, C., Coyne, J.T.: Using heart rate variability to assess mental workload in a command and control simulation of multiple unmanned aerial vehicles. In: 2016 Human Factors and Ergonomics Society Annual Meeting (in Press)Google Scholar
  10. 10.
    Monfort, S.S., Sibley, C., Coyne, J.T.: Using machine learning and real-time workload assessment to inform task allocation in a multiple UAV management simulation. In: 2016 SPIE Defense + Commercial Sensing (in Press)Google Scholar
  11. 11.
    Nadella, B.K., Avvari, G.V., Kumar, A., Mishra, M., Sidoti, D., Pattipati, K.R., Sibley, C., Coyne, J.T., Monfort, S.S.: Proactive Decision Support for Dynamic Assignment and Routing of Unmanned Aerial Systems. In: IEEE Aerospace Conference, Big Sky, Montana (2016)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Ciara Sibley
    • 1
    Email author
  • Joseph Coyne
    • 1
  • Gopi Vinod Avvari
    • 2
  • Manisha Mishra
    • 2
  • Krishna R. Pattipati
    • 2
  1. 1.Naval Research LaboratoryWashington, DCUSA
  2. 2.University of ConnecticutStorrsUSA

Personalised recommendations