Advertisement

Encephalographic Assessment of Situation Awareness in Teleoperation of Human-Swarm Teaming

  • Raul Fernandez RojasEmail author
  • Essam Debie
  • Justin Fidock
  • Michael Barlow
  • Kathryn Kasmarik
  • Sreenatha Anavatti
  • Matthew Garratt
  • Hussein Abbass
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 1142)

Abstract

An important factor in the operational success of any teleoperated human-swarm system is situation awareness (SA). A loss of SA has been associated with poor human performance, which can lead to misjudgement, errors, and life-threatening situations. One of the major factors that causes loss of SA is the degradation of data transmission. It is imperative to assess the SA of an operator before the performance of a teleoperated system has declined, in particular in situations of delayed relay and/or loss of critical information. We use electroencephalography (EEG) to predict different levels of SA. A human-swarm simulation was used to obtain subjective scores from participants. Quality of information significantly affected the perception of SA of the participants. EEG data provided objective confirmation of the resultant SA level. Theta, Alpha, and Beta band exhibited an increase during loss of SA. Frontal and occipital areas were identified to reflect changes in SA. These preliminary results offer evidence for the potential use of EEG to offer real-time indicators for the objective assessment of SA.

Keywords

Cognitive assessment Human performance EEG Teleoperation 

References

  1. 1.
    Berka, C., Levendowski, D.J., Davis, G., Whitmoyer, M., Hale, K., Fuchs, K.: Objective measures of situational awareness using neurophysiology technology. Augment. Cogn.: Past, Present. Future 145–154 (2006)Google Scholar
  2. 2.
    Catherwood, D., et al.: Mapping brain activity during loss of situation awareness: an EEG investigation of a basis for top-down influence on perception. Hum. Factors 56(8), 1428–1452 (2014) CrossRefGoogle Scholar
  3. 3.
    Chao, L.L., Lenoci, M., Neylan, T.C.: Effects of post-traumatic stress disorder on occipital lobe function and structure. NeuroReport 23(7), 412–419 (2012)Google Scholar
  4. 4.
    Chen, S.I., Visser, T.A., Huf, S., Loft, S.: Optimizing the balance between task automation and human manual control in simulated submarine track management. J. Exp. Psychol.: Appl. 23(3), 240 (2017)Google Scholar
  5. 5.
    Debie, E., et al.: Multimodal fusion for objective assessment of cognitive workload: a review. IEEE Trans. Cybern. 1–14 (2019)Google Scholar
  6. 6.
    Endsley, M.R.: Toward a theory of situation awareness in dynamic systems. Hum. Factors 37(1), 32–64 (1995)CrossRefGoogle Scholar
  7. 7.
    French, H.T., Clarke, E., Pomeroy, D., Seymour, M., Clark, C.R.: Psycho-physiological measures of situation awareness. Decis. Mak. Complex Environ. 291 (2007)Google Scholar
  8. 8.
    Lingard, L., et al.: Communication failures in the operating room: an observational classification of recurrent types and effects. BMJ Qual. Saf. 13(5), 330–334 (2004)CrossRefGoogle Scholar
  9. 9.
    Mathewson, K.E., Lleras, A., Beck, D.M., Fabiani, M., Ro, T., Gratton, G.: Pulsed out of awareness: EEG alpha oscillations represent a pulsed-inhibition of ongoing cortical processing. Front. Psychol. 2, 99 (2011) CrossRefGoogle Scholar
  10. 10.
    Pope, A.T., Bogart, E.H., Bartolome, D.S.: Biocybernetic system evaluates indices of operator engagement in automated task. Biol. Psychol. 40(1–2), 187–195 (1995)CrossRefGoogle Scholar
  11. 11.
    Thornton, R.C.: The effects of automation and task difficulty on crew coordination, workload, and performance, 00019 (1992)Google Scholar
  12. 12.
    Wang, M., Hussein, A., Rojas, R.F., Shafi, K., Abbass, H.A.: EEG-based neural correlates of trust in human-autonomy interaction. In: 2018 IEEE Symposium Series on Computational Intelligence (SSCI), pp. 350–357. IEEE (2018)Google Scholar
  13. 13.
    Winkler, I., Brandl, S., Horn, F., Waldburger, E., Allefeld, C., Tangermann, M.: Robust artifactual independent component classification for BCI practitioners. J. Neural Eng. 11(3), 035013 (2014)CrossRefGoogle Scholar
  14. 14.
    Yeo, L.G., et al.: Mobile EEG-based situation awareness recognition for air traffic controllers. In: 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 3030–3035. IEEE (2017)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Raul Fernandez Rojas
    • 1
    Email author
  • Essam Debie
    • 1
  • Justin Fidock
    • 2
  • Michael Barlow
    • 1
  • Kathryn Kasmarik
    • 1
  • Sreenatha Anavatti
    • 1
  • Matthew Garratt
    • 1
  • Hussein Abbass
    • 1
  1. 1.School of Engineering and ITUniversity of New South WalesCanberraAustralia
  2. 2.Defence Science and Technology OrganisationAdelaideAustralia

Personalised recommendations