Skip to main content

A Neurophysiological Examination of Multi-robot Control During NASA’s Extreme Environment Mission Operations Project

  • Conference paper
  • First Online:
Advances in Human Factors in Robots and Unmanned Systems

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 499))

Abstract

Previous research has explored the use of an external or “3rd person” view in the context of augmented reality, video gaming, and robot control. Few studies, however, involve the use of mobile robot to provide that viewpoint, and fewer still do so in dynamic, unstructured, high stress environments. This study examined the cognitive state of robot operators performing complex search and rescue tasks in a simulated crisis scenario. A solo robot control paradigm was compared with a dual condition in which an alternate (surrogate) perspective was provided via voice commands to a second robot employed as a highly autonomous teammate. Subjective and neurophysiological measurements indicate an increased level of situational awareness was achieved in the dual condition along with a reduction in workload and decision oriented task engagement. These results are discussed in the context of mitigation potential for cognitive overload in complex and unstructured task environments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Salamin, P., Thalmann, D., Vexo, F.: The benefits of third-person perspective in virtual and augmented reality?. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology. ACM (2006)

    Google Scholar 

  2. Milgram, P., Rastogi, A., Grodski, J.J.: Telerobotic control using augmented reality. In: Robot and Human Communication, Proceedings 4th IEEE International Workshop on RO-MAN’95 TOKYO. IEEE (1995)

    Google Scholar 

  3. Okura, F., et al.: Teleoperation of mobile robots by generating augmented free-viewpoint images. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE (2013)

    Google Scholar 

  4. Leeper, A.E., et al.: Strategies for human-in-the-loop robotic grasping. In: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction. ACM (2013)

    Google Scholar 

  5. Hashimoto, S., et al.: Touchme: an augmented reality based remote robot manipulation. In: Proceedings of ICAT2011 21st International Conference on Artificial Reality and Telexistence. (2011)

    Google Scholar 

  6. Blitch, J.G., et al.: Correlations of spatial orientation with simulation based robot operator training. In: 4th International Conference on Applied Human Factors and Ergonomics (AHFE). San Francisco CA (2012)

    Google Scholar 

  7. Adams, J.A., Kaymaz-Keskinpala, H.: Analysis of perceived workload when using a PDA for mobile robot teleoperation. In: Proceedings IEEE International Conference on Robotics and Automation ICRA’04. IEEE (2004)

    Google Scholar 

  8. Hancock, P.A., et al.: A meta-analysis of factors affecting trust in human-robot interaction. Hum. Fact. J. Hum. Fact. Ergon. Soc. 53(5), 517–527 (2011)

    Article  Google Scholar 

  9. Parasuraman, R., Cosenzo, K.A., De Visser, E.: Adaptive automation for human supervision of multiple uninhabited vehicles: Effects on change detection, situation awareness, and mental workload. Mil. Psychol. 21(2), 270 (2009)

    Article  Google Scholar 

  10. Scerbo, M.: Adaptive automation. In: Parasuraman, R., Rizzo, M. (eds.) Neuroergonomics: The Brain at Work, pp. 239–252. Oxford University Press, 198 Madison Ave, 10016, New York NY. (2007)

    Google Scholar 

  11. Parasuraman, R., Wilson, G.F.: Putting the brain to work: neuroergonomics past, present, and future. (Cover story). Hum. Fact. 50(3), 468–474 (2008)

    Article  Google Scholar 

  12. Matthews, G., et al.: The psychometrics of mental workload multiple measures are sensitive but divergent. Hum. Fact. J. Hum. Fact. Ergon. Soc. 57(1), 125–143 (2015)

    Article  MathSciNet  Google Scholar 

  13. Berka, C., et al.: Real-time analysis of EEG indexes of alertness, cognition, and memory acquired with a wireless EEG headset. Int. J. Hum-Comp. Inter. 17(2), 151–170 (2004)

    Article  Google Scholar 

  14. Adams, S., Kane, R., Bates, R.: Validation of the China Lake Situational Awareness Scale with 3D SART and S-CAT. Naval Air Warfare Center Weapons Division (452330D), China Lake, CA (1998)

    Google Scholar 

  15. Hart, S.: NASA-task load index (NASA-TLX); 20 years later. Annu. Meet. Hum. Fact. Ergon. Soc. 50(9), 904–908 (2006)

    Article  Google Scholar 

  16. Newton, P., Bristoll, H.: Psychometric Success Spatial Ability Practice Test 1, pp. 1–12 (2010)

    Google Scholar 

  17. Kozhevnikov, M., Hegarty, M.: A dissociation between object manipulation spatial ability and spatial orientation ability. Mem. Cogn. 29(5), 745–756 (2001)

    Article  Google Scholar 

  18. Wickens, C.D.: Statistics. Ergon. Des. Q. Hum. Fact. Appl. 6(4), 18–22 (1998)

    Article  Google Scholar 

Download references

Acknowledgments

This work was sponsored by the Warfighter Interface Division of the 711th Human Performance Wing at the Air Force Research Laboratory. The author would like to extend an especially warm and profound expression of gratitude to Bill Todd and Jason Poffenberger from NASA/JSC for their outstanding support, as well as Ethan Blackford, Jeff Bolles, and James Christensen for their tremendous prowess in handling complex data collection and participant management issues under daunting conditions and an extremely tight schedule.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to John G. Blitch .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing Switzerland

About this paper

Cite this paper

Blitch, J.G. (2017). A Neurophysiological Examination of Multi-robot Control During NASA’s Extreme Environment Mission Operations Project. In: Savage-Knepshield, P., Chen, J. (eds) Advances in Human Factors in Robots and Unmanned Systems. Advances in Intelligent Systems and Computing, vol 499. Springer, Cham. https://doi.org/10.1007/978-3-319-41959-6_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-41959-6_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-41958-9

  • Online ISBN: 978-3-319-41959-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics