A Neurophysiological Assessment of Multi-robot Control During NASA’s Pavilion Lake Research Project
A number of previous studies have explored the value of an external or “3rd person” view in the realm of video gaming and augmented reality. Few studies, however, actually utilize a mobile robot to provide that viewpoint, and fewer still do so in dynamic, unstructured environments. This study examined the cognitive state of robot operators performing complex survey and sample collection tasks in support of a time sensitive, high profile science expedition. A solo robot control paradigm was compared with a dual condition in which an alternate (surrogate) perspective was provided via voice commands to a second robot employed as a highly autonomous teammate. Subjective and neurophysiological measurements indicate an increased level of situational awareness was achieved in the dual condition along with a reduction decision oriented task engagement. These results are discussed in the context of mitigation potential for cognitive overload and automation induced complacency in complex and unstructured task environments.
KeywordsHuman robot interaction Cognitive state Situational awareness Workload Decision making Robot assisted rescue
This work was sponsored by the Warfighter Interface Division (RHC) of the 711th Human Performance Wing at the Air Force Research Laboratory. The author would like to express the utmost in profound gratitude to Dr. Darlene Lim of NASA/JSC and her amazing team for providing 711HPW/RHC with such a magnificent research opportunity. Boundless appreciation is also extended to Arnis Mangolds, Mark Micire, James Christensen, Justin Estepp, Ethan Blackford, Maggie Bowers, Jeffrey Bolles, and Samantha Klosterman for their extra efforts and technical prowess in handling complex data collection and participant management issues under daunting conditions and a compressed time line.
- 1.Salamin, P., Thalmann, D., Vexo, F.: The benefits of third-person perspective in virtual and augmented reality? In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology. ACM, (2006)Google Scholar
- 2.Milgram, P., Rastogi, A., Grodski, J.J.: Telerobotic control using augmented reality. In: Proceedings of 4th IEEE International Workshop on Robot and Human Communication. RO-MAN’95 TOKYO. IEEE (1995)Google Scholar
- 3.Okura, F., et al.: Teleoperation of mobile robots by generating augmented free-viewpoint images. In: International Conference on Intelligent Robots and Systems (IROS), 2013 IEEE/RSJ. 2013. IEEEGoogle Scholar
- 4.Leeper, A.E., et al.: Strategies for human-in-the-loop robotic grasping. In: Proceedings of the Seventh Annual ACM/IEEE International Conference on Human-Robot Interaction. ACM (2012)Google Scholar
- 5.Hashimoto, S., et al., Touchme: an augmented reality based remote robot manipulation. In: Proceedings of ICAT2011 21st International Conference on Artificial Reality and Telexistence (2011)Google Scholar
- 6.Lim, D.S., et al.: A historical overview of the Pavilion Lake research project—analog science and exploration in an underwater environment. Geol. Soc. Am. Spec. Pap. 483, 85–115 (2011)Google Scholar
- 7.Blitch, J.G., et al.: Correlations of spatial orientation with simulation based robot operator training. In: 4th International Conference on Applied Human Factors and Ergonomics (AHFE). San Francisco CA, 2012Google Scholar
- 8.Parasuraman, R., Hancock, P.: Mitigating the adverse effects of workload, stress, and fatigue with adaptive automation. Performance Under Stress (Epub), p. 45, 2012Google Scholar
- 13.Adams, S., Kane, R., Bates, R.: Validation of the China Lake situational awareness scale with 3D SART and S-CAT. China Lake, CA: Naval Air Warfare Center Weapons Division (452330D), 1998Google Scholar
- 15.Newton, P., Bristoll, H.: Psychometric success spatial ability practice test 1. pp. 1–12, (2010)Google Scholar