Abstract
In real-time multi-robot teleoperation, the operator faces a challenge of maintaining sufficient awareness of all robots in a team. We propose a novel approach to supporting operators, in instances where operators switch between controlling or observing multiple robots in a team. Just as how cinema or video games use visual and narrative techniques to support viewers when transitioning between scenes, we argue that multi-robot teleoperation interfaces should likewise leverage this transition time to provide pertinent information. That is, when switching to a new robot, the interface should take the opportunity to bring the operator up to speed, highlighting what happened while they were away, what current robot states are, and what specifics of the new robot being controlled are; thus, supporting situational awareness. In this paper, we outline this agenda and present our initial exploration and analysis of this informative visual transition.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Calhoun, G., Warfield, L., Wright, N., Spriggs, S., Ruff, H.: Automated aid evaluation for transitioning UAS camera views. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 54(4), 413–417 (2010). https://doi.org/10.1177/154193121005400430
Draper, M., et al.: Transition display aid for changing camera views in UAV operations. Proceedings of the First Conference Humans Opertors Unmanned Systems (HUMOUS 2008) (2008)
Endsley, M.R.: Toward a theory of situation awareness in dynamic systems. Hum. Factors J. Hum. Factors Ergon. Soc. 37(1), 32–64 (1995). https://doi.org/10.1518/001872095779049543
Freer, I., Gibbs, O.: Film Studies 101: The 30 Camera Shots Every Film Fan Needs to Know, https://www.empireonline.com/movies/features/film-studies-101-camera-shots-styles/. Accessed 18 Sep 2019
Katz, S.D.: Film Directing: Shot by Shot: Visualizing from Concept to Screen. Michael Wiese Productions; Anniversary edition (2019)
Lewis, M.: Human interaction with multiple remote robots. Rev. Hum. Factors Ergon. 9(1), 131–174 (2013). https://doi.org/10.1177/1557234X13506688
Rosenfeld, A., et al.: Human-multi-robot team collaboration for efficient warehouse operation. Auton. Robot. Multirobot Syst. (2016)
Saffer, D.: Chapter 4: Feedback. In: Microinteractions: designing with details, pp. 83–107 O’Reilly Media, Inc. (2013)
Singh, A., et al.: An interface for remote robotic manipulator control that reduces task load and fatigue. In: 2013 IEEE RO-MAN, pp. 738–743 IEEE (2013). https://doi.org/10.1109/ROMAN.2013.6628401
Wright, J.L., et al.: Human–automation interaction for multiple robot control: the effect of varying automation assistance and individual differences on operator performance. Ergonomics 61(8), 1033–1045 (2018). https://doi.org/10.1080/00140139.2018.1441449
Zheng, K., et al.: Supervisory control of multiple social robots for navigation. In: Proceedings of the 8th ACM/IEEE International Conference on Human-robot Interaction, pp. 17–24. IEEE Press (2013). https://doi.org/10.1109/HRI.2013.6483497
Zumbrunnen, A.: Smart transitions in user experience design. https://www.smashingmagazine.com/2013/10/smart-transitions-in-user-experience-design/. Accessed 01 July 2020
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Appendices
Appendix 1. Selective camera techniques and our classification with short descriptions.
Appendix 2. Video game loading screens and our classification based on the information that the scene conveys.
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Seo, S.H., Young, J.E. (2021). What Happened While I Was Away? Leveraging Visual Transition Techniques to Convey Robot States in Multi-robot Teleoperation. In: Li, H., et al. Social Robotics. ICSR 2021. Lecture Notes in Computer Science(), vol 13086. Springer, Cham. https://doi.org/10.1007/978-3-030-90525-5_66
Download citation
DOI: https://doi.org/10.1007/978-3-030-90525-5_66
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-90524-8
Online ISBN: 978-3-030-90525-5
eBook Packages: Computer ScienceComputer Science (R0)