Abstract
This paper proposes an intuitive teleoperation scheme by using human gesture in conjunction with multimodal human-robot interface. Further, in order to deal with the complication of dynamic daily environment, the authors apply haptic point cloud rendering and the virtual collaboration to the system. all these functions are achieved by a portable hardware that is proposed by authors newly, which is called “the mobile iSpace”. First, a surrounding environment of a teleoperated robot is captured and reconstructed as the 3D point cloud using a depth camera. Virtual world is then generated from the 3D point cloud, which a virtual teleoperated robot model is placed in. Operators use their own whole-body gesture to teleoperate the humanoid robot. The Gesture is captured in real time using the depth camera that was placed on operator side. The operator recieves both the visual and the vibrotactile feedback at the same time by using a head mounted display and a vibrotactile glove. All these system components, the human operator, the teleoperated robot and the feedback devices, are connected with the Internet-based virtual collaboration system for a flexible accessibility. This paper showcases the effectiveness of the proposed scheme with experiment that were done to show how the operators can access the remotely placed robot in anytime and place.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Intuitive surgical inc., http://www.intuitivesurgical.com
Ando, N., Suehiro, T., Kitagaki, K., Kotoku, T.: Rt (robot technology)-component and its standardization-towards component based networked robot systems development. In: Proceedings of the SICE-ICASE International Joint Conference, pp. 2633–2638 (2006)
Galambos, P.: Vibrotactile feedback for haptics and telemanipulation: Survey, concept and experiment. Acta Polytechnica Hungarica 9(1), 41–65 (2012) (in print)
Galambos, P., Baranyi, P.: VirCA as virtual intelligent space for RT-Middleware, pp. 140–145 (2011)
Hashimoto, H.: Intelligent space: Interaction and intelligence. Artificial Life and Robotics 7(3), 79–85 (2003)
Hashtrudi-Zaad, K., Salcudean, S.: Analysis of control architectures for teleoperation systems with impedance/admittance master and slave manipulators. The International Journal of Robotics Research 20(6), 419–445 (2001)
Haykin, S.: Active network theory. Addison-Wesley, Reading (1970)
Lee, J., Hashimoto, H.: Intelligent space concept and contents. Advanced Robotics 16(3), 265–280 (2002)
Son, H.I., Bhattacharjee, T., Lee, D.Y.: Control design based on analytical stability criteria for optimized kinesthetic perception in scaled teleoperation. In: Proceedings of the SICE-ICASE International Joint Conference, pp. 3365–3370 (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Song, Y.E., Niitsuma, M., Kubota, T., Hashimoto, H., Son, H.I. (2013). Multimodal Human-Robot Interface with Gesture-Based Virtual Collaboration. In: Kim, JH., Matson, E., Myung, H., Xu, P. (eds) Robot Intelligence Technology and Applications 2012. Advances in Intelligent Systems and Computing, vol 208. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37374-9_10
Download citation
DOI: https://doi.org/10.1007/978-3-642-37374-9_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37373-2
Online ISBN: 978-3-642-37374-9
eBook Packages: EngineeringEngineering (R0)