The Usability of Hand Pose and Gestures for Spaceflight Training System
Virtual hand pose and gestures for manipulation is one of the hardest interactive problem in Spaceflight Training System. This paper researched the usability of hand pose and gestures, proposed a couple of non-contact action determining rules and an action states transition method based on finite state machine (FSM) to control the manipulation process of virtual hand. Meanwhile, a gesture recognition method based on hand pose data was proposed. The experiment result shows that the proposed method has a high success rate and efficiency for manipulation. It can be used for the way of manipulation in Spaceflight Training System.
KeywordsUsability Hand pose and gestures Spaceflight training system
This work was supported by China Astronaut Research and Training Center within the following research programs: Advanced Space Medico-Engineering Research Project of China (2013SY54A1303, 9140c770204150c77318, 2013SY54B1301, FTKY201302).
- 1.Sen, F., Diaz, L., Horttana, T.: A novel gesture-based interface for a VR simulation: Re-discovering Vrouw Maria. In: 2012 18th International Conference on Virtual Systems and Multimedia (VSMM), pp. 323–330 (2012)Google Scholar
- 2.Sato, Y., Saito, M., Koike, H.: Real-time input of 3D pose and gestures of a user’s hand and its applications for HCI. In: Virtual Reality, 2001. Proceedings, pp. 79–86. IEEE (2003)Google Scholar
- 3.Lee, C.-S., Oh, K.-M., Park, C.-J.: Virtual environment interaction based on gesture recognition and hand cursor. Electron. Resour. (2008)Google Scholar
- 4.Nasser, N.H., Alhaj, M.: Hand gesture interaction with a 3D virtual environment. Res. Bull. Jordan ACM II(III), 186–193 (2011)Google Scholar
- 5.Ming, A., Yuqing, L., Bohe, Z., Fuchao, H.: Study on real-time interactive simulation of rotating top in weightlessness. Manned Spaceflight (2014)Google Scholar
- 6.Chen, Y., Lin, F.: Safety control of discrete event systems using finite state machines with parameters. In: Proceedings of the American Control Conference. Arlington: American Auotmatic Control Council, pp. 975–980 (2001)Google Scholar
- 7.Feng, Z., Yan, B., Xu, T., et al.: 3D direct human-computer interface paradigm based on free hand tracking. Chin. J. Comput. 37(6), 1309–1323 (2014)Google Scholar
- 8.Hu, H., Chao, J.G., Liu, J.G.: Grab simulation based on FSM for astronaut virtual training. In: 3rd International Conference on Mechatronics, Robotics and Automation (ICMRA 2015), pp. 1060–1064 (2015)Google Scholar
- 10.Marin, G., Dominio, F., Zanuttigh, P.: Hand gesture recognition with jointly calibrated Leap Motion and depth sensor. Multimedia Tools Appl., 1–25 (2015)Google Scholar
- 13.Casiez, G., Roussel, N., Vogel, D.: 1€ filter: a simple speed-based low-pass filter for noisy input in interactive systems. In: Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems, pp. 2527–2530 (2012)Google Scholar