Multimodal Gumdo Game: The Whole Body Interaction with an Intelligent Cyber Fencer
This paper presents an immersive multimodal Gumdo simulation game that allows a user to experience the whole body interaction with an intelligent cyber fencer. The proposed system consists of three modules: (i) a nondistracting multimodal interface with 3D vision and speech (ii) an intelligent cyber fencer and (iii) an immersive feedback by a big screen and sound. Firstly, the multimodal interface allows a user to move around and to shout without distracting the user. Secondly, an intelligent cyber fencer provides the user with intelligent interactions by perception and reaction modules that are created by the analysis of real Gumdo game. Finally, an immersive audio-visual feedback helps a user experience an immersive interaction. The proposed interactive system with an intelligent fencer is designed to satisfy comfortable interface, perceptual intelligence, and natural interaction (I-cubed) and enhance the life-like impression of fighting actions. The suggested system can be applied to various applications such as education, art, and exercise.
Unable to display preview. Download preview PDF.
- 1.W. Woo, N. Kim, K. Wong and M. Tadenuma, “ Sketch on Dynamic Gesture Tracking and Analysis Exploiting Vision-based 3D Interface,” in Proc. SPIE PW-EI-VCIP’01, vol. 4310, pp. 656–666, Jan. 2001.Google Scholar
- 4.Maes P., T. Darrell, B. Blumberg, A. Pentland, 1995. The ALIVE System: Full-body Interaction with Autonomous Agents. In Proc. Computer Animation’95, pp 11–18, 1995.Google Scholar
- 6.Gavrila, L.S. Davis, 1996. 3D Model-Based Tracking of Humans in Action: A Multi-View Approach. Proc. of IEEE Conf. on CVPR, pp 73–80, June 1996Google Scholar
- 7.W. Woo and Y. Iwadate, “Object-oriented hybrid segmentation using stereo images,” in Proc. SPIE VCIP, pp. 487–495, Jan. 2000.Google Scholar
- 9.Shuzo Saito, “ Fundamentals of Speech Signal Processing”, Academic Press, 1985Google Scholar
- 10.S-Y Yoon, R. C. Burke, B. M. Blumberg, G. E. Schneider, “Interactive Training for Synthetic Characters”, AAAI 2000.Google Scholar