Real-Time 3D Motion Capture by Monocular Vision and Virtual Rendering
Avatars in networked 3D virtual environments allow users to interact over the Internet and to get some feeling of virtual telepresence. However, avatar control may be tedious. Motion capture systems based on 3D sensors have recently reached the consumer market, but webcams and camera-phones are more widespread and cheaper. The proposed demonstration aims at animating a user’s avatar from real time 3D motion capture by monoscopic computer vision, thus allowing virtual telepresence to anyone using a personal computer with a webcam or a camera-phone. This kind of immersion allows new gesture-based communication channels to be opened in a virtual inhabited 3D space.
Keywords3D motion capture monocular vision 3D/2D registration particle filtering real-time computer vision
Unable to display preview. Download preview PDF.
- 1.Horain, P., Marques Soares, J., Rai, P.K., Bideau, A.: Virtually enhancing the perception of user actions. In: 15th International Conference on Artificial Reality and Telexistence (ICAT 2005), Christchurch, New Zealand, pp. 245–246 (2005)Google Scholar
- 5.Microsoft: Kinect - xbox.com (2011)Google Scholar
- 7.Gomez Jáuregui, D.A., Horain, P., Rajagopal, M.K., Karri, S.S.K.: Real-time particle filtering with heuristics for 3D motion capture by monocular vision. In: Proceedings of the 2010 IEEE International Workshop on Multimedia Signal Processing (MMSP 2010), Saint-Malo, France, pp. 139–144 (2010)Google Scholar
- 9.Sminchisescu, C., Triggs, B.: Kinematic jump processes for monocular 3D human tracking. In: International Conference on Computer Vision and Pattern Recognition, Madison, WI, pp. 69–76 (2003)Google Scholar
- 10.ISO/IEC 14996-2: Information technology-coding of audio-visual objects-part 2: visual (2001)Google Scholar
- 11.I-Maginer: Open source platform for 3D environments (2010), www.openspace3d.com