3D Gesture Touchless Control Based on Real-Time Stereo Matching
In this demonstration a real-time three-dimension gesture control system is reported. It consists with an FPGA board for the depth extraction from stereo camera and a PC with gesture recognition software followed by user interface examples. Application of this technology includes TV remote control, vendor machine interface, or other outdoor touchless control, etc. With optimization on both chip-area and operating clock rate, the stereo matching in FPGA yields a frame rate up to 60 FPS at a resolution of Full HD 1080i. Thus, the system makes the real-time gesture control practical.
KeywordsGesture Recognition Stereo Match Stereo Camera Brush Stroke FPGA Board
- 1.Motion sensing technology, http://www.pickar.caltech.edu/e103/
- 2.Hartfiel, A., Tung, J., Fakih, A., Hoey, J., Poupart, P.: 3D Pose tracking of walker users’ lower limb with a structured-light camera on a moving platform. In: 24th IEEE Computer Vision and Pattern Recognition Workshops, Colorado Springs, pp. 29–36 (2011)Google Scholar
- 3.Yi, G.Y., Yeh, H.C., Vanmeerbeeck, G., Zhang, K., Lafruit, G.: Real-time depth extraction and viewpoint interpolation on FPGA. In: 5th ACM/IEEE International Conference on Distributed Smart Cameras, Ghent, pp. 264–267 (2011)Google Scholar