Abstract
We present a gesture recognition system for recognizing hand movements in near realtime. The system uses a infra-red time-of-flight range camera with up to 30 Hz framerate to measure 3d-surface points captured from the hand of the user. The measured data is transformed into a cloud of 3d-points after depth keying and suppression of camera noise by median filtering. Principle component analysis (PCA) is used to obtain a first crude estimate on the location and orientation of the hand. An articulated hand model is fitted to the data to refine the first estimate. The unoptimized system is able to estimate the first 7 Degrees of Freedom of the hand within 200 ms. The reconstructed hand is visualized in AVANGO/Performer and can be utilized to implement a natural man-machine interface. The work reviews relevant publications, underlines the advantages and shortcomings of the approach and provides an outlook on future improvements.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hall-Holt, O., Rusinkiewicz, S.: Stripe boundary codes for real-time structured-light range scanning of moving objects. In: Eighth International Conference on Computer Vision (ICCV) (2001)
Ypsilos, I.A., Hilton, A., Rowe, S.: Video-rate capture of dynamic face shape and appearance. In: FGR, p. 117 (2004)
Malassiotis, S., et al.: A face and gesture recognition system based on an active stereo sensor. In: Proceedings 2001 ICIP, vol. 3, Thessaloniki, Greece, 7-10 Oct., 2001, pp. 955–958 (2001)
Bray, M., Koller-Meier, E., van Gool, L.: Smart particle filtering for 3d hand tracking. In: Proceedings FGR2004, Seoul, South Korea, 7-19 May, 2004, pp. 675–680. IEEE Computer Society Press, Los Alamitos (2004)
Perrin, S., Cassinelli, A., Ishikawa, M.: Gesture recognition using laser-based tracking system. In: Proceedings FGR2004, Seoul, South Korea, 17-19 May, 2004, pp. 541–546. IEEE Computer Society Press, Los Alamitos (2004)
Liu, X., Fujimura, K.: Hand gesture recognition using depth data. In: Proceedings FGR2004, Seoul, South Korea, 17-19 May, 2004, pp. 529–534. IEEE Computer Society Press, Los Alamitos (2004)
Computer graphik. Universität Bonn (2005), http://cg.cs.uni-bonn.de/
Bendels, G.H., Kahlesz, F., Klein, R.: Towards the next generation of 3d content creation. In: Proceedings AVI ’04, pp. 283–289 (2004)
Albrecht, I., Haber, J., Seidel, H.-P.: Construction and animation of anatomically based human hand models. In: SCA ’03: Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer animation, pp. 98–109. ACM Press, New York (2003)
Swiss center for electronics and microtechnology (2005), http://www.csem.ch/
Swissranger sr-2 miniature time of flight camera (2005), http://www.swissranger.ch/
CSEM: Swiss ranger sr-2 datasheet (2005), http://www.swissranger.ch/pdf/SR-2_DataSheet.pdf
Oggier, T., et al.: An all-solid-state optical range camera for 3d real-time imaging with sub-centimeter depth resolution (swissranger). In: SPIE, conference on optical system design, St. Etienne (September 2003)
Oggier, T., et al.: Swissranger sr3000 and first experiences based on miniaturized 3d-tof cameras. In: Proceedings, 1st Range Imaging Research Day, ETH Zurich Switzerland, September 8-9, 2005, pp. 97–108 (2005)
Kahlmann, T., Ingensand, H.: Calibration and improvements of the high-resolution range-imaging camera swissranger. In: Videometrics VIII, San Jose, California, USA, 16-20 January, 2005. Proceedings of SPIE, vol. 5665 (2005)
Kahlmann, T., Ingensand, H.: Range imaging sensor properties and calibration. In: Proceedings, 1st Range Imaging Research Day, ETH Zurich Switzerland, September 8-9, 2005, pp. 71–80 (2005)
Gut, O.: Untersuchungen des 3d-sensors swissranger. Master’s thesis, ETH Zürich (2004)
Dreiseitl, S.: Skriptum zu mat3 ws2004/05 (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Breuer, P., Eckes, C., Müller, S. (2007). Hand Gesture Recognition with a Novel IR Time-of-Flight Range Camera–A Pilot Study. In: Gagalowicz, A., Philips, W. (eds) Computer Vision/Computer Graphics Collaboration Techniques. MIRAGE 2007. Lecture Notes in Computer Science, vol 4418. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-71457-6_23
Download citation
DOI: https://doi.org/10.1007/978-3-540-71457-6_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-71456-9
Online ISBN: 978-3-540-71457-6
eBook Packages: Computer ScienceComputer Science (R0)