Abstract
Our paper proposes a vision-based hand gesture recognition system. It is implemented in a camera-projector system to achieve an augmented reality tool. In this configuration the main problem is that the hand surface reflects the projected background, thus we apply a robust hand segmentation method. Hand localizing is based on a background subtraction method, which adapts to the changes of the projected background. Hand poses are described by a method based on modified Fourier descriptors, which involves distance metric for the nearest neighbor classification. The proposed classification method is compared to other feature extraction methods. We also conducted tests on several users. Finally, the recognition efficiency is improved by the recognition probabilities of the consecutive detected gestures by maximum likelihood approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Streitz, N.A., Geissler, J., Haake, J.M., Hoi, I.: DOLPHIN: Integrated Meeting Support across Liveboards, Local and Remote Desktop Environments. In: Proceeding of the ACM CSCW, pp. 345–358 (1994)
Fraser, Q.S., Robinson, P.: BrightBoard: A Video-Augmented Environment. In: Proceedings of CHT 1996, Vancouver, pp. 134–141 (1996)
Wellner, P.: Interacting with Paper on the DigitalDesk. Communications of the ACM (1993)
Hardenberg, C., Berard, F.: Bare-Hand Human Computer Interaction. In: Proc. of ACM PUI, Orlando (2001)
Hall, D., Gal, C., Martin, J., Chomat, O., Crowley, J.L.: MagicBoard: A contribution to an intelligent office environment. Robotics and Autonomous Systems 35, 211–220 (2001)
Leubner, C., Brockmann, C., Miiller, H.: Computer-vision-based Human Computer Interaction with a Back Projection Wall Using Arm Gestures. In: 27th Euromicro Conference (2001)
Pratt, W.K.: Digital Image Processing. Wiley Interscience, New York (2001)
Stoning, M., Andersen, H.J., Granum, E.: Skin colour detection under changing lighting conditions. In: 7th Symposium on Intelligent Robotics Systems, Coimbra Portugal, pp. 20–23
Imagawa, K., Taniguchi, R., Arita, D., Matsuo, H., Lu, S., Igi, S.: Appearance-based Recognition of Hand Shapes for Sign Language in Low Resolution Image. In: Proceeding of 4th ACCV, pp. 943–948 (2000)
Koh, E.S.: Pose Recognition System. BE Thesis. National University of Singapore (1996)
Rui, Y., She, A., Huang, T.S.: A Modified Fourier Descriptor for Shape Matching in MARS. In: Image Databases and Multimedia Search, pp. 165–180 (1998)
Ng, C.W., Ranganath, S.: Real-time gesture recognition system and application. Image and Vision Computing 20, 993–1007 (2002)
Chen, F.S., Fu, C., Huang, C.L.: Hand Gesture Recognition Using a Real-Time Tracking Method and Hidden Markov Models. Image and Vision Computing 21, 745–758 (2003)
Zhang, D., Lu, G.: A Comparative Study of Fourier Descriptors for Shape representation and Retrieval. In: ACCV 2002, Melbourne Australia (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Licsár, A., Szirányi, T. (2004). Hand Gesture Recognition in Camera-Projector System*. In: Sebe, N., Lew, M., Huang, T.S. (eds) Computer Vision in Human-Computer Interaction. CVHCI 2004. Lecture Notes in Computer Science, vol 3058. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24837-8_9
Download citation
DOI: https://doi.org/10.1007/978-3-540-24837-8_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22012-1
Online ISBN: 978-3-540-24837-8
eBook Packages: Springer Book Archive