Abstract
We present in this paper an approach of hand gesture analysis that aims at recognizing a digit. The analysis is based on extracting a set of features from a hand image and then combining them by using an induction graph. The most important features we extract from each image are the fingers locations, their heights and the distance between each pair of fingers. Our approach consists of three steps: (i) Hand localization, (ii) fingers extraction and (iii) features identification and combination to digit recognition. Each input image is assumed to contain only one hand with black background, thus we apply a classifier based on one skin color to identify the skin pixels. In the finger extraction step, we attempt to remove all the hand components except the fingers, this process is based on the hand anatomy properties. The final step is based on histogram representation of the detected fingers which results in the features identification, which results in the digit recognition. The approach is invariant to scale, rotation and translation of the hand. Some experiments have been undertaken to show the effectivness of the proposed approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baudel, T., Beaudouin-Lafon, M.: Charade: Remote Control of objects using Free-Hand Gestures. Communications of the ACM 36(7), 28–35 (1993)
Bellik, Y.: Modality Integration: Speech and Gesture. Survey of the State of the Art in Human Language Technology, Section 9.4, 307–309 (1996)
Braffort, A.: Reconnaissance et Compréhension de gestes, application à la langue des signes, thèse de l’université de Paris XI, spécialité informatique (1996)
Iwai, Y., Yagi, Y., Yachida, M.: Gesture Recognition using Colored Gloves. In: Proc. of ICPR, pp. 662–666 (1996)
Berard, F., Coutaz, J., Crowley, J.L.: Finger Tracking as Input Device for Augmented Reality. In: Proc. Intel Workshop on Automatic Face and Gesture-Recognition, Zurich, Switzerland (1995)
Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active Shape Models: their Training and Application. Computer Vision and Image Understanding 61(1), 38–59 (1995)
Martin, J., Crowley, J.L.: An Appearance-Based Approach to Gesture-Recognition. In: Proc. of 9th Conf. on Image Analysis and Processing, Italy (1997)
Wagner, C.: The pianist’s hand anthropometry and biomechanics. Ergonomics 31(1), 97–131 (1988)
Wang, H., Chauf, S.F.: An highly efficient system for automatic face region detection in MPEG video. IEEE Trans. on Circuit Systems for video technology 7(4), 615–628 (1997)
Chai, D., Bouzerdoum, A.: A Bayesian Approach to Skin Color Classification in YCbCr Color Space. In: IEEE Region Ten Conference TENCON, vol. 2, pp. 421–424 (2000)
Dipietro, L., Sabatini, A.M., Dario, P.: Evaluation of an Instrumented Glove for Hand-Movement Acquisition. Journal of Rehabilitation Research and Development 40(2), 179–190 (2003)
Quinlan, J.R.: Induction of Decision Trees. Machine Learning, 81–106 (2003)
Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann, San Francisco (1993)
Zighed, D.A., Rakotomalala, R.: Graphes d’Induction - Apprentissage et Data Mining. Hermes (2000)
Rakotomalala, R., Lallich, S.: Handling noise with generalized entropy of type beta in induction graphs algorithm. In: Int. Conf. on Computer Science and Informatics, pp. 25–27 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jmaa, A.B., Mahdi, W., Jemaa, Y.B., Hamadou, A.B. (2009). Hand Localization and Fingers Features Extraction: Application to Digit Recognition in Sign Language. In: Corchado, E., Yin, H. (eds) Intelligent Data Engineering and Automated Learning - IDEAL 2009. IDEAL 2009. Lecture Notes in Computer Science, vol 5788. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04394-9_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-04394-9_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04393-2
Online ISBN: 978-3-642-04394-9
eBook Packages: Computer ScienceComputer Science (R0)