Skip to main content

Hand Localization and Fingers Features Extraction: Application to Digit Recognition in Sign Language

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNISA,volume 5788)

Abstract

We present in this paper an approach of hand gesture analysis that aims at recognizing a digit. The analysis is based on extracting a set of features from a hand image and then combining them by using an induction graph. The most important features we extract from each image are the fingers locations, their heights and the distance between each pair of fingers. Our approach consists of three steps: (i) Hand localization, (ii) fingers extraction and (iii) features identification and combination to digit recognition. Each input image is assumed to contain only one hand with black background, thus we apply a classifier based on one skin color to identify the skin pixels. In the finger extraction step, we attempt to remove all the hand components except the fingers, this process is based on the hand anatomy properties. The final step is based on histogram representation of the detected fingers which results in the features identification, which results in the digit recognition. The approach is invariant to scale, rotation and translation of the hand. Some experiments have been undertaken to show the effectivness of the proposed approach.

Keywords

  • Sign language
  • keyboard application
  • digits recognition

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-642-04394-9_19
  • Chapter length: 9 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   149.00
Price excludes VAT (USA)
  • ISBN: 978-3-642-04394-9
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   189.00
Price excludes VAT (USA)

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Baudel, T., Beaudouin-Lafon, M.: Charade: Remote Control of objects using Free-Hand Gestures. Communications of the ACM 36(7), 28–35 (1993)

    CrossRef  Google Scholar 

  2. Bellik, Y.: Modality Integration: Speech and Gesture. Survey of the State of the Art in Human Language Technology, Section 9.4, 307–309 (1996)

    Google Scholar 

  3. Braffort, A.: Reconnaissance et Compréhension de gestes, application à la langue des signes, thèse de l’université de Paris XI, spécialité informatique (1996)

    Google Scholar 

  4. Iwai, Y., Yagi, Y., Yachida, M.: Gesture Recognition using Colored Gloves. In: Proc. of ICPR, pp. 662–666 (1996)

    Google Scholar 

  5. Berard, F., Coutaz, J., Crowley, J.L.: Finger Tracking as Input Device for Augmented Reality. In: Proc. Intel Workshop on Automatic Face and Gesture-Recognition, Zurich, Switzerland (1995)

    Google Scholar 

  6. Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active Shape Models: their Training and Application. Computer Vision and Image Understanding 61(1), 38–59 (1995)

    CrossRef  Google Scholar 

  7. Martin, J., Crowley, J.L.: An Appearance-Based Approach to Gesture-Recognition. In: Proc. of 9th Conf. on Image Analysis and Processing, Italy (1997)

    Google Scholar 

  8. Wagner, C.: The pianist’s hand anthropometry and biomechanics. Ergonomics 31(1), 97–131 (1988)

    CrossRef  Google Scholar 

  9. Wang, H., Chauf, S.F.: An highly efficient system for automatic face region detection in MPEG video. IEEE Trans. on Circuit Systems for video technology 7(4), 615–628 (1997)

    CrossRef  Google Scholar 

  10. Chai, D., Bouzerdoum, A.: A Bayesian Approach to Skin Color Classification in YCbCr Color Space. In: IEEE Region Ten Conference TENCON, vol. 2, pp. 421–424 (2000)

    Google Scholar 

  11. Dipietro, L., Sabatini, A.M., Dario, P.: Evaluation of an Instrumented Glove for Hand-Movement Acquisition. Journal of Rehabilitation Research and Development 40(2), 179–190 (2003)

    CrossRef  Google Scholar 

  12. Quinlan, J.R.: Induction of Decision Trees. Machine Learning, 81–106 (2003)

    Google Scholar 

  13. Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann, San Francisco (1993)

    Google Scholar 

  14. Zighed, D.A., Rakotomalala, R.: Graphes d’Induction - Apprentissage et Data Mining. Hermes (2000)

    Google Scholar 

  15. Rakotomalala, R., Lallich, S.: Handling noise with generalized entropy of type beta in induction graphs algorithm. In: Int. Conf. on Computer Science and Informatics, pp. 25–27 (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Jmaa, A.B., Mahdi, W., Jemaa, Y.B., Hamadou, A.B. (2009). Hand Localization and Fingers Features Extraction: Application to Digit Recognition in Sign Language. In: Corchado, E., Yin, H. (eds) Intelligent Data Engineering and Automated Learning - IDEAL 2009. IDEAL 2009. Lecture Notes in Computer Science, vol 5788. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04394-9_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-04394-9_19

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-04393-2

  • Online ISBN: 978-3-642-04394-9

  • eBook Packages: Computer ScienceComputer Science (R0)