Re-sampling for Chinese Sign Language Recognition

  • Chunli Wang
  • Xilin Chen
  • Wen Gao
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3881)


In Sign Language recognition, one of the problems is to collect enough data. Data collection for both training and testing is a laborious but necessary step. Almost all of the statistical methods used in Sign Language Recognition suffer from this problem. Inspired by the crossover and mutation of genetic algorithms, this paper presents a method to enlarge Chinese Sign language database through re-sampling from existing sign samples. Two initial samples of the same sign are regarded as parents. They can reproduce their children by crossover. To verify the effectiveness of the proposed method, some experiments are carried out on a vocabulary with 350 static signs. Each sign has 4 samples. Three samples are used to be the original generation. These three original samples and their offspring are used to construct the training set, and the remaining sample is used for testing. The experimental results show that the data generated by the proposed method are effective.


Gesture Recognition Hand Gesture Sign Language Recognition Channel Number Hand Shape 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Starner, T., Weaver, J., Pentland, A.: Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video. IEEE PAMI 20(12), 1371–1375 (1998)CrossRefGoogle Scholar
  2. 2.
    Fels, S.S., Hinton, G.: GloveTalk: A neural network interface between a DataDlove and a speech synthesizer. IEEE Transactions on Neural Networks 4, 2–8 (1993)CrossRefGoogle Scholar
  3. 3.
    Sidney Fels, S.: Glove –TalkII: Mapping hand gestures to speech using neural networks-An approach to building adaptive interfaces. PhD thesis, Computer Science Department, University of Torono (1994)Google Scholar
  4. 4.
    Yanghee Nam, K.Y.W.: Recognition of space-time hand-gestures using hidden Markov model. In: ACM Symposium on Virtual Reality Software and Technology, HongKong, July 1996, pp. 51–58 (1996)Google Scholar
  5. 5.
    Liang, R.-H., Ouhyoung, M.: A real-time continuous gesture recognition system for sign language. In: Proceeding of the Third International Conference on Automatic Face and Gesture Recognition, Nara, Japan, pp. 558–565 (1998)Google Scholar
  6. 6.
    Grobel, K., Assan, M.: Isolated sign language recognition using hidden Markov models. In: Proceedings of the International Conference of System, Man and Cybernetics, pp. 162–167 (1996)Google Scholar
  7. 7.
    Vogler, C., Metaxas, D.: Toward scalability in ASL Recognition: Breaking Down Signs into Phonemes. In: Proceedings of Gesture Workshop, Gif-sur-Yvette, France, pp. 400–404 (1999)Google Scholar
  8. 8.
    Gao, W., Ma, J., Wu, J., Wang, C.: Large Vocabulary Sign Language Recognition Based on HMM/ANN/DP. International Journal of Pattern Recognition and Artificial Intelligence 14(5), 587–602 (2000)CrossRefGoogle Scholar
  9. 9.
    Wang, C., Gao, W., Ma, J.: A Real-time Large Vocabulary Recognition System for Chinese Sign Language. In: Wachsmuth, I., Sowa, T. (eds.) GW 2001. LNCS, vol. 2298, pp. 86–95. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  10. 10.
    Vamplew, P., Adams, A.: Recognition of Sign Language Gestures Using Neural Networks. Australian Journal of Intelligent Information Processing Systems 5(2), 94–102 (Winter 1998)Google Scholar
  11. 11.
    Akyol, S., Canzler, U.: An information terminal using vision based sign language recognition. In: ITEA Workshop on Virtual Home Environments, pp. 61–68 (2002)Google Scholar
  12. 12.
    Chen, J., Chen, X., Gao, W.: Expand Training Set for Face Detection by GA Re-sampling. In: The 6th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2004), Seoul, Korea, May 17-19, pp. 73–79 (2004)Google Scholar
  13. 13.
    Vogler, C., Metaxas, D.: Handshapes and movements: Multiple-channel ASL recognition. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 247–258. Springer, Heidelberg (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Chunli Wang
    • 1
    • 2
  • Xilin Chen
    • 1
  • Wen Gao
    • 1
  1. 1.Institute of Computing TechnologyChinese Academy of ScienceBeijingChina
  2. 2.Department of Computer Science and Engineering, School of Electronic and Information EngineeringDalian University of TechnologyDalianChina

Personalised recommendations