Real Time Isolated Turkish Sign Language Recognition from Video Using Hidden Markov Models with Global Features

  • Hakan Haberdar
  • Songül Albayrak
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3733)


This paper introduces a video based system that recognizes gestures of Turkish Sign Language (TSL). Hidden Markov Models (HMMs) have been applied to design a sign language recognizer because of the fact that HMMs seem ideal technology for gesture recognition due to its ability of handling dynamic motion. It is seen that sampling only four key-frames is enough to detect the gesture. Concentrating only on the global features of the generated signs, the system achieves a word accuracy of 95.7%.


Hide Markov Model Global Feature Gesture Recognition Sign Language Recognition American Sign 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Grobel, K., Assan, M.: Isolated Sign Language Recognition using Hidden Markov Models. In: International Conference on Computational Cybernetics and Simulation, vol. 4, pp. 3081–3084. IEEE, Los Alamitos (1997)Google Scholar
  2. 2.
    Imagawa, K., Matsuo, H., Taniguchi, R., Arita, D., Lu, S., Ilgi, S.: Recognition of Local Features from Camera-based Sign Language Recognition System. In: Proceedings of the 15th International Conference on Pattern Recognition, vol. 4, pp. 849–853 (2000)Google Scholar
  3. 3.
    Hai, W., Sutherland, A.: Irish Sign Language Recognition Using PCA, Multi-scale Theory, and Discrete Hidden Markov Models. In: Proceedings of the Irish Machine Vision Conference, pp. 66–73 (2004)Google Scholar
  4. 4.
    Özyürek, A., İlkbaşaran, D., Arık, E.: Turkish Sign Language Gestures. Koç University (2005),
  5. 5.
    Hsu, R.L., Abdel-Mottaleb, M., Jain, A.K.: Face Detection in Color Images. IEEE Trans. on Pattern Analysis and Machine Intelligence 2(5), 696–706 (2002)Google Scholar
  6. 6.
    Starner, T., Pentland, A.: Real-Time American Sign Language Recognition from Video Using HMMs. Technical Report No 375. MIT Cambridge, Media Laboratory (1995)Google Scholar
  7. 7.
    Takahashi, T., Kishino, F.: Hand Gesture Coding Based on Experiments Using a Hand Gesture Interface Device. SIGCHI Bulletin 23(2), 67–73 (1991)CrossRefGoogle Scholar
  8. 8.
    Liang, H., Ouhyoung, M.: A Sign Language Recognition System Using HMM and Context Sensitive Search. ACM VRST (1996)Google Scholar
  9. 9.
    Yoshino, K., Kawashima, T., Aoki, Y.: Recognition of Japanese Sign Language from Image Sequence Using Color Combination. In: Proceedings of the International Conference on Image Processing, vol. 3, pp. 511–514 (1996)Google Scholar
  10. 10.
    Gonzales, R.C., Woods, R.E.: Digital Image Processing. Addison-Wesley, Reading (1993)Google Scholar
  11. 11.
    Alpaydın, E.: Introduction to Machine Learning, pp. 305–326. The MIT Press, Cambridge (2004)Google Scholar
  12. 12.
    Young, S.: The Hidden Markov Model Toolkit Book Version 3.2.1. Cambridge University Eng. Dept. Speech Group and Entropic Research Lab. Inc., Washington DC (2002)Google Scholar
  13. 13.
    Yamato, J., Ohta, J., Ishii, K.: Recognition Human Action in Time-Sequential Images Using HMM. In: Proceedings of the Conference on Computer Vision and Pattern Recognition, pp. 379–385. IEEE, Los Alamitos (1992)CrossRefGoogle Scholar
  14. 14.
    Turkish Sign Language Manual for Adults. Turkish Ministry of Education, Ankara (1995)Google Scholar
  15. 15.
    Erhardt-Ferron, A.: Theory and Applications of Digital Image Processing. University of Applied Sciences Offenburg (2000)Google Scholar
  16. 16.
    Russ, J.C.: The Image Processing Handbook, 3rd edn. CRC Press LLC, Boca Raton (1999)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Hakan Haberdar
    • 1
  • Songül Albayrak
    • 1
  1. 1.Department of Computer EngineeringYildiz Technical UniversityIstanbulTurkey

Personalised recommendations