Automatic Recognition of Sign Language Images

  • J. RavikiranEmail author
  • Kavi Mahesh
  • Suhas Mahishi
  • R. Dheeraj
  • S. Sudheender
  • Nitin V. Pujari
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 52)


The objective of the research presented in this chapter is to enable communication between people with hearing impairment and those with visual impairment. Computer recognition of sign language snapshots is one of the most challenging research problems in this area. This chapter presents an efficient and fast algorithm for identification of the number of fingers opened in a gesture representing an alphabet of the American Sign Language. Finger detection is accomplished based on the concept of boundary tracing and finger tip detection. A significant feature of the solution is that it does not require the hand to be perfectly aligned to the camera or use any special markers or input gloves.


Boundary tracing Computer access for disabled Finger detection Image processing Sign language recognition 



The authors would like to acknowledge the contribution of Bharadvaj J., Ganesh S., Ravindra K., Vinod D. towards the development of one part of the solution presented in this chapter.


  1. 1.
    Canny, J. (Nov 1986). A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 8, 679–714.CrossRefGoogle Scholar
  2. 2.
    Shimada, N. et al. (1998). Hand gesture estimation and model refinement using monocular camera – Ambiguity limitation by inequality constraints. In Proceedings of the 3rd Conference on Face and Gesture Recognition, pp. 268–273.Google Scholar
  3. 3.
    Sonka, M., Hlavac, V., & Boyle, R. (1999). Image processing, analysis, and machine vision. Pacific Grove, CA: Brooks/Cole Publishing Company.Google Scholar
  4. 4.
    Starner, T., & Pentland, A. (21–23 Nov 1995) Real-time American sign language recognition from video using hidden Markov models. In Proceedings of International Symposium on Computer Vision, pp. 265–270.Google Scholar
  5. 5.
    Lee, J., & Kunii, T. (Sept 1995) Model-based analysis of hand posture. IEEE Computer Graphics Applications, 15(5), 77–86.CrossRefGoogle Scholar
  6. 6.
    Fillbrandt, H., Akyol, S., & Kraiss, K.F. (Oct 2003). Extraction of 3D hand shape and posture from image sequences for sign language recognition. IEEE International Workshop on Analysis and Modeling of Faces and Gestures, 17, 181–186.Google Scholar
  7. 7.
    Starner, T., Pentland, A., & Weaver, J. (Dec 1998) Real-time American sign language recognition using desk and wearable computer based video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(12), 1371–1375.CrossRefGoogle Scholar
  8. 8.
    Imagawa, K., Lu, S., & Igi, S. (14–16 Apr 1998) Color-based hands tracking system for sign language recognition. In Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 462–467.Google Scholar
  9. 9.
    Teh, C.H., & Chin, R.T. (Jul 1988) On image analysis by the methods of moments. IEEE Transactions on Pattern Analysis and Machine Intelligence, 10(4), 496–513.zbMATHCrossRefGoogle Scholar
  10. 10.
    Kang, S.K., Nam, M.Y., & Rhee, P.K. (Aug 2008) Color based hand and finger detection technology for user interaction. International Conference on Convergence and Hybrid Information Technology.Google Scholar
  11. 11.
    Shirai, Y., Tanibata, N., & Shimada, N. (2002). Extraction of hand features for recognition of sign language words. VI’2002, Computer-Controlled Mechanical Systems. Graduate School of Engineering, Osaka University.Google Scholar
  12. 12.
    Hamada, Y., Shimada, N., & Shirai, Y. (May 2004) Hand shape estimation under complex backgrounds for sign language recognition. In Proceedings of the 6th International Conference on Automatic Face and Gesture Recognition, pp. 589–594.Google Scholar
  13. 13.
    Ravikiran, J., Mahesh, K., Mahishi, S., Dheeraj, R., Sudheender, S., & Pujari, N.V. (2009). Finger detection for sign language recognition, ICCS2009. In Proceedings of the International Conference on Computer Science, International Multi-Conference of Engineers and Computer Scientists – IMECS 2009, March 2009, Hong Kong.Google Scholar

Copyright information

© Springer Science+Business Media B.V. 2009

Authors and Affiliations

  • J. Ravikiran
    • 1
    Email author
  • Kavi Mahesh
    • 1
  • Suhas Mahishi
    • 1
  • R. Dheeraj
    • 1
  • S. Sudheender
    • 1
  • Nitin V. Pujari
    • 1
  1. 1.Department of Computer Science and EngineeringPES Institute of TechnologyBangaloreIndia

Personalised recommendations