Efficient Generation of Large Amounts of Training Data for Sign Language Recognition: A Semi-automatic Tool

  • Ruiduo Yang
  • Sudeep Sarkar
  • Barbara Loeding
  • Arthur Karshmer
Conference paper

DOI: 10.1007/11788713_94

Part of the Lecture Notes in Computer Science book series (LNCS, volume 4061)
Cite this paper as:
Yang R., Sarkar S., Loeding B., Karshmer A. (2006) Efficient Generation of Large Amounts of Training Data for Sign Language Recognition: A Semi-automatic Tool. In: Miesenberger K., Klaus J., Zagler W.L., Karshmer A.I. (eds) Computers Helping People with Special Needs. ICCHP 2006. Lecture Notes in Computer Science, vol 4061. Springer, Berlin, Heidelberg

Abstract

We have developed a video hand segmentation tool which can help with generating hands ground truth from sign language image sequences. This tool may greatly facilitate research in the area of sign language recognition. In this tool, we offer a semi automatic scheme to assist with the localization of hand pixels, which is important for the purpose of recognition. A candidate hand generator is applied by using the mean shift image segmentation algorithm and a greedy seeds growing algorithm. After a number of hand candidates is generated, the user can reduce the candidates by simple mouse clicks. The tool also provides a hand tracking function for faster processing and a face detection function for groundtruthing non manual signals. In addition, we provided a two-passes groundtruthing scheme unlike other tools that only does one-pass. Our first pass processing is automatic and does not need user interaction. The experiment results demonstrate that based on the first pass’s result, one can groundtruth 10,000+ frames of sign language within 8 hours.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Ruiduo Yang
    • 1
  • Sudeep Sarkar
    • 1
  • Barbara Loeding
    • 2
  • Arthur Karshmer
    • 2
  1. 1.University of South FloridaTampaUSA
  2. 2.University of South FloridaLakelandUSA

Personalised recommendations