A Linguistic Feature Vector for the Visual Interpretation of Sign Language
This paper presents a novel approach to sign language recognition that provides extremely high classification rates on minimal training data. Key to this approach is a 2 stage classification procedure where an initial classification stage extracts a high level description of hand shape and motion. This high level description is based upon sign linguistics and describes actions at a conceptual level easily understood by humans. Moreover, such a description broadly generalises temporal activities naturally overcoming variability of people and environments. A second stage of classification is then used to model the temporal transitions of individual signs using a classifier bank of Markov chains combined with Independent Component Analysis. We demonstrate classification rates as high as 97.67% for a lexicon of 43 words using only single instance training outperforming previous approaches where thousands of training examples are required.
Unable to display preview. Download preview PDF.
- 2.D.B. (ed.): Dictionary of British Sign Language. British Deaf Association, Faber and Faber (1992) ISBN: 0571143466Google Scholar
- 4.Kadous, M.W.: Machine recognition of auslan signs using powergloves: towards large lexicon recognition of sign language. In: Proc. Workshop on the Integration of Gesture in Language and Speech, pp. 165–174 (1996)Google Scholar
- 6.Liang, R., Ouhyoung, M.: A real time continuous gesture recognition system for sign language. In: Intl. Conf. on Automatic Face and Gesture Recognition, pp. 558–565 (1998)Google Scholar
- 7.Lockton, R., Fitzgibbon, A.W.: Real-time gesture recognition using deterministic boosting. In: Proc. British Machine Vision Conf. (2002)Google Scholar
- 8.Starner, T., Pentland, A.: Visual recognition of american sign language using hidden markov models. In: Intl. Conf. on Automatic Face and Gesture Recognition, pp. 189–194 (1995)Google Scholar
- 9.Stenger, B., Thayananthan, A., Torr, P., Cipolla, R.: Filtering using a tree-based estimator. In: Proc. Intl. Conf. on Computer Vision, vol. II, pp. 1063–1070 (2003)Google Scholar
- 10.Sutton-Spence, R., Woll, B.: The Linguistics of British Sign Language, An Introduction. Cambridge University Press, Cambridge (1999)Google Scholar
- 11.Vogler, C., Metaxas, D.: Asl recognition based on a coupling between hmms and 3d motion analysis. In: Proc. Intl. Conf. on Computer Vision, pp. 363–369 (1998)Google Scholar
- 12.Vogler, C., Metaxas, D.: Towards scalability in asl recognition: Breaking down signs into phonemes. In: Gesture Workshop, pp. 17–99 (1999)Google Scholar