Skip to main content
SpringerLink
Log in

Towards an American Sign Language interface

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

In this paper, we present two major parts of an interface for American Sign Language (ASL) to computer applications currently under work; a hand tracker and an ASL-parser. The hand tracker extracts information about handshape, position and motion from image sequences. As an aid in this process, the signer wears a pair of gloves with colour-coded markers on joints and finger tips. We also present a computational model of American Sign Language. This model is realized in an ASL-parser which consists of a DCG-grammar and a non-lexical component that records non-manual and spatial information over an ASL-discourse.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Charayphan, C. & Marble A. E. (1992). Image Processing System for Interpreting Motion in ASL.Journal of Biomedical Engineering 14(5): 419–425.

    Google Scholar 

  • Darell, T. & Pentland, A. P. (1993). Space-time Gestures. In‘Looking at People: Recognition and Interpretation of Human Action’, Workshop WS26 at the International Joint Conference on Artificial Intelligence (IJCAI-93), Chambery: France.

    Google Scholar 

  • Davis, J. & Shah, M. (1993).Gesture Recognition. Technical Report CS-TR-93-11, University of Central Florida.

  • Dorner, B. (1993). Hand Shape Identification and Tracking for Sign Language Interpretation. In ‘Looking at People: Recognition and Interpretation of Human Action’,Workshop WS26 at the International Joint Conference on Artificial Intelligence (IJCAI-93), Chambery: France.

    Google Scholar 

  • Dorner, B. (1994).Chasing the Colour Glove: Visual Hand Tracking. Master's Thesis, School of Computing Science, Simon Fraser University, Burnaby, Canada.

    Google Scholar 

  • Fels, S. S. (1990).Building Adaptive Interfaces with Neural Networks: The Glove-talk Pilot Study. Technical Report CRG-TR-90-1, University of Toronto, Toronto, Canada.

    Google Scholar 

  • Fisher, S. (1975). Influences on Word Order Change in American Sign Language. In Li, C. N. (ed.)Word Order and Word Order Change, 1–25. University of Texas Press.

  • Friedman, L. A. (1975). Space, Time, and Person Reference in American Sign Language.Language 51(4): 940–961.

    Google Scholar 

  • Friedman, L. A. (1976). The Manifestation of Subject, Object, and Topic in the American Sign Language. In Li, C. N. (ed.)Subject and Topic, 125–148. Academic Press.

  • Hagen, E. & Dahl, V. (1994). On Multiple-Valued Deductive Databases. In Proceedings ofThe 10th Canadian Conference on Artificial Intelligence (AI94), 31–38.

  • Hagen, E. (1993).A Flexible American Sign Language Interface to Deductive Databases. Master's thesis, School of Computer Science, Simon Fraser University, Burnaby, Canada.

    Google Scholar 

  • Isenhath, J. O. (1990).The Linguistics of American Sign Language. McFarland & Company, Inc., Publishers: Jefferson, N.C.

    Google Scholar 

  • Klima, E. S. & Bellugi, U. (1979).The Signs of Language. Harvard University Press: Cambridge, Mass.

    Google Scholar 

  • Lucas, C. (ed.) (1990).Sign Language Research: Theoretical Issues. Gallaudet Press: Washington, D.C.

    Google Scholar 

  • Pentland, A., Starner, T., Etcoff, N., Masiou, A., Oliyide, O. & Turk, M. (1993). Experiments with eigenfaces. In ‘Looking at People: Recognition and Interpretation of Human Action’,Workshop WS26 at the International Joint Conference on Artificial Intelligence (IJCAI-93), Chambery: France.

    Google Scholar 

  • Ralescu, A. & Iwamoto, H. (1993). Reading Faces: A Fuzzy Logic Approach to Representation, Recognition and Description of Facial Expressions. In ‘Looking at People: Recognition and Interpretation of Human Action’,Workshop WS26 at the International Joint Conference on Artificial Intelligence (IJCAI-93), Chambery: France.

    Google Scholar 

  • Tamura, S. & Kawasaki, S. (1988). Recognition of Sign Language Motion Images.Pattern Recognition 21(4): 343–353.

    Google Scholar 

  • Wilbur, R. B. (1987).American Sign Language: Linguistic and Applied dimensions. College Hill Press, A division of Little, Brown and company (Inc.): Boston, second edition.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computing Science, Simon Fraser University, V5A 1S6, Burnaby, B.C., Canada

    Brigitte Dorner & Eli Hagen

Authors
  1. Brigitte Dorner
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eli Hagen
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Dorner, B., Hagen, E. Towards an American Sign Language interface. Artif Intell Rev 8, 235–253 (1994). https://doi.org/10.1007/BF00849076

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00849076

Key words

Search

Navigation