Abstract
A Human-Computer Interaction (HCI) system has been developed with an Artificial Neural Network (ANN) using a motion tracker and a data glove. The HCI system is able to recognize American Sign Language letter and number gestures. The finger joint angle data obtained from the strain gauges in the sensory glove define the hand shape while the data from the motion tracker describe the hand position and orientation. The data flow from the sensory glove is controlled by a software trigger using the data from the motion tracker during signing. Then, the glove data is processed by a recognition neural network.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Sturman, D.J., Zelter, D.: A Survey of Glove-Based Input. IEEE Computer and Applications, 30–39 (1994)
Wysoski, S.G., Lamar, M.V., Kuroyanagi, S., Iwata, A.: A Rotation Invariant Approach on Static Gesture Recognition Using Boundary Histograms and Neural networks. In: Proceeding of the 9th International Conference on Neural Information Processing (ICONIP 2002), vol. 4, pp. 2137–2141 (2002)
Vogler, C., Metaxas, D.: ASL Recognition Based on a Coupling Between HMMs and 3D Motion Analysis. In: Proceedings of the sixth IEEE International Computer Vision Conference, January 1998, pp. 363–369 (1998)
Lalit, G., Suei, M.: Gesture-Based Interaction and Communication: Automated Classification of Hand Gesture Contours. IEEE Transactions on Systems, Man, and Cybernetics, Part c: Application and Reviews 31(1), 114–120 (2001)
Cui, Y., Weng, J.: A Learning-Based Prediction and Verification Segmentation Scheme for Hand Sign Image Sequence. IEEE Transactions on Pattern Analysis and Machine Intelligence 21(8), 798–804 (1999)
Vogler, C., Metaxas, D.: Parallel Hidden Markov Models for American Sign Language Recognition. In: IEEE Proceeding of International Computer Vision Conference, pp. 116–122 (1999)
Lee, L.K., Kim, S., Choi, Y.K., Lee, M.H.: Recognition of Hand Gesture to Human-Computer Interaction. In: IECON 2000, 26th Annual Confjerence of the IEEE 2000, pp. 2177–2122 (2000)
Koker, R., Oz, C., Ferikoglu, A.: Object Recognition Based on Moment Invariants Using Artificial Neural Networks. In: Proceedings International Symposium on Intelligent Manufacturing Systems, August 30-31 (2001)
Oz, C., Sarawate, N.N., Leu, M.C.: American Sign Language Word Recognition with a Sensory Glove Using Artificial Neural Networks. In: Proceedings of ANNIE Conference, St. Louis, MO, November 7-10 (2004); also Book on Intelligent Engineering Systems through Artificial Neural Networks, vol. 14, pp. 633–638 (2004) ISBN 0-7918-0228-0
Oz, C., Leu, M.: Recognition of Finger Spelling of American Sign Language with ANN Using Position/Orientation Sensors and Data Glove. In: Wang, J., Liao, X.-F., Yi, Z. (eds.) ISNN 2005. LNCS, vol. 3497, pp. 157–164. Springer, Heidelberg (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Oz, C., Leu, M.C. (2005). Human-Computer Interaction System with Artificial Neural Network Using Motion Tracker and Data Glove. In: Pal, S.K., Bandyopadhyay, S., Biswas, S. (eds) Pattern Recognition and Machine Intelligence. PReMI 2005. Lecture Notes in Computer Science, vol 3776. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11590316_40
Download citation
DOI: https://doi.org/10.1007/11590316_40
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30506-4
Online ISBN: 978-3-540-32420-1
eBook Packages: Computer ScienceComputer Science (R0)