GART: The Gesture and Activity Recognition Toolkit
Conference paper
Abstract
The Gesture and Activity Recognition Toolit (GART) is a user interface toolkit designed to enable the development of gesture-based applications. GART provides an abstraction to machine learning algorithms suitable for modeling and recognizing different types of gestures. The toolkit also provides support for the data collection and the training process. In this paper, we present GART and its machine learning abstractions. Furthermore, we detail the components of the toolkit and present two example gesture recognition applications.
Keywords
Gesture recognition user interface toolkitPreview
Unable to display preview. Download preview PDF.
References
- 1.Frank, E., Hall, M.A., Holmes, G., Kirkby, R., Pfahringer, B., Witten, I.H., Trigg, L.: Weka - a machine learning workbench for data mining. In: Maimon, O., Rokach, L. (eds.): The Data Mining and Knowledge Discovery Handbook, pp. 1305–1314. Springer, Heidelberg (2005)CrossRefGoogle Scholar
- 2.Grossman, T., Wigdor, D., Balakrishnan, R.: Multi-finger gestural interaction with 3d volumetric displays. In: UIST 2004. Proceedings of the 17th annual ACM symposium on User interface software and technology, pp. 61–70. ACM Press, New York (2004)CrossRefGoogle Scholar
- 3.Hinckley, K., Pierce, J., Sinclair, M., Horvitz, E.: Sensing techniques for mobile interaction. In: UIST 2000. Proceedings of the 13th annual ACM symposium on User interface software and technology, pp. 91–100. ACM Press, New York (2000)CrossRefGoogle Scholar
- 4.Kristensson, P.O., Zhai, S.: Shark2: a large vocabulary shorthand writing system for pen-based computers. In: UIST 2004. Proceedings of the 17th annual ACM symposium on User interface software and technology, pp. 43–52. ACM Press, New York (2004)CrossRefGoogle Scholar
- 5.Malik, S., Ranjan, A., Balakrishnan, R.: Interacting with large displays from a distance with vision-tracked multi-finger gestural input. In: UIST 2005. Proceedings of the 18th annual ACM symposium on User interface software and technology, pp. 43–52. ACM Press, New York (2005)CrossRefGoogle Scholar
- 6.Starner, T., Weaver, J., Pentland, A.: Real-time American Sign Language recognition using desk and wearable computer-based video. IEEE Transactions Pattern Analysis and Machine Intelligence 20(12) (December 1998)Google Scholar
- 7.Vogler, C., Metaxas, D.: ASL recognition based on a coupling between HMMs and 3D motion analysis. In: ICCV, Bombay (1998)Google Scholar
- 8.Want, R., Schilit, B.N., Adams, N.I., Gold, R., Petersen, K., Goldberg, D., Ellis, J.R., Weiser, M.: An overview of the PARCTAB ubiquitous computing experiment. IEEE Personal Communications 2(6), 28–33 (1995)CrossRefGoogle Scholar
- 9.Westeyn, T., Brashear, H., Atrash, A., Starner, T.: Georgia tech gesture toolkit: supporting experiments in gesture recognition. In: ICMI 2003. Proceedings of the 5th International Conference on Multimodal Interfaces, pp. 85–92. ACM, New York (2003)CrossRefGoogle Scholar
- 10.Westeyn, T., Vadas, K., Bian, X., Starner, T., Abowd, G.D.: Recognizing mimicked autistic self-stimulatory behaviors using hmms. In: ISWC 2005, pp. 164–169. IEEE Computer Society, Washington (2005)Google Scholar
- 11.Wobbrock, J.O., Myers, B.A., Kembel, J.A.: Edgewrite: a stylus-based text entry method designed for high accuracy and stability of motion. In: UIST 2003. Proceedings of the 16th annual ACM symposium on User interface software and technology, pp. 61–70. ACM Press, New York (2003)CrossRefGoogle Scholar
- 12.Wu, M., Balakrishnan, R.: Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. In: UIST 2003. Proceedings of the 16th annual ACM symposium on User interf ce software and technology, pp. 193–202. ACM Press, New York (2003)CrossRefGoogle Scholar
- 13.Young, S., Evermann, G., Gales, M., Hain, T., Kershaw, D., Moore, G., Odell, J., Ollason, D., Povey, D., Valtchev, V., Woodland, P.: The HTK Book (for HTK Version 3.3) Cambridge University Engineering Department (2005)Google Scholar
Copyright information
© Springer-Verlag Berlin Heidelberg 2007