Towards a Hand-Based Gestural Language for Smart-Home Control Using Hand Shapes and Dynamic Hand Movements
The application of gestural application can vary a lot: from a simple pointing mechanism to a visual sign language. Application of gestural interaction as a sign language with a proper formalism to interact with the technology has not been studied much. In this work, we present our Kinect-based gesture recognition system that is able to recognize personalized hand shapes and dynamic hand movements. We then describe how we created a “language” for smart-home control based on a specific syntax over sequences of hand shapes and hand movements.
KeywordsGestural interaction sign language smart home control
Unable to display preview. Download preview PDF.
- 1.McNeill, D.: Hand and mind: What gestures reveal about thought. University of Chicago Press (1992)Google Scholar
- 2.Liddell, S.K.: Grammar, gesture, and meaning in American Sign Language. Cambridge University Press (2003)Google Scholar
- 5.Epps, J., Lichman, S., Wu, M.: A study of hand shape use in tabletop gesture interaction. In: CHI 2006 Extended Abstracts on Human Factors in Computing Systems, pp. 748–753. ACM (2006)Google Scholar
- 6.Deutscher, G.: The unfolding of language. Random House (2010)Google Scholar