Abstract
With the rise of technology in all areas of life new interaction techniques are required. With gestures and voice being the most natural ways to interact, it is a goal to also support this in human-computer interaction. In this paper, we introduce our approach to multimodal interaction in smart home environments and illustrate how device independent gesture recognition can be of great support in this area. We describe a trajectory-based approach that is applied to support device independent dynamic hand gesture recognition from vision systems, accelerometers or pen devices. The recorded data from the different devices is transformed to a common basis (2D-space) and the feature extraction and recognition is done on this basis. In a comprehensive case study we show the feasibility of the recognition and the integration with a multimodal and adaptive home operating system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Blake, A., Isard, M.: Active Contours: The Application of Techniques from Graphics, Vision, Control Theory and Statistics to Visual Tracking of Shapes in Motion. Springer, New York (1998)
Bradski, G.R.: Computer Vision Face Tracking for Use in a Perceptual User Interface (1998)
Eisenstein, J., Ghandeharizadeh, S., Golubchik, L., Shahabi, C., Yan, D., Zimmermann, R.: Device Independence and Extensibility in Gesture Recognition. In: Proceedings of the IEEE Virtual Reality 2003 (2003)
Dryden, I.L., Mardia, K.V.: Statistical Shape Analysis. Wiley, Chichester (1998)
Keir, P., Payne, J., Anderson, P., Elgoyhen, J., Horner, M., Naef, M.: Gesture Recognition with Non-referenced Tracking. In: Proceedings of the 3D User Interfaces, pp. 151–158 (2006)
Kendall, D.G.: A Survey of the Statistical Theory of Shape. Statistical Science 4, 87–99 (1989)
Kendall, D.G.: Shape Manifolds, Procrustean Metrics and Complex Projective Spaces. Bulletin of the London Mathematical Society, 81–121 (1984)
Lyons, K., Brashear, H., Westeyn, T., Kim, J.S., Starner, T.: GART: The Gesture and Activity Recognition Toolkit. In: Jacko, J.A. (ed.) HCI 2007. LNCS, vol. 4552, pp. 718–727. Springer, Heidelberg (2007)
Maynard, P.: Drawing Distinctions: The Varieties of Graphic Expression. Cornell University Press (2005)
Olivrin, G.J.: Gesture Modelling for Linguistic Purposes, pp. 145–150 (2009)
Parvini, F., Shahabi, C.: An Algorithmic Approach for Static and Dynamic Gesture Recognition Utilising Mechanical and Biomechanical Characteristics. Int. J. Bioinformatics Res. Appl. 3, 4–23 (2007)
Signer, B., Kurmann, U., Norrie, M.C.: igesture: A General Gesture Recognition Framework. In: Proceedings of the Ninth International Conference on Document Analysis and Recognition, vol. 2, pp. 954–958 (2007)
Titterton, D.H., Weston, J.L.: Strapdown Inertial Navigation Technology, 2nd edn. Institution of Engineering and Technology (2004)
Wang, J., Zhai, S., Canny, J.: Camera Phone based Motion Sensing: Interaction Techniques, Applications and Performance Study. In: Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology, pp. 101–110 (2006)
Welch, G., Bishop, G.: An Introduction to the Kalman Filter. Technical report (2006)
Weingarten, F., Blumendorf, M., Albayrak, S.: Conveying Multimodal Interaction Possibilities through the use of Appearances. In: Creative Inventions and Innovations for Everyday HCI, Edinburgh (2010)
Wilhelm, M., Blumendorf, M., Roscher, D., Albayrak, D.: A Novel Approach for Device Independent Gesture Recognition. In: Haptic Audio Interaction Design (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wilhelm, M., Roscher, D., Blumendorf, M., Albayrak, S. (2010). A Trajectory-Based Approach for Device Independent Gesture Recognition in Multimodal User Interfaces. In: Nordahl, R., Serafin, S., Fontana, F., Brewster, S. (eds) Haptic and Audio Interaction Design. HAID 2010. Lecture Notes in Computer Science, vol 6306. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15841-4_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-15841-4_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15840-7
Online ISBN: 978-3-642-15841-4
eBook Packages: Computer ScienceComputer Science (R0)