Abstract
This paper introduces a system for gesture based interaction with smart environments. The framework we present connects gesture recognition results with control commands for appliances in a smart home that are accessed through a middleware based on the ISO 24752 standard URC (Universal Remote Console). Gesture recognition is realized by applying three dimensional acceleration sensor information of the WiiMote from Nintendo. This information is trained to a toolkit for gesture recognition that implements machine learning algorithms well known from speech recognition. Our study focuses on two interaction concepts with the aim to exploit the context and special home scenarios. This serves to reduce the number of gestures while in parallel retaining the control complexity on a high level. A user test, also with older persons, compares both concepts and evaluates their efficiency by observing the response times and the subjective impressions of the test persons.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Zimmermann, G., Vanderheiden, G.C.: The universal control hub: An open platform for remote user interfaces in the digital home. In: Jacko, J.A. (ed.) HCI 2007. LNCS, vol. 4551, pp. 1040–1049. Springer, Heidelberg (2007)
Burzagli, L., Emiliani, P., Gabbanini, F.: Ambient intelligence and multimodality. In: Stephanidis, C. (ed.) UAHCI 2007 (Part II). LNCS, vol. 4555, pp. 33–42. Springer, Heidelberg (2007)
Machate, J.: Being natural: On the use of multimodal interaction concepts in smart homes (1999)
Song, W.G., Lim, J.T.: Design and Management in Smart Home. In: Independent Living for Persons with Disabilities and Elderly People, pp. 33–37. IOS Press, Amsterdam (2003)
Rahman, A.M., Hossain, M.A., Parra, J., El Saddik, A.: Motion-path based gesture interaction with smart home services. In: Proceedings of the Seventeen ACM International Conference on Multimedia, MM 2009, pp. 761–764. ACM, New York (2009)
Blumendorf, M., Feuerstack, S., Albayrak, S.: Multimodal smart home user interfaces. In: Mukasa, K., Holzinger, A., Karshmer, A. (eds.) Intelligent User Interfaces for Ambient Assisted Living: Proceedings of the First International Workshop IUI4AAL 2008. IRB Verlag (2008)
Westermann, T.: I’m home: Smartphone-enabled gestural interaction with multi-modal smart-home systems. In: Informatiktage. LNI, vol. S-9, pp. 137–140. GI (2010)
Neßelrath, R., Alexandersson, J.: A 3d gesture recognition system for multimodal dialog systems. In: Proceedings of the 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue Systems. Twenty-First International Joint Conference On Artificial Intelligence (IJCAI 2009), in Conjunction with 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue Systems (KRPD 2009), Pasadena,, California, United States, July 12, pp. 46–51 (2009)
Frey, J., Schulz, C.H., Neßelrath, R., Stein, V., Alexandersson, J.: Towards pluggable user interfaces for people with cognitive disabilities. In: Proceedings of the 3rd International Conference on Health Informatics. HEALTHINF 2010, in Conjunction with Proceedings of the 3rd International Conference on Health Informatics, Valencia, Spain, January 20-23. Springer, Heidelberg (2010)
Neßelrath, R.: TaKG - Ein Toolkit zur automatischen Klassifikation von Gesten. Mastersthesis, DFKI (2008)
ten Holt, G., Reinders, M., Hendriks, E.: Multi-dimensional dynamic time warping for gesture recognition. In: Thirteenth Annual Conference of the Advanced School for Computing and Imaging (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Neßelrath, R., Lu, C., Schulz, C.H., Frey, J., Alexandersson, J. (2011). A Gesture Based System for Context – Sensitive Interaction with Smart Homes. In: Wichert, R., Eberhardt, B. (eds) Ambient Assisted Living. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-18167-2_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-18167-2_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-18166-5
Online ISBN: 978-3-642-18167-2
eBook Packages: EngineeringEngineering (R0)