Abstract
The ongoing utilization of computer technologies in all areas of life leads to the development of smart environments comprising numerous networked devices and resources. Interacting in and with such environments requires new interaction paradigms, abstracting from single interaction devices to utilize the environment as interaction space. Using a networked set of interaction resources allows supporting multiple modalities and new interaction techniques, but also requires the consideration of the set of devices and the adaptation to this set at runtime. While the generation of user interfaces based on UI models, although still challenging, has been widely researched, the runtime processing and delivery of the derivable user interfaces has gained less attention. Delivering distributed user interfaces while maintaining their interdependencies and keeping them synchronized is not a trivial problem. In this paper we present an approach to realize a runtime environment, capable of distributing user interfaces to a varying set of devices to support multimodal interaction based on a user interface model and the management of interaction resources.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abowd, G., Coutaz, J., Nigay, L.: Structuring the space of interactive system properties. In: Engineering for Human-Computer Interaction. IFIP Transactions, vol. A-18, pp. 113–129 (1992)
Blumendorf, M., Feuerstack, S., Albayrak, S.: Event-based synchronization of model-based multimodal user interfaces. In: LNCS MoDELS 2006 workshop proceedings: MDDAUI 2006 (2006)
Book, M., Gruhn, V.: Modeling web-based dialog flows for automatic dialog control. In: ASE 2004: Proceedings of the 19th IEEE international conference on Automated software engineering, pp. 100–109 (2004)
Book, M., Gruhn, V., Lehmann, M.: Automatic dialog mask generation for device-independent web applications. In: ICWE 2006: Proceedings of the 6th international conference on Web engineering (2006)
Braun, E., Mühlhauser, M.: Automatically generating user interfaces for device federations. In: ISM 2005: Proceedings of the Seventh IEEE International Symposium on Multimedia (2005)
Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Bouillon, L., Vanderdonckt, J.: A unifying reference framework for multi-target user interfaces. Interacting with Computers 15(3), 289–308 (2003)
Clerckx, T., Vandervelpen, C., Coninx, K.: Task-based design and runtime support for multimodal user interface distribution. In: Proceedings of Engineering Interactive Systems (2007)
Coninx, K., Luyten, K., Vandervelpen, C., Van den Bergh, J., Creemers, B.: Dynamically generating interfaces for mobile computing devices and embedded systems. In: Chittaro, L. (ed.) Mobile HCI 2003. LNCS, vol. 2795, Springer, Heidelberg (2003)
Coomans, M., Timmermans, H.: Towards a taxonomy of virtual reality user interfaces. In: IV 1997: Proceedings of the IEEE Conference on Information Visualisation (1997)
Nigay, L., Coutaz, J., Salber, D.: The msm framework: A design space for multi-sensori-motor systems. In: EMO 2001. LNCS, vol. 753 (1993)
Elting, C., Rapp, S., Möhler, G., Strube, M.: Architecture and implementation of multimodal plug and play. In: ICMI 2003: Proceedings of the 5th international conference on Multimodal interfaces (2003)
Mori, G., Paternò, F., Santoro, C.: Design and development of multidevice user interfaces through multiple logical descriptions. IEEE Trans. Softw. Eng. 30(8), 507–520 (2004)
Paternò, F.: Model-Based Design and Evaluation of Interactive Applications. Applied Computing. Springer, Heidelberg (1999)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Blumendorf, M., Feuerstack, S., Albayrak, S. (2008). Multimodal User Interaction in Smart Environments: Delivering Distributed User Interfaces. In: Mühlhäuser, M., Ferscha, A., Aitenbichler, E. (eds) Constructing Ambient Intelligence. AmI 2007. Communications in Computer and Information Science, vol 11. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85379-4_14
Download citation
DOI: https://doi.org/10.1007/978-3-540-85379-4_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85378-7
Online ISBN: 978-3-540-85379-4
eBook Packages: Computer ScienceComputer Science (R0)