Ambient Intelligence and Multimodality
Ambient Intelligence (AmI) scenarios place strong emphasis on the fact that interaction takes place through natural interfaces, in such a way that people can perceive the presence of smart objects only when needed. As a possible solution to achieving relaxed and enjoyable interaction with the intelligent environments depicted by AmI, the ambient could be equipped with suitably designed multimodal interfaces bringing up the opportunity to communicate using multiple natural interaction modes. This paper discusses challenges to be faced when trying to design multimodal interfaces that allow for natural interaction with systems, with special attention to speech-based interfaces. It describes an application that was built to serve as a test bed and to conduct evaluation sessions in order to ascertain the impact of multimodal natural interfaces on users and to assess their usability and accessibility.
KeywordsUniversal Access Ambient Intelligence Multimodal Interface Smart Object Multimodal Interaction
Unable to display preview. Download preview PDF.
- 1.Carbonell, N.: Multimodal interfaces -A generic design approach. In: Stephanidis, C. (ed.) Universal Access in Health Telematics. LNCS, vol. 3041, pp. 209–223. Springer, Heidelberg (2005)Google Scholar
- 5.Ducatel, K., Bogdanowicz, M., Scapolo, F., Leijten, J., Burgelman, J.C.: Scenarios for ambient intelligence in 2010. Technical report, Information Society Technologies Programme of the European Union Commission (IST) ((February 2001)Google Scholar
- 6.Fan, Y., Saliba, A., Kendall, E.A., Newmarch, J.: Speech interface: An enhancer to the acceptance of m-commerce applications. In: ICMB ’05: Proceedings of the International Conference on Mobile Business (ICM 2005), pp. 445–451. IEEE Computer Society Press, Los Alamitos (2005)Google Scholar
- 7.Harris, R.A.: Voice Interaction Design: Crafting the New Conversational Speech Systems. Morgan Kaufmann, San Francisco (2005)Google Scholar
- 9.Oviatt, S.: Multimodal interfaces. In: Jacko, J., Sears, A. (eds.) Handbook of Human-Computer Interaction, pp. 286–304. Lawrence Erlbaum, New Jersey (2003)Google Scholar
- 11.Richter, K., Hellenschmidt, M.: Position paper: Interacting with the ambience: Multimodal interaction and ambient intelligence. In: W3C Workshop on Multi-modal Interaction, 19./20.07.2004, Sophia Antipolis, France (2004)Google Scholar
- 14.Wilpon, J.G., Jacobsen, C.N.: A study of speech recognition for children and the elderly. In: Acoustics, Speech, and Signal Processing, ICASSP-1996. Conference Proceedings, May 7-10, 1996, vol. 1, pp. 349–352 (1996)Google Scholar
- 15.Yankelovich, N., Levow, G.A., Marx, M.: Designing SpeechActs: issues in speech user interfaces. In: CHI 1995: Proceedings of the SIGCHI conference on Human factors in computing systems, New York, ACM Press/Addison-Wesley Publishing Co, pp. 369–376 ( 1995)Google Scholar