Ambient Intelligence and Multimodality

  • Laura Burzagli
  • Pier Luigi Emiliani
  • Francesco Gabbanini
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4555)


Ambient Intelligence (AmI) scenarios place strong emphasis on the fact that interaction takes place through natural interfaces, in such a way that people can perceive the presence of smart objects only when needed. As a possible solution to achieving relaxed and enjoyable interaction with the intelligent environments depicted by AmI, the ambient could be equipped with suitably designed multimodal interfaces bringing up the opportunity to communicate using multiple natural interaction modes. This paper discusses challenges to be faced when trying to design multimodal interfaces that allow for natural interaction with systems, with special attention to speech-based interfaces. It describes an application that was built to serve as a test bed and to conduct evaluation sessions in order to ascertain the impact of multimodal natural interfaces on users and to assess their usability and accessibility.


Universal Access Ambient Intelligence Multimodal Interface Smart Object Multimodal Interaction 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Carbonell, N.: Multimodal interfaces -A generic design approach. In: Stephanidis, C. (ed.) Universal Access in Health Telematics. LNCS, vol. 3041, pp. 209–223. Springer, Heidelberg (2005)Google Scholar
  2. 2.
    Carbonell, N.: Ambient multimodality: towards advancing computer accessibility and assisted living. Universal Access in the Information Society 5(1), 96–104 (2006)CrossRefGoogle Scholar
  3. 3.
    Coutaz, J., Crowley, J.L., Dobson, S., Garlan, D.: Context is key. Commun. ACM 48(3), 49–53 (2005)CrossRefGoogle Scholar
  4. 4.
    Crowley, J.L., Coutaz, J., Rey, G., Reignier, P.: Perceptual components for context aware computing. In: UbiComp 2002: Proceedings of the 4th international conference on Ubiquitous Computing, London, UK, pp. 117–134. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  5. 5.
    Ducatel, K., Bogdanowicz, M., Scapolo, F., Leijten, J., Burgelman, J.C.: Scenarios for ambient intelligence in 2010. Technical report, Information Society Technologies Programme of the European Union Commission (IST) ((February 2001)Google Scholar
  6. 6.
    Fan, Y., Saliba, A., Kendall, E.A., Newmarch, J.: Speech interface: An enhancer to the acceptance of m-commerce applications. In: ICMB ’05: Proceedings of the International Conference on Mobile Business (ICM 2005), pp. 445–451. IEEE Computer Society Press, Los Alamitos (2005)Google Scholar
  7. 7.
    Harris, R.A.: Voice Interaction Design: Crafting the New Conversational Speech Systems. Morgan Kaufmann, San Francisco (2005)Google Scholar
  8. 8.
    Maybury, M.T.: Universal multimedia information access. Universal Access in the Information Society 2(2), 96–104 (2003)CrossRefGoogle Scholar
  9. 9.
    Oviatt, S.: Multimodal interfaces. In: Jacko, J., Sears, A. (eds.) Handbook of Human-Computer Interaction, pp. 286–304. Lawrence Erlbaum, New Jersey (2003)Google Scholar
  10. 10.
    Oviatt, S.: User-centered modeling and evaluation of multimodal interfaces. Proceedings of the IEEE 91(9), 1457–1468 (2003)CrossRefGoogle Scholar
  11. 11.
    Richter, K., Hellenschmidt, M.: Position paper: Interacting with the ambience: Multimodal interaction and ambient intelligence. In: W3C Workshop on Multi-modal Interaction, 19./20.07.2004, Sophia Antipolis, France (2004)Google Scholar
  12. 12.
    Russell, D.M., Streitz, N.A., Winograd, T.: Building disappearing computers. Communications of the ACM 48(3), 42–48 (2005)CrossRefGoogle Scholar
  13. 13.
    Trewin, S., Zimmermann, G., Vanderheiden, G.: Abstract representations as a basis for usable user interfaces. Interacting with Computers 16, 477–506 (2004)CrossRefGoogle Scholar
  14. 14.
    Wilpon, J.G., Jacobsen, C.N.: A study of speech recognition for children and the elderly. In: Acoustics, Speech, and Signal Processing, ICASSP-1996. Conference Proceedings, May 7-10, 1996, vol. 1, pp. 349–352 (1996)Google Scholar
  15. 15.
    Yankelovich, N., Levow, G.A., Marx, M.: Designing SpeechActs: issues in speech user interfaces. In: CHI 1995: Proceedings of the SIGCHI conference on Human factors in computing systems, New York, ACM Press/Addison-Wesley Publishing Co, pp. 369–376 ( 1995)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Laura Burzagli
    • 1
  • Pier Luigi Emiliani
    • 1
  • Francesco Gabbanini
    • 1
  1. 1.IFAC-CNR, Via Madonna del Piano, 10, Sesto Fiorentino, FirenzeItaly

Personalised recommendations