Multimodal Interfaces for the Smart Home: Findings in the Process from Architectural Design to User Evaluation

  • Miguel Ángel Fernández
  • Víctor Peláez
  • Gloria López
  • Juan Luis Carus
  • Vanesa Lobato
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7656)

Abstract

Smart Environments have specific natural interaction needs that can be provided for with multimodal interfaces. There are still challenges to face, such as the adaptability of the interaction and an evaluation of the proposed systems. This work focuses on these problems and proposes an architectural design evaluated in the domain of Smart Homes. The architectural approach is based on the Model View Presenter Pattern and the Service Oriented paradigm. The evaluation was conducted with a laboratory deployment of a prototype of the system and usability tests were carried out with a usability questionnaire. Results show the technical feasibility of the proposed design and positive user acceptance of the multimodal interface as compared to mono-modal interfaces.

Keywords

multimodal interaction smart home usability evaluation 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Blumendorf, M., Albayrak, S.: Towards a Framework for the Development of Adaptive Multimodal User Interfaces for Ambient Assisted Living Environments. In: Stephanidis, C. (ed.) UAHCI 2009, Part II. LNCS, vol. 5615, pp. 150–159. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  2. 2.
    Herzog, G., Reithinger, N.: The SmartKom architecture: A framework for multimodal dialogue systems. SmartKom: Foundations of Multimodal Dialogue (2006)Google Scholar
  3. 3.
    Dumas, B., Lalanne, D., Oviatt, S.: Multimodal Interfaces: A Survey of Principles, Models and Frameworks. In: Lalanne, D., Kohlas, J. (eds.) Human Machine Interaction. LNCS, vol. 5440, pp. 3–26. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  4. 4.
    Sebe, N.: Multimodal interfaces: Challenges and perspectives. Journal of Ambient Intelligence and Smart Environments 1, 23–30 (2009)Google Scholar
  5. 5.
    López-cózar, R., Callejas, Z.: Handbook of Ambient Intelligence and Smart Environments (2010)Google Scholar
  6. 6.
    Folmer, E., Bosch, J.: Architecting for usability: a survey. Journal of Systems and Software, 61–78 (2004)Google Scholar
  7. 7.
    Bernsen, N.O., Dybkjær, L.: Multimodal Usability: Conclusions and Future Work. Multimodal Usability, 413–419 (2009)Google Scholar
  8. 8.
    Guna, J., Kos, A., Pogačnik, M.: Evaluation of a multimodal interaction concept in virtual worlds. ev.fe.uni-lj.si 77, 287–292 (2010)Google Scholar
  9. 9.
    Hassenzahl, M., Burmester, M., Koller, F.: AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. Mensch & Computer, 187–196 (2003)Google Scholar
  10. 10.
    Möller, S., Engelbrecht, K.P., Kühnel, C., Naumann, A., Wechsung, I., Weiss, B.: Evaluation of Multimodal Interfaces for Ambient Intelligence. In: Human-Centric Interfaces for Ambient Intelligence, pp. 347–370 (2010)Google Scholar
  11. 11.
    Arnone, D., Rossi, A., Bertoncini, M.: An open source integrated framework for rapid prototyping of multimodal affective applications in digital entertainment. Journal on Multimodal User Interfaces 3, 227–236 (2010)CrossRefGoogle Scholar
  12. 12.
    Lawson, J.J.-Y.L., Al-Akkad, A.-A., Vanderdonckt, J., Macq, B.: An open source workbench for prototyping multimodal interactions based on off-the-shelf heterogeneous components. In: EICS 2009: Proceedings of the First ACM SIGCHI Symposium on Engineering Interactive Computing, New York (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Miguel Ángel Fernández
    • 1
  • Víctor Peláez
    • 1
  • Gloria López
    • 1
  • Juan Luis Carus
    • 1
  • Vanesa Lobato
    • 1
  1. 1.Fundación CTIC – Centro TecnológicoGijónSpain

Personalised recommendations