Abstract
When designing multimodal systems, the designer faces the problem of the choice of modalities to optimize the system usability. Based on modeling at a high level of abstraction, we propose an evaluation of this choice during the design phase, using a multi-criteria principle. The evaluation focuses on several points of view simultaneously, weighted according to the environment and the nature of the task. It relies on measures estimating the adequacies between the elements involved in the interaction. These measures arise from a fine decomposition of the interaction modalities.
Chapter PDF
Similar content being viewed by others
References
Appert, C.: Modélisation, Évaluation et Génération de Techniques d’Interaction. PhD Thesis. Paris: Université Paris Sud (2007)
Beaudouin-Lafon, M.: Instrumental interaction: an interaction model for designing post-WIMP user interfaces. In: Proceedings of the SIGCHI conference on Human factors in computing systems. ACM Press, The Hague (2000)
Bellik, Y.: Présentation Multimodale de l’Information. HDR. In: LIMSI-CNRS. Paris: Université d’Orsay Paris-Sud (2006)
Bouchet, J.: Ingénierie de l’interaction multimodale en entrée. Approche à composants ICARE. PhD Thesis. Grenoble Université Joseph-Fourier - Grenoble I (2006)
Bürgy, C., Garrett, J.H.J.: Situation-aware Interface Design: An Interaction Constraints Model for Finding the Right Interaction for Mobile and Wearable Computer Systems. NIST Special Publication (2003)
Coutrix, C., Nigay, L.: Interagir avec un objet mixte: Propriétés physique et numérique. In: IHM 2007, Paris (2007)
Dubois, E., Gray, P.: A Design-Oriented Information-Flow Refinement of the ASUR Interaction Model. In: Engineering Interactive Systems (EHCI-HCSE-DSVIS 2007), IFIP, Salamanca, Spain (2007)
Dubois, E., et al.: Un modèle préliminaire du domaine des systèmes mixtes. In: IHM 2004 Namur, Belgium (2004)
Fishkin, K.P.: A taxonomy for and analysis of tangible interfaces. In: Personal Ubiquitous Computing, vol. 8, pp. 347–358. Springer, Heidelberg (2004)
John, B.E., Kieras, D.E.: Using GOMS for User Interface Design and Evaluation: Which Technique? ACM Transactions on Computer-Human Interaction 3, 287–319 (1996)
Karsenty, L.: Les déterminants du choix d’une modalité d’interaction avec une interface multimodale. In: ERGO-IA 2006 (2006)
Kieras, D.E., Wood, S.D., Meyer, D.E.: Predictive engineering models based on the EPIC architecture for a multimodal high-performance human-computer interaction task. ACM Press, New York (1997)
Klug, T., Mühlhäuser, M.: Modeling Human Interaction Resources to Support the Design of Wearable Multimodal Systems. In: ICMI 2007. ACM, Nagoya (2007)
Nigay, L.: Modalité d’interaction et multimodalité. Université Joseph Fourier, Grenoble (2001)
Oviatt, S.: Ten myths of multimodal interaction 42(11), pp. 74–81 (1999)
Oviatt, S., Coulston, R., Lunsford, R.: When do we interact multimodally? cognitive load and multimodal communication patterns. In: Proceedings of the 6th international conference on Multimodal interfaces. ACM Press, State College (2004)
Sottet, J.-S., et al.: A Model-Driven Engineering Approach for the Usability of Plastic User Interfaces. In: Engineering Interactive Systems, Salamanca, Spain (2007)
Sweller, J., Van Merrienboer, J.J.G., Paas, F.G.W.C.: Cognitive Architecture and Instructional Design. Educational Psychology Review 10(3), 251–296 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Verdurand, E., Coppin, G., Poirier, F., Grisvard, O. (2009). Modeling Multimodal Interaction for Performance Evaluation. In: Jacko, J.A. (eds) Human-Computer Interaction. Novel Interaction Methods and Techniques. HCI 2009. Lecture Notes in Computer Science, vol 5611. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02577-8_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-02577-8_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02576-1
Online ISBN: 978-3-642-02577-8
eBook Packages: Computer ScienceComputer Science (R0)