Abstract
The way users interact with mobile applications varies according to the context where they are. We conducted a study where users had to manipulate a multimodal questionnaire in 4 different contexts (home, park, subway and driving), considering different variables (lighting, noise, position, movement, type of content, number of people surrounding the user and time constraints) that affect interaction. This study aimed at understanding the effect of the context variables in users’ choices regarding the interaction modalities available (voice, gestures, etc). We describe the results of our study, eliciting situations where users adopted specific modalities and the reasons for that. Accordingly, we draw conclusions on users’ preferences regarding interaction modalities on real life contexts.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Nicolle, C., Abascal, J. (eds.): Inclusive Design Guidelines for HCI. Taylor and Francis, London (2001)
Sá, M., Carriço, M.: Defining Scenarios for Mobile Design and Evaluation. In: Procs. of CHI 2008 SIGCHI Conference on Human Factors in Computing Systems, Florence, Italy. ACM Press, New York (2008)
Hurtig, T.: A mobile multimodal dialogue system for public transportation navigation evaluated. In: Procs. of HCI 2006, pp. 251–254. ACM Press, New York (2006)
Turk, M., Robertson, G.: Perceptual user interfaces introduction. Commun. of the ACM 43(3), 33–35 (2000)
Oviatt, S., Darrell, T., Flickner, M.: Multimodal interfaces that flex, adapt, and persist. Commun. ACM 47(1), 30–33 (2004)
Lai, J.: Facilitating Mobile Communication with Multimodal Access to Email Messages on a Cell Phone. In: Procs. of CHI 2004, pp. 1259–1262. ACM Press, New York (2004)
Blattner, M.M., Glinter, E.P.: Multimodal integration. IEEE Multimedia 14–24 (1996)
Signer, B., Norrie, M., Grossniklaus, M., Belotti, R., Decurtins, C., Weibel, N.: Paper Based Mobile Access to Databases. In: Procs. of the ACM SIGMOD, pp. 763–765 (2006)
Santoro, C., Paternò, F., Ricci, G., Leporini, B.: A Multimodal Museum Guide for All. In: Mobile interaction with the Real World Workshop, Mobile HCI, Singapore (2007)
Oviatt, S.: Mutual disambiguation of recognition errors in a multimodal architecture. In: Procs. CHI 1999, pp. 576–583. ACM Press, New York (1999)
Blenkhorn, P., Evans, D.G.: Using speech and touch to enable blind people to access schematic diagrams. Journal of Network and Computer Applications 21, 17–29 (1998)
Boyd, L.H., Boyd, W.L., Vanderheiden, G.C.: The Graphical User Interface: Crisis, Danger and Opportunity, Q. Journal of Visual Impairment and Blindness 84, 496–502 (1990)
Reis, T., Sá, M., Carriço, L.: Designing Mobile Multimodal Artefacts. In: Procs. of 10th ICEIS, Barcelona, Spain, pp.75 - 89. INSTICC (2008)
Brewster, S.A.: Overcoming the lack of screen space on mobile computers. Personal and Ubiquitous Computing 6(3), 188–205 (2002)
Brewster, S.A., Lumsden, J., Bell, M., Hall, M., Tasker, S.: Multi-modal ‘eyes free’ interaction techniques for wearable devices. In: Proc. CHI 2003 Conference on Human Factors in Computing Systems, CHI Letters, vol. 5(1), pp. 473–480. ACM Press, New York (2003)
Palen, L., Salzman, M.: Beyond the Handset: Designing for Wireless Communications. ACM Transactions on ComputerHuman Interaction 9, 125–151 (2002)
Makela, A., Giller, V., Tscheligi, M., Sefelin, R.: Joking, storytelling, art sharing, expressing affection: A field trial of how children and their social network communicate with digital images in leisure time. In: Proceedings of CHI 2000, pp. 548–555. ACM Press, New York (2000)
Kjeldskov, J., Skov, M.B., Als, B.S., Hoegh, R.T.: Is it Worth the Hassle? Exploring the Added Value of Evaluating the Usability of Context-Aware Mobile Systems in the Field. In: Proceedings of Mobile HCI 2004, Berlin, Heidelberg, pp. 61–73 (2004)
Beck, E.T., Christiansen, M.K., Kjeldskov, J.: Experimental Evaluation of Techniques for Usability testing of Mobile Systems in a Laboratory Setting. In: Proceedings of OzCHI 2003, Brisbane Austriala (2003)
Goodman, J., Gray, P., Khammampad, K., Brewster, S.: Using Landmarks to Support Older People in Navigation. In: Proceedings of Mobile HCI 2004, Verlag, Berlin, Heidelberg, pp. 38–48 (2004)
Baillie, L., Schatz, R.: Exploring multimodality in the laboratory and the field. In: Procs. of the 7th international conference on Multimodal interfaces, Torento, Italy (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Reis, T., de Sá, M., Carriço, L. (2008). Multimodal Interaction: Real Context Studies on Mobile Digital Artefacts. In: Pirhonen, A., Brewster, S. (eds) Haptic and Audio Interaction Design. HAID 2008. Lecture Notes in Computer Science, vol 5270. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-87883-4_7
Download citation
DOI: https://doi.org/10.1007/978-3-540-87883-4_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-87882-7
Online ISBN: 978-3-540-87883-4
eBook Packages: Computer ScienceComputer Science (R0)