Abstract
Multimodal systems that adapt their interface to the surroundings and the user shall be able to handle uncertain data provided by ubiquitous sensors. This has to be realized for the complete communication cycle and therefore demands collaboration between the system’s output and input processes. In this article we demonstrate how dedicated fission and fusion components that handle uncertainty can be connected via an additional interaction content management component. We present the overall architecture of the resulting adaptive system and discuss the status quo of our implementation.
Chapter PDF
Similar content being viewed by others
References
Costa, D., Duarte, C.: Adapting multimodal fission to user’s abilities. In: Stephanidis, C. (ed.) Universal Access in HCI, Part I, HCII 2011. LNCS, vol. 6765, pp. 347–356. Springer, Heidelberg (2011)
Foster, M.E.: State of the art review: Multimodal fission. University of Edinburgh, Edinburgh (2002)
Rousseau, C., Bellik, Y., Vernier, F., Bazalgette, D.: A framework for the intelligent multimodal presentation of information. Signal Processing 86(12), 3696–3713 (2006)
Hina, M.D., Tadj, C., Ramdane-Cherif, A., Levy, N.: A Multi-Agent based Multimodal System Adaptive to the User’s Interaction Context. In: Alkhateeb, F. (ed.) Multi-Agent Systems – Modeling, Interactions, Simulations and Case Studies, pp. 29–56. InTech (2011)
Honold, F., Schüssel, F., Weber, M.: Adaptive Probabilistic Fission for Multimodal Systems. In: Proceedings of the OzCHI 2012, pp. 222–231. ACM, New York (2012)
Schüssel, F., Honold, F., Weber, M.: Using the Transferable Belief Model for Multimodal Input Fusion in Companion Systems. In: Schwenker, F., Scherer, S., Morency, L.-P. (eds.) MPRSS 2012. LNCS, vol. 7742, pp. 100–115. Springer, Heidelberg (2013)
Holzapfel, H., Nickel, K., Stiefelhagen, R.: Implementation and evaluation of a constraint-based multimodal fusion system for speech and 3d pointing gestures. In: Proceedings of the 6th International Conference on Multimodal Interfaces, ICMI 2004, pp. 175–182. ACM, New York (2004)
Pfleger, N.: Context based multimodal fusion. In: Proceedings of the 6th International Conference on Multimodal Interfaces, ICMI 2004, pp. 265–272. ACM, New York (2004)
Dumas, B., Ingold, R., Lalanne, D.: Benchmarking fusion engines of multimodal interactive systems. In: Proceedings of the 2009 International Conference on Multimodal Interfaces, ICMI-MLMI 2009, pp. 169–176. ACM, New York (2009)
Norman, D.A.: Psychology of Everyday Things. Basic Books, New York (1988)
Honold, F., Schüssel, F., Nothdurft, F., Kurzok, P.: Companion Technology for Multimodal Interaction. In: Proceedings of the 14th ACM International Conference on Multimodal Interaction, ICMI 2012, pp. 67–68. ACM, New York (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schüssel, F., Honold, F., Weber, M. (2013). Adaptive Multimodal HCI with Uncertain Data by Collaborative Fission and Fusion. In: Stephanidis, C. (eds) HCI International 2013 - Posters’ Extended Abstracts. HCI 2013. Communications in Computer and Information Science, vol 373. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39473-7_75
Download citation
DOI: https://doi.org/10.1007/978-3-642-39473-7_75
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39472-0
Online ISBN: 978-3-642-39473-7
eBook Packages: Computer ScienceComputer Science (R0)