Temporal and Spatial Design of Explanations in a Multimodal System
Modern dialog systems are known to act user-specific. They apply individual decisions for content presentation and course adaptation. However, it is still an open research question how additional, but required explanations should be integrated best into a given dialog structure. Previous research focused on the improvement of user knowledge models and its fine-grained use in human-computer interaction, but does not directly address the temporal and spatial aspects of presentation when it comes to explanations. In this paper, we introduce different strategies for an ad-hoc integration of required explanations. We describe a user study, and show which parameters from the fields of user experience, personality, and cognitive load theory have what effects on the applied strategies. We expect that our findings can help to increase usability and decrease unwanted cognitive load.
KeywordsDialog Adaption Multimodal Explanation HCI
This work was supported by the Transregional Collaborative Research Centre SFB/TRR 62 “Companion-Technology for Cognitive Technical Systems” which is funded by the German Research Foundation (DFG).
- 2.Behnke, G., Ponomaryov, D., Schiller, M., Bercher, P., Nothdurft, F., Glimm, B., Biundo, S.: Coherence across components in cognitive systems - one ontology to rule them all. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI 2015). AAAI Press (2015)Google Scholar
- 3.Bercher, P., Richter, F., Hörnle, T., Geier, T., Höller, D., Behnke, G., Nothdurft, F., Honold, F., Minker, W., Weber, M., Biundo, S.: A planning-based assistance system for setting up a home theater. In: Proceedings of the 29th National Conference on Artificial Intelligence (AAAI 2015), pp. 4264–4265. AAAI Press (2015)Google Scholar
- 7.Honold, F., Bercher, P., Richter, F., Nothdurft, F., Geier, T., Barth, R., Hoernle, T., Schüssel, F., Reuter, S., Rau, M., Bertrand, G., Seegebarth, B., Kurzok, P., Schattenberg, B., Minker, W., Weber, M., Biundo, S.: Companion-technology: Towards user- and situation-adaptive functionality of technical systems. In: 10th International Conference on Intelligent Environments (IE 2014), pp. 378–381. IEEE (2014)Google Scholar
- 8.Honold, F., Schüssel, F., Weber, M.: Adaptive probabilistic fission for multimodal systems. In: Proceedings of the 24th Australian Computer-Human Interaction Conference, OzCHI 2012, pp. 222–231. ACM, New York, 26–30 November 2012Google Scholar
- 10.Jokinen, K., Kanto, K.: User expertise modelling and adaptivity in a speech-based e-mail system. In: Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics, p. 87. Association for Computational Linguistics (2004)Google Scholar
- 11.Klepsch, M., F.W., Seufert, T.: Differentiated measurement of cognitive load: Possible or not? (2015, in press)Google Scholar
- 12.Nothdurft, F., Minker, W.: Using multimodal resources for explanation approaches in technical systems. In: Proceedings of the 8th Conference on International Language Resources and Evaluation (LREC 2012), pp. 411–415 (2012)Google Scholar
- 14.Wendemuth, A., Biundo, S.: A companion technology for cognitive technical systems. In: Esposito, A., Esposito, A.M., Vinciarelli, A., Hoffmann, R., Müller, V.C. (eds.) COST 2012. LNCS, vol. 7403, pp. 89–103. Springer, Heidelberg (2012)Google Scholar