Abstract
The success of software applications, in a worldwide setup offering simple development and distribution models, is often determined by the quality and ease of use of provided interfaces. In this paper, we present a framework for multimodal signal analysis operating in conjunction with any other Android application to estimate the cognitive load imposed by its interface. The framework integrates seamlessly with such applications, even existing ones, by acting as middleware between the sensors layer and the application logic. The interaction between interface elements is mainly targeted in this work: a game presenting an increasingly complex interface was designed and tracking modules for touch events and eye movements were implemented. We show that the framework is able to capture and present raw data together with underlying models estimated by least squares approximation. We then discuss the implications of such a framework for the evaluation of efficient application interfaces.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Calandra, D., Caso, A., Cutugno, F., Origlia, A., Rossi, S.: Cowme: a general framework to evaluate cognitive workload during multimodal interaction. In: Proceedings of International Conference on Multimodal Interfaces. pp. 111–118 (2013)
Baddeley, A.D.: Working Memory. Oxford University Press (1986)
Miyake, A., Shah, P.: Toward unified theories of working memory: Emerging general consensus, unresolved theoretical issues, and future research directions. In: Models of Working Memory: Mechanisms of Active Maintenance and Executive Control. pp. 442–481. Cambridge University Press (1999)
Sweller, J.: Cognitive load as a factor in the structuring of technical material. J. Exp. Psychol. 119, 176–192 (1990)
Sweller, J.: Cognitive load during problem solving—effect on learning. Cogn. Sci. 12, 257–285 (1998)
Sweller, J.: Element interactivity and intrinsic, extraneous, and germane cognitive load. Educ. Psychol. Rev. 22(2), 123–138 (2010). doi:10.1007/s10648-010-9128-5
Acknowledgments
Antonio Origlia’s work is supported by the Italian PAC project Cultural Heritage Emotional Experience See-Through Eyewear (CHEESE).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Sensale, R., Cutugno, F., Origlia, A. (2016). A Generic, Multimodal Framework for Sensorial Feedback on Android Systems. In: Caporarello, L., Cesaroni, F., Giesecke, R., Missikoff, M. (eds) Digitally Supported Innovation. Lecture Notes in Information Systems and Organisation, vol 18. Springer, Cham. https://doi.org/10.1007/978-3-319-40265-9_19
Download citation
DOI: https://doi.org/10.1007/978-3-319-40265-9_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-40264-2
Online ISBN: 978-3-319-40265-9
eBook Packages: Business and ManagementBusiness and Management (R0)