Abstract
The main goal of this work was to design and conduct usability tests of mobile applications, with particular emphasis on cognitive load. Not only was the cognitive load due to user interface design errors considered, but also the cognitive load due to external factors such as the real world. The study involved 12 participants, who were young adults, i.e. people aged 20–30 who regularly use mobile devices. The participants were randomly divided into two groups of 6 people. These groups independently carried out the scenario of activities using two different applications, in two different environments: laboratory and field. The collected results were statistically analysed in terms of task completion time, number of actions, number of errors and satisfaction with regard to net promoters score and system usability scale. The analysis of these features allowed to determine the relationship between the quality of the graphical user interface, the impact of the environmental factors and user satisfaction.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Leppink, J.: Cognitive load theory: practical implications and an important. J. Taibah Univ. Med. Sci. 12(5), 385–391 (2017). https://doi.org/10.1016/j.jtumed.2017.05.003
de Jong, T.: Cognitive load theory, educational research, and instructional design: some food for thought. Instr. Sci. 38, 105–134 (2010). https://doi.org/10.1007/s11251-009-9110-0
Bernacki, J., Błażejczyk, I., Indyka-Piasecka, A., Kopel, M., Kukla, E., Trawiński, B.: Responsive web design: testing usability of mobile web applications. In: Nguyen, N.T., Trawiński, B., Fujita, H., Hong, T.-P. (eds.) ACIIDS 2016. LNCS (LNAI), vol. 9621, pp. 257–269. Springer, Heidelberg (2016). https://doi.org/10.1007/978-3-662-49381-6_25
Błażejczyk, I., Trawiński, B., Indyka-Piasecka, A., Kopel, M., Kukla, E., Bernacki, J.: Usability testing of a mobile friendly web conference service. In: Nguyen, N.-T., Manolopoulos, Y., Iliadis, L., Trawiński, B. (eds.) ICCCI 2016. LNCS (LNAI), vol. 9875, pp. 565–579. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-45243-2_52
Krzewińska, J., Indyka-Piasecka, A., Kopel, M., Kukla, E., Telec, Z., Trawiński, B.: Usability testing of a responsive web system for a school for disabled children. In: Nguyen, N.T., Hoang, D.H., Hong, T.-P., Pham, H., Trawiński, B. (eds.) ACIIDS 2018. LNCS (LNAI), vol. 10751, pp. 705–716. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-75417-8_66
Myka, J., Indyka-Piasecka, A., Telec, Z., Trawiński, B., Dac, H.C.: Comparative analysis of usability of data entry design patterns for mobile applications. In: Nguyen, N.T., Gaol, F.L., Hong, T.-P., Trawiński, B. (eds.) ACIIDS 2019. LNCS (LNAI), vol. 11431, pp. 737–750. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-14799-0_63
Waloszek, S., Zihisire Muke, P., Piwowarczyk, M., Telec, Z., Trawiński, B., Nguyen, L.T.T.: Usability study of data entry design patterns for mobile applications. In: Nguyen, N.T., Hoang, B.H., Huynh, C.P., Hwang, D., Trawiński, B., Vossen, G. (eds.) ICCCI 2020. LNCS (LNAI), vol. 12496, pp. 888–901. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-63007-2_70
Weichbroth, P.: Usability of mobile applications: a systematic literature study. IEEE Access 8, 55563–55577 (2020). https://doi.org/10.1109/ACCESS.2020.2981892
Bashirl, M.S., Farooq, A.: EUHSA: extending usability heuristics for smartphone application. IEEE Access 7, 100838–100859 (2019). https://doi.org/10.1109/ACCESS.2019.2923720
Da Costa, R.P., Canedo, E.D., De Sousa, R.T., De Oliveira Albuquerque, R., Garcia Villalba, L.J.: Set of usability heuristics for quality assessment of mobile applications on smartphones. IEEE Access 7, 116145–116161 (2019). https://doi.org/10.1109/ACCESS.2019.2910778
Harrison, R., Flood, D., Duce, D.: Usability of mobile applications: literature review and rationale for a new usability model. J. Interact. Sci. 1, 1 (2013). https://doi.org/10.1186/2194-0827-1-1
Ejaz, A., Rahim, M., Khoja, S.A.: The effect of cognitive load on gesture acceptability of older adults in mobile application. In: 2019 IEEE 10th Annual Ubiquitous Computing, Electronics and Mobile Communication Conference, UEMCON 2019, pp. 0979–0986 (2019). https://doi.org/10.1109/UEMCON47517.2019.8992970
Sunardi, Desak, G.F.P., Gintoro: List of most usability evaluation in mobile application: a systematic literature review. In: Proceedings of 2020 International Conference on Information Management and Technology, ICIMTech 2020, pp. 283–287 (2020). https://doi.org/10.1109/ICIMTech50083.2020.9211160
Paas, F., van Merriënboer, J.J.G.: Instructional control of cognitive load in the training of complex cognitive tasks. Educ. Psychol. Rev. 6(4), 351–371 (1994). https://doi.org/10.1007/BF02213420
Sun, G., Yao, S., Carretero, J.A.: A pilot study for investigating factors that affect cognitive load in the conceptual design process. In: Proceedings of the Human Factors and Ergonomics Society, pp. 180–184 (2015). https://doi.org/10.1177/1541931215591037
Liang, Y., Liang, W., Qu, J., Yang, J.: Experimental study on EEG with different cognitive load. In: 2018 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2018, pp. 4351–4356 (2019). https://doi.org/10.1109/SMC.2018.00735
Ferreira, E., et al.: Assessing real-time cognitive load based on psycho-physiological measures for younger and older adults. In: IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain, Proceedings, pp. 39–48 (2014). https://doi.org/10.1109/CCMB.2014.7020692
Fast Budget - Expense & Money Manager: https://play.google.com/store/apps/details?id=com.blodhgard.easybudget&hl=en&gl=US. Accessed 15 Jan 2021
Family Budget: https://play.google.com/store/apps/details?id=pl.com.cierniak.android.familybudget&hl=en&gl=US. Accessed 15 Jan 2021
Kaikkonen, A., Kekäläinen, A., Cankar, M., Kallio, T., Kankainen, A.: Usability testing of mobile applications: a comparison between laboratory and field testing. J. Usability Stud. 1(1), 4–16 (2005)
Alshehri, F., Freeman, M.: Methods for usability evaluations of mobile devices. In: Lamp, J.W. (eds.) 23rd Australian Conference on Information Systems, pp. 1–10. Deakin University, Geelong (2012)
Nielsen, J.: Why You Only Need to Test with 5 Users: https://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/. Accessed 15 Jan 2021
Macefield, R.: How to specify the participant group size for usability studies: a practitioner’s guide. J. Usability Stud. 5(1), 34–45 (2009)
Faulkner, L.: Beyond the five-user assumption: benefits of increased sample sizes in usability testing. Behav. Res. Methods Instrum. Comput. 35(3), 379–383 (2003)
Screen Recorder: https://play.google.com/store/apps/details?id=com.fragileheart.screenrecorder&hl=en_US&gl=US. Accessed 15 Jan 2021
Net Promoter Score. A Comprehensive Introduction. https://www.genroe.com/net-promoter-score. Accessed 15 Jan 2021
Pollack, B.L., Alexandrov, A.: Nomological validity of the net promoter index question. J. Serv. Mark. 27(1), 118–129 (2013). https://doi.org/10.1108/08876041311309243
Sauro, J.: Measuring Usability with the System Usability Scale (SUS): https://measuringu.com/sus/. Accessed 15 Jan 2021
Thomas, N.: How to Use the System Usability Scale (SUS) to Evaluate the Usability of Your Website: https://usabilitygeek.com/how-to-use-the-system-usability-scale-sus-to-evaluate-the-usability-of-your-website/. Accessed 15 Jan 2021
Bangor, A., Kortum, P.T., Miller, J.T.: An empirical evaluation of the system usability scale. Int. J. Hum.-Comput. Interact. 24(6), 574–594 (2008)
Brooke, J.: SUS: a retrospective. J. Usability Stud. 8(2), 29–40 (2013)
Wieckowska, B.: User Guide - PQStat. Downloaded from https://download.pqstat.pl/UserGuideGeo.pdf. Accessed 15 Jan 2021
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Karczewska, B., Kukla, E., Muke, P.Z., Telec, Z., Trawiński, B. (2021). Usability Study of Mobile Applications with Cognitive Load Resulting from Environmental Factors. In: Nguyen, N.T., Chittayasothorn, S., Niyato, D., Trawiński, B. (eds) Intelligent Information and Database Systems. ACIIDS 2021. Lecture Notes in Computer Science(), vol 12672. Springer, Cham. https://doi.org/10.1007/978-3-030-73280-6_67
Download citation
DOI: https://doi.org/10.1007/978-3-030-73280-6_67
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-73279-0
Online ISBN: 978-3-030-73280-6
eBook Packages: Computer ScienceComputer Science (R0)