Abstract
Standardized questionnaires are widely used instruments to evaluate UX and their capture mechanism has been implemented in written form, either on paper or in digital format. This study aims to determine if the UX evaluations obtained in the standardized UEQ questionnaire (User Experience Questionnaire) are equivalent if the response capture mechanism is implemented using the traditional written form (digitally) or if a conversational voice interface is used. Having a UX evaluation questionnaire whose capture mechanism is implemented by voice could provide an alternative to collect user responses, preserving the advantages present in standardized questionnaires (quantitative results, statistically validated, self-reported by users) and adding the ease of use and growing adoption of conversational voice interfaces. The results of the case study described in this paper show that, with an adequate number of participants, there are no significant differences in the results of the six scales that make up UEQ when using either of the two response capture mechanisms.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
ISO, ISO DIS 9241-210:2010 Ergonomics of Human-System Interaction, International Standardization Organization (ISO), Geneva, Switzerland (2010)
Vermeeren, A., Law, E., Roto, V., Obrist, M., Hoonhout, J., Väänänen, K.: User experience evaluation methods. In: Proceedings of the 6th Nordic Conference on Human-Computer Interaction Extending Boundaries – NordiCHI’10, Reykjavik, Iceland, 16–20 (2010)
Lallemand, C., Gronier, G.: Méthodes de design UX. 30 méthodes fondamentales pour concevoir des expériences optimales. 2eme édition; Éditions Eyrolles. Paris, France (2018)
Gronier, G., Lallemand, C., Chauvet, A.: Mesurer la formation de la première impression d’une interface à l’aide du test des 5 secondes. In: Huitième Colloque de Psychologie Ergonomique (EPIQUE), Aix-en-Provence, France, pp. 8–10 July (2015)
Kortum, P.: HCI beyond GUI: Design for haptic, speech, olfactory and other nontraditional interfaces, 1st edn. Morgan Kaufmann Publishers Inc., California, USA (2008)
López, G., Quesada, L., Guerrero, L.A.: Alexa vs. Siri vs. Cortana vs. Google Assistant: a comparison of speech-based natural user interfaces. In: Nunes, I. (eds.) Advances in Human Factors and Systems Interaction, AHFE 2017. Springer, Cham (2018)
Pradhan, A., Mehta, K., Findlater, L.: Accessibility came by accident: use of voice-controlled intelligent personal assistants by people with disabilities. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, ACM (2018)
Hassenzahl, M.: The effect of perceived hedonic quality on product appealingness. Int. J. Hum.-Comput. Int. 13, 481–499 (2001)
Baumgartner, J., Sonderegger, A., Sauer, J.: No need to read: developing a pictorial single-item scale for measuring perceived usability. Int. J. Hum. Comput. Stud. 122, 78–79 (2019)
Bradley, M., Lang, P.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25(1), 49–59 (1994)
Diaz-Oreiro, I., López, G., Quesada, L., Guerrero, L.A.: UX evaluation with standardized questionnaires in ubiquitous computing and ambient intelligence: a systematic literature review. Adv.Hum.-Comput. Interact. 2021, 1–22 (2021)
Chien, Y.-H., Chang, W.-T., Chuang, C.-C., Chen, S.-H.: A Taiwanese user experience questionnaire. Adv. Intell. Syst. Comput. pp. 347–355 (2016)
Lallemand, C., Koenig, V., Gronier, G., Martin, R.: Création et validation d’une version française du questionnaire AttrakDiff pour l’évaluation de l’expérience utilisateur des systèmes interactifs. Eur. Rev. Appl. Psychol. 65(5), 239–252 (2015)
Bernhaupt, R., Pirker, M.: Evaluating user experience for interactive television: towards the development of a domain-specific user experience questionnaire. Lecture Notes in Computer Science, pp. 642–659 (2013)
Tomlinson, B., Noah, B., Walker, B.: BUZZ: an auditory interface user experience scale. In: CHI Conference on Human Factors in Computing Systems. Paper No. LBW096 (2018)
Hoy, M.B.: Alexa, siri, cortana, and more: an introduction to voice assistants. Med. Ref. Serv. Q. 37(1), 81–88 (2018)
Yang, X., Aurisicchio, M., Baxter, W.: Understanding Affective Experiences with Conversational Agents (2019)
Berdasco, A., López, G., Diaz, I., Quesada, L., Guerrero, L.A.: User experience comparison of intelligent personal assistants: Alexa, Google Assistant, Siri and Cortana. In: MDPI Proceedings, vol. 31, p. 51 (2019)
SurveyLine homepage. https://www.surveybyvoice.com (2021). Accessed 01 Aug 2021
VoiceFlow homepage. https://www.voiceflow.com (2021). Accessed 01 Aug 2021
Acknowledgments
This research was partially funded by CITIC at the University of Costa Rica, grant number 834-C1-013 and 834-B7-766.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Mata-Serrano, J.C., Díaz-Oreiro, I., López, G., Guerrero, L.A. (2022). Comparing Written and Voice Captured Responses of the User Experience Questionnaire (UEQ). In: Rocha, Á., Ferrás, C., Méndez Porras, A., Jimenez Delgado, E. (eds) Information Technology and Systems. ICITS 2022. Lecture Notes in Networks and Systems, vol 414. Springer, Cham. https://doi.org/10.1007/978-3-030-96293-7_43
Download citation
DOI: https://doi.org/10.1007/978-3-030-96293-7_43
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-96292-0
Online ISBN: 978-3-030-96293-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)