Abstract
Intelligent personal assistants (IPA), such as Siri, Google Assistant, Alexa, and Cortana, are rapidly becoming a popular way of interacting with our smart devices. As a result, there has been a wealth of research on all aspects of IPAs in recent years, such as studies of usage of and user satisfaction with IPAs. However, the overwhelming majority of these studies have focused on English as the interaction language. In this paper, we investigate the usage and perceived usability of IPAs in Denmark. We conduct a questionnaire with 357 Danish-speaking respondents that sheds light on how IPAs are used in Denmark. We find they are only used regularly by 19.9% of respondents and that most people do not find IPAs to be reliable. We also conduct a usability study of Siri and find that Siri suffers from several issues when used in Danish: poor voice recognition, unnatural dialogue responses, and an inability to support mixed-language speech recognition. Our findings shed light on both the current state of usage and adoption of IPAs in Denmark as well as the usability of its most popular IPA in a foreign-language setting.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The full questionnaire is available at http://toinebogers.com/?page_id=796.
- 2.
Our usability test protocol is available at http://toinebogers.com/?page_id=796.
References
Assefi, M., Liu, G., Wittie, M.P., Izurieta, C.: An experimental evaluation of apple siri and google speech recognition. In: Proceedings of the 2015 ISCA SEDE (2015)
Bhutta, C.B.: Not by the book: Facebook as a sampling frame. Sociological Methods Res. 41(1), 57–88 (2012)
Brill, T.M.: Siri, Alexa, and Other Digital Assistants: A Study of Customer Satisfaction With Artificial Intelligence. Ph.D. thesis, University of Dallas, February 2018
Brooke, J.: SUS: a ‘quick and dirty’ usability scale. Usability Eval. Ind. 189(194), 4–7 (1996)
Cowan, B.R., et al.: “What can I help you with?" – infrequent users’ experiences of intelligent personal assistants. In: Proceedings of MobileHCI 2017, pp. 1–12. ACM Press, New York (2017)
Ehrenbrink, P., Osman, S., Möller, S.: Google now is for the extraverted, Cortana for the introverted: investigating the influence of personality on IPA preference. In: Proceedings of OZCHI 2017, pp. 257–265 (2017)
Faulkner, L.: Beyond the five-user assumption: benefits of increased sample sizes in usability testing. Behav. Res. Methods Instrum. Comput. 35(3), 379–383 (2003)
Garcia, M.P., Lopez, S.S., Donis, H.: Everybody is talking about voice activated virtual assistants, but how are people really adopting and using them? lessons from a multi-country study. In: Proceedings of the 32nd Human Computer Interaction Conference. BCS (2018)
Giles, H., Powesland, P.: Accommodation theory. In: Coupland, N., Jaworski, A. (eds.) Sociolinguistics. MLS, pp. 232–239. Macmillan Education UK, London (1997). https://doi.org/10.1007/978-1-349-25582-5_19
Guy, I.: Searching by talking: analysis of voice queries on mobile web search. In: Proceedings of SIGIR 2016, pp. 35–44. ACM, New York (2016)
Ho, D.K.-H.: Voice-controlled virtual assistants for the older people with visual impairment. Eye 32(1), 53 (2017)
Jiang, J., et al.: Automatic online evaluation of intelligent assistants. In: Proceedings of WWW 2015, pp. 506–516 (2015)
Kinsella, B.: Over half of smartphone owners use voice assistants, Siri leads the pack. https://voicebot.ai/2018/04/03/over-half-of-smartphone-owners-use-voice-assistants-siri-leads-the-pack/. Accessed 10 Sep 2018
Kiseleva, J., Williams, K., Hassan Awadallah, A., Crook, A.C., Zitouni, I., Anastasakos, I.: Predicting User satisfaction with intelligent assistants. In Proceedings of SIGIR 2016, pp. 45–54. ACM, New York (2016)
Kiseleva, J., et al.: Understanding user satisfaction with intelligent assistants. In: Proceedings of CHIIR 2016, pp. 121–130. ACM, New York (2016)
Konrad, P., Jørgensen, S.: Ny rekord: Vi bruger Appleprodukter som aldrig før. Via Ritzau, July 2017. https://via.ritzau.dk/pressemeddelelse/ny-rekord-vi-bruger-appleprodukter-som-aldrig-for?publisherId=10330283&releaseId=11205808
López, G., Quesada, L., Guerrero, L.A.: Alexa vs. Siri vs. Cortana vs. Google assistant: a comparison of speech-based natural user interfaces. In: Nunes, I. (ed.) AHFE 2017. AISC, vol. 592, pp. 241–250. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-60366-7_23
Luger, E., Sellen, A.: “Like having a really bad PA": the gulf between user expectation and experience of conversational agents. In: Proceedings of CHI 2016, pp. 5286–5297. ACM, New York (2016)
Mehrotra, R., Kholy, A.E., Zitouni, I., Shokouhi, M., Hassan, A.: Identifying user sessions in interactions with intelligent digital assistants. In: Proceedings of WWW 2017, pp. 821–822 (2017)
Rogers, E.M.: Diffusion of Innovations, chap. 7. Simon & Schuster (1983)
Strayer, D.L., Cooper, J.M., Turrill, J., Coleman, J.R., Hopman, R.J.: The smartphone and the driver’s cognitive workload: a comparison of Apple, Google, and Microsoft’s Intelligent Personal Assistants. Can. J. Exp. Psychol. 71(2), 93 (2017)
Tassy, A.: It-anvendelse i befolkningen - 2017. Technical report, Danmarks Statistik (2017). https://www.dst.dk/da/Statistik/Publikationer/VisPub?cid=20739
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Bogers, T. et al. (2019). A Study of Usage and Usability of Intelligent Personal Assistants in Denmark. In: Taylor, N., Christian-Lamb, C., Martin, M., Nardi, B. (eds) Information in Contemporary Society. iConference 2019. Lecture Notes in Computer Science(), vol 11420. Springer, Cham. https://doi.org/10.1007/978-3-030-15742-5_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-15742-5_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-15741-8
Online ISBN: 978-3-030-15742-5
eBook Packages: Computer ScienceComputer Science (R0)