Skip to main content

How Human Communication Influences Virtual Personal Assistants

  • Conference paper
  • First Online:
Knowledge in the Information Society (PCSF 2020, CSIS 2020)

Abstract

Virtual Personal Assistants (VPI) are becoming part of our daily lives. The possibility of voice communication marks a new stage in the development of the interaction between people and computers. New challenges are associated not only with security issues and lack of the VPIs ability to give relevant answers to critical questions but also with the fact that the new artificial interlocutor does not always meet people’s expectations. The article discusses how the answers to the tricky questions of the virtual assistant Alice have been changing from the moment of its creation in 2017 to 2020. It was revealed that Alice not only developed the ability to respond to questions more correctly and avoid problematic topics (including those that could offend a human interlocutor), but also became more “modest” and less gender-oriented. Alice’s small talk and answers to personal questions have changed, thus the VPI hesitates to express her own opinion and make free jokes, begins to make excuses, and promises to improve, which was not observed earlier.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Shipunova, O., Evseeva, L., Pozdeeva, E., Evseev, V.V., Zhabenko, I.: Social and educational environment modeling in future vision: infosphere tools. E3S Web Conf. 110, 02011 (2019). https://doi.org/10.1051/e3sconf/201911002011

    Article  Google Scholar 

  2. Pozdeeva, E.G., Shipunova, O.D., Evseeva, L.I.: Social assessment of innovations and professional responsibility of future engineers. IOP Conf. Ser. Earth Environ. Sci. 337, 012049 (2019). https://doi.org/10.1088/1755-1315/337/1/012049

    Article  Google Scholar 

  3. Mureyko, L.V., Shipunova, O.D., Pasholikov, M.A., Romanenko, I.B., Romanenko, Y.M.: The correlation of neurophysiologic and social mechanisms of the subconscious manipulation in media technology. Int. J. Civ. Eng. Technol. 9, 2020–2028 (2018)

    Google Scholar 

  4. Pokrovskaia, N., Khansuvarova, T., Khansuvarov, R.: Network decentralized regulation with the fog-edge computing and blockchain for business development. In: 14th European Conference on Management, Leadership and Governance, ECMLG 2018, pp. 205–212. Academic Conferences and Publishing International Limited, Utrecht (2018)

    Google Scholar 

  5. Pokrovskaia, N.N., Ababkova, M.Y., Fedorov, D.A.: Educational services for intellectual capital growth or transmission of culture for transfer of knowledge—consumer satisfaction at St. Petersburg Universities. Educ. Sci. 9, 183 (2019). https://doi.org/10.3390/educsci9030183

    Article  Google Scholar 

  6. Aladyshkin, I.V., Kulik, S.V., Odinokaya, M.A., Safonova, A.S., Kalmykova, S.V.: Development of electronic information and educational environment of the university 4.0 and prospects of integration of engineering education and humanities. In: Anikina, Z. (ed.) IEEHGIP 2020. LNNS, vol. 131, pp. 659–671. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-47415-7_70

    Chapter  Google Scholar 

  7. Pylkin, A., Stroganova, O., Sokolova, N., Pylkina, M.: The development of information technology and the problem of identity. In: 2019 8th Mediterranean Conference on Embedded Computing (MECO), St. Petersburg, pp. 1–5. IEEE (2019). https://doi.org/10.1109/MECO.2019.8760159

  8. Guzman, A.L.: Making AI safe for humans: a conversation with Siri. In: Gehl, R.W., Bakardjieva, M. (eds.) Socialbots and Their Friends, pp. 69–86. Routledge, New York (2016)

    Google Scholar 

  9. Mitrevski, M.: Conversational interface challenges. In: Developing Conversational Interfaces for iOS, pp. 217–228. Apress, Berkeley (2018). https://doi.org/10.1007/978-1-4842-3396-2_8

  10. Hoy, M.B.: Alexa, Siri, Cortana, and more: an introduction to voice assistants. Med. Ref. Serv. Q. 37, 81–88 (2018). https://doi.org/10.1080/02763869.2018.1404391

    Article  Google Scholar 

  11. Diao, W., Liu, X., Zhou, Z., Zhang, K.: Your voice assistant is mine. In: Proceedings of the 4th ACM Workshop on Security and Privacy in Smartphones & Mobile Devices - SPSM 2014, pp. 63–74. ACM Press, New York (2014). https://doi.org/10.1145/2666620.2666623

  12. Bickmore, T.W., Trinh, H., Olafsson, S., O’Leary, T.K., Asadi, R., Rickles, N.M., Cruz, R.: Patient and consumer safety risks when using conversational assistants for medical information: an observational study of Siri, Alexa, and Google Assistant. J. Med. Internet Res. 20, e11510 (2018). https://doi.org/10.2196/11510

    Article  Google Scholar 

  13. Picard, C., Smith, K.E., Picard, K., Douma, M.J.: Can Alexa, Cortana, Google Assistant and Siri save your life? A mixed-methods analysis of virtual digital assistants and their responses to first aid and basic life support queries. BMJ Innov. 6, 26–31 (2020). https://doi.org/10.1136/bmjinnov-2018-000326

    Article  Google Scholar 

  14. Miner, A.S., Milstein, A., Schueller, S., Hegde, R., Mangurian, C., Linos, E.: Smartphone-based conversational agents and responses to questions about mental health, interpersonal violence, and physical health. JAMA Intern. Med. 176, 619 (2016). https://doi.org/10.1001/jamainternmed.2016.0400

    Article  Google Scholar 

  15. McTear, M., Callejas, Z., Griol, D.: The Conversational Interface. Springer International Publishing, Cham (2016). https://doi.org/10.1007/978-3-319-32967-3

  16. Seymour, W., Van Kleek, M.: Does Siri have a soul? Exploring voice assistants through shinto design fictions. In: CHI 2020 Extended Abstracts, Honolulu, HI, USA, pp. 1–12. ACM (2020). http://dx.doi.org/10.1145/3334480.3381809

  17. Luger, E., Sellen, A.: “Like having a really bad PA”: the Gulf between user expectation and experience of conversational agents. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 5286–5297. ACM, New York (2016). https://doi.org/10.1145/2858036.2858288

  18. Lehman, J.F., Leite, I.: Turn-taking, children, and the unpredictability of fun. AI Mag. 37, 55–62 (2017). https://doi.org/10.1609/aimag.v37i4.2685

    Article  Google Scholar 

  19. Rawassizadeh, R., Sen, T., Kim, S.J., Meurisch, C., Keshavarz, H., Mühlhäuser, M., Pazzani, M.: Manifestation of virtual assistants and robots into daily life: vision and challenges. CCF Trans. Pervasive Comput. Interact. 1(3), 163–174 (2019). https://doi.org/10.1007/s42486-019-00014-1

    Article  Google Scholar 

  20. Lee, L., Glass, J., Lee, H., Chan, C.: Spoken content retrieval—beyond cascading speech recognition with text retrieval. IEEE/ACM Trans. Audio Speech Lang. Process. 23, 1389–1420 (2015). https://doi.org/10.1109/TASLP.2015.2438543

    Article  Google Scholar 

  21. Yuan, Y., Thompson, S., Watson, K., Chase, A., Senthilkumar, A., Bernheim Brush, A.J., Yarosh, S.: Speech interface reformulations and voice assistant personification preferences of children and parents. Int. J. Child-Comput. Interact. 21, 77–88 (2019). https://doi.org/10.1016/j.ijcci.2019.04.005

    Article  Google Scholar 

  22. Røyneland, K.: “It knows how to not understand us!”; A study on what the concept of robustness entails in design of conversational agents for preschool children. https://www.duo.uio.no/handle/10852/69059. Accessed 21 May 2020

  23. Bergen, H.: ‘I’d blush if I could’: digital assistants, disembodied cyborgs and the problem of gender. Word Text J. Lit. Stud. Linguist. VI, 95–113 (2016)

    Google Scholar 

  24. Han, S., Yang, H.: Understanding adoption of intelligent personal assistants. Ind. Manag. Data Syst. 118, 618–636 (2018). https://doi.org/10.1108/IMDS-05-2017-0214

    Article  Google Scholar 

  25. Bentley, F., Luvogt, C., Silverman, M., Wirasinghe, R., White, B., Lottrjdge, D.: Understanding the long-term use of smart speaker assistants. Proc. ACM Interact. Mob. Wearable Ubiquit. Technol. 2, 1–24 (2018). https://doi.org/10.1145/3264901

  26. Loideain, N.N., Adams, R.: From Alexa to Siri and the GDPR: the gendering of virtual personal assistants and the role of data protection impact assessments. Comput. Law Secur. Rev. 36, 105366 (2019). https://doi.org/10.1016/J.CLSR.2019.105366

    Article  Google Scholar 

  27. Phan, T.: The materiality of the digital and the gendered voice of Siri. Transformations 29, 23–33 (2017)

    Google Scholar 

  28. Ernst, C.-P., Herm-Stapelberg, N.: Gender stereotyping’s influence on the perceived competence of Siri and Co. In: Proceedings of the 53rd Hawaii International Conference on System Sciences | 2020 Gender, pp. 4448–4453 (2020)

    Google Scholar 

  29. Mathur, V., Stavrakas, Y., Singh, S.: Intelligence analysis of Tay Twitter bot. In: 2016 2nd International Conference on Contemporary Computing and Informatics (IC3I), pp. 231–236. IEEE (2016). https://doi.org/10.1109/IC3I.2016.7917966

  30. Chernyshova, E., Kalyukov, E .: Tinkoff put down the bot Oleg’s offer to cut off his fingers to open data. https://www.rbc.ru/finances/26/11/2019/5ddd2f279a79474903b72986. Accessed 2 May 2020

  31. Olesha, I.K., Schwartz, M.: Envy. New York Review Books, New York (2004)

    Google Scholar 

  32. Bilton, N.: Siri, Tell Me a Joke. No, a Funny One. - The New York Times. https://www.nytimes.com/2015/08/13/fashion/siri-tell-me-a-joke-no-a-funny-one.html. Accessed 22 May 2020

  33. Kolomyichenko, M., Balashova, A.: The voice assistant of Yandex learned to love the GULAG and Mizulina. https://www.rbc.ru/technology_and_media/24/10/2017/59ef3d879a7947e7ac6ae. Accessed 22 May 2020

  34. Shit That Siri Says. https://shitthatsirisays.tumblr.com/post/13270535305. Accessed 22 May 2020

  35. Shit That Siri Says. https://shitthatsirisays.tumblr.com/post/30802972898. Accessed 22 May 2020

  36. Natale, S.: If software is narrative: Joseph Weizenbaum, artificial intelligence and the biographies of ELIZA. New Media Soc. 21, 712–728 (2019). https://doi.org/10.1177/1461444818804980

    Article  Google Scholar 

  37. Lee, K.-M., Nass, C.: Social-psychological origins of feelings of presence: creating social presence with machine-generated voices. Media Psychol. 7, 31–45 (2005). https://doi.org/10.1207/S1532785XMEP0701_2

    Article  Google Scholar 

  38. Shum, H., He, X., Li, D.: From Eliza to XiaoIce: challenges and opportunities with social chatbots. Front. Inf. Technol. Electron. Eng. 19(1), 10–26 (2018). https://doi.org/10.1631/FITEE.1700826

    Article  Google Scholar 

Download references

Acknowledgement

This paper was financially supported by the Ministry of Education and Science of the Russian Federation on the program to improve the competitiveness of Peter the Great St. Petersburg Polytechnic University (SPbPU) among the world’s leading research and education centers in 2016–2020.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Daria Bylieva .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bylieva, D., Lobatyuk, V., Kuznetsov, D., Anosova, N. (2021). How Human Communication Influences Virtual Personal Assistants. In: Bylieva, D., Nordmann, A., Shipunova, O., Volkova, V. (eds) Knowledge in the Information Society. PCSF CSIS 2020 2020. Lecture Notes in Networks and Systems, vol 184. Springer, Cham. https://doi.org/10.1007/978-3-030-65857-1_11

Download citation

Publish with us

Policies and ethics