Skip to main content
SpringerLink
Log in

Qualitative Research in Evaluation. An Usability Evaluation Protocol for the Assistant on Care and Health Offline (ACHO)

  • Conference paper
  • First Online:
Gerontechnology III (IWoG 2020)

Part of the book series: Lecture Notes in Bioengineering ((LNBE))

Included in the following conference series:

Abstract

One of the problems associated with ageing that most concerns health professionals is low therapeutic adherence. In recent years, technological developments have appeared that can increase therapeutic adherence. To do so, it is necessary to know their usability and the possibility of use that they may have. In the framework of the project “International Institute for Research and Innovation on Ageing” (4IE), we have developed the Assistant on Care and Health Offline (ACHO), a voice assistant that provides medical appointments and medication reminders for patients. In this text we present a usability evaluation protocol for this voice assistant. We will use a multidimensional and multidisciplinary analysis in the framework of the Living Lab for the usability evaluation. Our methodology for measuring results includes three phases and different quantitative and qualitative research tools. The application of this methodology will allow us to develop a better prototype, increasing ease of use and improving the user experience.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. WHO: World report on ageing and health. Technical report, World Health Organization, Geneva, Switzerland (2015). https://apps.who.int/iris/bitstream/handle/10665/186463/9789240694811_eng.pdf;jsessionid=182A9CD45B7035C521E9DC1A8BCDE127?sequence=1

  2. Pisano González, M.M., González Pisano, A.: La modificación de los hábitos y la adherencia terapéutica, clave para el control de la enfermedad crónica. Enfermería Clínica 24(1), 59–66 (2014). https://doi.org/10.1016/j.enfcli.2013.10.006

    Article  Google Scholar 

  3. Smith, D., Lovell, J., Weller, C., Kennedy, B., Winbolt, M., Young, C., Ibrahim, J.: A systematic review of medication non-adherence in persons with dementia or cognitive impairment. PloS One 12(2), e0170651 (2017). https://doi.org/10.1371/journal.pone.0170651

    Article  Google Scholar 

  4. Haynes, R.B., Ackloo, E., Sahota, N., McDonald, H.P., Yao, X.: Interventions for enhancing medication adherence. Cochrane Database Syst. Rev. (2), CD000011 (2008). https://doi.org/10.1002/14651858.CD000011.pub3

  5. Andrade, A.S.A., et al.: A programmable prompting device improves adherence to highly active antiretroviral therapy in HIV-infected subjects with memory impairment. Clin. Infect. Dis. Official Publ. Infect. Dis. Soc. Am. 41(6), 875–882 (2005). https://doi.org/10.1086/432877

  6. Christensen, A., et al.: The impact of an electronic monitoring and reminder device on patient compliance with antihypertensive therapy: a randomized controlled trial. J. Hypertension 28(1), 194–200 (2010). https://doi.org/10.1097/HJH.0b013e328331b718

  7. Chung, A.E., Griffin, A.C., Selezneva, D., Gotz, D.: Health and fitness apps for hands-free voice-activated assistants: content analysis. JMIR mHealth uHealth 6(9), e174 (2018). https://doi.org/10.2196/mhealth.9705

  8. Miner, A.S., Milstein, A., Schueller, S., Hegde, R., Mangurian, C., Linos, E.: Smartphone-based conversational agents and responses to questions about mental health, interpersonal violence, and physical health. JAMA Intern. Med. 176(5), 619–625 (2016). https://doi.org/10.1001/jamainternmed.2016.0400

  9. Alagha, E.C., Helbing, R.R.: Evaluating the quality of voice assistants’ responses to consumer health questions about vaccines: an exploratory comparison of Alexa, Google Assistant and Siri. BMJ Health Care Inform. 26(1) (2019). https://doi.org/10.1136/bmjhci-2019-100075

  10. Thilo, F.J., Bilger, S., Halfens, R.J., Schols, J.M., Hahn, S.: Involvement of the end user: exploration of older people’s needs and preferences for a wearable fall detection device - a qualitative descriptive study. Patient Prefer. Adherence 11, 11–22 (2017). https://doi.org/10.2147/PPA.S119177

    Article  Google Scholar 

  11. Almirall, E., Wareham, J.: Living labs: arbiters of mid- and ground-level innovation. Technol. Anal. Strateg. Manage. 23(1), 87–102 (2011). https://doi.org/10.1080/09537325.2011.537110

  12. Jesús-Azabal, M., Rojo, J., Moguel, E., Flores-Martin, D., Berrocal, J., García-Alonso, J., Murillo, J.M.: Voice Assistant to Remind Pharmacologic Treatment in Elders. In: García-Alonso, J., Fonseca, C. (eds.) Gerontechnology. IWOG 2020, pp. 123–133. Springer, Cham (2020)

    Google Scholar 

  13. Moguel, E., Jesus Azabal, M., Flores-martin, D., Berrocal, J., García-Alonso, J., Murillo, J.M.: Asistente de voz para el recordatorio de tratamiento farmacológico. In: Jornadas de Ingeniería del Software y Bases de Datos (JISBD). Cáceres (2019). hdl.handle.net/11705/JISBD/2019/078

  14. Hoppe, A.: Technological stress-mental strain of younger and older users if technology fails. In: Wichert, R., Eberhardt, B. (eds.) Ambient Assisted Living, pp. 17–29. Springer, Heidelberg (2011)

    Google Scholar 

  15. Ennis, A., Rafferty, J., Synnott, J., Cleland, I., Nugent, C., Selby, A., McIlroy, S., Berthelot, A., Masci, G.: A smart cabinet and voice assistant to support independence in older adults. In: International Conference on Ubiquitous Computing and Ambient Intelligence, pp. 466–472 (2017). https://doi.org/10.1007/978-3-319-67585-5_47

  16. European Commission: Shaping Europes digital future. Technical report, Brussels (2020)

    Google Scholar 

  17. The international classification of functioning, disability and health as a conceptual model for the evaluation of environmental factors. Procedia Comput. Sci. 14, 293–300 (2012). https://doi.org/10.1016/j.procs.2012.10.033

  18. Pradhan, A., Mehta, K., Findlater, L.: “Accessibility came by accident”: use of voice-controlled intelligent personal assistants by people with disabilities. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI 2018, pp. 1–13. ACM Press, New York (2018). https://doi.org/10.1145/3173574.3174033

  19. Garcia-Alonso, J., Berrocal, J., Rivero Jiménez, B., Conde Caballero, D., Mariano Juárez, L., Murillo, J.M., Mendes, D., Fonseca, C., Lopes, M., Perez-Vereda, A., Canal, C.: Instituto Internacional de Investigación e Innovación del Envejecimiento. In: Jornadas de Ingenieria del Software y Bases de Datos, JISBD 2018 (2018)

    Google Scholar 

  20. Coucke, A., Saade, A., Ball, A., Bluche, T., Caulier, A., Leroy, D., Doumouro, C., Gisselbrecht, T., Caltagirone, F., Lavril, T., Primet, M., Dureau, J.: Snips voice platform: an embedded spoken language understanding system for private-by-design voice interfaces. CoRR abs/1805.10190 (2018). http://arxiv.org/abs/1805.10190

  21. Martins, A.I., Queirós, A., Rocha, N.P., Santos, B.S.: Avaliação de usabilidade: uma revisão sistemática da literatura. RISTI-Rev Ibérica Sist E Tecnol Informação, pp. 31–43 (2013)

    Google Scholar 

  22. Best, M.L., Smyth, T.N.: Global/Local Usability: Locally Contextualized Usability in the Global South BT - Global Usability, pp. 9–22. Springer, London (2011). https://doi.org/10.1007/978-0-85729-304-6_2

  23. Martins, A., Queirós, A., da Rocha, N.: Usability evaluation of products and services: a systematic review. In: E-Soc (2013)

    Google Scholar 

  24. Martins, A.I., Rosa, A.F., Queirós, A., Silva, A., Rocha, N.P.: European Portuguese validation of the system usability scale (SUS). Procedia Comput. Sci. 67, 293–300 (2015). https://doi.org/10.1016/j.procs.2015.09.273

  25. Jegundo, A.L., Dantas, C., Quintas, J., Dutra, J., Almeida, A.L., Caravau, H., Rosa, A.F., Martins, A.I., Queirós, A., Rocha, N.P.: Usability evaluation of a virtual assistive companion. In: World Conference on Information Systems and Technologies, pp. 706–715 (2019)

    Google Scholar 

  26. Martins, A.I., Queirós, A., Silva, A.G., Rocha, N.P.: ICF based usability scale: evaluating usability according to the evaluators’ perspective about the users’ performance. In: Proceedings of the 7th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion, pp. 378–383 (2016)

    Google Scholar 

  27. Dekker, R., Franco Contreras, J., Meijer, A.: The living lab as a methodology for public administration research: a systematic literature review of its applications in the social sciences. Int. J. Public Adm. 43(14), 1207–1217 (2020). https://doi.org/10.1080/01900692.2019.1668410

  28. Bevan, N.: European usability support centres: support for a more usable information society. In: European Telematics: Advancing the Information Society. Proceedings of TAP Annual Concertation Meeting, pp. 50–65 (1998)

    Google Scholar 

  29. Brooke, J.: Others: SUS-a quick and dirty usability scale. Usability Eval. Ind. 189(194), 4–7 (1996)

    Google Scholar 

  30. Sauro, J.: A Practical Guide to the System Usability Scale: Background, Benchmarks & Best Practices. LLC, Denver (2011)

    Google Scholar 

  31. Ivory, M.Y., Hearst, M.A.: The state of the art in automating usability evaluation of user interfaces. ACM Comput. Surv. (2001). https://doi.org/10.1145/503112.503114

    Article  Google Scholar 

  32. Tsiourti, C., Ben Moussa, M., Quintas, J., Loke, B., Jochem, I., Lopes, J.A., Konstantas, D.: A virtual assistive companion for older adults: design implications for a real-world application. In: Bi, Y., Kapoor, S., Bhatia, R. (eds.) Proceedings of SAI Intelligent Systems Conference (IntelliSys) 2016. IntelliSys 2016. LNNS (2018). https://doi.org/10.1007/978-3-319-56994-9_69

  33. Martins, A.I., Queirós, A., Rocha, N.P.: Validation of a usability assessment instrument according to the evaluators’ perspective about the users’ performance. Univers. Access Inf. Soc. 19(3), 515–525 (2020). https://doi.org/10.1007/s10209-019-00659-w

    Article  Google Scholar 

  34. Kalimullah, K., Sushmitha, D.: Influence of design elements in mobile applications on user experience of elderly people. Procedia Comput. Sci. 113, 352–359 (2017). https://doi.org/10.1016/j.procs.2017.08.344

  35. Holden, R.J., Campbell, N.L., Abebe, E., Clark, D.O., Ferguson, D., Bodke, K., Boustani, M.A., Callahan, C.M.: Usability and feasibility of consumer-facing technology to reduce unsafe medication use by older adults. Res. Soc. Adm. Pharm. RSAP 16(1), 54–61 (2020). https://doi.org/10.1016/j.sapharm.2019.02.011

  36. Gitlin, L.N.: The role of social science research in understanding technology use among older adults. Self-care in later life, pp. 142–169 (1998)

    Google Scholar 

Download references

Acknowledgment

This work was supported by the 4IE+ project (0499_4IE_4_PLUS_4_E) funded by the Interreg V-A España-Portugal (POCTEP) 2014–2020 program.

Author information

Authors and Affiliations

  1. University of Extremadura, Cáceres, Spain

    Borja Rivero Jiménez, David Conde Caballero, J. Jesús-Azabal, Jerónimo Luengo-Polo, Jara Bonilla-Bermejo & Lorenzo Mariano Juárez

Authors
  1. Borja Rivero Jiménez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. David Conde Caballero
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. J. Jesús-Azabal
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jerónimo Luengo-Polo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jara Bonilla-Bermejo
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Lorenzo Mariano Juárez
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Borja Rivero Jiménez .

Editor information

Editors and Affiliations

  1. University of Extremadura, Cáceres, Spain

    José García-Alonso

  2. University of Évora, Évora, Portugal

    César Fonseca

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rivero Jiménez, B., Conde Caballero, D., Jesús-Azabal, J., Luengo-Polo, J., Bonilla-Bermejo, J., Mariano Juárez, L. (2021). Qualitative Research in Evaluation. An Usability Evaluation Protocol for the Assistant on Care and Health Offline (ACHO). In: García-Alonso, J., Fonseca, C. (eds) Gerontechnology III. IWoG 2020. Lecture Notes in Bioengineering. Springer, Cham. https://doi.org/10.1007/978-3-030-72567-9_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-72567-9_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-72566-2

  • Online ISBN: 978-3-030-72567-9

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics

Search

Navigation