Skip to main content
SpringerLink
Log in

Gamification to Improve Medication Adherence: A Mixed-method Usability Study for MedScrab

  • Original Paper
  • Published:
Journal of Medical Systems Aims and scope Submit manuscript

Abstract

Medication non-adherence is a prevalent healthcare problem with poor health outcomes and added healthcare costs. MedScrab, a gamification-based mHealth app, is the first attempt to deliver crucial life-saving medication information to patients and increase their medication adherence. The paper presents the development of MedScrab and a two-phase mixed-method usability evaluation of MedScrab. Phase I qualitatively evaluated MedScrab using a think-aloud protocol for its usability. With 51 participants, qualitative data analysis of Phase I revealed two themes: positive functionality of the app and four areas of improvement. The improvement recommendations were incorporated into MedScrab’s design. Phase I also validated a widely used mHealth App Usability Questionnaire (MAUQ). Quantitative data analysis of Phase I reduced the original 18-item MAUQ scale to a 15-item scale with two factors: ease of use (4 items) and usefulness and satisfaction (11 items). Phase II surveyed 83 participants from Amazon’s Mechanical Turk using a modified MAUQ. The modified MAUQ scale showed strong internal consistency (Cronbach alpha = 0.959) and high factor loadings (between 0.623 and 0.987). The study design of the usability evaluation can serve as a methodological guide for designing, evaluating, and improving mHealth apps.

The usability study showed that MedScrab was perceived as ease of use (6.24 out of 7) with high usefulness and satisfaction (5.72 out of 7). The quantitative data analysis results support the use of the modified MAUQ as a valid instrument to measure the usability of the MedScrab. However, the instrument should be used with adaptation based on the app’s characteristics.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

Data Availability

The datasets generated during the current study are available from the corresponding author upon reasonable request.

Notes

  1. https://www.medscrab.com/.

References

  1. Osterberg L, Blaschke T: Adherence to medication. New England journal of medicine 2005, 353(5):487–497.

    Article  CAS  PubMed  Google Scholar 

  2. Cutler RL, Fernandez-Llimos F, Frommer M, Benrimoj C, Garcia-Cardenas V: Economic impact of medication non-adherence by disease groups: a systematic review. BMJ open 2018, 8(1):e016982.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Grenard JL, Munjas BA, Adams JL, Suttorp M, Maglione M, McGlynn EA, Gellad WF: Depression and medication adherence in the treatment of chronic diseases in the United States: a meta-analysis. Journal of general internal medicine 2011, 26(10):1175–1182.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Iuga AO, McGuire MJ: Adherence and health care costs. Risk management and healthcare policy 2014, 7:35.

    PubMed  PubMed Central  Google Scholar 

  5. Wilhelmsen NC, Eriksson T: Medication adherence interventions and outcomes: an overview of systematic reviews. European Journal of Hospital Pharmacy 2019, 26(4):187–192.

    Article  PubMed  Google Scholar 

  6. Dawoodi I, Bhosale UA: Evaluation of knowledge and awareness of patients about prescribed drugs and their package inserts: a cross-sectional study. Asian Journal of Pharmaceutics (AJP) 2016, 10(2):S96–S99.

    Google Scholar 

  7. Hoy MG, Levenshus AB: A mixed-methods approach to assessing actual risk readership on branded drug websites. Journal of Risk Research 2018, 21(5):521–538.

    Article  Google Scholar 

  8. Roosan D, Li Y, Law A, Truong H, Karim M, Chok J, Roosan M: Improving medication information presentation through interactive visualization in mobile Apps: human factors design. JMIR mHealth and uHealth 2019, 7(11):e15940.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Chakraborty S, Bouder F: The future of risk communication and the role of the pharmaceutical industry. Current drug safety 2013, 8(1):4–10.

    Article  PubMed  Google Scholar 

  10. Konstantinou P, Kassianos AP, Georgiou G, Panayides A, Papageorgiou A, Almas I, Wozniak G, Karekla M: Barriers, facilitators, and interventions for medication adherence across chronic conditions with the highest non-adherence rates: a scoping review with recommendations for intervention development. Translational Behavioral Medicine 2020, 10(6):1390–1398.

    PubMed  Google Scholar 

  11. Roberts KJ, Revenson TA, Urken ML, Fleszar S, Cipollina R, Rowe ME, Dos Reis LL, Lepore SJ: Testing with feedback improves recall of information in informed consent: a proof of concept study. Patient education and counseling 2016, 99(8):1377–1381.

    Article  PubMed  Google Scholar 

  12. Anglada-Martínez H, Martin-Conde M, Rovira-Illamola M, Sotoca-Momblona JM, Sequeira E, Aragunde V, Codina-Jané C: An interactive mobile phone–website platform to facilitate real-time management of medication in chronically ill patients. Journal of Medical Systems 2017, 41(8):1–8.

    Article  Google Scholar 

  13. Sardi L, Idri A, Fernández-Alemán JL: A systematic review of gamification in e-Health. Journal of biomedical informatics 2017, 71:31–48.

    Article  PubMed  Google Scholar 

  14. Rahim MIA, Thomas RH: Gamification of medication adherence in epilepsy. Seizure 2017, 52:11–14.

    Article  PubMed  Google Scholar 

  15. Paglialonga A, Lugo A, Santoro E: An overview on the emerging area of identification, characterization, and assessment of health apps. Journal of biomedical informatics 2018, 83:97–102.

    Article  PubMed  Google Scholar 

  16. Zhou L, Bao J, Setiawan IMA, Saptono A, Parmanto B: The mHealth APP usability questionnaire (MAUQ): development and validation study. JMIR mHealth and uHealth 2019, 7(4):e11500.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Islam R, Weir C, Del Fiol G: Clinical complexity in medicine: a measurement model of task and patient complexity. Methods of information in medicine 2016, 55(01):14–22.

    Article  CAS  PubMed  Google Scholar 

  18. Bassett SM, Schuette SA, O’Dwyer LC, Moskowitz JT: Positive affect and medication adherence in chronic conditions: A systematic review. Health Psychology 2019, 38(11):960.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Mundfrom DJ, Shaw DG, Ke TL: Minimum sample size recommendations for conducting factor analyses. International journal of testing 2005, 5(2):159–168.

    Article  Google Scholar 

  20. Joe J, Chaudhuri S, Le T, Thompson H, Demiris G: The use of think-aloud and instant data analysis in evaluation research: Exemplar and lessons learned. Journal of biomedical informatics 2015, 56:284–291.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Cho H, Yen P-Y, Dowding D, Merrill JA, Schnall R: A multi-level usability evaluation of mobile health applications: A case study. Journal of biomedical informatics 2018, 86:79–89.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Materia FT, Smyth JM: Acceptability of intervention design factors in mHealth Intervention research: Experimental Factorial Study. JMIR mHealth and uHealth 2021, 9(7):e23303.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Lobo EH, Kensing F, Frølich A, Rasmussen LJ, Livingston PM, Islam SMS, Grundy J, Abdelrazek M: mHealth intervention for carers of individuals with a history of stroke: Heuristic evaluation and user perspectives. DIGITAL HEALTH 2022, 8:20552076221089070.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Casler K, Bickel L, Hackett E: Separate but equal? A comparison of participants and data gathered via Amazon’s MTurk, social media, and face-to-face behavioral testing. Computers in human behavior 2013, 29(6):2156–2160.

    Article  Google Scholar 

  25. Lu L, Neale N, Line ND, Bonn M: Improving data quality using Amazon mechanical Turk through platform setup. Cornell Hospitality Quarterly 2022, 63(2):231–246.

    Article  Google Scholar 

  26. Hunt NC, Scheetz AM: Using MTurk to distribute a survey or experiment: Methodological considerations. Journal of Information Systems 2019, 33(1):43–65.

    Article  Google Scholar 

  27. Islam R, Weir CR, Jones M, Del Fiol G, Samore MH: Understanding complex clinical reasoning in infectious diseases for improving clinical decision support design. BMC medical informatics and decision making 2015, 15(1):1–12.

    Article  Google Scholar 

  28. Mustafa N, Safii NS, Jaffar A, Sani NS, Mohamad MI, Abd Rahman AH, Sidik SM: Malay Version of the mHealth App Usability Questionnaire (M-MAUQ): Translation, Adaptation, and Validation Study. JMIR mHealth and uHealth 2021, 9(2):e24457.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Chumkasian W, Fernandez R, Win KT, Petsoglou C, Lord H: Adaptation of the MAUQ and usability evaluation of a mobile phone–based system to promote eye donation. International Journal of Medical Informatics 2021, 151:104462.

    Article  PubMed  Google Scholar 

  30. Schnall R, Higgins T, Brown W, Carballo-Dieguez A, Bakken S: Trust, perceived risk, perceived ease of use and perceived usefulness as factors related to mHealth technology use. Studies in health technology and informatics 2015, 216:467.

    PubMed  PubMed Central  Google Scholar 

  31. Kraidy U: Digital media and education: cognitive impact of information visualization. Journal of Educational Media 2002, 27(3):95–106.

    Article  Google Scholar 

  32. Ahmed I, Ahmad NS, Ali S, Ali S, George A, Danish HS, Uppal E, Soo J, Mobasheri MH, King D: Medication adherence apps: review and content analysis. JMIR mHealth and uHealth 2018, 6(3):e6432.

    Article  Google Scholar 

  33. Tran S, Smith L, El-Den S, Carter S: The use of Gamification and incentives in mobile health Apps to improve medication adherence: Scoping review. JMIR mHealth and uHealth 2022, 10(2):e30671.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Maramba I, Chatterjee A, Newman C: Methods of usability testing in the development of eHealth applications: a scoping review. International journal of medical informatics 2019, 126:95–104.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

The authors did not receive support from any organization for the submitted work.

Author information

Authors and Affiliations

  1. Center for Information Systems and Technology (CISAT), Claremont Graduate University, 130 E. Ninth St. ACB225, Claremont, CA, 91711, USA

    Yan Li

  2. College of Pharmacy, Western University of Health Sciences, Pomona, CA, USA

    Huong Phan, Anandi V Law & Don Roosan

  3. Graduate College of Biomedical Sciences, Western University of Health Sciences, Pomona, CA, USA

    Andrius Baskys

Authors
  1. Yan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Huong Phan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anandi V Law
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Andrius Baskys
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Don Roosan
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Yan Li and Don Roosan contributed to the conceptualization of the study. Yan Li determined the study methodology and design. Yan Li and Don Roosan provided supervision of the entire study. Yan Li, Huong Phan, and Don Roosan contributed to the data collection. Yan Li, Huong Phan, Anandi V Law, and Don Roosan contributed to data analysis and data interpretation. The first draft of the manuscript was written by Yan Li and all authors reviewed and edited previous versions of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Yan Li.

Ethics declarations

Competing Interests

The authors declare no competing interests.

Ethical Approval and Consent to Participate

This study was reviewed and approved by the Western University of Health Sciences IRB.

Human and Animal Ethics

Informed Consent was obtained from all individual participants included in the study.

Consent for Publication

Authors give consent for publication in the Journal of Medical Systems.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic Supplementary Material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, Y., Phan, H., Law, A.V. et al. Gamification to Improve Medication Adherence: A Mixed-method Usability Study for MedScrab. J Med Syst 47, 108 (2023). https://doi.org/10.1007/s10916-023-02006-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10916-023-02006-2

Keywords

Search

Navigation