Skip to main content
SpringerLink
Log in

Concordance of Adherence Measurement Using Self-Reported Adherence Questionnaires and Medication Monitoring Devices: An Updated Review

  • Review Article
  • Published:
PharmacoEconomics Aims and scope Submit manuscript

Abstract

Introduction

As medication adherence continues to be a prevalent issue in today’s society, the methods used to monitor medication-taking behaviors are constantly being re-evaluated and compared in search of the ‘gold standard’ measure. Our review aimed to assess the current literature surrounding the correlation between self-reported questionnaires (SRQs) and electronic monitoring devices to determine if these measures produce similar results.

Methods

We performed a literature search from 2009 to 2017 using PubMed, PubMed In-Process and Non-Indexed, EMBASE, Ovid MEDLINE, and Ovid MEDLINE In-Process. A keyword search using the terms ‘patient compliance’, ‘treatment compliance’, ‘medication adherence’, ‘drug monitoring’, ‘drug therapy’, ‘electronic’, ‘digital’, ‘computer’, ‘monitor’, ‘monitoring’, ‘drug’, ‘pharmaceutical preparations’, ‘compliance’, and ‘medications’ was done to capture all articles. We included articles measuring adherence using both monitoring devices and SRQs.

Results

Thirty-five articles were included in this review. The average difference in measured adherence rates between the two measures was 9.2% (range −66.3 to 61.5). A majority (62.7%) of articles reported moderate (n = 12; 27.9%), high (n = 5, 11.6%), or significant (n = 10, 23.3%) correlations between SRQs and monitoring devices.

Conclusion

Results from our review are consistent with previous studies, as we found that many of our studies produced moderate to high correlation between both SRQs and monitoring devices [Farmer, Clin Ther 21(6):1074–90 (1999), IMS Institute for Healthcare Informatics. Avoidable costs in US health care (2012), Patel et al., Respirology 18(3):546–52 (2013), Siracusa et al., J Cyst Fibros 14(5):621–6 (2015), Smith et al., Int J Cardiol 145(1):122–3 (2010)]. Our findings demonstrate that self-reported adherence produces comparable results to electronic monitoring devices. As there is not yet a ‘gold standard’ measure for monitoring patient adherence, SRQs and Medication Event Monitoring Systems (MEMS) operating together continue to emerge as the preferred effective method for measuring medication adherence.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  1. Brown MT, Bussell JK. Medication adherence: WHO cares? Mayo Clin Proc. 2011;86(4):304–14. doi:10.4065/mcp.2010.0575.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Hugtenburg JG, Timmers L, Elders PJ, Vervloet M, van Dijk L. Definitions, variants, and causes of nonadherence with medication: a challenge for tailored interventions. Patient Prefer Adher. 2013;7:675–82. doi:10.2147/PPA.S29549.

    Article  Google Scholar 

  3. Osterberg L, Blaschke T. Adherence to medication. N Engl J Med. 2005;353(5):487–97. doi:10.1056/NEJMra050100.

    Article  CAS  PubMed  Google Scholar 

  4. Bosworth HB, Granger BB, Mendys P, Brindis R, Burkholder R, Czajkowski SM, Granger CB. Medication adherence: a call for action. Am Heart J. 2011;162(3):412–24. doi:10.1016/j.ahj.2011.06.007.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Iuga AO, McGuire MJ. Adherence and health care costs. Risk Manag Healthc Policy. 2014;7:35–44. doi:10.2147/RMHP.S19801.

    PubMed  PubMed Central  Google Scholar 

  6. De Geest S, Sabate E. Adherence to long-term therapies: evidence for action. Eur J Cardiovasc Nurs. 2003;2(4):323. doi:10.1016/S1474-5151(03)00091-4.

    Article  PubMed  Google Scholar 

  7. Farmer KC. Methods for measuring and monitoring medication regimen adherence in clinical trials and clinical practice. Clin Ther. 1999;21(6):1074–90. doi:10.1016/S0149-2918(99)80026-5 (discussion 1073).

    Article  CAS  PubMed  Google Scholar 

  8. Lam WY, Fresco P. Medication adherence measures: an overview. Biomed Res Int. 2015;2015:217047. doi:10.1155/2015/217047.

    PubMed  PubMed Central  Google Scholar 

  9. Williams AB, Amico KR, Bova C, Womack JA. A proposal for quality standards for measuring medication adherence in research. AIDS Behav. 2013;17(1):284–97. doi:10.1007/s10461-012-0172-7.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Velligan DI, Wang M, Diamond P, Glahn DC, Castillo D, Bendle S, Miller AL. Relationships among subjective and objective measures of adherence to oral antipsychotic medications. Psychiatr Serv. 2007;58(9):1187–92. doi:10.1176/ps.2007.58.9.1187.

    Article  PubMed  Google Scholar 

  11. Dew MA, Dabbs AD, Myaskovsky L, Shyu S, Shellmer DA, DiMartini AF, Greenhouse JB. Meta-analysis of medical regimen adherence outcomes in pediatric solid organ transplantation. Transplantation. 2009;88(5):736–46. doi:10.1097/TP.0b013e3181b2a0e0.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Clifford S, Perez-Nieves M, Skalicky AM, Reaney M, Coyne KS. A systematic literature review of methodologies used to assess medication adherence in patients with diabetes. Curr Med Res Opin. 2014;30(6):1071–85. doi:10.1185/03007995.2014.884491.

    Article  CAS  PubMed  Google Scholar 

  13. Shi L, Liu J, Koleva Y, Fonseca V, Kalsekar A, Pawaskar M. Concordance of adherence measurement using self-reported adherence questionnaires and medication monitoring devices. Pharmacoeconomics. 2010;28(12):1097–107. doi:10.2165/11537400-000000000-00000.

    Article  PubMed  Google Scholar 

  14. Quality of Reporting of Meta-Analyses (QUOROM). (2008). https://www.biomedcentral.com/content/supplementary/1471-2261-10-24-s1.pdf. Accessed 24 Oct 2014.

  15. Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). PRISMA 27-item Systematic Review and Meta-Analyses checklist. Transparent Reporting of Systematic Reviews and Meta-Analyses (2009). http://prisma-statement.org/PRISMAStatement/Checklist.aspx. Accessed 2 Jan 2015.

  16. Yang J, Ko YH, Paik JW, Lee MS, Han C, Joe SH, Kim SH. Symptom severity and attitudes toward medication: impacts on adherence in outpatients with schizophrenia. Schizophr Res. 2012;134(2–3):226–31. doi:10.1016/j.schres.2011.11.008.

    Article  PubMed  Google Scholar 

  17. IMS Institute for Healthcare Informatics. Avoidable costs in US health care. 2013. Available at: http://www.imshealth.com/deployedles/imshealth/Global/Content/Corporate/IMS%20Institute/RUOM-2013/IHII_Responsible_Use_Medicines_2013.pdf. Accessed 10 Sept 2013.

  18. Benjamin RM. Medication adherence: helping patients take their medicines as directed. Public Health Rep. 2012;127(1):2–3.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Cook PF, Schmiege SJ, Mansberger SL, Kammer J, Fitzgerald T, Kahook MY. Predictors of adherence to glaucoma treatment in a multisite study. Ann Behav Med. 2015;49(1):29–39. doi:10.1007/s12160-014-9641-8.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Garber MC, Nau DP, Erickson SR, et al. The concordance of self-report with other measures of medication adherence: a summary of the literature. Med Care. 2004;42(7):649–52.

    Article  PubMed  Google Scholar 

  21. Wang P, Benner JS, Glynn RJ, et al. How well do patients report noncompliance with antihypertensive medications? A comparison of self-report versus filled prescriptions. Pharmacoepidemiol Drug Saf. 2004;13(1):11–9.

    Article  CAS  PubMed  Google Scholar 

  22. Barnestein-Fonseca P, Leiva-Fernandez J, Vidal-Espana F, Garcia-Ruiz A, Prados-Torres D, Leiva-Fernandez F. Is it possible to diagnose the therapeutic adherence of patients with COPD in clinical practice? A cohort study. BMC Pulm Med. 2011;11:6. doi:10.1186/1471-2466-11-6.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Badiee J, Riggs PK, Rooney AS, Vaida F, Grant I, Atkinson JH, Hiv Neurobehavioral Research Program, G. Approaches to identifying appropriate medication adherence assessments for HIV infected individuals with comorbid bipolar disorder. AIDS Patient Care STDS. 2012;26(7):388–94. doi:10.1089/apc.2011.0447.

    PubMed  PubMed Central  Google Scholar 

  24. Van den Boogaard J, Lyimo RA, Boeree MJ, Kibiki GS, Aarnoutse RE. Electronic monitoring of treatment adherence and validation of alternative adherence measures in tuberculosis patients: a pilot study. Bull World Health Organ. 2011;89(9):632–9. doi:10.2471/BLT.11.086462.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Wickstrom G, Bendix T. The ‘Hawthorne effect’: what did the original Hawthorne studies actually show? Scand J Work Environ Health. 2000;26(4):363–7.

    Article  CAS  PubMed  Google Scholar 

  26. Feinstein AR. On white-coat effects and the electronic monitoring of compliance. Arch Intern Med. 1990;150(7):1377–8.

    Article  CAS  PubMed  Google Scholar 

  27. Chesney MA, Ickovics JR, Chambers DB, Gifford AL, Neidig J, Zwickl B, Wu AW. Self-reported adherence to antiretroviral medications among participants in HIV clinical trials: the AACTG adherence instruments. Patient Care Committee and Adherence Working Group of the Outcomes Committee of the Adult AIDS Clinical Trials Group (AACTG). AIDS Care. 2000;12(3):255–66.

    Article  CAS  PubMed  Google Scholar 

  28. Doro P, Benko R, Czako A, Matuz M, Thurzo F, Soos G. Optimal recall period in assessing the adherence to antihypertensive therapy: a pilot study. Int J Clin Pharm. 2011;33(4):690–5. doi:10.1007/s11096-011-9529-7.

    Article  PubMed  Google Scholar 

  29. Cate H, Bhattacharya D, Clark A, Holland R, Broadway DC. A comparison of measures used to describe adherence to glaucoma medication in a randomised controlled trial. Clin Trials. 2015;12(6):608–17. doi:10.1177/1740774515592636.

    Article  PubMed  Google Scholar 

  30. Ayoade A, Oladipo I. Evaluation of the correlation between self-report and electronic monitoring of adherence to hypertension therapy. Blood Press. 2012;21(3):161–6. doi:10.3109/08037051.2012.679029.

    Article  PubMed  Google Scholar 

  31. Dunn KE, King VL, Brooner RK. Comparison of methods to assess psychiatric medication adherence in methadone-maintained patients with co-occurring psychiatric disorder. Drug Alcohol Depend. 2016;160:212–7. doi:10.1016/j.drugalcdep.2016.01.016.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Dunbar-Jacob J, Sereika SM, Houze M, Luyster FS, Callan JA. Accuracy of measures of medication adherence in a cholesterol-lowering regimen. West J Nurs Res. 2012;34(5):578–97. doi:10.1177/0193945912439251.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Cate H, Bhattacharya D, Clark A, Holland R, Broadway DC. Patterns of adherence behaviour for patients with glaucoma. Eye (Lond). 2013;27(4):545–53. doi:10.1038/eye.2012.294.

    Article  CAS  Google Scholar 

  34. Sayner R, Carpenter DM, Blalock SJ, Robin AL, Muir KW, Hartnett ME, Sleath B. Accuracy of patient-reported adherence to glaucoma medications on a visual analog scale compared with electronic monitors. Clin Ther. 2015;37(9):1975–85. doi:10.1016/j.clinthera.2015.06.008.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Price DD, Staud R, Robinson ME, et al. How should we use the visual analogue scale (VAS) in rehabilitation outcomes? II: Visual analogue scales as ratio scales: an alternative to the view of Kersten et al. J Rehabil Med. 2012;44(9):800–4. doi:10.2340/16501977-1031.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Buscher A, Hartman C, Kallen MA, Giordano TP. Validity of self-report measures in assessing antiretroviral adherence of newly diagnosed, HAART-naive, HIV patients. HIV Clin Trials. 2011;12(5):244–54. doi:10.1310/hct1205-244.

    Article  PubMed  PubMed Central  Google Scholar 

  37. De Cuyper E, De Gucht V, Maes S, Van Camp Y, De Clerck LS. Determinants of methotrexate adherence in rheumatoid arthritis patients. Clin Rheumatol. 2016;35(5):1335–9. doi:10.1007/s10067-016-3182-4.

    Article  PubMed  Google Scholar 

  38. Svarstad BL, Chewning BA, Sleath BL, Claesson C. The Brief Medication Questionnaire: a tool for screening patient adherence and barriers to adherence. Patient Educ Couns. 1999;37(2):113–24.

    Article  CAS  PubMed  Google Scholar 

  39. Bogner HR, de Vries HF, O’’onnell AJ, Morales KH. Measuring concurrent oral hypoglycemic and antidepressant adherence and clinical outcomes. Am J Manag Care. 2013;19(3):e85–92.

    PubMed  PubMed Central  Google Scholar 

  40. Applebaum AJ, Reilly LC, Gonzalez JS, Richardson MA, Leveroni CL, Safren SA. The impact of neuropsychological functioning on adherence to HAART in HIV-infected substance abuse patients. AIDS Patient Care STDS. 2009;23(6):455–62. doi:10.1089/apc.2008.0181.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Bruxvoort K, Festo C, Cairns M, Kalolella A, Mayaya F, Kachur SP, Goodman C. Measuring patient adherence to malaria treatment: a comparison of results from self-report and a customised electronic monitoring device. PLoS One. 2015;10(7):e0134275. doi:10.1371/journal.pone.0134275.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Christensen A, Christrup LL, Fabricius PE, Chrostowska M, Wronka M, Narkiewicz K, Hansen EH. The impact of an electronic monitoring and reminder device on patient compliance with antihypertensive therapy: a randomized controlled trial. J Hypertens. 2010;28(1):194–200. doi:10.1097/HJH.0b013e328331b718.

    Article  CAS  PubMed  Google Scholar 

  43. Das M, Santos D, Matheson T, Santos GM, Chu P, Vittinghoff E, Colfax GN. Feasibility and acceptability of a phase II randomized pharmacologic intervention for methamphetamine dependence in high-risk men who have sex with men. AIDS. 2010;24(7):991–1000.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  44. Eberlin M, Otto G, Kramer I. Increased medication compliance of liver transplant patients switched from a twice-daily to a once-daily tacrolimus-based immunosuppressive regimen. Transplant Proc. 2013;45(6):2314–20. doi:10.1016/j.transproceed.2012.10.037.

    Article  CAS  PubMed  Google Scholar 

  45. Gillespie D, Hood K, Farewell D, Stenson R, Probert C, Hawthorne AB. Electronic monitoring of medication adherence in a 1-year clinical study of 2 dosing regimens of mesalazine for adults in remission with ulcerative colitis. Inflamm Bowel Dis. 2014;20(1):82–91. doi:10.1097/01.MIB.0000437500.60546.2a.

    Article  PubMed  Google Scholar 

  46. Greenley RN, Kunz JH, Biank V, Martinez A, Miranda A, Noe J, Stephens MC. Identifying youth nonadherence in clinical settings: data-based recommendations for children and adolescents with inflammatory bowel disease. Inflamm Bowel Dis. 2012;18(7):1254–9. doi:10.1002/ibd.21859.

    Article  PubMed  Google Scholar 

  47. Inauen J, Bierbauer W, Luscher J, Konig C, Tobias R, Ihle A, Scholz U. Assessing adherence to multiple medications and in daily life among patients with multimorbidity. Psychol Health. 2017;. doi:10.1080/08870446.2016.1275632.

    PubMed  Google Scholar 

  48. Jentzsch NS, Camargos PA, Colosimo EA, Bousquet J. Monitoring adherence to beclomethasone in asthmatic children and adolescents through four different methods. Allergy. 2009;64(10):1458–62. doi:10.1111/j.1398-9995.2009.02037.x.

    Article  CAS  PubMed  Google Scholar 

  49. Kennedy AP, Epstein DH, Jobes ML, Agage D, Tyburski M, Phillips KA, Preston KL. Continuous in-the-field measurement of heart rate: correlates of drug use, craving, stress, and mood in polydrug users. Drug Alcohol Depend. 2015;151:159–66. doi:10.1016/j.drugalcdep.2015.03.024.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Modi AC, Zeller MH, Xanthakos SA, Jenkins TM, Inge TH. Adherence to vitamin supplementation following adolescent bariatric surgery. Obesity (Silver Spring). 2013;21(3):E190–5. doi:10.1002/oby.20031.

    Article  CAS  Google Scholar 

  51. Waimann CA, Marengo MF, de Achaval S, Cox VL, Garcia-Gonzalez A, Reveille JD, Suarez-Almazor ME. Electronic monitoring of oral therapies in ethnically diverse and economically disadvantaged patients with rheumatoid arthritis: consequences of low adherence. Arthritis Rheum. 2013;65(6):1421–9. doi:10.1002/art.37917.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  52. Pai AL, Rausch J, Tackett A, Marsolo K, Drotar D, Goebel J. System for integrated adherence monitoring: real-time non-adherence risk assessment in pediatric kidney transplantation. Pediatr Transplant. 2012;16(4):329–34. doi:10.1111/j.1399-3046.2012.01657.x.

    Article  PubMed  Google Scholar 

  53. Okeke CO, Quigley HA, Jampel HD, Ying GS, Plyler RJ, Jiang Y, Friedman DS. Adherence with topical glaucoma medication monitored electronically the Travatan Dosing Aid study. Ophthalmology. 2009;116(2):191–9. doi:10.1016/j.ophtha.2008.09.004.

    Article  PubMed  Google Scholar 

  54. Patel M, Perrin K, Pritchard A, Williams M, Wijesinghe M, Weatherall M, Beasley R. Accuracy of patient self-report as a measure of inhaled asthma medication use. Respirology. 2013;18(3):546–52. doi:10.1111/resp.12059.

    Article  PubMed  Google Scholar 

  55. Van Camp YP, Vrijens B, Abraham I, Van Rompaey B, Elseviers MM. Adherence to phosphate binders in hemodialysis patients: prevalence and determinants. J Nephrol. 2014;27(6):673–9. doi:10.1007/s40620-014-0062-3.

    Article  PubMed  Google Scholar 

  56. Wiens MO, MacLeod S, Musiime V, Ssenyonga M, Kizza R, Bakeera-Kitaka S, Ssali F. Adherence to antiretroviral therapy in HIV-positive adolescents in Uganda assessed by multiple methods: a prospective cohort study. Paediatr Drugs. 2012;14(5):331–5. doi:10.2165/11599280-000000000-00000.

    Article  PubMed  Google Scholar 

  57. Smith H, Hankins M, Hodson A, George C. Measuring the adherence to medication of elderly patients with heart failure: is there a gold standard? Int J Cardiol. 2010;145(1):122–3. doi:10.1016/j.ijcard.2009.06.031.

    Article  PubMed  Google Scholar 

  58. Siracusa CM, Ryan J, Burns L, Wang Y, Zhang N, Clancy JP, Drotar D. Electronic monitoring reveals highly variable adherence patterns in patients prescribed ivacaftor. J Cyst Fibros. 2015;14(5):621–6. doi:10.1016/j.jcf.2015.05.009.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Sajatovic M, Levin JB, Sams J, Cassidy KA, Akagi K, Aebi ME, Tatsuoka C. Symptom severity, self-reported adherence, and electronic pill monitoring in poorly adherent patients with bipolar disorder. Bipolar Disord. 2015;17(6):653–61. doi:10.1111/bdi.12326.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Data Availability Statement

All data that support these findings can be found in each of the articles listed in Table 3. Additionally, for further information, each article included in this review is listed in the References section.

Author information

Authors and Affiliations

  1. Department of Global Health Management and Policy, Tulane University School of Public Health and Tropical Medicine, New Orleans, LA, 70112, USA

    Alisha Monnette, Yichen Zhang, Hui Shao & Lizheng Shi

Authors
  1. Alisha Monnette
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yichen Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hui Shao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lizheng Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

The editor of PharmacoEconomics suggested the review. Alisha Monnette conducted the literature review, participated in the design, interpretation of the results, and led the writing of the manuscript. Yichen Zhang assisted the principal investigator with the literature search, performed the statistical analyses, and the interpretation of the results. Hui Shao participated in the analytical plan and interpretation of the results. Lizheng Shi was the consultant for the project and participated in the interpretation of the results and manuscript presentation. All authors contributed to the development of the manuscript and agreed on the final submitted version. The authors thank the editor and two anonymous reviewers for their constructive comments.

Corresponding author

Correspondence to Lizheng Shi.

Ethics declarations

Funding

No external funding was received.

Conflict of interest

No conflict exists for Alisha Monnette, Yichen Zhang, Hui Shao, or Lizheng Shi.

Ethical approval

For this type of study formal consent is not required.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Monnette, A., Zhang, Y., Shao, H. et al. Concordance of Adherence Measurement Using Self-Reported Adherence Questionnaires and Medication Monitoring Devices: An Updated Review. PharmacoEconomics 36, 17–27 (2018). https://doi.org/10.1007/s40273-017-0570-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40273-017-0570-9

Search

Navigation