Skip to main content
Log in

Quasi experimental designs in pharmacist intervention research

  • Research Article
  • Published:
International Journal of Clinical Pharmacy Aims and scope Submit manuscript

Abstract

Background In the field of pharmacist intervention research it is often difficult to conform to the rigorous requirements of the “true experimental” models, especially the requirement of randomization. When randomization is not feasible, a practice based researcher can choose from a range of “quasi-experimental designs” i.e., non-randomised and at time non controlled. Objective The aim of this article was to provide an overview of quasi-experimental designs, discuss their strengths and weaknesses and to investigate their application in pharmacist intervention research over the previous decade. Results In the literature quasi experimental studies may be classified into five broad categories: quasi-experimental design without control groups; quasi-experimental design that use control groups with no pre-test; quasi-experimental design that use control groups and pre-tests; interrupted time series and stepped wedge designs. Quasi-experimental study design has consistently featured in the evolution of pharmacist intervention research. The most commonly applied of all quasi experimental designs in the practice based research literature are the one group pre-post-test design and the non-equivalent control group design i.e., (untreated control group with dependent pre-tests and post-tests) and have been used to test the impact of pharmacist interventions in general medications management as well as in specific disease states. Conclusion Quasi experimental studies have a role to play as proof of concept, in the pilot phases of interventions when testing different intervention components, especially in complex interventions. They serve to develop an understanding of possible intervention effects: while in isolation they yield weak evidence of clinical efficacy, taken collectively, they help build a body of evidence in support of the value of pharmacist interventions across different practice settings and countries. However, when a traditional RCT is not feasible for logistical and/or ethical reasons researchers should endeavour to use the more robust of the quasi experimental designs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Hatah E, Braund R, Duffull S, Tordoff J. General practioners’ perceptions of pharmacists’ new services in New Zealand. Int J Clin Pharm. 2012;34:364–73.

    Article  PubMed  Google Scholar 

  2. Tannenbaum C, Tsuyuki RT. The expanding scope of pharmacists’ practice: implications for physicians. CMAJ. 2013;185:1228–32.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Benrimoj SI, Roberts AS. Providing patient care in community pharmacies in Australia. Ann Pharmacother. 2005;39:1911–7.

    Article  PubMed  Google Scholar 

  4. Farley TM, Shelsky C, Powell S, Farris KB, Carter BL. Effect of clinical pharmacist intervention on medication discrepancies following hospital discharge. Int J Clin Pharm. 2014;36:430–7.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Andreoli L, Alexandra JF, Tesmoingt C, Eerdekens C, Macrez A, Papo T, et al. Medication reconciliation: a prospective study in an internal medicine unit. Drugs Aging. 2014;31:387–93.

    Article  PubMed  Google Scholar 

  6. Blenkinsopp A, Bond C, Raynor DK. Medication reviews. Br J Clin Pharmacol. 2012;74:573–80.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Pharmacy Guild of Australia. Home Medicines Review (HMR). 2012. http://www.guild.org.au/docs/default-source/public-documents/tab—the-guild/Strategic-Direction/hmr.pdf?sfvrsn=0.

  8. Bradley F, Wagner AC, Elvey R, Noyce PR, Ashcroft DM. Determinants of the uptake of medicines use reviews (MURs) by community pharmacies in England: a multi-method study. Health Policy. 2008;88:258–68.

    Article  PubMed  Google Scholar 

  9. American Pharmacists Association. Medication Therapy Management. 2014. http://www.pharmacist.com/mtm.

  10. Bond C. The need for pharmacy practice research. Int J Pharm Pract. 2006;14:1–2.

    Article  Google Scholar 

  11. Robinson R. Different approaches to the evaluation of programs and services. Aust Psychol. 1984;19:147–61.

    Article  Google Scholar 

  12. Tsuyuki RT, Houle SK, Charrois TL, Kolber MR, Rosenthal MM, Lewanczuk R, et al. Randomized trial of the effect of pharmacist prescribing on improving blood pressure in the community: the Alberta clinical trial in optimizing hypertension (RxACTION). Circulation. 2015;132:93–100.

    Article  PubMed  Google Scholar 

  13. Kjeldsen LJ, Bjerrum L, Dam P, Larsen BO, Rossing C, Sondergaard B, et al. Safe and effective use of medicines for patients with type 2 diabetes—a randomized controlled trial of two interventions delivered by local pharmacies. Res Soc Adm Pharm. 2015;11:47–62.

    Article  Google Scholar 

  14. Krass I, Armour CL, Mitchell B, Brillant M, Dienaar R, Hughes J, et al. The Pharmacy Diabetes Care Program: assessment of a community pharmacy diabetes service model in Australia. Diabet Med. 2007;24:677–83.

    Article  CAS  PubMed  Google Scholar 

  15. Medical Research Council. A framework for development and evaluation of RCTs for complex interventions to improve health; 2000. https://www.mrc.ac.uk/documents/pdf/rcts-for-complex-interventions-to-improve-health/

  16. Morgado M, Rolo S, Castelo-Branco M. Pharmacist intervention program to enhance hypertension control: a randomised controlled trial. Int J Clin Pharm. 2011;33:132–40.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Lapane KL, Hughes CM, Daiello LA, Cameron KA, Feinberg J. Effect of a pharmacist-led multicomponent intervention focusing on the medication monitoring phase to prevent potential adverse drug events in nursing homes. J Am Geriatr Soc. 2011;59:1238–45.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Roberts MS, Stokes JA, King MA, Lynne TA, Purdie DM, Glasziou PP, et al. Outcomes of a randomized controlled trial of a clinical pharmacy intervention in 52 nursing homes. Br J Clin Pharmacol. 2001;51:257–65.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  19. Eussen SR, van der Elst ME, Klungel OH, Rompelberg CJ, Garssen J, Oosterveld MH, et al. A pharmaceutical care program to improve adherence to statin therapy: a randomized controlled trial. Ann Pharmacother. 2010;44:1905–13.

    Article  PubMed  Google Scholar 

  20. Cook TD, Campbell DT. Experimental and quasi experimental designs for generalized causal inference. Chicago: Rand McNally Publishing Company; 1979.

    Google Scholar 

  21. Harris AD, McGregor JC, Perencevich EN, Furuno JP, Zhu J, Peterson DE, et al. The use and interpretation of quasi-experimental studies in medical informatics. J Am Med Inform Assoc. 2006;13:16–23.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC Med Res Methodol. 2006;6:54.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Luder HR, Frede SM, Kirby JA, Epplen K, Cavanaugh T, Martin-Boone JE, et al. TransitionRx: impact of community pharmacy postdischarge medication therapy management on hospital readmission rate. J Am Pharm Assoc. 2003;2015(55):246–54.

    Google Scholar 

  24. Walker PC, Bernstein SJ, Jones JN, Piersma J, Kim HW, Regal RE, et al. Impact of a pharmacist-facilitated hospital discharge program: a quasi-experimental study. Arch Intern Med. 2009;169:2003–10.

    Article  PubMed  Google Scholar 

  25. Harris IM, Westberg SM, Frakes MJ, Van Vooren JS. Outcomes of medication therapy review in a family medicine clinic. J Am Pharm Assoc. 2003;2009(49):623–7.

    Google Scholar 

  26. Hammerlein A, Muller U, Schulz M. Pharmacist-led intervention study to improve inhalation technique in asthma and COPD patients. J Eval Clin Pract. 2011;17:61–70.

    Article  PubMed  Google Scholar 

  27. Gums TH, Carter BL, Milavetz G, Buys L, Rosenkrans K, Uribe L, et al. Physician–pharmacist collaborative management of asthma in primary care. Pharmacotherapy. 2014;34:1033–42.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Bunting BA, Cranor CW. The Asheville Project: long-term clinical, humanistic, and economic outcomes of a community-based medication therapy management program for asthma. J Am Pharm Assoc. 2003;2006(46):133–47.

    Google Scholar 

  29. Anaya JP, Rivera JO, Lawson K, Garcia J, Luna J Jr, Ortiz M. Evaluation of pharmacist-managed diabetes mellitus under a collaborative drug therapy agreement. Am J Health Syst Pharm. 2008;65:1841–5.

    Article  PubMed  Google Scholar 

  30. Johnson CL, Nicholas A, Divine H, Perrier DG, Blumenschein K, Steinke DT. Outcomes from DiabetesCARE: a pharmacist-provided diabetes management service. J Am Pharm Assoc. 2003;2008(48):722–30.

    Google Scholar 

  31. Mularski KS, Yeh CP, Bains JK, Mosen DM, Hill AK, Mularski RA. Pharmacist glycemic control team improves quality of glycemic control in surgical patients with perioperative dysglycemia. Perm J. 2012;16:28–33.

    Article  PubMed  PubMed Central  Google Scholar 

  32. LaMarr B, Valdez C, Driscoll K, Ryan M. Influence of pharmacist intervention on prescribing of angiotensin-converting-enzyme inhibitors, angiotensin II-receptor blockers, and aspirin for diabetic patients. Am J Health Syst Pharm. 2010;67:290–4.

    Article  PubMed  Google Scholar 

  33. Cripps RJ, Gourley ES, Johnson W, Cassidy R, Morgan TC, Venugopal D, et al. An evaluation of diabetes-related measures of control after 6 months of clinical pharmacy specialist intervention. J Pharm Pract. 2011;24:332–8.

    Article  PubMed  Google Scholar 

  34. Xin C, Ge X, Zheng L, Huang P. Evaluation of pharmaceutical care in a diabetes ward from China: a pre-and post-intervention study. Int J Clin Pharm. 2014;36:963–8.

    Article  PubMed  Google Scholar 

  35. Al Hamarneh YN, Charrois T, Lewanczuk R, Tsuyuki RT. Pharmacist intervention for glycaemic control in the community (the RxING study). BMJ Open. 2013;3:e003154.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Bluml BM, Watson LL, Skelton JB, Manolakis PG, Brock KA. Improving outcomes for diverse populations disproportionately affected by diabetes: final results of Project IMPACT: diabetes. J Am Pharm Assoc. 2003;2014(54):477–85.

    Google Scholar 

  37. John EJ, Vavra T, Farris K, Currie J, Doucette W, Button-Neumann B, et al. Workplace-based cardiovascular risk management by community pharmacists: impact on blood pressure, lipid levels, and weight. Pharmacotherapy. 2006;26:1511–7.

    Article  PubMed  Google Scholar 

  38. Garrett DG, Bluml BM. Patient self-management program for diabetes: first-year clinical, humanistic, and economic outcomes. J Am Pharm Assoc. 2003;2005(45):130–7.

    Google Scholar 

  39. Bex SD, Boldt AS, Needham SB, Bolf SM, Walston CM, Ramsey DC, et al. Effectiveness of a hypertension care management program provided by clinical pharmacists for veterans. Pharmacotherapy. 2011;31:31–8.

    Article  PubMed  Google Scholar 

  40. McNamara KP, O’Reilly SL, Dunbar JA, Bailey MJ, George J, Peterson GM, et al. A pilot study evaluating multiple risk factor interventions by community pharmacists to prevent cardiovascular disease: the PAART CVD pilot project. Ann Pharmacother. 2012;46:183–91.

    Article  PubMed  Google Scholar 

  41. Bunting BA, Smith BH, Sutherland SE. The Asheville Project: clinical and economic outcomes of a community-based long-term medication therapy management program for hypertension and dyslipidemia. J Am Pharm Assoc. 2003;2008(48):23–31.

    Google Scholar 

  42. Marin Armero A, Calleja Hernandez MA, Perez-Vicente S, Martinez-Martinez F. Pharmaceutical care in smoking cessation. Patient Prefer Adherence. 2015;9:209–15.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Joost R, Dorje F, Schwitulla J, Eckardt KU, Hugo C. Intensified pharmaceutical care is improving immunosuppressive medication adherence in kidney transplant recipients during the first post-transplant year: a quasi-experimental study. Nephrol Dial Transplant. 2014;29:1597–607.

    Article  PubMed  Google Scholar 

  44. Bereznicki B, Peterson G, Jackson S, Walters EH, Gee P. The sustainability of a community pharmacy intervention to improve the quality use of asthma medication. J Clin Pharm Ther. 2011;36:144–51.

    Article  CAS  PubMed  Google Scholar 

  45. Armour CL, Reddel HK, LeMay KS, Saini B, Smith LD, Bosnic-Anticevich SZ, et al. Feasibility and effectiveness of an evidence-based asthma service in Australian community pharmacies: a pragmatic cluster randomized trial. J Asthma. 2013;50:302–9.

    Article  PubMed  Google Scholar 

  46. Saini B, Filipovska J, Bosnic-Anticevich S, Taylor S, Krass I, Armour C. An evaluation of a community pharmacy-based rural asthma management service. Aust J Rural Health. 2008;16:100–8.

    Article  PubMed  Google Scholar 

  47. Moore JM, Shartle D, Faudskar L, Matlin OS, Brennan TA. Impact of a patient-centered pharmacy program and intervention in a high-risk group. J Manag Care Pharm. 2013;19:228–36.

    PubMed  Google Scholar 

  48. Guenette L, Breton MC, Gregoire JP, Jobin MS, Bolduc Y, Boulet LP, et al. Effectiveness of an asthma integrated care program on asthma control and adherence to inhaled corticosteroids. J Asthma. 2015;52:1–8.

    Google Scholar 

  49. Fox D, Ried LD, Klein GE, Myers W, Foli K. A medication therapy management program’s impact on low-density lipoprotein cholesterol goal attainment in Medicare Part D patients with diabetes. J Am Pharm Assoc. 2003;2009(49):192–9.

    Google Scholar 

  50. Johnson KA, Chen S, Cheng IN, Lou M, Gregerson P, Blieden C, et al. The impact of clinical pharmacy services integrated into medical homes on diabetes-related clinical outcomes. Ann Pharmacother. 2010;44:1877–86.

    Article  PubMed  Google Scholar 

  51. Salvo MC, Brooks AM. Glycemic control and preventive care measures of indigent diabetes patients within a pharmacist-managed insulin titration program vs standard care. Ann Pharmacother. 2012;46:29–34.

    Article  PubMed  Google Scholar 

  52. Wertz D, Hou L, DeVries A, Dupclay L Jr, McGowan F, Malinowski B, et al. Clinical and economic outcomes of the Cincinnati Pharmacy Coaching Program for diabetes and hypertension. Manag Care. 2012;21:44–54.

    PubMed  Google Scholar 

  53. Calleja Hernandez MA, Reyes-Morales H, Flores-Hernandez S. Effectiveness of involving pharmacists in the process of ambulatory health care to improve drug treatment adherence and disease control. J Eval Clin Pract. 2015;21:7–12.

    Article  Google Scholar 

  54. Skinner JS, Poe B, Hopper R, Boyer A, Wilkins CH. Assessing the effectiveness of pharmacist-directed medication therapy management in improving diabetes outcomes in patients with poorly controlled diabetes. Diabetes Educ. 2015;459–65.

  55. McAdam-Marx C, Dahal A, Jennings B, Singhal M, Gunning K. The effect of a diabetes collaborative care management program on clinical and economic outcomes in patients with type 2 diabetes. J Manag Care Spec Pharm. 2015;21:452–68.

    Article  PubMed  Google Scholar 

  56. Nicholas J, Gulliford MC. Commentary: What is a propensity score? Br J Gen Pract. 2008;58:687.

    Article  PubMed Central  Google Scholar 

  57. Austin PC. An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivar Behav Res. 2011;46:399–424.

    Article  Google Scholar 

  58. Roughead EE, Kalisch Ellett LM, Ramsay EN, Pratt NL, Barratt JD, LeBlanc VT, et al. Bridging evidence-practice gaps: improving use of medicines in elderly Australian veterans. BMC Health Serv Res. 2013;13:514.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Seah XF, Ong YL, Tan SW, Krishnaswamy G, Chong CY, Tan NW, et al. Impact of an antimicrobial stewardship program on the use of carbapenems in a tertiary women’s and children’s hospital, Singapore. Pharmacotherapy. 2014;34:1141–50.

    Article  CAS  PubMed  Google Scholar 

  60. Wong I, Campion P, Coulton S, Cross B, Edmondson H, Farrin A, et al. Pharmaceutical care for elderly patients shared between community pharmacists and general practitioners: a randomised evaluation. RESPECT (Randomised Evaluation of Shared Prescribing for Elderly people in the Community over Time) [ISRCTN16932128]. BMC Health Serv Res. 2004;4:11.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Funding

None.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ines Krass.

Ethics declarations

Conflicts of interest

None.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Krass, I. Quasi experimental designs in pharmacist intervention research. Int J Clin Pharm 38, 647–654 (2016). https://doi.org/10.1007/s11096-016-0256-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11096-016-0256-y

Keywords

Navigation