Skip to main content

Randomized Policy Evaluation of the Veterans Health Administration Stratification Tool for Opioid Risk Mitigation (STORM)



The Veterans Health Administration (VHA) developed a dashboard Stratification Tool for Opioid Risk Mitigation (STROM) to guide clinical practice interventions. VHA released a policy mandating that high-risk patients of an adverse event based on the STORM dashboard are to be reviewed by an interdisciplinary team of clinicians.


Randomized program evaluation to evaluate if patients in the oversight arm had a lower risk of opioid-related serious adverse events (SAEs) or death compared to those in the non-oversight arm.

Setting and Participants

One-hundred and forty VHA facilities (aka medical centers) were randomly assigned to two groups: oversight and non-oversight arms. VHA patients who were prescribed opioids between April 18, 2018, and November 8, 2019, were included in the cohort.

Program Description

We hypothesized that patients cared for by VHA facilities that received the policy with the oversight accountability language would achieve lower opioid-related SAEs or death.

Program Evaluation

We did not observe a relationship between the oversight arm and opioid-related SAEs or death. Patients in the non-oversight arm had a significantly higher chance of receiving a case review compared to those in the oversight arm.


Even though our findings were unexpected, the STORM policy overall was likely successful in focusing the provider’s attention on very high-risk patients.

This is a preview of subscription content, access via your institution.

Fig. 1


  1. Maurice L. Moffett, Robert O. Morgan, Carol M. Ashton. Health Policy. 2005;75(1):109-115.

  2. Frakt AB, Prentice JC, Pizer SD, et al. Overcoming challenges to evidence-based policy development in a large, integrated delivery system. Health Serv Res. Published online 2017.

  3. U.S. Government Accountability Office. Veterans Affairs Health Care: Addition to GAO’s High Risk List and Actions Needed for Removal (GAO-15-580T).; 2015.

  4. Oliva EM, Bowe T, Tavakoli S, et al. Development and applications of the Veterans Health Administration’s Stratification Tool for Opioid Risk Mitigation (STORM) to improve opioid safety and prevent overdose and suicide. Psychol Serv. 2017;14(1):34-49.

    Article  Google Scholar 

  5. Gellad WF, Good CB, Shulkin DJ. Addressing the opioid epidemic in the United States: lessons from the Department of Veterans Affairs. JAMA Intern Med. 2017;177(5):611-612.

    Article  Google Scholar 

  6. Chinman M, McCarthy S, Hannah G, Byrne TH, Smelson DA. Using getting to outcomes to facilitate the use of an evidence-based practice in VA homeless programs: a cluster-randomized trial of an implementation support strategy. Implement Sci. 2017;12(1):34.

    Article  Google Scholar 

  7. Minegishi T, Garrido MM, Pizer SD, Frakt AB. Effectiveness of policy and risk targeting for opioid-related risk mitigation: a randomised programme evaluation with stepped-wedge design. BMJ Open. 2018;8(e020097):1-6.

    CAS  Google Scholar 

  8. Austin PC. Using the standardized difference to compare the prevalence of a binary variable between two groups in observational research. Commun Stat - Simul Comput. 2009;38(6):1228-1234.

    Article  Google Scholar 

  9. Rogal SS, Yakovchenko V, Waltz TJ, et al. The association between implementation strategy use and the uptake of hepatitis C treatment in a national sample. Implement Sci. 2017;12(1):60.

    Article  Google Scholar 

  10. Barry C. Burden, David T. Canon, Kenneth R. Mayer, Donald P. Moynihan. The effect of administrative burden on bureaucratic perception of policies: evidence from election administration. Public Adm Rev. 2012;72(5):741-751.

    Article  Google Scholar 

  11. Strombotne KL, Legler A, Minegishi T, Trafton JA, et al. Effect of a predictive analytics-targeted program in patients on opioids: a stepped-wedge cluster randomized controlled trial. J Gen Intern Med. 2022;1-7.

Download references

Author information

Authors and Affiliations


Corresponding author

Correspondence to Taeko Minegishi MS, PhD.

Ethics declarations

Conflict of Interest

This work is supported by Department of Veterans Affairs, Veterans Health Administration, Office of Research and Development (QUERI PEC 16-001) and HSR&D SDR 16-19. The contents do not represent the views of the U.S. Department of Veterans Affairs, the United States Government, Northeastern University, Boston University, or Harvard University.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information


(DOCX 131 kb)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Minegishi, T., Garrido, M.M., Lewis, E.T. et al. Randomized Policy Evaluation of the Veterans Health Administration Stratification Tool for Opioid Risk Mitigation (STORM). J GEN INTERN MED (2022).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI:


  • Veterans Health Administration
  • randomization
  • policy
  • opioids