Army and Navy ECHO Pain Telementoring Improves Clinician Opioid Prescribing for Military Patients: an Observational Cohort Study



Opioid overdose deaths occur in civilian and military populations and are the leading cause of accidental death in the USA.


To determine whether ECHO Pain telementoring regarding best practices in pain management and safe opioid prescribing yielded significant declines in opioid prescribing.


A 4-year observational cohort study at military medical treatment facilities worldwide.


Patients included 54.6% females and 46.4% males whose primary care clinicians (PCCs) opted to participate in ECHO Pain; the comparison group included 39.9% females and 60.1% males whose PCCs opted not to participate in ECHO Pain.


PCCs attended 2-h weekly Chronic Pain and Opioid Management TeleECHO Clinic (ECHO Pain), which included pain and addiction didactics, case-based learning, and evidence-based recommendations. ECHO Pain sessions were offered 46 weeks per year. Attendance ranged from 1 to 3 sessions (47.7%), 4–19 (32.1%, or > 20 (20.2%).

Main Measures

This study assessed whether clinician participation in Army and Navy Chronic Pain and Opioid Management TeleECHO Clinic (ECHO Pain) resulted in decreased prescription rates of opioid analgesics and co-prescribing of opioids and benzodiazepines. Measures included opioid prescriptions, morphine milligram equivalents (MME), and days of opioid and benzodiazepine co-prescribing per patient per year.

Key Results

PCCs participating in ECHO Pain had greater percent declines than the comparison group in (a) annual opioid prescriptions per patient (− 23% vs. − 9%, P < 0.001), (b) average MME prescribed per patient/year (−28% vs. −7%, p < .02), (c) days of co-prescribed opioid and benzodiazepine per opioid user per year (−53% vs. −1%, p < .001), and (d) the number of opioid users (−20.2% vs. −8%,p < .001). Propensity scoring transformation–adjusted results were consistent with the opioid prescribing and MME results.


Patients treated by PCCs who opted to participate in ECHO Pain had greater declines in opioid-related prescriptions than patients whose PCCs opted not to participate.


An estimated 100 million Americans suffer from chronic pain.1 In the USA, prescriptions for opioid analgesics quadrupled between 1999 and 2012.2 Prescribing behaviors associated with increased overdose risk include co-prescribing benzodiazepines and opioids and exceeding a daily dose of 50 morphine milligram equivalents (MME).3, 4 Approximately 175 people die everyday from drug-related deaths.5 Drug overdose deaths surpass injury deaths caused by motor vehicle accidents and firearms.6 The public health epidemics of chronic pain and drug overdose affect both civilian and military populations.7,8,9,10

Chronic pain, opioid use disorder (OUD), and post-traumatic stress disorder (PTSD) frequently occur together. Preventing these conditions is a high priority for the Department of Defense (DoD).10,11,12,13,14,15 Pain is a leading reason patients seek medical care and primary care clinicians (PCCs) are often the first points of contact.16, 17 Pain management and safe opioid prescribing education for civilian pre-licensure students and PCCs is not universally required, but is required for MHS clinicians.18,19,20,21

Opioid misuse is a problem for both military and civilian populations.4 When opioids are prescribed to patients with PTSD and other mental health diagnoses, this may increase their risk for adverse events.11, 22, 23 In 2009, the DoD recognized that the military needed an optimal pain management plan and prepared a Pain Management Task Force (PMTF) Report recommending an evidence-based approach to manage chronic pain across the Military Health System (MHS).24 Among several training platforms available for pain education, the U.S. Army chose the University of New Mexico Health Sciences Center (UNMHSC) Project ECHO (Extension for Community Healthcare Outcomes) model of Chronic Pain training for its rapid diffusion of pain management strategies.25

This observational cohort study assessed whether PCC participation in telementoring through the Chronic Pain and Opioid Management TeleECHO Clinic (ECHO Pain) improved pain management and safe opioid prescribing skills.


The ECHO Model

Project ECHO is a lifelong learning and guided practice model of medical education and mentoring that uses a hub-and-spoke design to create knowledge networks. Expert teams at the hub use multi-point videoconferencing to conduct virtual learning sessions. Spoke attendees include physicians, advanced practice clinicians, and care teams. TeleECHO sessions run for 2 h weekly (96 total hours annually). Each session consists of a short, evidence-based didactic followed by case discussions intended to reduce variations in care.

Benefits for participating in ECHO Pain include no-cost continuing medical education (CME) credits and increased diagnostic, treatment, and referral skills related to multi-modal pain management and OUD.26 Clinicians learn prescribing behaviors that reduce opioid overdose risks including judicious use of opioids, identification of patients at risk of OUD, and risks of co-prescribing.27,28,29 Participating PCCs learn to provide specialty care which would otherwise be difficult to obtain for patients in their own communities.30, 31

Army and Navy ECHO Pain Intervention

Between 2012 and 2014, military medical treatment facilities (MTFs) were strategically chosen to serve as hub sites based on geographical location (time zone) and availability of specialty clinicians to serve as facilitators. Integrative and interdisciplinary pain teams were fully staffed at five U.S. Army and two U.S. Navy hub sites. The 47 remote Army and 33 remote Navy spoke locations were chosen based on PCC interest and volume of chronic pain patients. Project ECHO provided on-site and virtual trainings to both the hub and spoke clinicians regarding facilitation, case presentation skills, and the basics of pain management. See Fig. 1.

Fig. 1

Geographic distribution of army and navy ECHO pain hubs and spokes.

Study Design

This is an observational cohort study comparing ECHO Pain participating PCCS with non-ECHO Pain participating PCCs. Clinics were separated into two primary groups: (1) 99 clinics whose PCCs voluntarily participated in ECHO Pain at least once per year and had data both before and after ECHO intervention and (2) 1283 comparison clinics that whose PCCs did not participate in ECHO Pain. Prescription counts for adult patients enrolled with Army and Navy PCC teams for fiscal years 2013 to 2016 (i.e., October through September) were supplied, de-identified, and aggregated from the Military Health System Data Repository (MDR). The MDR patient data was stratified by combinations of the covariables: fiscal year, age, sex, and beneficiary category and aggregated in these patient strata (combinations) for each clinic. Our study excluded patients under 18 years. Beneficiary categories included active duty military personnel, dependents of active duty personnel, members of the National Guard or Reserve, and military retirees. ECHO Pain data was additionally stratified for pre/post ECHO intervention. PCCs for ECHO Pain were either active duty or civilian clinicians working at Army or Navy MTFs (see Fig. 2).

Fig. 2

Flow diagram: data collection and analysis.

Primary and Secondary Outcomes

The primary outcome of this study was to assess whether voluntary PCC participation in ECHO Pain resulted in decreased prescriptions of opioids for enrolled patients. Secondary outcome measures included evaluation of MME dose and co-prescribing of opioids and benzodiazepines. Both primary and secondary outcome measures were developed prior to the launch of Army and Navy ECHO Pain. PCCs exposed to ECHO Pain (intervention group) were compared with PCCs who did not participate in ECHO Pain (comparison group).

Outcome Variables

Prescriptions analyzed included opioids and their MME, benzodiazepines, and the overlap in the co-prescription of opioids and benzodiazepines. Opioids included codeine, dihydrocodeine, belladonna-opium, fentanyl, hydrocodone, hydromorphone, levorphanol, meperidine, morphine, methadone, oxycodone, tapentadol, and oxymorphone. Tramadol was also included as a partial opioid. Benzodiazepines included diazepam, lorazepam, clonazepam, alprazolam, temazepam, oxazepam, triazolam, midazolam, flurazepam, estazolam, quazepam, clorazepate dipotassium, and chlordiazepoxide/clinidium.

Covariables of age, sex, and beneficiary category were represented by the stratification used in the aggregation of data.


Onset of participation in ECHO Pain was staggered over 4 years to accommodate training in the ECHO model for the large number of Army and Navy hubs and spokes. Because ECHO Pain lacked a single start date, the authors matched the comparison groups with fiscal years to best analyze comparison and intervention groups. Demographics included assigned sex, age, service, and beneficiary category (see Aggregation in SOM).

A common timeline was determined based on yearly midpoints which are labeled as −1.5 − 0.5, + 0.5, and + 1.5 relative to the starting time of ECHO Pain intervention (time = 0). For the comparison group, fiscal year midpoints were used and the first 2 years were labeled as − 1.5 and − 0.5 (see Definition of Time Line in Supplemental Online Material (SOM)).


Statistical significance was determined for rate changes over time, both within and between groups, evaluated as slopes using Repeated Measures (RM) Analysis of Covariance (ANCOVA) weighted by the numbers of patients. Log-transformed data were used so that slopes represent relative percent change. These percent changes are comparable.

Alternative analysis of primary outcomes used a propensity scoring transformation with ECHO Pain as the target distribution to reduce selection bias in the baseline values. Alternative analysis adjusted for sex, age, and beneficiary category as covariables (see Propensity Scoring sections in SOM).

Outcome variables were analyzed as a time series of clinic averages per patient. Opioid prescriptions were also analyzed for percentages of opioid users, and opioid prescriptions per opioid user, as these explanatory analyses are based on the decomposition of rates given by the formula: opioid prescriptions per enrollee = (opioid scripts/opioid users) × (opioid users/patients). MME rates and co-prescribed days of opioids and benzodiazepines were analyzed similarly.

Institutional Review Board Approval

This study was approved by the UNMHSC Human Research Protections Office (study ID #16-388) and the Defense Health Agency (DHA) Institutional Review Board (CDO-16-2036 IRB #879675). A data sharing agreement (FP1032 DHA 17-1670) was signed by the DHA and UNMHSC to allow for data to be shared between the two institutions.


Demographics and Baseline Rates

The comparison group had 1283 clinics and ECHO Pain had 99 clinics. Baseline demographics for ECHO Pain and comparison clinics for sex, age, service, and beneficiary status as well as PCC participation level are given in Table 1.

Table 1 Baseline Demographics of Adult Study Patients 2013–2014a

Baseline demographics of adult beneficiaries included approximately 24,000 males (45.4%) and 29,000 females (54.6%) whose PCCs participated in ECHO Pain. The comparison group included 721,000 males and 479,000 female whose PCCs did not participate in ECHO Pain. Age distribution of adult beneficiaries for ECHO Pain was 18–24 years: 19.7%; 25–34 years: 30.6%; 35–44 years: 21.4%; and 45–64 years: 28.3%, and the corresponding age distribution for comparison group was 27.1%, 33.7%, 19.0%, and 20.2%. Fifty-two percent of PCPs participated in four or more TeleECHO clinics (see Table 1).

Opioid Prescriptions per Patient

While prescribed opioid rates declined in both comparison clinics and ECHO Pain (both p < 0.001), the relative decline was greater in clinics participating in ECHO Pain (Fig. 3a). The average annual percent declines were 9.2% (p < 0.001) from a baseline of 0.86 RX/patient/year in comparison clinics and 23.0% (p < 0.001) from a baseline of 0.31 RX/patient/year in ECHO Pain. The slopes differed between ECHO Pain and comparison groups (p = 0.004, Table 2).

Fig. 3

Percent change for selected outcome measures.

Table 2 The Effects of ECHO Pain Clinician Participation on Prescribing of Opioids and Co-prescribing of Opioids and Benzodiazepines

MME Dosages per Patient

While prescribed MME dosages declined in both comparison clinics and ECHO Pain, the relative decline was greater in clinics participating in ECHO Pain (Fig. 3b). The average annual percent declines were 7.3% (p < 0.001) from a baseline of 364 MME/patient/year in comparison clinics and 28.0% (p = 0.002) from a baseline of 172 MME/patient/year in ECHO Pain. The slopes differed between ECHO Pain and comparison groups (p = 0.02, Table 2).

Co-prescribed Opioids and Benzodiazepines per Patient

While days of co-prescribed opioids and benzodiazepines declined in both comparison clinics and ECHO Pain, the relative change was greater in clinics participating in ECHO Pain (Fig. 3c). The average annual percent declines were 9.6% (p < 0.001) from a baseline of 0.54 co-Rx/patients/year in comparison clinics and 68.9% (p < 0.001) from a baseline of 0.36 co-Rx/patient/year in ECHO Pain. The slopes differed between ECHO Pain and comparison groups (p < 0.001).

Co-prescribed Opioids and Benzodiazepines per Opioid User

While days of co-prescribed opioids and benzodiazepines per opioid user declined in both comparison clinics and ECHO Pain, the relative change was greater in clinics participating in ECHO Pain (Fig. 3d). The average annual percent declines were 1.3% (p = 0.41) from a baseline of 1.01 co-Rx/opioid user/year in comparison clinics and 53.3% (p = 0.002) from a baseline of 2.65 co-Rx/opioid user/year in ECHO Pain. The slopes differed between ECHO Pain and comparison groups (p < 0.001, Table 2).

Percent Opioid Users

While the percent of opioid users in their patient panels declined in both comparison clinics and ECHO Pain, the relative decline was greater in clinics participating in ECHO Pain. The percent of opioid users in comparison clinics declined annually at 8.0% (p < 0.001) from an average annual baseline of 53.6%. The percent of opioid users in ECHO Pain declined annually at 20.2% (p < 0.001) from a baseline of 13.7%. The slopes differed between ECHO Pain and comparison groups (p < 0.001, Table 2).

Alternative Analysis

Since baseline values of outcome variables were higher for the comparison group, a potential selection bias, an alternative analysis was conducted to adjust for such a bias. Alternative analyses for percent opioid users, average number of opioid prescriptions per patient/year, and average MME/patients/year used propensity scoring transformations. Resulting weights were applied to the comparison group data, attempting to reduce the selection bias present at baseline. Results were adjusted for age, sex, and beneficiary status as covariables (see SOM). Baseline bias was reduced, and since the alternative analysis results differ little from the original results, they validate the original analysis (see Table 3 for primary outcome variables).

Table 3 The Effects of ECHO Pain Participation on Prescribing: Results Adjusted for Selection Bias and for Sex, Age, Beneficiary Category Covariables (Alternative Analysis)


Recent Centers for Disease Control and Prevention (CDC) and Veteran’s Affairs (VA)/DoD guidelines recommend safe opioid prescribing practices, especially focused on moderate- and high-dose opioids (> 50 MME) and opioids in combination with benzodiazepines.3, 32 Findings from this study provide evidence that ECHO Pain may be used as a successful tool for effectively teaching PCCs to apply safe opioid prescribing practices.

Since the launch of ECHO Pain in 2012, many other interventions nationwide have been implemented to address the opioid epidemic. These include the National Pain Strategy, CDC Pain Management Guidelines, and the VA/DoD Opioid Guidelines, as well as the military sole provider program.1, 3, 32,33,34 These interventions may explain whyboth ECHO Pain PCCs and the comparison group demonstrated declines in opioids and co-prescription.

Clinicians who volunteered to participate in ECHO Pain had lower rates of opioid prescribing and opioid/benzodiazepine co-prescribing at baseline, with higher average baseline MME. We postulate that this difference reflects clinicians who were early adopters of best practices for pain management and who may have treated more challenging chronic pain patients. Both ECHO Pain and comparison groups had declines in opioid prescribing. ECHO Pain had steeper declines than the comparison group even though it started at a lower baseline. ECHO Pain PCCs may have had more initial interest in learning about complex chronic pain patients and developed self-efficacy in managing these patients by participating in ECHO Pain.26 Repeat exposure to ECHO Pain deepens knowledge, skills, and confidence, and may explain the robust reduction in opioid prescribing demonstrated in this study.35

The significant findings of this study provide evidence that interventions such as ECHO Pain may contribute to reductions in opioid prescribing and co-prescribing of benzodiazepines. ECHO Pain incorporates case-based learning and didactics, promotes increased PCC self-efficacy, knowledge development, and increases social connectedness among participants.36, 37

Fifty-two percent of the PCCs exposed to ECHO Pain in this study participated in ≥ four training sessions. This is similar to the ECHO Pain dose-response seen in a recent large Veterans administration SCAN-ECHO Pain analysis showing improved quality of pain care.38 Future data analyses may identify the necessary minimum exposure to ECHO Pain which allows PCCs to acquire the knowledge and skills necessary for successful prescribing changes seen in this study. Learning collaborative strategies posit that iterative educational processes are necessary to reduce variation in care and promote practice change.39,40,41

Regardless of the educational platform (multi-point videoconferencing or live trainings), many key stakeholders agree that clinician education in pain and opioid prescribing should focus on providing more non-pharmacologic and non-opioid pain management tools for PCCs while assuring that opioids are prescribed safely when indicated.3, 35, 42 CME in pain management and safe opioid prescribing is associated with reductions in opioid and benzodiazepine dispensing as well as reductions in overdose mortality.43, 44 There is growing clinician and policymaker support for mandated pain and addiction education.42, 45,46,47 Clinicians practicing in the military (DoD), the Veterans Affairs, and the Indian Health Service (HIS) as well as 23 states and the District of Columbia now have mandatory CME requirements for pain and safe opioid prescribing.48


This study has limitations related to data analysis and selection bias. Most importantly, selection bias may explain the results because of several naturally occurring factors. Because this study could not randomize the assignment of clinicians and patients into matched groups, the baseline demographics for the comparison group are skewed towards male and active duty patients. To the extent that these show up in baseline outcome values, our alternative analysis with propensity scoring adjusts for this. In addition, PCCs volunteered to attend ECHO Pain and, despite the fact that their patient panel appeared to include highly complex chronic pain patients on high doses of opioid analgesics, this clinician cohort may have skewed the results.

The database is a de-identified, aggregated file from the MDR and clinician ECHO Pain participation data provided by the Army and Navy. Due to the aggregated nature of the data, it was not possible to analyze the data down to the individual clinician or patient level. Data was provided on individual clinics with MTFs, but not on individual providers or patients.

Due to the aggregated nature of the data, the authors could not specify the reasons opioids or benzodiazepines were used in each patient. Additionally, it was not possible to (1) quantify how each patient’s opioid MME dose may have changed or (2) to address specific patient/level causes for the reductions in opioid prescriptions, co-prescribing, and MME.


The findings suggest that the ECHO model may be effective both in reducing opioid-related prescription rates and in training PCCs. ECHO Pain reduces variation in care, promoting case-based learning with short, pertinent, evidenced-based didactics. This study suggests that clinician education in both the federal and civilian sectors may have a substantial impact on the opioid epidemic. Since ECHO Pain in this study represented only 5% of the beneficiary population, ECHO Pain could be expanded to benefit a greater number of patients. Additionally, future prospective clinical trials with chronic pain and/or other common and complex conditions may provide information regarding the benefits of the ECHO model at the patient level.


  1. 1.

    Institute of Medicine (U.S.). Committee on Advancing Pain Research Care and Education. Relieving pain in America: a blueprint for transforming prevention, care, education, and research. Washington, DC: National Academies Press, 2011.

    Google Scholar 

  2. 2.

    Centers for Disease Control and Prevention. Annual Surveillance report of drug-related risks and outcomes — United States, 2017. Surveillance Special Report 1. Available at: Accessed 25 September 2018

  3. 3.

    Dowell D, Haegerich TM, Chou R. CDC guidelines for prescribing opioids for chronic pain – United States, 2016. MMWR. 2016; 65(1): 1–49.

    PubMed  Google Scholar 

  4. 4.

    Larochelle MR, Liebschutz JM, Zhang F, Ross-Degnan D, Wharam JF. Opioid prescribing after nonfatal overdose and association with repeated overdose. Ann Intern Med. 2016; 164(1): 1–13.

    PubMed  Google Scholar 

  5. 5.

    Ahmad FB, Rossen LM, Spencer MR, Warner M, Sutton P. Provisional drug overdose death counts. Hyattsville, MD: National Center for Health Statistics. 2017

    Google Scholar 

  6. 6.

    Drug Enforcement Administration. 2016 National drug threat assessment survey. Washington, DC: U.S. Dept of Justice; 2016.

    Google Scholar 

  7. 7.

    Gellad WF, Good CB, Shulkin DJ. Addressing the opioid epidemic in the United States: lessons from the Department of Veterans Affairs. JAMA Int Med. 2017; 177(5): 611–12.

    Google Scholar 

  8. 8.

    Bohnert AS, Valenstein M, Bair MJ, et al. Association between opioid prescribing patterns and opioid overdose-related deaths. JAMA. 2011; 305(13): 1315–21.

    CAS  PubMed  Google Scholar 

  9. 9.

    Han B, Compton WM, Blanco C, Crane E, Lee J, Jones CJ. Prescription opioid Use, misuse and use disorders in U.S. adults: 2015 national survey on drug use and health. Ann Intern Med. 2017; 167(5): 293–302.

    PubMed  Google Scholar 

  10. 10.

    Chou R, Turner JA, Devine EB, et al. The effectiveness and risks of long-term opioid therapy for chronic pain: a systematic review for a National Institutes of Health Pathways to Prevention workshop. Ann Intern Med. 2015; 162(4): 276–95.

    PubMed  Google Scholar 

  11. 11.

    Golub A, Bennett AS. Prescription opioid initiation, correlates and consequences among a sample of OEF/OIF military personnel. Subst Use Misuse. 2013; 48(10): 811–20.

    PubMed  PubMed Central  Google Scholar 

  12. 12.

    Toblin RL, Quintana PJ, Riviere LA, Walper KC, Hoge CW. Chronic pain and opioid use in U.S. soldiers after combat deployment. JAMA Int Med. 2014; 174(8): 1400–01.

    Google Scholar 

  13. 13.

    Seal KH, Shi Y, Cohen G, et al. Association of mental health disorders with prescription opioids and high-risk opioid use in U.S. veterans of Iraq and Afghanistan. JAMA. 2012; 307(9): 940–47.

    CAS  PubMed  Google Scholar 

  14. 14.

    Outcalt SD, Yu Z, Hoen HM, Pennington TM, Krebs EE. Health care utilization among veterans with pain and posttraumatic stress symptoms. Pain Med. 2013; 15: 1872–79.

    PubMed  Google Scholar 

  15. 15.

    Gerrits MMJG, Vogelzangs N, van Oppen P, van Marwijk HWJ, van der Horst H, Penninx BWJH. Impact of pain on the course of depressive and anxiety disorders. Pain. 2012; 153(32): 429–36.

    PubMed  Google Scholar 

  16. 16.

    Schneiderhan J, Clauw D, Schwenk TL. Primary care of patients with chronic pain. JAMA.2017; 317(23): 2367–68.

    PubMed  Google Scholar 

  17. 17.

    Chang HY, Daubresse M, Kruszewski S, et al. Prevalence and treatment of pain in emergency departments in the United States, 2000-2010. Am J Emerg Med.2014; 32(5):421–31.

    PubMed  Google Scholar 

  18. 18.

    Davis CS, Carr D. Physician continuing education to reduce opioid misuse, abuse, and overdose: many opportunities, few requirements, Drug Alcohol Depend. 2016; 163(6): 100–07.

    PubMed  Google Scholar 

  19. 19.

    Fishman SM, Young HM, Arwood EL, et al. Core competencies for pain management: results of an interprofessional consensus summit. Pain Med. 2013; 14(7): 971–81.

    PubMed  PubMed Central  Google Scholar 

  20. 20.

    Chelminski TC, Fischer RL, Levin JB, Cheren MI, Marsh SK, Janata, JW. The primary practice physician program for chronic pain (©4PCP): Outcomes of a primary physician-pain specialist collaboration for community-based training and support. Clin J Pain. 2013; 29(12): 1036–43.

    Google Scholar 

  21. 21.

    Mezei L, Murinson BB. Pain education in North American medical schools. J Pain. 2011; 12(12): 1199–1208.

    PubMed  Google Scholar 

  22. 22.

    Spelman JF, Hunt SC, Seal KH, Burgo-Black AL. Post deployment care for returning veterans. J Gen Intern Med. 2012; 27(9):1200–09.

    PubMed  PubMed Central  Google Scholar 

  23. 23.

    Bennet AS, Elliott L, Golub A, Wolfson-Stofko B, Guarino H. Opioid-involved overdose among male Afghanistan/Iraq-era U.S. military veterans: a multidimensional perspective. Substance Use & Misuse. 2017; 52(13): 1701–11

    Google Scholar 

  24. 24.

    Pain Management Task Force: Final Report. Falls Church, VA: Office of the Army Surgeon General, 2010.

  25. 25.

    Katzman JG, Galloway K, Olivas C, et al. Expanding health care access through education: dissemination and implementation of the ECHO model. Mil Med. 2016; 181 (3): 227–35.

    PubMed  Google Scholar 

  26. 26.

    Katzman JG, Comerci GD, Boyle JF, et al. Innovative telementoring for pain management: project ECHO pain. J Contin Educ Health Prof. 2014; 34(1):68–75.

    PubMed  Google Scholar 

  27. 27.

    Gudin JA, Mogali S, Jones JD, Comer, SD. Risks, management, and monitoring of combination opioid, benzodiazepines, and/or alcohol use. Postgrad Med. 2013; 125(4): 115–30.

    PubMed  PubMed Central  Google Scholar 

  28. 28.

    Zedler B, Xie L, Wang L, et al. Risk factors for serious prescription opioid-toxicity or overdose among Veterans Health Administration patients. Pain Med. 2014; 15: 1911–1929.

    PubMed  Google Scholar 

  29. 29.

    Shelley BM, Katzman JG, Comerci GD, et al. ECHO pain curriculum: Balancing mandated continuing education with the needs of rural health care practitioners. J Contin Educ Health Prof. 2017; 37(3): 190–94.

    PubMed  Google Scholar 

  30. 30.

    Arora S, Thornton K, Murata G, et al. Outcomes of treatment for hepatitis C virus infection by primary care providers. N Engl J Med. 2011: 364(23): 2199–2207.

    CAS  PubMed  Google Scholar 

  31. 31.

    Arora S, Kalishman S, Dion D, et al. Partnering urban academic medical centers and rural primary care clinicians to provide complex chronic disease care. Health Affairs. 2011: 30(6): 1176–84.

    PubMed  Google Scholar 

  32. 32.

    Department of Veterans Affairs. Department of Defense: VA/DoD Clinical Practice Guideline for Management of Opioid Therapy for Chronic Pain, Version 3.0. Washington, DC: U.S. Dept of Defense; 2016: 15–16.

  33. 33.

    National Institutes of Health. Interagency Pain Research Coordinating Committee. National Pain Strategy: A Comprehensive Population Health –Level Strategy for Pain. 2016. Available at: Accessed 25 September 2018

  34. 34.

    Potter JS, Bebarta VS, Marino EN, Ramos AG, Turner BJ. Pain management and opioid risk mitigation in the military. Mil Med. 2014; 179(5): 553–58.

    Google Scholar 

  35. 35.

    Jonas WP, Schoomaker EB. Pain and opioids in the military: we must do better. JAMA Int Med. 2014: 174(8): 1402–03.

    Google Scholar 

  36. 36.

    Anderson D, Zlateva I, David B, et al. Improving pain care with Project ECHO in community health centers. Pain Med. 2017; 18(10): 1882–89.

    PubMed  PubMed Central  Google Scholar 

  37. 37.

    Lewiecki EM, Bouchonville MF, Chafey DH, Bankhurst A, Arora S. Bone health ECHO: telementoring to improve osteoporosis care. Women's Health (London). 2016; 12(1): 79–81.

    CAS  PubMed Central  Google Scholar 

  38. 38.

    Moore B, Lee A, Mutalik P, Kerns R. Sustained participation in the VA SCAN ECHO pain management telementoring program enhances pain care quality. J Pain. 2017; 18(4):

  39. 39.

    Nordstrom BF, Saunders EC, McLeman B, et al. Using a learning collaborative strategy with office-based practices to increase access and improve quality of care for patients with opioid use disorders. J Addict Med. 2016; 10(2): 117–23.

    PubMed  Google Scholar 

  40. 40.

    Clarke JR. The use of collaboration to implement evidence-based best practices. J Public Health Res. 2013; 2(3): e26.

    PubMed  PubMed Central  Google Scholar 

  41. 41.

    Arora S, Geppert CM, Kalishman S, et al. Academic health center management of chronic diseases through knowledge networks: project ECHO. Acad Med. 2007; 82(2): 154–60.

    PubMed  Google Scholar 

  42. 42.

    Comerci G Jr, Katzman J, Duhigg D. Controlling the swing of the opioid pendulum. N Engl J Med. 2018; 378(8):691–63.

    PubMed  Google Scholar 

  43. 43.

    Katzman JG, Comerci GD, Landen M, et al. Rules and values: a coordinated regulatory and educational approach to the public health crises of chronic pain and addiction. Am J Pub Health. 2014; 104(8): 1356–62.

    Google Scholar 

  44. 44.

    Alexandridis A, McCort A, Ringwalt CL, et al. A statewide evaluation of seven strategies to reduce opioid overdose in North Carolina. Injury Prev. Published Online First: 23 August 2017.

  45. 45.

    Kennedy-Hendricks A, Busch SH, McGinty EE, et al. Primary care physicians’ perspectives on the prescription opioid epidemic. Drug Alcohol Depend. 2016; 165(1):61–70.

    PubMed  PubMed Central  Google Scholar 

  46. 46.

    Katzman JG, Fore C, Bhatt S, et al. Evaluation of American Indian Health Service training in pain management and opioid substance use disorder. Am J Public Health. 2016; 106(8): 1427–29.

    PubMed  PubMed Central  Google Scholar 

  47. 47.

    Barth KS, Guille C, McCauley, Brady KT. Targeting practitioners: a review of guidelines, training, and policy in pain management. Drug Alcohol Depend. 2017; 173(Suppl 1):S22–30.

    PubMed  PubMed Central  Google Scholar 

  48. 48.

    National Alliance for Model State Drug Laws. Overview of state pain management and prescribing policies. 2016. Available at: Accessed 25 September 2018.

Download references


The authors would like to thank Nathan Banks; Andrea Bradford, MSc; Justyna La Pay; Cynthia Olivas, MSN, and William Szaroletta, PhD, ECHO Institute; Erin Mattingly, SLP; and William Rayburn, MD, UNM School of Medicine; Jeffrey Goodie, PhD, Uniformed Services University; and CAPT Jennifer Bodart, PhD, Defense Health Agency, for the review of the final manuscript.


This work was financially supported by the U.S. Defense Health Agency (DHA). The sponsor provided access to, and collaborated with, the analysis and interpretation of the data. The DHA approved publication of the final manuscript.

Author information



Corresponding author

Correspondence to Joanna G. Katzman MD, MSPH.

Ethics declarations

Conflict of Interest

The authors declare that they do not have a conflict of interest.


The sponsor had no role in the design of the study. The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Defense Health Agency or the US government.

Electronic supplementary material


(DOCX 172 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Katzman, J.G., Qualls, C.R., Satterfield, W.A. et al. Army and Navy ECHO Pain Telementoring Improves Clinician Opioid Prescribing for Military Patients: an Observational Cohort Study. J GEN INTERN MED 34, 387–395 (2019).

Download citation


  • clinician education
  • project ECHO
  • telementoring
  • opioids
  • opioid overdose deaths
  • benzodiazepines