Background

Diabetes is a highly prevalent chronic condition, associated with a significantly elevated risk of adverse cardiovascular outcomes, including coronary heart disease and strokes [1]. Effective cardiovascular risk reduction with vascular protective medications for appropriate patients, including statins, angiotensin-converting enzyme inhibitors (ACEIs) or angiotensin receptor blockers (ARBs) and antiplatelet agents is an essential component of diabetes management [2].

To improve the uptake of vascular protective medications, Diabetes Canada issued simplified guidelines in 2013. The 2008 guidelines recommended stratifying patients into risk categories. Patients at high risk should receive one of more of ACEIs or ARBs, statins or possibly ASA [3]. The 2013 guidelines simplified this and no longer require risk stratification. Therefore, the complexity of decisions was reduced as recommendations to start a vascular protective medication were largely based on patient age. The guidelines recommended statins for patients age 40 or over and ACEIs/ARBs for patients age 55 or over. Antiplatelet agents were no longer recommended for the primary prevention of cardiovascular disease but continue to be recommended for secondary prevention [2]. These recommendations were disseminated and implemented nationwide using the Knowledge-to-Action Framework [4]. Interventions including in-person lecture series, conferences, webinars, web-based professional and patient resources such as flow sheets, electronic point of care decision support, a mobile application, and electronic medical record (EMR) templates were rolled out over 24 months starting April 2013 [5]. The recommendations for vascular protection continue to be endorsed through the most recently released 2018 guidelines [6].

We recently examined the uptake of vascular protective medications in Canada following the release of the 2013 Diabetes Canada guidelines, using primary care EMR data from the Canadian Primary Care Sentinel Surveillance Network (CPCSSN), a pan-Canadian EMR-based surveillance system. Primary care providers participating in CPCSSN consent to contribute de-identified EMR data to regional network repositories; patients can opt-out. Data from all participating networks are extracted and processed every 6 months and aggregated in a single central database [7].

We found no improvements in the trend for rates of prescriptions [8]. While the EMR provides information on whether a patient was given a prescription by their primary care provider, it may not provide complete information on whether a patient has filled the prescription or is likely taking the medication (coverage rate). Prescriptions may be received from other providers as patients with diabetes may see both a family physician and an endocrinologist for care. As well, data on the duration of each prescription may be incompletely captured: a medication may be prescribed with several refills that may not be completely captured due to the structure of the EMR. Our previous guideline evaluation used a lag-lead approach to account for such variations in refill protocol and prescription procedures among family physicians [8]. Validating our results using different sources of information under different assumptions is important.

Health administrative databases and clinical data derived from EMRs provide complementary information, and can lead to more complete understanding of patients’ care trajectories [9,10,11]. Diabetes case definitions based on EMR data have higher sensitivity than those based on administrative data [12, 13]. When validated against chart audits, the sensitivity and specificity for diabetes using CPCSSN data are 95.6 and 97.1% [12]. A widely used, validated Canadian case definition using administrative data has a sensitivity of 86% and a specificity of 97% [14]. EMR data contains information that may not be present in administrative data, including the presence of a diagnosis for the disease in patients’ summary health profiles [13, 15]. Health administrative databases are population based and provide information from sources not captured in EMRs, including hospital visits and specialist encounters [16].

We are now therefore validating our results using data from ICES (formerly the Institute for Clinical Evaluative Sciences), a prescribed entity under Ontario’s privacy legislation authorized to collect and use health care data for the purposes of health system analysis, evaluation and decision support [17]. Our research questions were: did the 2013 Diabetes Canada guidelines influence the coverage of vascular protective medications in patients with diabetes? Was the change in coverage rates obtained using administrative data and linked administrative-EMR data similar to the change in prescription rates obtained using only primary care clinical EMR data? Was a population-based trend in coverage rates similar to our earlier results?

Methods

This was a retrospective cohort study; we used the Strengthening the Reporting of Observational Studies in Epidemiology guidelines to report the study [18].

Setting and participants

This study was conducted using data from Ontario, Canada. Ontario’s health care system includes universal, tax-funded coverage for all medically necessary physician services and laboratory tests, with no patient co-payment. About 75% of Ontario’s population is formally registered or enrolled in primary care; each patient is attached to the practice of a family physician. 75% of family physicians practicing comprehensive care use a patient enrollment model. 25% of physicians in patient enrollment models practice in inter-professional Family Health Teams [19].

Two different validated algorithms to define two cohorts of patients living with diabetes were used to examine our data. The first used the CPCSSN (EMR derived) algorithm [20] and the second used the Ontario Diabetes Database (ODD), derived using an administrative data algorithm [14].

EMR cohort

We used EMR data from the Ontario sites of CPCSSN, extracted up to the end of 2014 and linked at ICES [21]. The four sites included were: Toronto and surroundings, eastern Ontario, Hamilton and London. The CPCSSN algorithm for diabetes [12] was used to identify patients with diabetes in that dataset.

Linked CPCSSN-ICES data from January 1st, 2010 to December 31st 2016 were included. We retrieved data on patients that were present in the CPCSSN dataset, had a valid Ontario health card number, were enrolled or virtually enrolled to a primary care physician and were age 66 or more at the beginning of each quarter of interest. Patients were enrolled in the cohort during or after the quarter containing their first patient-physician encounter as recorded in CPCSSN, if they met the CPCSSN definitions for diabetes at any time prior to each quarter of interest.

Administrative cohort

We replicated the study using Ontario population based administrative data. Ontario has a population based publicly funded healthcare system; a unique health care number (the Ontario Health Insurance Plan or OHIP) identifies each patient. We used a validated administrative definition for diabetes, the ODD, which is a population-based registry at ICES [14]. The ODD validated algorithm labels cases as diabetes if there are two physician billing claims for diabetes (ICD9 code 250) or one hospitalization discharge record with a diagnostic code of diabetes within 2 years [14]. Patients likely to have gestational diabetes are excluded by not counting billing claims or hospitalizations that appeared 120 days before or 180 days after a hospital record with a diagnosis of pregnancy care or delivery [14].

Similar to the EMR cohort, ICES data from January 1st, 2010 to December 31st 2016 were included. We retrieved data on patients that had a valid Ontario health card number and were age 66 or more at the beginning of each quarter of interest. Patients were enrolled in the cohort if they met the ODD definitions for diabetes at any time prior to each quarter of interest.

Patients were censored from the cohort during the quarter in which they met at least one of the following conditions 1) deceased; 2) last encounter with the healthcare system prior to study end date; 3) loss of eligibility for Ontario’s publicly funded health insurance plan, OHIP; 4) No longer enrolled or virtually enrolled with a primary care physician.

Variables

The outcome of interest was prescription coverage rates as an indication of whether a patient with diabetes was likely taking an appropriate cardiovascular protective medication in each quarter of interest as per Diabetes Canada guidelines between January 1, 2010 and December 31, 2016. Proton pump inhibitors (PPIs) were used as a comparator for secular trends.

The medications of interest were: 1) Statins; 2) ACE Inhibitors; 3) ARBs; 4) Antiplatelets (only for those with no cardiovascular disease); 5) PPIs.

Data sources

ICES holds databases on OHIP eligibility, publicly funded medications, and encounters with the health care system such as inpatient and outpatient visits. These datasets were linked using unique encoded identifiers and analyzed at ICES. All patients age 65 or more and covered by OHIP are eligible for publicly funded medication coverage through the Ontario Drug Benefit (ODB) program. The ODB database, available at ICES, contains a copy of information on all ODB eligible medications dispensed in Ontario pharmacies including date dispensed, number of days supplied, cost and Drug Identification Number (DIN), .

Data on medications were obtained using the ODB database. We used the index date corresponding to the date when the medication was dispensed by the pharmacist.

Linked databases at ICES were used to define patient eligibility. These included claims data using the OHIP database for dates of encounters and the Registered Persons Database (RPDB) to define OHIP eligibility, basic demographics and date of death. The Client Agency Program Enrollment (CAPE) tables were used to identify enrollment with a primary care physician; for patients not enrolled, virtual enrollment to a physician was defined through their pattern of care (physician with the majority of primary care billings for a patient). The Ontario Myocardial Infarction Dataset (OMID) [22] were used to define the presence of cardiovascular conditions.

The Johns Hopkins Adjusted Clinical Groups (ACG) method was used to measure disease burden. Adjusted diagnostic groups (ADGs) cluster groups of diagnostic codes (ACGs) to categorize illnesses and predict health care utilization. These diagnostic clusters, or conditions have similar clinical criteria and expected use of resources; there are 32 diagnostic clusters. Each individual patient is assigned ADGs based on their health conditions; a patient can be assigned between zero and 32 ADGs, with more ADGs indicating greater health care needs [23].

ACGs are also used to group patients by expected health care utilization, or Resource Use bands (RUBs). RUBs range from zero (non-users of health care) to five (very high users) [24].

Data from the Ontario portion of CPCSSN have been linked at ICES; linkage rates were 98.7% [21]. The population included in the linked data was slightly older, included a greater proportion of women and was more likely to live in urban areas than the Ontario population. The linked, combined data were used for this study.

Quantitative variables

An individual was considered to be covered (likely taking a medication) during a given quarter if they were found to have a supply of this medication with a duration overlapping at least 75% of days in that time period. The medication did not have to be dispensed in the given quarter, as the maximum allowed supply in ODB is 100 days. For early refills, we restricted the maximum leftover supply to be 100 days. We grouped ACEis and ARBs in the analysis as they were considered to be equivalent in terms of cardiovascular protection [25]. ARBs are often substituted if ACE is cause side effects such as coughing [25].

This study used an interrupted time series model to determine the impact of the 2013 guidelines on the prescription rates of statin, ACEi/ARB and antiplatelets on a quarterly basis from 2010 to 2016. In particular, the primary outcome included the proportion of eligible patients who had a supply of statin, ACEi/ARB or antiplatelets medication for at least 67 days (75% of days or more) within a 90-day quarter. A total of 13 and 14 quarters were selected before and after the implementation of the Diabetes Canada guidelines in April 2013 (Quarter 2). The intervention effect is assessed using two parameters: (i) a change in trend (i.e. difference in pre-slope and post-slope) and (ii) a change in level (i.e. difference at the beginning of the intervention) [26].

Since the Diabetes Canada guidelines are readily available as a public resource to clinicians, this interrupted time series model was fitted without a roll-in period of the intervention. As part of the sensitivity analyses, the interrupted time series analysis was repeated by excluding patients with no encounters in the EMR (CPCSSN dataset), where there was therefore no opportunity to prescribe medications in primary care.

The analyses were carried out using SAS version 9.4 (SAS Institute. SAS/STAT Software, Version 9.4. SAS, Cary, NC, 2012) and p-values < 0.05 were considered to be statistically significant.

Results

EMR cohort

The size of the cohort increased from 2010 to 2015 as additional practices were being recruited each year into CPCSSN. The size of the cohort varied from 4385 patients to 7424 patients.

Patient characteristics for the first quarter of each year of interest are provided in Table 1. A table with all quarters is provided as supplementary file 1. Between 94.1 and 97.1% of patients identified using the CPCSSN algorithm were also flagged in the ODD. A greater proportion of patients in the CPCSSN data were in the highest income quintile when compared to those in the administrative data.

Table 1 Patient characteristics for the first quarter of each year of interest, EMR cohort

The rates of medications dispensed, where coverage was at least 75% of days within each quarter is shown in Table 2. This table provides the first quarter of each year of interest and the full data are in Supplementary file 2 .

Table 2 Rates of medication coverage for patients with diabetes, for the first quarter of each year, EMR cohort

Medication coverage for patients with at least one encounter in the CPCSSN data is shown in Supplementary file 2.

Results of the interrupted time series analyses are presented in Table 3 and graphically in Fig. 1. There was no significant change in the trend for coverage of any of the vascular protective medications after guideline release. The comparator drug class, PPIs, was increasing prior to guidelines and the rate of increase did not change significantly after.

Table 3 Segmented regression analysis for vascular protective medication and comparator coverage 2010 to 2016, EMR cohort
Fig. 1
figure 1

Segmented regression for rate of dispensed medications, EMR data

Sensitivity analyses were done, removing all patients with no encounter in the CPCSSN dataset. Results were similar and are provided in Supplementary file 3.

Administrative cohort

Patient characteristics for the first quarter of each year are provided in Table 4; all quarters are shown in Supplementary file 4. Patient characteristics were similar to those in the EMR cohort; a smaller proportion of patients were enrolled to a family physician.

Table 4 Patient characteristics for the first quarter of each year of interest, administrative cohort

The rates of medications dispensed, where coverage was at least 75% of days within each quarter is shown in Table 5. This table provides the first quarter of each year of interest and the full data are in Supplementary file 5. Rates are similar to those in the EMR cohort.

Table 5 Rates of medication coverage for patients with diabetes, for the first quarter of each year, 2010 to 2016, administrative cohort

Results of the interrupted time series analyses are presented in Table 6 and graphically in Fig. 2. Similar to those in the EMR cohort, statin coverage continued to increase while ACEi/ARB coverage decreased. There was no increase in the trend for statins or ACEi/ARBs. The trend in change for antiplatelets and PPIs decreased slightly.

Table 6 Segmented regression analysis for vascular protective and comparator medication coverage, 2010 to 2016, administrative cohort
Fig. 2
figure 2

Segmented regression for rate of dispensed medications, administrative data

Discussion

This study estimated coverage for vascular protective medications in a population of Ontario patients aged 66 or more and living with diabetes. We confirmed using both a primary care EMR cohort and a population-based cohort that the release of guidelines were not associated with an increase in the rate of statin or ACEi/ARB coverage.

Our previous study evaluated the 2013 Diabetes Canada guidelines impact on vascular protective prescriptions using EMR data from CPCSSN, which had limitations in its ability to capture medication coverage, medications prescribed outside of primary care, and duration of prescription given variation in refill protocols [8]. Using administrative data has helped to mitigate these concerns and validate previous findings, which revealed no increase in the rates of statin or ACEi/ARB prescriptions after guideline implementation.

Overall prescription rates from the previous study were lower (52–56% for statins, 42–44% for ACEI/ARBs) compared to the current study (63–65% for statins, 60–64% for ACEI/ARB). Differences may be due to different age criteria (age > 40 years in previous study, age > 65 years for ODB,) or medication coverage. For example, ICES data includes an older cohort (age > 65 years) compared to the previous study, making patients more likely to be prescribed a vascular protective medication given their age and universal prescription coverage. The difference in prescription rates was less marked for antiplatelets, which were prescribed in 10–12% of patients in our previous EMR evaluation compared to 6–10% using administrative dispensing data. We believe this difference may also be related to the increased number of over-the counter antiplatelet medications captured in CPCSSN, which are missing from ODB data.

EMR and health administrative data provide valuable tools for disease monitoring and health surveillance. With the increased use of EMR systems for clinical care, there has been a number of initiatives to link EMR data with administrative data to better identify health conditions, inform health care planning and improve patient outcomes [16, 27,28,29]. A number of studies demonstrate comparable data from both sources, but note differences in the way data is captured [11] [30]. [31] In terms of prescription data, the EMR contains prescriptions for patients of all ages, as well as those that are prescribed over the counter or those that are not in the provincial drug formulary. Administrative data includes drugs dispensed (rather than prescribed), and from patients who receive provincial drug coverage, often excluding those in younger age categories. Previous research suggests that approximately 14% of medications prescribed do not get filled, leading to a difference in the match rate between prescribing and dispensing data [32]. The combination of both sources thus provides a more robust understanding of medication trends in Canada.

Limitations

The CPCSSN cohort includes a convenience sample of patients who visit primary care offices, and thus findings may be limited in generalizability. Our data are also derived from the Ontario population, which may not be generalizable to other regions. Patients less than 66 years who are included in the recommendations for vascular protective medications, were not included in the current study as ICES holds medication data from patients who are covered through the ODB program. However, these patients were captured in our previous assessment and demonstrated similar medication trends. This also means that patients without OHIP coverage and those with over the counter prescriptions would not have been captured, however we expect these would represent a small minority of patients overall. Finally, results must be interpreted with caution as administrative data capture medications dispensed, and actual usage of the medications was inferred from these estimates.

Conclusions

The use of both EMR and administrative data provides a more comprehensive picture of the current state of vascular protection for patients with diabetes in Ontario, Canada. This research helps validate previous findings, which used EMR data and found no improvement in vascular protective prescription rates following the 2013 Diabetes Canada Guidelines implementation and dissemination. Given the similarity in findings between EMR and administrative data, our results suggest that EMR data may offer an additional tool to understand prescription trends across Canada with reasonable accuracy. Future work will be directed at validating the methodology used in analyzing such data, including the lag lead approach from our previous study. Further research efforts are also needed to examine reasons for ongoing vascular protection guideline non-adherence in primary care, including more qualitative assessments.