Applying standardized drug terminologies to observational healthcare databases: a case study on opioid exposure
- First Online:
- Cite this article as:
- DeFalco, F.J., Ryan, P.B. & Soledad Cepeda, M. Health Serv Outcomes Res Method (2013) 13: 58. doi:10.1007/s10742-012-0102-1
Observational healthcare databases represent a valuable resource for health economics, outcomes research, quality of care, drug safety, epidemiology and comparative effectiveness research. The methods used to identify a population for study in an observational healthcare database with the desired drug exposures of interest are complex and not consistent nor apparent in the published literature. Our research evaluates three drug classification systems and their impact on prevalence in the analysis of observational healthcare databases using opioids as a case in point. The standard terminologies compiled in the Observational Medical Outcomes Partnership’s Common Data Model vocabulary were used to facilitate the identification of populations with opioid exposures. This study analyzed three distinct observational healthcare databases and identified patients with at least one exposure to an opioid as defined by drug codes derived through the application of three classification systems. Opioid code sets were created for each of the three classification systems and the number of identified codes was summarized. We estimated the prevalence of opioid exposure in three observational healthcare databases using the three defined code sets. In addition we compared the number of drug codes and distinct ingredients that were identified using these classification systems. We found substantial variation in the prevalence of opioid exposure identified using an individual classification system versus a composite method using multiple classification systems. To ensure transparent and reproducible research publications should include a description of the process used to develop code sets and the complete code set used in studies.
KeywordsObservational databasesClassification systemsCoding standardsDrug exposuresOMOP
Opioids are strong analgesics which are increasingly used for the treatment of chronic malignant and nonmalignant pain (Ballantyne and Mao 2003; Sullivan et al. 2008). Systematic reviews of randomized controlled trials have confirmed their short-term efficacy for the treatment of neuropathic pain, back pain, osteoarthritis, cancer pain, and fibromyalgia (Cepeda et al. 2007; Deshpande et al. 2007; Eisenberg et al. 2006; Furlan et al. 2006; Martell et al. 2007; Noble et al. 2008). However, these trials have limited follow-up periods (around 16 weeks) (Deshpande et al. 2007; Furlan et al. 2006; Noble et al. 2008) and in the trials with longer follow-up periods, the lack of generalizability of the findings has been identified as a serious shortcoming (Deshpande et al. 2007). Observational healthcare databases provide an opportunity to assess their long term safety in a population based setting.
In this research we explore the question of how opioid exposures can be identified in observational healthcare databases through the use of standard vocabularies and classification systems.
Although most observational healthcare databases capture individual patient drug exposures, there is no single, standard drug coding scheme. In general, finding a comprehensive and accurate list of drug codes for these studies is cumbersome and time consuming. Code sets can be inconsistent across investigators as it requires manual review of code lists, often generated through a simple text search and unique to a specific database. Code set development is susceptible to multiple forms of errors including the omission of relevant codes and inadvertent code inclusion.
In U.S. based databases, commonly used coding schemes include the National Drug Code (NDC) (National Drug Code Directory 2011), Generic Product Identifier (GPI) (Master Drug Data Base v2.5 (MDDB®) 2011) or Veterans Affairs National Drug File (NDF) (National Formulary 2011) while outside the U.S. different coding schemes will be found. In addition drug exposures are captured as procedural administrations and represented in adjacent coding schemes (i.e., Healthcare Common Procedure Coding System (HCPCS) (HCPCS General Information 2011)).
Even after a single database and coding terminology are selected for study, analysis is further complicated by the process for selecting the proper set of codes as most coding schemes lack an obvious biologically or ingredient-based organizational structure. In these cases a classification system may be selected and applied to the underlying coding scheme in order to identify a particular class of drug. The National Library of Medicine provides RxNorm (An Overview to RxNorm 2011) as a standardized nomenclature for clinical drugs that provides classifications of branded products and generic ingredients. Additionally there are multiple classification systems available including the First DataBank Enhanced Therapeutic Classification (ETC.) system (Enhanced Therapeutic Classification System 2011), World Health Organization (WHO) Anatomical Therapeutic Chemical (ATC) classification system (WHOCC-Structure and principles 2011), and Veterans Affairs (VA) National Drug File Reference Terminology (NDF-RT) (National Drug File-Reference Terminology (NDF-RT) 2011) and each varies in content and structure.
In an effort to address the challenge of multiple coding systems and terminologies, the Observational Medical Outcomes Partnership (OMOP) (Stang et al. 2010) compiled multiple standardized terminologies and classification systems into an interrelated vocabulary. This vocabulary relies on existing standards and mappings, and leverages work within the Unified Medical Language System’s Metathesaurus (UMLS-Metathesaurus 2011). This study evaluates the use of the OMOP vocabulary in a network of disparate observational databases and explores the ability of its multiple standardized terminologies and classification systems to define an appropriate pool of codes for opioid exposure.
2 Materials and methods
Standard vocabularies, classification systems and their relationships were derived from the OMOP’s Standard Terminologies [(OMOP Standard Terminologies 2011); this reference contains the complete set of standard terminologies]. Based on the expertise of our research team, oxycodone was used as a seed ingredient to define an opioid drug grouping in each drug classification system. We identified the point at which oxycodone was categorized within each hierarchy and selected the highest-level drug class that subsumed oxycodone while still being inclusive of other opioid-related drugs. The classes identified through this process were ‘Analgesic-Narcotic’ in ETC., ‘Opioids’ in ATC, and ‘Opioid Agonist’ in NDF-RT. Iterative exploration of ingredients subsumed within these classes was used to exclude other potential classes. Source codes were identified as all codes mapped to any descendent concept within the identified drug class. The source codes identified from each classification system were compared to identify overlap across the three systems. The string terms for all opioid ingredients identified by the three systems (e.g. ‘oxycodone’, ‘hydrocodone’, ‘codeine’) were used in lexical searches amongst all NDC descriptions for codes not previously classified as ‘opioids’ to identify any potentially unmapped source codes. The prevalence of opioid exposure was estimated for each definition based on occurrence of at least one coded record as either an 11 digit NDC code from a pharmacy dispensing record or a HCPCS from a procedural administration.
While the focus of this paper is the exploration of classification system variation as it relates to opioids additional high level analysis was performed to ensure this was not simply an issue in one therapeutic category. The high level analysis was repeated for NSAIDs, Antidiabetics and Antidepressants and we found the variation also occurs in these other therapeutic areas. While we do not discuss these results further we have included the results for review (see Table 3).
To ensure that there was no substantial impact of the addition or removal of pharmacologic agents over time additional data has been provided which stratify the prevalence over time using each of the three individual classification systems (see Table 2).
Three observational healthcare databases were included in this study; the MarketScan Commercial Claims and Encounters (CCAE), Medicare Supplemental (MDCR) databases, MarketScan Medicaid (MDCD) database, and OptumInsight Clinformatics (OPTUM) database.
The MarketScan Commercial Claims and Encounters Database consists of employer and health plan sourced data for several million individuals containing medical and drug data linked to outpatient prescription drug claims and person-level enrollment information. Similar data are also available for the subset of employee retirees who have supplemental Medicare coverage (MDCR) (David et al. 2008). The MarketScan Medicaid Database captures similar data for Medicaid enrollees in several states (David et al. 2008). Results from the CCAE and MDCR databases were combined as the patient records can be continuous across the two databases (CCAEMDCR). The version of the CCAEMDCR database used in this study contained data from 2000 to 2009. The version of the MDCD database used in this study contained data from 2006 to 2008.
The OptumInisght (OPTUM) Clinformatics database contains patient-level data inclusive of administrative data, pharmacy claims data, physician and facility claims data, and lab test results from enrollees in managed care plans administered by United Health Group (i3 InVision Data Mart 2010). The version of the OPTUM database used in this study contained data from 2005 to 2010.
While the observational healthcare databases used in this study are only available under licenses from their respective organizations, the OMOP vocabulary is publically available allowing further investigation of our results against other available data sources.
An opioid related literature review was conducted to assess the proportion of papers that explicitly articulate the code set used or a description of the process used to develop the code set.
3.1 Composite code mappings
Composite code mappings across three observational healthcare databases
Observational healthcare databases
No. distinct drug codes (11 digit NDC)
No. drug records
No. mapped codes
No. records covered by mapping
% of codes mapped
% of records covered by mapping
3.2 Classification systems
Opioid prevalence by classification system and observational healthcare database
No. of persons with record
% of database
No. of records
No. of persons with record
% of database
No. of records
No. of persons with record
% of database
No. of records
3.3 Classification hierarchies
Identification of related 11 digit NDC codes by drug class and vocabulary
Antiinflam and antirheumatic products, non-steroids
Nonsalicylate NSAIDs, antirheumatic
Drugs used in diabetes
Oral antidiabetic agents
Insulin receptor agonists
Oral hypoglycemic agents
Serotonin uptake inhibitors, norepinephrine uptake inhibitors, dopamine uptake inhibitors
Standard drug vocabularies have utility in many applications. They provide a useful tool for comparing the prevalence of drugs across disparate data sources, assist in the identification of drugs within a class, and can help define a comparator population based on treatments for the same indication. Vocabularies can also help identify codes for exposures that appear as drug administration procedures as well as all combination drugs that include a specific active ingredient.
A relatively low percentage of all distinct drug codes found in the observational healthcare databases can be mapped to the standard drug vocabularies used in this study (55.8–69.2 %). The codes that do not map appear to be due to erroneous coding in the source data, incomplete mappings, and limitations of the target vocabularies. Despite the low percentage of distinct code mappings we found that a vast majority of data records were successfully mapped to the used vocabularies (93.8–95.2 %). While further work can potentially enhance the quality and completeness of code mappings, we believe that the law of diminishing returns will quickly reduce the amount of additional information captured through a more extensive mapping. The biggest benefit of applying drug classification standards would be in eliminating erroneous data by ensuring that all drug codes match standard vocabularies.
It is clear through this opioid example that there is no superior classification system and that there is substantial value in using multiple drug classification systems concurrently to reduce the risk of under-ascertainment of exposure. For example, restricting to only the ATC system would lead to the exclusion of hydrocodone—one of the most commonly prescribed opioids—as well as buprenorphine and methadone that, although used for the treatment of opioid dependence, are also used for the treatment of pain. Restricting to only the NDF-RT system would lead to the exclusion of tapentadol, a recently approved opioid. Additionally restricting to only the NDF-RT system would lead to the exclusion of alfentanil, but to the inclusion of other similar opioids with only intravenous formulations such as sufentanil.
Each classification system simply reflects a different perspective for organizing clinical concepts and the most value can be realized by leveraging multiple perspectives, which would lead to a more complete representation. While ETC. had the highest coverage of the opioid NDCs, the high level analysis of the three other therapeutic areas showed that no single classification system consistently exhibited this capability.
In our opinion, inclusion of drug code sets and a description of the process used to develop code sets in publications would provide a significant value for the healthcare research community. This level of detail is generally lacking in current literature. A literature search was performed to determine how often authors reported the complete set of drug codes used in observational database studies. The intent of this review was to illustrate the potential for variation while attempting to reproduce other study results. We limited the search to studies published in English and used the Medical Subject Headings terms: “epidemiologic studies”, “case–control studies”, “cohort studies”, and “follow-up studies” combined with “Analgesics, Opioids” and the key word: “database”. Out of the 23 studies (Cepeda et al. 2010; Chen et al. 2010; Franklin et al. 2008; Gallagher et al. 2009; Gasse et al. 2000; Goettsch et al. 2007; Gross et al. 2009; Iyer et al. 2010; Jick et al. 1998; Kwong et al. 2010; Massey et al. 2005; Parente et al. 2004; Pradel et al. 2004; Sittl et al. 2005; Skurtveit et al. 2010; Skurtveit et al. 2008; Sullivan et al. 2010; Victor et al. 2009; Voaklander et al. 2008; Von Korff et al. 2011; White et al. 2009; Ytterberg et al. 1998; Zorowitz et al. 2005) we identified as observational studies using electronic medical record or claims databases, only three reported the drug codes used. Notably, the authors of these manuscripts were the same and the codes provided were identical. Understanding the process used to develop code sets provides a way for researchers to understand the decisions made in the framing of the research question and in turn, determine possible implications for replication of the results.
Code sets can be very large making peer reviewed publications a less than ideal location to present them, however, they could be made available as an online supplement. Perhaps a public library of code sets with appropriate definitions could be made available through the National Library of Medicine or some other curated source.
This is a single study of a single drug class and more research of additional drug classes would be required to further support our conclusions.
Even with shared code sets reproducing results could be challenging given the fact that observational healthcare databases have non-standard versions, formats, update frequencies and time frames across different organizations.
The authors wish to acknowledge the support of Paul Stang, Marsha Wilcox, Irene Cosmatos, Erica Voss and Victor Lobanov for their thoughtful review and comments on earlier drafts of this manuscript.
Frank J. DeFalco, Patrick B. Ryan, and M. Soledad Cepeda are employees of Janssen Research & Development, L.L.C. Johnson & Johnson Pharmaceutical Research & Development, L.L.C., is an affiliate of Ortho-McNeil-Janssen Scientific Affairs, LLC, which markets several analgesic drug products including opioids and over-the-counter analgesics.
This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.