European Journal of Epidemiology

, Volume 31, Issue 4, pp 351–368

Generic versus brand-name drugs used in cardiovascular diseases

  • Lamberto Manzoli
  • Maria Elena Flacco
  • Stefania Boccia
  • Elvira D’Andrea
  • Nikola Panic
  • Carolina Marzuillo
  • Roberta Siliquini
  • Walter Ricciardi
  • Paolo Villari
  • John P. A. Ioannidis
Open AccessMETA-ANALYSIS

DOI: 10.1007/s10654-015-0104-8

Cite this article as:
Manzoli, L., Flacco, M.E., Boccia, S. et al. Eur J Epidemiol (2016) 31: 351. doi:10.1007/s10654-015-0104-8

Abstract

This meta-analysis aimed to compare the efficacy and adverse events, either serious or mild/moderate, of all generic versus brand-name cardiovascular medicines. We searched randomized trials in MEDLINE, Scopus, EMBASE, Cochrane Controlled Clinical Trial Register, and ClinicalTrials.gov (last update December 1, 2014). Attempts were made to contact the investigators of all potentially eligible trials. Two investigators independently extracted and analyzed soft (including systolic blood pressure, LDL cholesterol, and others) and hard efficacy outcomes (including major cardiovascular adverse events and death), minor/moderate and serious adverse events. We included 74 randomized trials; 53 reported ≥1 efficacy outcome (overall sample 3051), 32 measured mild/moderate adverse events (n = 2407), and 51 evaluated serious adverse events (n = 2892). We included trials assessing ACE inhibitors (n = 12), anticoagulants (n = 5), antiplatelet agents (n = 17), beta-blockers (n = 11), calcium channel blockers (n = 7); diuretics (n = 13); statins (n = 6); and others (n = 3). For both soft and hard efficacy outcomes, 100 % of the trials showed non-significant differences between generic and brand-name drugs. The aggregate effect size was 0.01 (95 % CI −0.05; 0.08) for soft outcomes; −0.06 (−0.71; 0.59) for hard outcomes. All but two trials showed non-significant differences in mild/moderate adverse events, and aggregate effect size was 0.07 (−0.06; 0.20). Comparable results were observed for each drug class and in each stratified meta-analysis. Overall, 8 serious possibly drug-related adverse events were reported: 5/2074 subjects on generics; 3/2076 subjects on brand-name drugs (OR 1.69; 95 % CI 0.40–7.20). This meta-analysis strengthens the evidence for clinical equivalence between brand-name and generic cardiovascular drugs. Physicians could be reassured about prescribing generic cardiovascular drugs, and health care organization about endorsing their wider use.

Keywords

Generic drugBrand-name drugCardiovascular diseasesMeta-analysisEfficacySafety

Introduction

Because generic medicines are produced by multiple manufacturers after the patent of the brand-name equivalent expires, most of them are significantly less expensive than their brand-name counterparts [1]. To control pharmaceutical expenses, in the last two decades many payers and providers have encouraged the use of generic drugs, whose market share sharply increased and exceeded 40 % of the market volume in most developed countries in 2011 [2].

Generic drugs contain the same active ingredients as the original brand-name formulations and they aim to be identical to them or within an acceptable bioequivalent range in terms of their pharmacokinetic and pharmacodynamic characteristics. By extension, generics are considered identical in dose, strength, route of administration, safety, efficacy, and intended use [3].

Besides bioequivalence, the crucial assumption of identical health benefits of generics and brand-name drugs is based upon a few systematic reviews [1, 47]. In particular, in the context of cardiovascular diseases, which represents the first cause of disease burden in EU, USA and globally [8], only two meta-analyses directly compared the health outcomes of generic and brand-name medicines [4, 7]. One meta-analysis focused on clopidogrel only [7]. The other meta-analysis considered all drugs and included data on 30 randomized controlled trials (RCTs) [4]. However, it was published in 2008, and the results of dozens of RCTs reporting at least one efficacy or safety outcomes have been made available since then. Also, only efficacy outcomes from randomized trials had been considered in the prior meta-analysis, and the comparisons between generic and brand-name medicines lacked statistical power for several drug classes. For example, the conclusions on antiplatelet agents, ACE inhibitors and statins were based upon only 50, 23 and 71 subjects, respectively [4]. Finally, 16 of the 30 included trials had follow-up shorter than 48 h, a duration that allows bioequivalence measurements but provides very little information for safety or efficacy outcomes.

We updated and expanded previous work and carried out a meta-analysis of RCTs comparing the efficacy and adverse events, either serious or mild/moderate, of all generic versus brand-name cardiovascular drugs.

Methods

Search, study inclusion criteria and quality assessment

We included RCTs directly comparing at least one brand-name drug and at least one of its generic versions, and reporting at least one efficacy or safety outcome to treat or control cardiovascular diseases in humans, including vital signs (e.g. blood pressure), laboratory parameters used in clinical practice (e.g. low-density lipoprotein), mortality, and indices of morbidity. Trials focusing and reporting only on bioequivalence measures (e.g. drug serum concentration, time until maximum concentration, area under the curve based on serum concentration as a function of time) were retrieved to search whether safety and/or efficacy outcomes were also reported or could be retrieved from their investigators. Trials on biologic products (any medicinal product manufactured in or extracted from biological sources; e.g. vaccines) were excluded, as well as observational studies. No language or date restrictions were used.

The search was initially made online in MEDLINE, Scopus, EMBASE, Cochrane Controlled Clinical Trial Register (CCCTR), and ClinicalTrials.gov (last update December 1, 2014). The bibliographies of all relevant articles including reviews were then reviewed for further references. When it was not possible to extract any safety or efficacy outcome from a study, several attempts to contact the corresponding author were made. We planned to include also results that were posted in ClinicalTrials.gov and not published in peer-review journals. The search string was adjusted for each database while maintaining a common overall architecture. We used various combinations of the following terms related to four main domains: “generic* OR non-proprietary OR nonproprietary OR non-brand name drug” (title/abstract) AND “brand-name drug OR innovator OR patent drug OR proprietary drug” (all fields) AND “cardiovascular disease* OR coronary heart disease OR myocardial infarction OR acute coronary syndrome OR heart failure OR congestive heart disease OR blood pressure OR cholesterol OR hypertension OR hypercholesterolemia OR atherosclerosis OR antihypertensive* OR antiarrhythmic* OR beta blocker* OR calcium channel blocker* OR ace inhibitor* OR angiotensin receptor blocker* OR diuretic* OR statin*” (title/abstract) AND “random*” (all fields). Several alternative strings were used in PubMed by two investigators, independently, in order to enhance the sensitivity. Details on the adopted search strings are available in Additional Appendix S1. Although we could not exactly reproduce the search by Kesselheim et al. [4], as not enough details were available, we used the same main subject heading domains and, as a proof of principle for the sensitivity of our searches, we retrieved all 35 trials [946] found in the previous meta-analysis [4]. Indeed, the only substantial difference between the two searches were the online databases: we searched Scopus, CCCTR, and ClinicalTrials.gov in addition to MEDLINE and EMBASE.

We assessed aspects of the reported methodological quality of each study using the Cochrane risk of bias tool: generation of allocation sequences, allocation concealment, blinding, type of analysis, missing or selective outcome reporting and other sources of bias [47].

Outcomes and data analysis

A standardized effect size (Cohen’s d) and its 95 % confidence intervals (95 % CIs) were computed for each study using the methodology detailed elsewhere [4850]. In brief, the standardized effect sizes compare the difference in effect between the study groups divided by the standard deviation of this difference. This measure is independent of the measurement used, sample size, and standard deviation of the outcome measure, and allows the aggregation of different outcomes across studies to obtain effect sizes for each cardiovascular drug class as well as an aggregate effect size for all studies included in the meta-analysis [4, 51]. If the repeated measures correlation of a cross-over trial was not reported, we assumed a coefficient of 0.5 [4]. For continuous outcomes, if the standard deviation of the mean difference between the pre-post differences of the groups under comparison were not reported, we used the largest standard deviation of the mean differences of the groups [52]. For categorical outcomes, the natural logarithms of single study odds ratios were first computed and then divided by 1.81 to obtain the equivalent d [50]. If the sample size at the end of follow-up was not clearly specified, we extracted the baseline sample. An effect size lower than 0.2 should be considered very small; small if ranging from 0.2 to 0.5; medium from 0.5 to 0.8; and large if greater than 0.8 [51]. In our analysis, a positive effect size favors generics.

Two investigators independently extracted all outcomes. For efficacy outcomes, we initially selected for extraction the outcomes that were most closely related to the supposed clinical effect of the drug. For ACE inhibitors or Angiotensin receptor blockers, beta-blockers, calcium-channel blockers, and other drugs, we used systolic blood pressure reduction from baseline to the end of follow-up. For statins, we used LDL cholesterol reduction. For anticoagulants, we used the percentage of subjects within therapeutic INR range. For antiplatelet agents, we used bleeding time, or the variation in platelet aggregation inhibition, when bleeding time was not reported. For diuretics, we used the variation in urinary sodium excretion, or variation in urine volume, when urinary sodium secretion was not available, or systolic blood pressure, when both the above outcomes were not available. If the first choice outcomes were not available, we tried to contact authors for more information. In case of no response (as for all attempts), we extracted the other efficacy outcome among those listed above. In any case, all reported outcomes of any study were extracted, and the authors of all studies were contacted to request additional information of outcomes and on published or unpublished trials. Also, we requested information from the authors of the potentially eligible trials that were excluded because only bioequivalence outcome were reported.

For safety outcomes, we recorded separately mild/moderate and serious adverse events (any medical occurrence that resulted in death, life-threatening medical conditions, persistent or substantial disability or incapacity, or admission to hospital). When information was available, we only extracted the adverse events that were possibly related to the drug (as defined by the authors).

Hard efficacy outcomes (e.g. major cardiovascular events—MACE—or death) were extracted and combined separately from soft outcomes (e.g. systolic blood pressure or LDL reduction). Efficacy outcomes were reported at more than one follow-up point in several trials. We always extracted the data referred to the longest follow-up, except for five trials [33, 35, 40, 53, 54]. In these trials, the drug was administered only once, and efficacy data were reported at several time-points, some of which were distant from the estimated duration of the effect (based upon the half-life reported in study); we extracted the data referred to the time-point that was closer to the estimated duration of the drug effect (although, in all cases, the results of the various time-points did not vary substantially). Four other trials reported efficacy and safety data at different time points [25, 30, 34, 55]: we accordingly reported different follow-up durations for the same study in the meta-regression analyses on efficacy and safety outcomes. Finally, one trial compared two doses (25 and 50 mg) of generic and brand-name captopril [56]: the results were similar with both doses, and we extracted the data relative to the 50 mg dose. The details of the outcome extraction for each included study are reported in Additional Table S1.

The effect sizes of efficacy outcomes and mild/moderate adverse events were combined using a random-effect, generic inverse variance approach [47], and statistical heterogeneity was quantified using the I2 metric [57]. In case of limited data I2 metric 95 % confidence intervals are typically large [58] and thus inferences on the magnitude of the statistical heterogeneity should be cautious. Data on serious adverse events were combined using individual data random-effect logistic regression, with single study as the cluster unit, to avoid the exclusion of the many trials with zero events in both groups [47, 59]. The combined datasets with individual data were reconstructed using published 2X2 tables. The protocol of the review is available online as supporting information.

Several stratified meta-analyses were made to explore the potential influence of several a priori selected variables (health status: healthy, if defined so by the authors or without any major disease, or non-healthy; sample size: ≤30, 31–99, ≥100; study location: USA, Europe, Asia or other; design: cross-over or classic parallel group; follow-up duration: ≤1, 2–27, ≥28 days; blinding: open-label or single-blinded, double-blinded; funding: generic manufacturer, brand-name manufacturer, other funding, not reported). In addition to stratification, we used meta-regression with multiple covariates to explore potential predictors of the summary estimate of risk [60]. To reduce potential overfitting and false positive results, the number of variables included in both final and intermediate models (during modelling) was limited to 1 tenth of the included studies [57].

The impact of potential publication bias could not be evaluated as trials in this context are typically aimed at producing non-significant rather than significant results and indeed studies rarely had statistically significant differences in outcomes of interest. Standardized effect sizes and 95 % CIs for continuous outcomes were computed and combined using RevMan 5.3 (Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2014). Stata version 13 (Stata Corp., College Station, TX, 2013) was used to perform meta-regression and logistic regression analysis.

Results

Characteristics of eligible studies

Of the 745 papers initially retrieved (online PRISMA flow diagram), we included 74 randomized trials comparing generic vs brand-name drugs against cardiovascular diseases [913, 1540, 42, 43, 5356, 6196]: 53 trials evaluated at least one efficacy outcome (overall sample 3051), 32 trials measured mild or moderate adverse events (n = 2407), and 52 reported on serious adverse events (n = 2952). Among the 53 trials including at least one efficacy outcome, we could extract hard outcomes (MACE or death) from 3 trials only, and soft outcomes from 52 trials. The safety outcomes of four trials were not published in peer-reviewed journal but were posted on ClinicalTrials.gov [61, 62, 65, 66]. 38 reports were excluded because only bioequivalence outcomes were reported or relevant outcome data could not be extracted. We attempted to contact all investigators, and thanks to their answers we were able to retrieve four additional trials [72, 73, 78, 81], and to add the data on mild/moderate [83] or serious [75] adverse events for two studies. The complete list of the excluded trials is available in Additional Appendix S2.

The main characteristics of each included trial have been reported in Table 1: the drug-classes under evaluation were ACE inhibitors or Angiotensin receptor blockers (12 trials), anticoagulants (n = 5), antiplatelet agents (n = 17), beta-blockers (n = 11), calcium channel blockers (n = 7); diuretics (n = 13); statins (n = 6); and others including alpha-blockers (n = 1); heparin (n = 1), and ezetimibe (n = 1).
Table 1

Characteristics of the 74 included randomized controlled trials

First author

Year

Country

Active principle

Patient’s status

Mean age (years)

Follow-up durationa

Design

Total sample (generics)

Extracted outcomes

Funding

Protocol registration

ACE inhibitors or ARBs

Portoles [33]

2004

Spain

Enalapril

Healthy

23

5 h (36 h)

Crossover

23 (23)

SBP (E), mAEs (S), sAEs (S)

Not reported

No

Carranza [56]

2005

Mexico

Captopril

Hypertension

58

24 h

Cross-over

21 (21)

SBP (E)

Not reported

No

Kim (A) [64]

2009

Korea

Ramipril

Hypertension

50

8 weeks

Parallel-group

89 (45)

SBP (E), mAEs (S), sAEs (S)

Generic manufacturer

No

Spinola [69]

2009

Canada

Valsartan

Healthy

37

36 h

Cross-over

41 (41)

mAEs (S), sAEs (S)

Generic manufacturer

No

Iqbal [63]

2010

India

Valsartan

Healthy

25

24 h

Cross-over

18 (18)

sAEs (S)

Generic manufacturer

No

Jia [54]

2010

China

Losartan

Healthy

24

24 h (36 h)

Cross-over

27 (27)

SBP (E), mAEs (S), sAEs (S)

Generic manufacturer

No

Li [67]

2010

China

Olmesartan

Healthy

21

48 h

Cross-over

21 (21)

sAEs (S)

Generic manufacturer

2005L01077

Larouche 1 [65]b

2010

USA

Losartan

Healthy

42

2 weeks

Cross-over

80 (80)

mAEs (S), sAEs (S)

Generic manufacturer

NCT01124162

Larouche 2 [66]b

2010

USA

Losartan

Healthy

45

2 weeks

Cross-over

80 (80)

mAEs (S), sAEs (S)

Generic manufacturer

NCT01124175

Carlson 1 [61]b

2010

USA

Losartan and HCT

Healthy

42

2 weeks

Cross-over

80 (80)

sAEs (S)

Generic manufacturer

NCT01149473

Carlson 2 [62]b

2010

USA

Losartan and HCT

Healthy

42

2 weeks

Cross-over

20 (20)

mAEs (S), sAEs (S)

Generic manufacturer

NCT01149486

Oigman [68]

2013

Brazil

Ramipril and HCT

Hypertension

57

8 weeks

Parallel-group

102 (54)

SBP (E), mAEs (S), sAEs (S)

Generic manufacturer

ISRCTN 05051235

Anticoagulants

Handler [19]

1998

USA

Warfarin

Atrial fibrillation

71

4 weeks

Cross-over

55 (54)

% within INR range (E), Anticoagulation events (S), sAEs (S)

Generic manufacturer

No

Neutel [28]

1998

USA

Warfarin

Atrial fibrillation

70

5 weeks

Cross-over

39 (39)

% within INR range (E)

Not reported

No

Weibert [42]

2000

USA

Warfarin

Atrial fibrillation

70

4 weeks

Cross-over

104 (102)

mAEs (S), sAEs (S)

Generic manufacturer

No

Lee [22]

2005

Taiwan

Warfarin

Heart Valves

52

12 weeks

Cross-over

35 (35)

% within INR range (E) Anticoagulation events (S), sAEs (S)

Industry (other)

No

Pereira [31]

2005

Canada

Warfarin

Outpatients to be treated

63

15 weeks

Cross-over

7 (7)

% within INR range (E)

Not reported

No

Antiplatelet agents

Rao [34]

2003

India

Clopidogrel

Healthy

27

2 h (10 days)

Parallel-group

20 (10)

Bleeding time (E), mAEs (S), sAEs (S)

Generic manufacturer

No

Ashraf [9]

2005

Pakistan

Clopidogrel

CVD

49

24 h

Cross-over

30 (30)

Platelet aggr. inhibition (E), sAEs (S)

Non profit

No

Mijares [73]

2008

Venezuela

Clopidogrel

Healthy

30

2 weeks

Cross-over

20 (20)

Platelet aggr. inhibition (E), mAEs (S), sAEs (S)

Industry (other)

No

Kim (P) [55]

2009

Korea

Clopidogrel

Healthy

24

7 days (13 days)

Cross-over

44 (44)

Platelet aggr. inhibition (E), mAEs (S), sAEs (S)

Generic manufacturer

No

Di Girolamo [70]

2010

Argentina

Clopidogrel

Healthy

34

12 h

Cross-over

24 (24)

sAEs (S)

Generic manufacturer

No

Müller [74]

2010

Venezuela

Clopidogrel

Healthy

23

7 days

Cross-over

20 (20)

Platelet aggr. inhibition (E)

Not reported

No

Shim [95]

2010

Korea

Clopidogrel

Healthy

29

1 week

Cross-over

29 (29)

Bleeding time (E), sAEs (S)

Generic manufacturer

No

Khosravi [71]

2011

Iran

Clopidogrel

PCI

59

6 months

Parallel-group

442 (224)

MACE and death (E)

Generic manufacturer

IRCT 138712111723N1

Suh [96]

2011

Korea

Clopidogrel

CVD

62

4 weeks

Parallel-group

203 (100)

mAEs (S), sAEs (S)

Generic manufacturer

NCT00947843

Oberhänsli [75]

2012

Swiss

Clopidogrel

CVD

69

10 days

Cross-over

60 (60)

Platelet aggr. inhibition (E), sAEs (S)

Non profit

No

Srimahachota [78]

2012

Thailand

Clopidogrel

CVD

NR

6 h

Parallel-group

49 (25)

Platelet aggr. inhibition (E), mAEs (S)

Not reported

No

Tsoumani (A) [79]

2012

Greece

Clopidogrel

ACS

70

6 months

Parallel-group

86 (45)

Platelet aggr. inhibition (E)

Generic manufacturer

No

Tsoumani (E) [80]

2012

Greece

Clopidogrel

ACS

64

4 weeks

Parallel-group

96 (51)

Platelet aggr. inhibition (E)

Non profit

No

Zou [81]

2012

China

Clopidogrel

Healthy

24

36 h

Cross-over

20 (20)

sAEs (S)

Not reported

No

Park (J) [76]

2013

Korea

Clopidogrel

CVD

62

4 weeks

Parallel-group

130 (65)

Platelet aggr. inhibition (E), MACE and death (E), mAEs (S), sAEs (S)

Generic manufacturer

NCT01584791

Komosa [72]

2014

Poland

Clopidogrel

CVD

49

8 days

Parallel-group

53 (28)

Platelet aggr. inhibition (E), mAEs (S)

Not reported

No

Seo [77]

2014

Korea

Clopidogrel

ACS

58

24 h (4 weeks for AEs and MACE)

Parallel-group

95 (47)

Platelet aggr. inhibition (E), MACE and death (E), sAEs (S)

Generic manufacturer

NCT02060786

Beta-blockers

Biswas [82]

1989

India

Propranolol

Healthy

26

7 days

Cross-over

18 (18)

SBP (E)

Not reported

No

Carter [13]

1989

USA

Propranolol

Hypertension

46

4 weeks

Cross-over

12 (12)

SBP (E)

Non profit

No

el-Sayed [16]

1989

UK

Propranolol

Healthy

20

2 h

Cross-over

12 (12)

SBP (E)

Not reported

No

Chiang [15]

1995

Taiwan

Atenolol

Hypertension

59

4 weeks

Cross-over

23 (23)

SBP (E)

Not reported

No

Sarkar [35]

1995

USA

Atenolol

Healthy

NR

12 h (24 h)

Cross-over

29 (29)

SBP (E), sAEs (S)

Generic manufacturer

No

Bongers [12]

1999

Germany

Metoprolol

Stable angina

62

4 weeks

Cross-over

51 (51)

SBP (E), mAEs (S), sAEs (S)

Brand-name manufacturer

No

Cuadrado [53]

2002

Spain

Atenolol

Healthy

23

24 h (30 h)

Cross-over

24 (24)

SBP (E), mAEs (S), sAEs (S)

Generic manufacturer

No

Mirfazaelian [26]

2003

Iran

Atenolol

Healthy

36

24 h

Cross-over

12 (12)

SBP (E), sAEs (S)

Not reported

No

Portoles [32]

2005

Spain

Carvedilol

Healthy

23

24 h

Cross-over

24 (24)

sAEs (S)

Not reported

No

Bus-Kwasnik [83]

2012

Poland

Bisoprolol

Healthy

23

60 h

Cross-over

24 (24)

mAEs (S), sAEs (S)

Generic manufacturer

EudraCT 2009 014861-20

Liu [84]

2013

China

Carvedilol

Healthy

27

24 h

Cross-over

23 (23)

mAEs (S), sAEs (S)

Generic manufacturer

No

Calcium channel blockers

Usha [40]

1997

India

Diltiazem

Healthy

27

12 h

Cross-over

12 (12)

SBP (E)

Generic manufacturer

No

Saseen [36]

1997

USA

Verapamil

Hypertension

70

2 weeks

Cross-over

8 (8)

SBP (E), sAEs (S)

Not reported

No

Park [30]

2004

Korea

Amlodipine

Healthy

22

7 h (6 days)

Cross-over

18 (18)

SBP (E), sAEs (S)

Not reported

No

Kim [21]

2007

Korea

Amlodipine

Hypertension

53

8 weeks

Parallel-group

188 (94)

SBP (E), mAEs (S), sAEs (S)

Generic manufacturer

No

Mignini [25]

2007

Italy

Amlodipine

Healthy

35

3 h (6 days)

Cross-over

24 (24)

SBP (E), mAEs (S), sAEs (S)

Not reported

No

Kim [85]

2008

Korea

Amlodipine

Hypertension

53

8 weeks

Parallel-group

124 (63)

SBP (E), mAEs (S), sAEs (S)

Generic manufacturer

No

Liu [86]

2009

China

Amlodipine

Healthy

21

5 days

Cross-over

20 (20)

mAEs (S), sAEs (S)

Non profit

No

Diuretics

Garg [17]

1984

India

Furosemide

Healthy

33

6 h

Cross-over

16 (16)

SBP (E), mAEs (S), sAEs (S)

Not reported

No

Grahnen [18]

1984

Sweden

Furosemide

Healthy

26

7 h

Cross-over

8 (8)

Urine volume (E)

Not reported

No

Martin [23]

1984

UK

Furosemide

Healthy

30

24 h

Cross-over

12 (12)

Urine sodium (E)

Non profit

No

Pan [29]

1984

Hong Kong

Furosemide

CVD

NR

8 h

Cross-over

5 (5)

Urine sodium (E)

Not reported

No

Meyer [24]

1985

S. Africa

Furosemide

Healthy

29

6 h

Cross-over

12 (12)

Urine volume (E)

Not reported

No

Singh [38]

1987

India

Furosemide

Edema of renal origin

36

6 h

Cross-over

7 (7)

SBP (E), sAEs (S)

Not reported

No

Sharoky [37]

1989

USA

HCT and Triamterene

Hypertension

55

3 weeks

Cross-over

30 (30)

SBP (E), sAEs (S)

Generic manufacturer

No

Kaojarern [20]

1990

Thailand

Furosemide

Healthy

32

8 h

Cross-over

8 (8)

Urine sodium (E)

Brand-name manufacturer

No

Awad [11]

1992

Jordan

Furosemide

Healthy

27

8 h

Cross-over

20 (20)

Urine sodium (E)

Not reported

No

Murray [27]

1997

USA

Furosemide

CVD

65

2 weeks

Cross-over

17 (17)

Urine sodium (E)

Brand-name manufacturer

No

Almeida [87]

2011

Portugal

Eplerenone

Healthy

40

24 h

Cross-over

27 (27)

mAEs (S), sAEs (S)

Generic manufacturer

No

Kumar (India) [88]

2014

India

Losartan and HCT

Healthy

33

48 h

Cross-over

15 (15)

sAEs (S)

Generic manufacturer

No

Kumar (Japan) [88]

2014

Japan

Losartan and HCT

Healthy

30

48 h

Cross-over

24 (24)

sAEs (S)

Generic manufacturer

No

Statins

Assawawitoontip [10]

2002

Thailand

Simvastatin

Hypercholest.

37

8 weeks

Cross-over

48 (48)

LDL (E)

Generic Manufacturer

No

Wiwanitkit [43]

2002

Thailand

Simvastatin

Healthy

49

16 weeks

Cross-over

37 (37)

LDL (E), sAEs (S)

Generic manufacturer

No

Kim [91]

2010

Korea

Atorvastatin

CVD

61

8 weeks

Parallel-group

235 (119)

LDL (E), mAEs (S), sAEs (S)

Generic manufacturer

NCT01029522.

Liu [93]

2010

China

Atorvastatin

Healthy

24

48 h

Cross-over

45 (45)

sAEs (S)

Brand-name manufacturer

CNR 2007L02512

Boh [89]

2011

Slovenia

Atorvastatin

Hypercholest.

56

16 weeks

Parallel-group

137 (66)

LDL (E), mAEs (S), sAEs (S)

Not reported

No

Kim [92]

2013

Korea

Atorvastatin

Hypercholest.

61

8 weeks

Parallel-group

289 (143)

LDL (E), mAEs (S), sAEs (S)

Generic manufacturer

NCT01285544.

Others

Tsai [39]

2007

Taiwan

Terazosin

Healthy

64

6 weeks

Cross-over

43 (43)

SBP (E), mAEs (S), sAEs (S)

Generic manufacturer

No

Feng [90]

2009

China

Heparin

Healthy

21

24 h

Cross-over

22 (22)

sAEs (S)

Not reported

No

Palmer [94]

2014

India

Ezetimibe

Healthy

27

72 h

Cross-over

51 (50)

sAEs (S)

Generic manufacturer

NCT01597700

NR not reported, HCT hydrochlorothiazide, ACE angiotensin-converting-enzyme, ARBs angiotensin II receptor blockers, SBP systolic blood pressure, LDL low-density lipoprotein, sAEs serious adverse events, mAEs mild adverse events, Hypercholest. hypercholesterolemia, CVD cardiovascular diseases, ACS acute coronary syndrome, PCI percutaneous coronary intervention, (E) efficacy outcome, (S) safety outcome, MACE major cardiovascular events, INR international normalized ratio

aWhen the follow-up duration differed between safety and efficacy outcomes, the follow-up of the safety outcome has been reported under brackets (see text and Additional Table S1 for details)

bResults posted in ClinicalTrials.gov only

Of the 74 trials, 39 trials were performed in Asian countries, 15 in Europe and 18 in America; 24 studies had a follow-up duration equal or longer than 4 weeks; 58 trials had a cross-over design; the sample size was ≥100 in 10 trials, while 40 studies included 30 subjects or less; 37 trials were funded by the generic manufacturer, and only 11 of the 37 studies published after 2005 had the protocol registered online (11/27 from 2010, the year in which the first trial with a registered protocol was published).

All outcomes evaluated in each trial are listed in Additional Table S1: the extracted outcomes varied across single studies, however an outcome that was closely related to the supposed clinical effect of the drug was extracted in all trials with at least one efficacy outcome, with two exceptions that were excluded [14, 41]. The mean difference between groups in systolic blood pressure change from baseline was extracted in 18 of the 18 trials with efficacy outcomes on beta-blockers, ACE inhibitors (or Angiotensin receptor blockers) and calcium channel blockers. Also, the variation in LDL cholesterol was extracted from all studies on statins.

As shown in Additional Table S2, based on their reporting 7 of the 70 included trials were at low risk of bias for at least 5 of the 6 methodological characteristics included in Cochrane risk-of-bias assessment tool, while 14 “scored” 1 or 0. As regards the single items, the random sequence generation and allocation concealment were unclear or inappropriate for 35 and 60 studies, respectively. Only 24 trials were double-blinded, and 27 had low risk of selective reporting.

Efficacy

Overall, 52 trials including 2609 subjects were included in the meta-analysis evaluating soft efficacy outcomes (Table 1; Fig. 1), and 3 trials including 667 subjects were included in the meta-analysis evaluating hard efficacy outcomes (Fig. 2). For both soft and hard outcomes, all RCTs (100 %) showed non-significant differences between generic and brand-name drugs. The aggregate effect size was 0.01 (95 % CI −0.05; 0.08) for soft outcomes; −0.06 (95 % CI −0.71; 0.59) for hard outcomes, both indicating no difference between generic and brand-name drugs. Similar results were observed for each drug class and in each stratified meta-analysis (Table 2). There was no large statistical heterogeneity between studies in any of the comparisons. No covariate was significantly associated with effect size in meta-regression analysis (Additional Table S3).
https://static-content.springer.com/image/art%3A10.1007%2Fs10654-015-0104-8/MediaObjects/10654_2015_104_Fig1_HTML.gif
Fig. 1

Meta-analysis evaluating the clinical efficacy (soft outcomes) of generic vs brand-name drugs against cardiovascular diseases

https://static-content.springer.com/image/art%3A10.1007%2Fs10654-015-0104-8/MediaObjects/10654_2015_104_Fig2_HTML.gif
Fig. 2

Meta-analysis evaluating the clinical efficacy (hard outcomes: MACE or death) of generic versus brand-name drugs against cardiovascular diseases

Table 2

Results of meta-analyses comparing the efficacy and safety of generic versus brand-name drugs against cardiovascular diseases

 

Efficacy (soft outcomes)

I2 (%)

Mild or moderate adverse events

I2 (%)

n (N)

ES (95 % CI)

Upper (95 % CI)

n (N)

ES (95 % CI)

Upper (95 % CI)

Overall

52 (2609)

0.01 (−0.05; 0.08)

0 (32)

32 (2407)

0.07 (−0.06; 0.20)

15 (45)

Drug class

ACE inhibitors or ARBs

5 (262)

0.07 (−0.15; 0.28)

0 (79)

8 (456)

0.10 (−0.20; 0.41)

38 (72)

Anticoagulants

4 (136)

0.09 (−0.15; 0.33)

0 (85)

3 (196)

0.19 (−0.12; 0.50)

0 (90)

Antiplatelet agents

13 (732)

0.01 (−0.12; 0.15)

0 (57)

7 (519)

−0.10 (−0.40; 0.19)

0 (71)

Beta-blockers

8 (181)

0.00 (−0.21; 0.21)

0 (68)

4 (123)

0.23 (−0.10; 0.57)

0 (85)

Calcium channel blockers

6 (374)

−0.03 (−0.22; 0.16)

0 (75)

4 (356)

0.09 (−0.23; 0.42)

0 (85)

Diuretics

10 (135)

−0.07 (−0.31; 0.17)

0 (62)

2 (43)

0.27 (−1.81; 2.36)

91 (–)

Statins

5 (746)

0.04 (−0.10; 0.18)

0 (79)

3 (671)

−0.06 (−0.40; 0.27)

16 (91)

Others

1 (43)

−0.06 (−0.37; 0.25)

1 (43)

0.05 (−0.43; 0.53)

Health status

Healthy

23 (488)

−0.06 (−0.19; 0.06)

0 (45)

17 (557)

0.14 (−0.13; 0.40)

38 (65)

Non-healthy

29 (2121)

0.05 (−0.03; 0.13)

0 (41)

15 (1850)

0.05 (−0.09; 0.19)

0 (53)

Continent

America

11 (258)

0.03 (−0.14; 0.21)

0 (60)

7 (402)

0.11 (−0.16; 0.37)

36 (73)

Europe

12 (586)

0.02 (−0.13; 0.17)

0 (60)

8 (365)

0.15 (−0.15; 0.46)

24 (65)

Asia

27 (1651)

0.01 (−0.07; 0.10)

0 (44)

16 (1545)

0.02 (−0.16; 0.21)

4 (52)

Others

2 (114)

−0.15 (−0.67; 0.37)

49 (–)

1 (95)

−0.22 (−0.67; 0.23)

Funding

Industry—generic

20 (1721)

0.01 (−0.08; 0.09)

0 (47)

22 (2009)

0.05 (−0.08; 0.18)

10 (44)

Industry—brand-name

2 (25)

−0.03 (−0.89; 0.83)

55 (–)

0 (0)

Other funding

7 (321)

0.02 (−0.21; 0.24)

0 (71)

3 (75)

−0.35 (−0.99; 0.29)

0 (90)

Not reported

22 (552)

−0.01 (−0.12; 0.14)

0 (46)

7 (323)

0.48 (0.04; 0.92)

28 (69)

Follow-up duration

≤1 day

22 (484)

0.00 (−0.13; 0.14)

0 (46)

4 (115)

0.23 (−0.72; 1.81)

73 (91)

2–27 days

10 (299)

−0.02 (−0.19; 0.16)

0 (62)

14 (501)

0.16 (0.09; 0.41)

10 (48)

≥28 days

20 (1826)

0.02 (−0.06; 0.11)

0 (48)

14 (1791)

0.04 (−0.09; 0.18)

0 (55)

Study design

Parallel-group

14 (1693)

0.02 (−0.08; 0.12)

0 (55)

12 (1622)

−0.03 (−0.19; 0.14)

0 (58)

Cross-over

38 (916)

0.00 (−0.09; 0.10)

0 (37)

20 (805)

0.15 (−0.04; 0.34)

27 (58)

Blinding

Open-label or single-blind

30 (1557)

0.01 (−0.07; 0.10)

0 (40)

25 (1452)

0.09 (−0.05; 0.23)

0 (44)

Double-blind

22 (1052)

0.02 (−0.09; 0.12)

0 (46)

7 (955)

0.07 (−0.22; 0.36)

52 (80)

Sample size

≤30

28 (512)

−0.01 (−0.14; 0.12)

0 (42)

11 (249)

0.19 (−0.23; 0.60)

46 (73)

31–99

17 (892)

0.06 (−0.05; 0.17)

0 (51)

13 (738)

0.13 (−0.04; 0.30)

0 (57)

≥100

7 (1205)

−0.01 (−0.13; 0.10)

0 (71)

8 (1420)

−0.01 (−0.19; 0.18)

10 (71)

A positive effect size favors generics

ES effect size, OR odds ratio, CI confidence interval, n number of trials, (N) number of participants, ARBs angiotensin II receptor blockers

Mild or moderate adverse events

Overall, 32 trials including 2407 subjects were included in the meta-analysis evaluating mild or moderate adverse events. All but 2 trials showed non-significant differences between generic and brand-name drugs, and aggregate effect size was 0.07 (95 % CI −0.06; 0.20; Table 2; Fig. 3). Comparable results were observed for each drug class and in each stratified meta-analysis (Table 2). The statistical heterogeneity between studies was low or moderate in most comparisons. A significant difference in the risk of mild or moderate adverse events favoring generic versus brand-name drugs was found in two stratified meta-analyses (trials not reporting the sponsor; trials of intermediate follow-up duration). However, none of such covariates was significantly associated with effect size in meta-regression analysis, either univariate or multivariate (Additional Table S4).
https://static-content.springer.com/image/art%3A10.1007%2Fs10654-015-0104-8/MediaObjects/10654_2015_104_Fig3_HTML.gif
Fig. 3

Meta-analysis evaluating the risk of mild or moderate adverse events of generic versus brand-name drugs against cardiovascular diseases

Serious adverse events

Overall, 8 serious possibly drug-related adverse events were reported in 52 studies: 5 events among the 2134 subjects who assumed generics (819 from parallel-group RCTs and 1315 from cross-over RCTs; rate = 2.34 ‰); 3 events among the 2136 subjects who assumed brand-name drugs (815 from parallel-group RCTs and 1321 from cross-over RCTs; rate = 1.40 ‰). All but 1 event were reported by industry-sponsored Asian studies, published after the year 2005, with follow-up longer than 27 days [22, 39, 92, 96]. No deaths were reported, and all cases made a full recovery. The meta-analysis on serious adverse events showed no significant differences between generic and brand-name medicines (odds ratio for generics: 1.69; 95 % CI 0.40; 7.20). No stratified analysis produced significant results.

Discussion

Every clinician is repeatedly exposed to anecdotal evidence from patients, colleagues, and of course company representatives, claiming that generic drugs are not as effective and/or safe as their branded counterparts [9799]. A number of observational studies [4, 5, 100, 101] show good results with generics, however their use is still modest in several countries [102, 103]. Brand name antiplatelet agents, ACE inhibitors, Angiotensin receptor blockers and statins have combined sales which exceed $100 billion yearly and dominate the cardiovascular pharmaceutical market [104106]. The only other published meta-analysis to-date on this topic, although rigorously done, only included 50, 23 and 71 subjects in the evaluation of antiplatelet agents, ACE inhibitors and statins, respectively [4]. Also, most of these subjects had been followed for <2 days, only efficacy outcomes were combined, and many trials have been published later on [32, 54, 55, 63, 64, 6772, 7481, 83, 84, 8696]. In the present meta-analysis all 53 RCTs evaluating efficacy outcomes found no significant differences between generic and brand-name cardiovascular drugs. Unsurprisingly, the combined estimate of efficacy did not approach significance for any drug-class and in any stratified analysis, all of which showed low or moderate between-study heterogeneity. Similarly, the risk of mild or moderate adverse events was comparable between generics and branded medicines in 26 out of 29 trials, and combining trial results no evidence emerged of a superiority of one drug type over the other. Concerning serious adverse events, the results of 47 studies showed again a similar risk with both generics and proprietary drugs, however the number of events was sparse, and further data must be collected to achieve satisfactory statistical power.

Taken together, these results suggest that using generic instead of brand-name cardiovascular drugs does not imply a loss in either efficacy or safety. These findings provide a more solid confirmation to observational analyses and to the previous meta-analysis on randomized trials, with respect to which we included from 10 to 15 times more subjects consuming statins, ACE inhibitors and antiplatelet agents, and included 24 versus 7 trials with a follow-up of 4 weeks or more [4].

Our study has some potential limitations that must be mentioned. First, approximately half of the included studies were bioequivalence trials with cross-over design, short follow-up duration and small samples, sometimes including disproportionately young and healthy participants. Although the validity of such trials to demonstrate differences in clinical outcomes may be debated, it is worth noting that similar results were obtained combining trials with a parallel-group design, larger samples, longer follow-up, and including only unhealthy subjects, and age was not associated with the effect estimate in meta-regression analysis. In any case, age, multimorbidity, polypharmacy and a greater degree of compromised metabolic function might have influenced the bioequivalence of generic drugs and, due to limited evidence from RCTs, the influence of these parameters cannot be studied. Second, most of the included studies did not report the funding source or were sponsored by the generic manufacturer, thus it is very difficult to draw any firm conclusions about the potential impact of any sponsorship bias, even if the stratified analyses and meta-regression revealed no clear patterns. Given that the vast majority of trials in this field have very low power to detect significant differences, it is unlikely that a lot of significant differences have been generated and then suppressed by sponsors. Third, we combined together different outcomes of efficacy, and adverse events that were heterogeneously measured. However, within several drug-classes (ACE inhibitors or Angiotensin receptor blockers, anticoagulants, beta-blockers, calcium-channel blockers and statins) the extracted efficacy outcomes were identical. Moreover, for the other drug-classes the alternative efficacy outcomes that could be extracted from single studies never showed a different result (Additional Table S1), and both soft and hard outcomes were always non-significant in single studies. Fourth, almost two-thirds of all studies were at high-risk of selective outcome reporting, less than one-third of the trials published after 2005 had their protocol registered online, and most cross-over studies failed to accommodate the within-individual differences in the analysis. Therefore, on one side there is the need of an in-depth analysis of the publication pattern of generic trials starting from clinical trial registries, as a relevant proportion of RCTs likely remained unpublished [107]. On the other side, more journals in the field should adhere to ICMJE recommendation of trial protocol registration in a public trials registry as a condition for publication [108]. Fifth, it must be noted that more studies on drugs with narrow therapeutic interval like antiarrhythmics are strongly needed, and that even though we found no differences between generics and brand-name drugs, there might be differences concerning adverse events between two generic drugs. Finally, the overall meta-analytic estimate combining the results of different drug classes is typically problematic and should be interpreted with caution, because for some drugs the influence of the preparation (inert binders, fillers, manufacturing process) might be bigger than for other drugs, even though the mechanism of the drug is the same for generic and brand name drugs. Unfortunately, we could not dissect the potential influence of the preparation as this information was generally not available across the included studies.

Conclusions

The present meta-analysis confirmed the substantial clinical equivalence between brand-name and generic cardiovascular drugs. On one side, this finding is based upon a suboptimal evidence: very few studies used hard outcomes and followed patients for more than 3 months, and many trials were conducted in healthy volunteers. On the other side, the relatively large randomized sample size, the inclusion of many trials with a follow-up longer than 4 weeks, the stability of the results, and the inclusion of adverse events in the analyses may provide a more solid reassurance to the scientific community, possibly contributing to reduce the claims and mistrust towards generic medications [109]. Although generic prices also may substantially raise following opportunistic behaviors [110], the growing availability as generic products of blockbuster drugs is likely to produce several USD billions of savings [111, 112]. Physicians could be reassured about prescribing generic cardiovascular drugs to patients, and health care organizations about endorsing their larger use.

Acknowledgments

The authors would like to thank Prof. Marco Bucci for his contribution to the early phases of the study. The work was not funded.

Authors’ contributions

All authors participated in the design, analysis and interpretation of the study. LM, MEF, and JPAI were involved in all phases of the study. ED, NP, and CM made the bibliographic search. LM and SB lead the statistical analysis and assisted ED, NP, and CM in data extraction. RS carried out the methodological quality assessment. LM, MEF and JPAI wrote the manuscript, which was revised by PV and WR. LM had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Compliance with ethical standards

Conflict of interest

All authors declare that they have no competing interest.

Supplementary material

10654_2015_104_MOESM1_ESM.doc (1.2 mb)
Supplementary material 1 (DOC 1190 kb)
10654_2015_104_MOESM2_ESM.doc (60 kb)
Supplementary material 2 (DOC 60 kb)

Copyright information

© The Author(s) 2015

Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Authors and Affiliations

  • Lamberto Manzoli
    • 1
    • 2
  • Maria Elena Flacco
    • 1
    • 2
  • Stefania Boccia
    • 3
  • Elvira D’Andrea
    • 4
  • Nikola Panic
    • 3
  • Carolina Marzuillo
    • 4
  • Roberta Siliquini
    • 5
  • Walter Ricciardi
    • 3
    • 6
  • Paolo Villari
    • 4
  • John P. A. Ioannidis
    • 7
    • 8
    • 9
  1. 1.Department of Medicine and Aging SciencesUniversity of ChietiChietiItaly
  2. 2.Regional Health Care Agency of AbruzzoPescaraItaly
  3. 3.Institute of Public HealthCatholic University of RomeRomeItaly
  4. 4.Department of Public Health and Infectious DiseasesSapienza University of RomeRomeItaly
  5. 5.Department of Public Health SciencesUniversity of TurinTurinItaly
  6. 6.Italian National Institute of HealthRomeItaly
  7. 7.Stanford Prevention Research Center, Department of Medicine and Department of Health Research and PolicyStanford University School of MedicineStanfordUSA
  8. 8.Department of StatisticsStanford University School of Humanities and SciencesStanfordUSA
  9. 9.Meta-Research Innovation Center at Stanford (METRICS)StanfordUSA