Advertisement

Drug Safety

, Volume 39, Issue 1, pp 29–43 | Cite as

An Empirical Approach to Explore the Relationship Between Measures of Disproportionate Reporting and Relative Risks from Analytical Studies

  • Miguel-Angel Maciá-MartínezEmail author
  • Francisco J. de Abajo
  • Gilly Roberts
  • Jim Slattery
  • Bharat Thakrar
  • Antoni F. Z. Wisniewski
Original Research Article
First Online:

Abstract

Introduction

Although it seems reasonable to suppose that a drug that increases the risk of an adverse event might tend to show increased disproportionality statistics in spontaneous reporting databases, that relationship is not clear. Therefore, an empirical approach was taken to investigate the relationship between proportional reporting ratios (PRRs) and relative risk (RR) estimates from formal studies in a set of known adverse drug reactions (ADRs).

Methods

Drug-event pairs that were the subject of pharmacovigilance-driven European regulatory actions from 2007 to 2010 were selected. Only pairs having RR derived from formal studies and where it was considered that there was well-established evidence supporting the actions were included. A best estimate of the RR for each ADR was chosen based on pre-specified rules. PRRs were then calculated in Eudravigilance using only those cases reported before the date of first recognition of the ADR in the medical community. An additional analysis was carried out in FEDRA, the Spanish spontaneous reports database. A descriptive analysis and an orthogonal regression model were performed.

Results

From an initial dataset of 78 drug-event pairs, 15 were selected. The regression model (ln RR = 0.203 + 0.463 × ln PRR) showed a significant (p < 0.001) correlation between RR and PRR in Eudravigilance. None of the ADR-related variables analysed modified the relationship. Exploratory results in FEDRA went in the same direction.

Conclusions

Disproportionality measures should not replace formal studies but could provide an initial indication of the likely clinical importance of an ADR, should the signal be confirmed subsequently. Whether the same conclusions can be applied to other datasets should be further studied.

Keywords

European Union Piroxicam Finasteride Relative Risk Estimate Proportional Reporting Ratio 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.

Notes

Acknowledgments

The views expressed in this paper are those of the authors only and do not reflect the official policy or position of the IMI JU (Innovative Medicines Initiative Joint Undertaking), the European Union, AEMPS (Spanish Agency for Medicines and Medical Devices), or the European Federation of Pharmaceutical Industries and Associations.

The authors would like to thank Pilar Vicente, previously a trainee at the AEMPS, for contributions to the early phases of this project.

Compliance with Ethical Standards

Funding

The research leading to these results was conducted as part of the PROTECT consortium (Pharmacoepidemiological Research on Outcomes of Therapeutics by a European ConsorTium, http://www.imiprotect.eu), which is a public-private partnership coordinated by the European Medicines Agency. The PROTECT project has received support from the Innovative Medicine Initiative Joint Undertaking (http://www.imi.europa.eu) under Grant Agreement No. 115004, resources of which are composed of financial contribution from the European Union’s Seventh Framework Program (FP7/2007–2013) and companies of the European Federation of Pharmaceutical Industries and Associations in-kind contribution.

Conflicts of interest

Miguel-Angel Maciá-Martínez, Francisco J. de Abajo and Jim Slattery have no conflicts of interest that are directly relevant to the content of this study. Gilly Roberts is an employee of GlaxoSmithKline and has shareholdings in GlaxoSmithKline and Astra Zeneca. Bharat Thakrar is an employee of Roche. Antoni F. Z. Wisniewski is a full-time employee of Astra Zeneca. Products from these companies were among those used to test the methodologies in this research.

References

  1. 1.
    Council for International Organizations of Medical Sciences (CIOMS). Practical Aspects of Signal Detection in Pharmacovigilance. Report of CIOMS Working Group VIII. Geneva 2010.Google Scholar
  2. 2.
    Evans SJW, Waller PC, Davis S. Use of proportional reporting ratios (PRRs) for signal generation from spontaneous adverse drug reaction reports. Pharmacoepidemiol Drug Saf. 2001;10(6):483–6.PubMedCrossRefGoogle Scholar
  3. 3.
    European Medicines Agency, EudraVigilance Expert Working Group. Guideline on the use of statistical signal detection methods in the EudraVigilance data analysis system (EMEA/106464/2006 rev.1) [online]. Available from URL: http://www.ema.europa.eu/docs/en_GB/document_library/Regulatory_and_procedural_guideline/2009/11/WC500011434.pdf. Accessed 14 Jul 2015.
  4. 4.
    Hennessy S. Disproportionality analyses of spontaneous reports. Pharmacoepidemiol Drug Saf. 2004;13(8):503–4.PubMedCrossRefGoogle Scholar
  5. 5.
    Rothman KJ, Lanes S, Sacks ST. The reporting odds ratio and its advantages over the proportional reporting ratio. Pharmacoepidemiol Drug Saf. 2004;13(8):519–23.PubMedCrossRefGoogle Scholar
  6. 6.
    Waller P, van Puijenbroek E, Egberts A, Evans SJW. The reporting odds ratio versus the proportional reporting ratio: ‘deuce’. Pharmacoepidemiol Drug Saf.. 2004;13(8):525–6.PubMedCrossRefGoogle Scholar
  7. 7.
    Pierfitte C, Bégaud B, Lagnaoui R, Moore ND. Is reporting rate a good predictor of risks associated with drugs? Br J Clin Pharmacol. 1999;47(3):329–31.PubMedPubMedCentralCrossRefGoogle Scholar
  8. 8.
    Kim J, Gaskin M, Prieto-Merino D, Meeraus W, Thomson A, Collier A, et al. Proportionality between Adverse Events Identified in Spontaneous Reporting Databases and Population-Based Estimates of Drug Exposure. Pharmacoepidemiol Drug Saf. 2014;23(S1):230–1.Google Scholar
  9. 9.
    Wisniewski et al. Characterisation of databases (DBs) used for signal detection (SD): results of a survey of IMI PROTECT work package (WP) 3 participants.In: 28th International conference on pharmacoepidemiology and therapeutic risk management, 23–26 Aug 2012, Barcelona. [online]. Available from URL: http://www.imi-protect.eu/documents/WisniewskietalCharacterisationofdatabasesusedorsignaldetectionposterfinalICPE2012.pdf. Accessed 14 Jul 2015.
  10. 10.
    Motola D, Vargiu A, Leone R, Conforti A, Moretti U, Vaccheri A, et al. Influence of regulatory measures on the rate of spontaneous adverse drug reaction reporting in Italy. Drug Saf. 2008;31(7):609–16.PubMedCrossRefGoogle Scholar
  11. 11.
    Kahn SE, Zinman B, Lachin JM, Haffner SM, Herman WH, Holman RR, et al. ADOPT Study Group. Rosiglitazone-associated fractures in type 2 diabetes: an Analysis from A Diabetes Outcome Progression Trial (ADOPT). Diabetes Care. 2008;31:845–51.PubMedCrossRefGoogle Scholar
  12. 12.
    Henry D, McGettigan P. Epidemiology overview of gastrointestinal and renal toxicity of NSAIDs. Int J Clin Pract Suppl. 2003;135:43–9.PubMedGoogle Scholar
  13. 13.
    Laheij RJ, Sturkenboom MC, Hassing RJ, Dieleman J, Stricker BH, Jansen JB. Risk of community-acquired pneumonia and use of gastric acid-suppressive drugs. JAMA. 2004;292(16):1955–60.PubMedCrossRefGoogle Scholar
  14. 14.
    US Food and Drug Administration, 2005. Clinical review: relationship between Antidepressant drugs and suicidality in adults. Available from http://www.fda.gov/ohrms/dockets/ac/06/briefing/2006-4272b1-01-FDA.pdf. Accessed 14 Jul 2015.
  15. 15.
    Schade R, Andersohn F, Suissa S, Haverkamp W, Garbe E. Dopamine agonists and the risk of cardiac-valve regurgitation. N Engl J Med. 2007;356:29–38.PubMedCrossRefGoogle Scholar
  16. 16.
    US Food and Drug Administration, 2008. Statistical review and evaluation. Antiepileptic drugs and suicidality. Available from: http://www.fda.gov/ohrms/dockets/ac/08/briefing/2008-4372b1-01-FDA.pdf. Accessed 14 Jul 2015.
  17. 17.
    Medicines and Healthcare products Regulatory Agency (MHRA) public assessment report, the risk of male breast cancer with finasteride, 2009. Available from: http://www.mhra.gov.uk/home/groups/s-par/documents/websiteresources/con079340.pdf. Accessed 14 Jul 2015.
  18. 18.
    Bohlius J, Schmidlin K, Brillant C, Schwarzer G, Trelle S, Seidenfeld J et al. Erythropoietin or Darbepoetin for patients with cancer—meta-analysis based on individual patient data. Cochrane Database of Systematic Reviews 2009, Issue 3. Art. No.: CD007303. doi: 10.1002/14651858.CD007303.pub2.
  19. 19.
    James WP, Caterson ID, Coutinho W, Finer N, Van Gaal LF, Maggioni AP, et al. SCOUT Investigators. Effect of sibutramine on cardiovascular outcomes in overweight and obese subjects. N Engl J Med. 2010;363:905–17.PubMedCrossRefGoogle Scholar
  20. 20.
    Källén B, Olausson PO. Maternal use of selective serotonin re-uptake inhibitors and persistent pulmonary hypertension of the newborn. Pharmacoepidemiol Drug Saf. 2008;17(8):801–6.PubMedCrossRefGoogle Scholar
  21. 21.
    Ridker PM, Danielson E, Fonseca FA, Genest J, Gotto AM Jr, Kastelein JJ, et al. JUPITER Study Group. Rosuvastatin to prevent vascular events in men and women with elevated C-reactive protein. N Engl J Med. 2008;359(21):2195–207.PubMedCrossRefGoogle Scholar
  22. 22.
    Nelson HS, Weiss ST, Bleecker ER, Yancey SW, Dorinsky PM; SMART Study Group. The Salmeterol Multicenter Asthma Research Trial: a comparison of usual pharmacotherapy for asthma or usual pharmacotherapy plus salmeterol. Chest. 2006;129(1):15–26.Google Scholar
  23. 23.
    Lidegaard Ø, Løkkegaard E, Svendsen AL, Agger C. Hormonal contraception and risk of venous thromboembolism: national follow-up study. BMJ. 2009;13(339):b2890.CrossRefGoogle Scholar
  24. 24.
    Peralta C, Wolf E, Alber H, Seppi K, Müller S, Bösch S, et al. Valvular heart disease in Parkinson’s disease vs. controls: An echocardiographic study. Mov Disord. 2006;21(8):1109–13.PubMedCrossRefGoogle Scholar
  25. 25.
    Pinero A, Marcos-Alberca P, Fortes J. Cabergoline-related severe restrictive mitral regurgitation. N Engl J Med. 2005;353:1976–7.PubMedCrossRefGoogle Scholar
  26. 26.
    Pritchett AM, Morrison JF, Edwards WD, Schaff HV, Connolly HM, Espinosa RE. VaIvular heart disease in patients taking pergolide. Mayo Clin Proc. 2002;77:1280–6.PubMedCrossRefGoogle Scholar
  27. 27.
    Bohlius J, Wilson J, Seidenfeld J, Piper M, Schwarzer G, Sandercock J, et al. Recombinant human erythropoietins and cancer patients: updated meta-analysis of 57 studies including 9353 patients. J Natl Cancer Inst. 2006;98(10):708–14.PubMedCrossRefGoogle Scholar
  28. 28.
    Chambers CD, Hernandez-Diaz S, Van Marter LJ, Werler MM, Louik C, Jones KL, Mitchell AA. Selective serotonin-reuptake inhibitors and risk of persistent pulmonary hypertension of the newborn. N Engl J Med. 2006;354(6):579–87.PubMedCrossRefGoogle Scholar
  29. 29.
    Sheldon T. Dutch GPs warned against new contraceptive pill. BMJ. 2002;13(324):869.CrossRefGoogle Scholar
  30. 30.
    Alvarez-Requejo A, Carvajal A, Bégaud B, Moride Y, Vega T, Arias LH. Under-reporting of adverse drug reactions. Estimate based on a spontaneous reporting scheme and a sentinel system. Eur J Clin Pharmacol. 1998;54(6):483–8.PubMedCrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Miguel-Angel Maciá-Martínez
    • 1
    Email author
  • Francisco J. de Abajo
    • 2
    • 3
  • Gilly Roberts
    • 4
  • Jim Slattery
    • 5
  • Bharat Thakrar
    • 6
  • Antoni F. Z. Wisniewski
    • 7
  1. 1.AEMPS (Spanish Agency for Medicines and Medical Devices)MadridSpain
  2. 2.Pharmacology Unit, Department of Biomedical Sciences, School of MedicineUniversity of AlcaláMadridSpain
  3. 3.Clinical Pharmacology UnitUniversity Hospital Príncipe de AsturiasMadridSpain
  4. 4.Global Clinical Safety and PharmacovigilanceGlaxoSmithKlineMiddlesexUK
  5. 5.European Medicines AgencyLondonUK
  6. 6.RocheBaselSwitzerland
  7. 7.Global Regulatory Affairs, Patient SafetyAstraZenecaCheshireUK

Personalised recommendations

Cite article

Buy options