Skip to main content
Log in

Assessment of a New Instrument for Detecting Preventable Adverse Drug Reactions

  • Original Research Article
  • Published:
Drug Safety Aims and scope Submit manuscript

Abstract

Background

Pharmacovigilance centres (PVCs) in the World Health Organization (WHO) Programme for International Drug Monitoring have demonstrated their ability to detect preventable adverse drug reactions (ADRs) in their databases. In this field, there is no gold-standard method for detecting medication errors and evaluating ADR preventability. Therefore, we developed, from existing tools, a preventability assessment method: the ‘P Method’ (PM).

Objective

To present the PM and to evaluate its inter-rater reliability.

Methods

The PM includes 20 explicit criteria for assessing ADR preventability. This approach is based on identification of any potentially preventable risk factor that increases the likelihood of ADR occurrence. The outcome of the preventability assessment results in one of three possible scores: ‘preventable’, ‘non-preventable’ or ‘not assessable’. The PM was tested in a multicentre study involving nine national PVCs. Two experienced reviewers at each participating PVC independently analysed the preventability of 183 ADRs, applying the PM.

Results

The overall agreement between all reviewers for assessment of ADR preventability was ‘fair’, with a kappa value of 0.27 [95 % confidence interval (CI) 0.21–0.40]. The level of agreement between reviewer pairs ranged from ‘slight’, with a kappa value of 0.12 (95 % CI −0.03 to 0.27), to ‘substantial’, with a kappa value of 0.69 (95 % CI 0.48–0.89).

Conclusion

The analysis of the agreements and disagreements between reviewers highlighted where improvements might be made. Given that no standard assessment tool exists in the WHO Programme, the transparency of the assessment process in this method provides a substantial basis for further development and for support in signalling possible preventability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Alj L, Touzani MDW, Benkirane R, Edwards IR, Soulaymani R. Detecting medication errors in pharmacovigilance database: capacities and limits. Int J Risk Saf Med. 2007;19(4):187–94.

    Google Scholar 

  2. Kunac DL, Tatley MV. Detecting medication errors in the New Zealand pharmacovigilance database: a retrospective analysis. Drug Saf. 2011;34(1):59–71.

    Article  PubMed  Google Scholar 

  3. Caduff-Janosa P. Medication errors in Switzerland: an analysis of the spontaneous adverse reactions reports received at the Swissmedic Pharmacovigilance Centre. Drug Saf. 2004;27:831–977.

    Article  Google Scholar 

  4. Bencheikh RS, Benabdallah G. Medication errors: pharmacovigilance centres in detection and prevention. Br J Clin Pharmacol. 2009;67(6):687–90.

    Article  PubMed Central  PubMed  Google Scholar 

  5. Olivier P, Boulbés O, Tubery M, Lauque D, Montastruc JL, Lapeyre-Mestre M. Assessing the feasibility of using an adverse drug reaction preventability scale in clinical practice: a study in a French emergency department. Drug Saf. 2002;25(14):1035–44.

    Article  PubMed  Google Scholar 

  6. Desai RJ, Williams CE, Greene SB, Pierson S, Caprio AJ, Hansen RA. Analgesic medication errors in North Carolina nursing homes. J Pain Palliat Care Pharmacother. 2013;27(2):125–31.

    Article  PubMed  Google Scholar 

  7. Rajanayagam J, Bishop JR, Lewindon PJ, Evans HM. Paracetamol-associated acute liver failure in Australian and New Zealand children: high rate of medication errors. Arch Dis Child. doi:10.1136/archdischild-2013-304902. (Epub 2014 Sep 16).

  8. Ferner RE, Aronson JK. Preventability of drug-related harms—part I: a systematic review. Drug Saf. 2010;33(11):985–94.

    Article  PubMed  Google Scholar 

  9. Aronson JK, Ferner RE. Preventability of drug-related harms—part II: proposed criteria, based on frameworks that classify adverse drug reactions. Drug Saf. 2010;33(11):995–1002.

    Article  PubMed  Google Scholar 

  10. Uppsala Monitoring Centre. Monitoring medicines. 2014. www.monitoringmedicines.org. Accessed 16 Mar 2014.

  11. Benabdallah G, Benkirane R, Khattabi A, Edwards IR, Soulaymani Bencheikh R. The involvement of pharmacovigilance centres in medication errors detection: a questionnaire-based analysis. Int J Risk Saf Med. 2011;23(1):17–29.

    PubMed  Google Scholar 

  12. UMC presents ‘ICSRs and VigiBase—the vital importance of quality’. 9 March 2012. http://www.who-umc.org/DynPage.aspx?id=108464&mn1=7347&mn2=7489&mn3=7248&newsid=10762. Accessed 30 Nov 2012.

  13. Morimoto T, Gandhi TK, Seger AC, Hsieh TC, Bates DW. Adverse drug events and medication errors: detection and classification methods. Qual Saf Health Care. 2004;13:306–14.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  14. Uppsala Monitoring Centre. The use of the WHO-UMC system for standardised case causality assessment. http://www.who-umc.org/Graphics/24734.pdf. Accessed 20 Jan 2013.

  15. Uppsala Monitoring Centre. WHO-ART—WHO adverse reaction terminology. http://www.umc-products.com/DynPage.aspx?id=73589&mn1=1107&mn2=1664. Accessed 10 Jan 2012.

  16. MedDRA. Medical dictionary for regulatory activities. http://www.meddra.org. Accessed 10 Jan 2012.

  17. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.

    Article  CAS  PubMed  Google Scholar 

  18. Kunac DL, Reith DM, Kennedy J, Austin NC, Williams SM. Inter- and intra-rater reliability for classification of medication related events in paediatric inpatients. Qual Saf Health Care. 2006;15:196–201.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  19. Schumock GT, Thornton JP. Focusing on the preventability of adverse drug reactions. Hosp Pharm. 1992;27:538.

    CAS  PubMed  Google Scholar 

  20. Imbs JL, Pletan Y, Spriet A, et al. Evaluation de la iatrogénèse médicamenteuse évitable: méthodologie. Therapie. 1998;53:365–70.

    CAS  PubMed  Google Scholar 

  21. Hakkarainen KM, Andersson Sundell K, Petzold M, Hägg S. Methods for assessing the preventability of adverse drug events: a systematic review. Drug Saf. 2012;35(2):105–26.

    Article  PubMed  Google Scholar 

  22. Zegers M, de Bruijne MC, Wagner C, et al. The inter-rater agreement of retrospective assessments of adverse events does not improve with two reviewers per patient record. J Clin Epidemiol. 2010;63(1):94–102.

    Article  PubMed  Google Scholar 

  23. World Health Organization. Reporting and learning systems for medication errors: the role of pharmacovigilance centres. 2014. http://apps.who.int/iris/bitstream/10665/137036/1/9789241507943_eng.pdf?ua=1. Accessed 28 Nov 2014.

  24. Lip GY, et al. Bleeding risk assessment and management in atrial fibrillation patients: a position document from the European Heart Rhythm Association, endorsed by the European Society of Cardiology Working Group on Thrombosis. Europace. 2011;13:723–46.

    Article  PubMed  Google Scholar 

  25. Ibanez L, Vidal X, Ballarin E, Laporte JR. Population-based drug-induced agranulocytosis. Arch Intern Med. 2005;165(8):869–74.

    Article  CAS  PubMed  Google Scholar 

  26. Andrade SE, Martinez C, Walker AM. Comparative safety evaluation of non-narcotic analgesics. J Clin Epidemiol. 1998;51(12):1357–65.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgments

The authors would like to thank their colleagues from the national pharmacovigilance centres for their valuable contributions to this work: Luciana Soubihe and Eliane Gil Rodrigues de Castro from Brazil; Gloria Shalviri and Naghmeh Javidnikou from Iran; Uchenna Elemuwa, Cassandra A. Elagbaje, Desirée Kunac and Michael Tatley from New Zealand; Mariano Madurga and Cristina Fernandez from Spain; Alexandra Raetz Bravo and Wolfgang Renftl from Switzerland; Pattreya Pokhagul and Watcharee Rungapiromnan from Nigeria; Mohamed lakhal and Sihem El Aïdli from Tunisia; and Fatima Abadi, Driss Soussi Tanani and Souad Skalli from Morocco. The authors would also like to thank Wendy Shepherd for proofreading the text.

Funding

This project was funded by the EU-FP7 Monitoring Medicines Project (grant number 223566). The funding organization (the European Commission) had no role either in the conduct of the present study or in the writing of the present manuscript.

Conflicts of interest

Raja Benkirane, Rachida Soulaymani-Bencheikh, Asmae Khattabi, Ghita Benabdallah, Loubna Alj, Houda Sefiani, Khedidja Hedna, Lahcen Ouammi, Sten Olsson and Shanti N. Pal have no conflicts of interest that are directly relevant to the content of this study.

Theme issue

This article is part of a theme issue co-edited by Elliot G. Brown, Shanthi Pal and Sten Olsson. No external funding was used to support the publication of this theme issue.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Raja Benkirane.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 63 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Benkirane, R., Soulaymani-Bencheikh, R., Khattabi, A. et al. Assessment of a New Instrument for Detecting Preventable Adverse Drug Reactions. Drug Saf 38, 383–393 (2015). https://doi.org/10.1007/s40264-014-0257-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40264-014-0257-5

Keywords

Navigation