Abstract
Background
Pharmacovigilance centres (PVCs) in the World Health Organization (WHO) Programme for International Drug Monitoring have demonstrated their ability to detect preventable adverse drug reactions (ADRs) in their databases. In this field, there is no gold-standard method for detecting medication errors and evaluating ADR preventability. Therefore, we developed, from existing tools, a preventability assessment method: the ‘P Method’ (PM).
Objective
To present the PM and to evaluate its inter-rater reliability.
Methods
The PM includes 20 explicit criteria for assessing ADR preventability. This approach is based on identification of any potentially preventable risk factor that increases the likelihood of ADR occurrence. The outcome of the preventability assessment results in one of three possible scores: ‘preventable’, ‘non-preventable’ or ‘not assessable’. The PM was tested in a multicentre study involving nine national PVCs. Two experienced reviewers at each participating PVC independently analysed the preventability of 183 ADRs, applying the PM.
Results
The overall agreement between all reviewers for assessment of ADR preventability was ‘fair’, with a kappa value of 0.27 [95 % confidence interval (CI) 0.21–0.40]. The level of agreement between reviewer pairs ranged from ‘slight’, with a kappa value of 0.12 (95 % CI −0.03 to 0.27), to ‘substantial’, with a kappa value of 0.69 (95 % CI 0.48–0.89).
Conclusion
The analysis of the agreements and disagreements between reviewers highlighted where improvements might be made. Given that no standard assessment tool exists in the WHO Programme, the transparency of the assessment process in this method provides a substantial basis for further development and for support in signalling possible preventability.
Similar content being viewed by others
References
Alj L, Touzani MDW, Benkirane R, Edwards IR, Soulaymani R. Detecting medication errors in pharmacovigilance database: capacities and limits. Int J Risk Saf Med. 2007;19(4):187–94.
Kunac DL, Tatley MV. Detecting medication errors in the New Zealand pharmacovigilance database: a retrospective analysis. Drug Saf. 2011;34(1):59–71.
Caduff-Janosa P. Medication errors in Switzerland: an analysis of the spontaneous adverse reactions reports received at the Swissmedic Pharmacovigilance Centre. Drug Saf. 2004;27:831–977.
Bencheikh RS, Benabdallah G. Medication errors: pharmacovigilance centres in detection and prevention. Br J Clin Pharmacol. 2009;67(6):687–90.
Olivier P, Boulbés O, Tubery M, Lauque D, Montastruc JL, Lapeyre-Mestre M. Assessing the feasibility of using an adverse drug reaction preventability scale in clinical practice: a study in a French emergency department. Drug Saf. 2002;25(14):1035–44.
Desai RJ, Williams CE, Greene SB, Pierson S, Caprio AJ, Hansen RA. Analgesic medication errors in North Carolina nursing homes. J Pain Palliat Care Pharmacother. 2013;27(2):125–31.
Rajanayagam J, Bishop JR, Lewindon PJ, Evans HM. Paracetamol-associated acute liver failure in Australian and New Zealand children: high rate of medication errors. Arch Dis Child. doi:10.1136/archdischild-2013-304902. (Epub 2014 Sep 16).
Ferner RE, Aronson JK. Preventability of drug-related harms—part I: a systematic review. Drug Saf. 2010;33(11):985–94.
Aronson JK, Ferner RE. Preventability of drug-related harms—part II: proposed criteria, based on frameworks that classify adverse drug reactions. Drug Saf. 2010;33(11):995–1002.
Uppsala Monitoring Centre. Monitoring medicines. 2014. www.monitoringmedicines.org. Accessed 16 Mar 2014.
Benabdallah G, Benkirane R, Khattabi A, Edwards IR, Soulaymani Bencheikh R. The involvement of pharmacovigilance centres in medication errors detection: a questionnaire-based analysis. Int J Risk Saf Med. 2011;23(1):17–29.
UMC presents ‘ICSRs and VigiBase—the vital importance of quality’. 9 March 2012. http://www.who-umc.org/DynPage.aspx?id=108464&mn1=7347&mn2=7489&mn3=7248&newsid=10762. Accessed 30 Nov 2012.
Morimoto T, Gandhi TK, Seger AC, Hsieh TC, Bates DW. Adverse drug events and medication errors: detection and classification methods. Qual Saf Health Care. 2004;13:306–14.
Uppsala Monitoring Centre. The use of the WHO-UMC system for standardised case causality assessment. http://www.who-umc.org/Graphics/24734.pdf. Accessed 20 Jan 2013.
Uppsala Monitoring Centre. WHO-ART—WHO adverse reaction terminology. http://www.umc-products.com/DynPage.aspx?id=73589&mn1=1107&mn2=1664. Accessed 10 Jan 2012.
MedDRA. Medical dictionary for regulatory activities. http://www.meddra.org. Accessed 10 Jan 2012.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.
Kunac DL, Reith DM, Kennedy J, Austin NC, Williams SM. Inter- and intra-rater reliability for classification of medication related events in paediatric inpatients. Qual Saf Health Care. 2006;15:196–201.
Schumock GT, Thornton JP. Focusing on the preventability of adverse drug reactions. Hosp Pharm. 1992;27:538.
Imbs JL, Pletan Y, Spriet A, et al. Evaluation de la iatrogénèse médicamenteuse évitable: méthodologie. Therapie. 1998;53:365–70.
Hakkarainen KM, Andersson Sundell K, Petzold M, Hägg S. Methods for assessing the preventability of adverse drug events: a systematic review. Drug Saf. 2012;35(2):105–26.
Zegers M, de Bruijne MC, Wagner C, et al. The inter-rater agreement of retrospective assessments of adverse events does not improve with two reviewers per patient record. J Clin Epidemiol. 2010;63(1):94–102.
World Health Organization. Reporting and learning systems for medication errors: the role of pharmacovigilance centres. 2014. http://apps.who.int/iris/bitstream/10665/137036/1/9789241507943_eng.pdf?ua=1. Accessed 28 Nov 2014.
Lip GY, et al. Bleeding risk assessment and management in atrial fibrillation patients: a position document from the European Heart Rhythm Association, endorsed by the European Society of Cardiology Working Group on Thrombosis. Europace. 2011;13:723–46.
Ibanez L, Vidal X, Ballarin E, Laporte JR. Population-based drug-induced agranulocytosis. Arch Intern Med. 2005;165(8):869–74.
Andrade SE, Martinez C, Walker AM. Comparative safety evaluation of non-narcotic analgesics. J Clin Epidemiol. 1998;51(12):1357–65.
Acknowledgments
The authors would like to thank their colleagues from the national pharmacovigilance centres for their valuable contributions to this work: Luciana Soubihe and Eliane Gil Rodrigues de Castro from Brazil; Gloria Shalviri and Naghmeh Javidnikou from Iran; Uchenna Elemuwa, Cassandra A. Elagbaje, Desirée Kunac and Michael Tatley from New Zealand; Mariano Madurga and Cristina Fernandez from Spain; Alexandra Raetz Bravo and Wolfgang Renftl from Switzerland; Pattreya Pokhagul and Watcharee Rungapiromnan from Nigeria; Mohamed lakhal and Sihem El Aïdli from Tunisia; and Fatima Abadi, Driss Soussi Tanani and Souad Skalli from Morocco. The authors would also like to thank Wendy Shepherd for proofreading the text.
Funding
This project was funded by the EU-FP7 Monitoring Medicines Project (grant number 223566). The funding organization (the European Commission) had no role either in the conduct of the present study or in the writing of the present manuscript.
Conflicts of interest
Raja Benkirane, Rachida Soulaymani-Bencheikh, Asmae Khattabi, Ghita Benabdallah, Loubna Alj, Houda Sefiani, Khedidja Hedna, Lahcen Ouammi, Sten Olsson and Shanti N. Pal have no conflicts of interest that are directly relevant to the content of this study.
Theme issue
This article is part of a theme issue co-edited by Elliot G. Brown, Shanthi Pal and Sten Olsson. No external funding was used to support the publication of this theme issue.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Benkirane, R., Soulaymani-Bencheikh, R., Khattabi, A. et al. Assessment of a New Instrument for Detecting Preventable Adverse Drug Reactions. Drug Saf 38, 383–393 (2015). https://doi.org/10.1007/s40264-014-0257-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40264-014-0257-5