Skip to main content
SpringerLink
Log in

Inter-rater reliability of the assessment of adverse drug reactions in the hospitalised elderly

  • Published:
The journal of nutrition, health & aging

Abstract

Background

The identification and assessment of adverse drug reactions (ADRs) is very challenging especially among the older person. Inter observer reliability of an ADR classification system by different healthcare providers is vital to establish the validity of the reaction.

Objective

To assess the inter-rater reliability of an ADR classification system in hospitalised elderly patients and to investigate the differences in reliability by different professions.

Methods

From a cohort of 330 elderly patients, patients who experienced a suspected medication related incident (n=87) were selected. The data were analysed by four healthcare professionals (2 pharmacists and 2 physicians) who independently classified the events into event type, types of adverse drug reactions, severity and preventability after a standardised induction based on previously published criteria. Fleiss’ kappa was used to assess the level of agreement between the four raters. The difference in level of agreement between the professions was assessed using the weighted least-squares approach for comparing correlated kappa of Barnhart et al.

Results

Pharmacists and physicians showed high agreement in the identification and on the type and causality of ADRs. However there was lower (moderate) agreement for the severity (kappa = 0.61) and preventability of ADR (kappa = 0.48). Statistically significant differences were also noted between the professions; pharmacists have higher agreement in the classification of preventability (p=0.03) whereas the physicians pairs showed stronger agreement for classifying severity (p<0.001).

Conclusion

Despite the high agreement in the identification, type and causality of ADRs, physicians and pharmacists have difficulties in classifying preventability and severity in a reliable way. A multi-disciplinary approach would enable each profession to share their expert knowledge in order to facilitate better or safer patient care.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Davies EC, Green CF, Taylor S, Williamson PR, Mottram DR, Pirmohamed M. Adverse drug reactions in hospital in-patients: a prospective analysis of 3695 patientepisodes. PLoS ONE 2009;4(2):e4439.

    Article  PubMed  Google Scholar 

  2. Pirmohamed M, James S, Meakin S, Green C, Scott AK, Walley TJ, et al. Adverse drug reactions as cause of admission to hospital: prospective analysis of 18 820 patients. BMJ 2004 Jul 3;329(7456):15–19.

    Article  PubMed  Google Scholar 

  3. Mangoni AA, Jackson SHD. Age-related changes in pharmacokinetics and pharmacodynamics: Basic principles and practical applications. Br J Clin Pharmacol 2003;57:6–14.

    Article  Google Scholar 

  4. Tangiisuran B, Wright J, Van der Cammen T, Rajkumar C. Adverse drug reactions in elderly: Challenges in identification and improving preventative strategies. Age Ageing 2009;38(4):358–359.

    Article  PubMed  Google Scholar 

  5. Green JL, Hawley JN, Rask KJ. Is the number of prescribing physicians an independent risk factor for adverse drug events in an elderly outpatient population? Am J Geriatr Pharmacother 2007;5: 31–39

    Article  PubMed  Google Scholar 

  6. Hajjar ER, Hanlon JT, Artz MB, Lindbald CI, Pieper CF et al. Adverse drug reaction risk factors in older outpatients. Am J Geriatr Pharmacother 2003;1: 82–89

    Article  PubMed  Google Scholar 

  7. Onder G, Petrovic M, Tangiisuran B, Meinardi MC, Markito-Notenboom WP, Somers A, et al. Development and validation of a score to assess risk of adverse drug reactions among in-hospital patients 65 years or older: the GerontoNet ADR risk score. Arch Intern Med 2010 Jul 12;170(13):1142–1148.

    Article  PubMed  Google Scholar 

  8. Haynes K, Hennessy S, Morales KH, Gibson GA, Barnhart C, et al. Inter-rater reliability of a classification system for hospital adverse drug event reports. Clin Pharmacol Ther 2008 Mar;83(3):485–488.

    Article  PubMed  CAS  Google Scholar 

  9. Morimoto T, Gandhi TK, Seger AC, Hsieh TC, Bates DW. Adverse drug events and medication errors: detection and classification methods. Qual Saf Health Care 2004 Aug;13(4):306–314.

    Article  PubMed  CAS  Google Scholar 

  10. Bates DW, Leape LL, Petrycki S. Incidence and preventability of adverse drug events in hospitalized adults. J Gen Intern Med 1993 Jun;8(6):289–294.

    Article  PubMed  CAS  Google Scholar 

  11. Bates DW, Boyle DL, Vander Vliet MB, Schneider J, Leape L. Relationship between medication errors and adverse drug events J Gen Intern Med 1995;10:199–205.

    Article  PubMed  CAS  Google Scholar 

  12. Bates DW, Cullen DJ, Laird N, Petersen LA, Small SD, Servi D, et al. Incidence of adverse drug events and potential adverse drug events. Implications for prevention. ADE Prevention Study Group. JAMA 1995 Jul 5;274(1):29–34.

    Article  PubMed  CAS  Google Scholar 

  13. Cunningham G, Dodd TR, Grant DJ, McMurdo ME, Richards RM. Drug-related problems in elderly patients admitted to Tayside hospitals, methods for prevention and subsequent reassessment. Age Ageing 1997 Sep;26(5):375–382.

    Article  PubMed  CAS  Google Scholar 

  14. Gurwitz JH, Field TS, Harrold LR, Rothschild J, Debellis K, Seger AC, Cadoret C, Fish LS, Garber L, Kelleher M, Bates DW. Incidence and preventability of adverse drug events among older persons in the ambulatory setting. JAMA 2003;289:1107–1116.

    Article  PubMed  Google Scholar 

  15. Gurwitz JH, Field TS, Avorn J, McCormick D, Jain S, Eckler M, Benser M, Edmonson AC, Bates DW. Incidence and preventability of adverse drug events in nursing homes. Am J Med 2000;109:87–94.

    Article  PubMed  CAS  Google Scholar 

  16. Field TS, Gurwitz JH, Harrold LR, Rothschild J, DeBellis KR, Seger AC, et al. Risk factors for adverse drug events among older adults in the ambulatory setting. J Am Geriatr Soc 2004 Aug;52(8):1349–1354.

    Article  PubMed  Google Scholar 

  17. Kaushal R, Bates DW, Landrigan C, McKenna KJ, Clapp, MD Federico F, Goldmann DA. Medication errors and adverse drug events in peadiatric inpatients. JAMA 2001;285:2114–2120.

    Article  PubMed  CAS  Google Scholar 

  18. Kozer E, Scolnik D, Macpherson A, Keays T, Shi K, Luk T, Koren G. Variables associated with medication errors in paediatric emergency medicine. Pediatrics 2002;110:737–742.

    Article  PubMed  Google Scholar 

  19. King WJ, Paice N, Rangrej J, Forestell GJ, Swartz R. The effect of computerised physician order entry on medication errors and adverse drug events in paediatric inpatients. Pediatrics 2003;112:506–509.

    Article  PubMed  Google Scholar 

  20. Potts AL, Barr FE, Gregory DF, Wright L, Patel NR. Computerised physician order entry and medication errors in a paediatric critical care unit. Pediatric 2004;113:59–63.

    Article  Google Scholar 

  21. Kunac DL, Reith DM, Kennedy J, Austin NC, Williams SM. Inter and intra-rater reliability for classification of medication related events in paediatric inpatients. Qual Saf Health Care 2006;15:196–201.

    Article  PubMed  CAS  Google Scholar 

  22. Davies EC, Rowe PH, James S, Nickless G, Ganguli A, et al. An Investigation of disagreement in causality assessment of adverse drug reactions. Pharmaceut Med 2011;25(1):17–24.

    Google Scholar 

  23. Tangiisuran B, Davies JG, Wright J and Rajkumar C. Adverse drug reactions in population hospitalised very elderly patients. Drugs & Aging 2012;29(8):669–679.

    Google Scholar 

  24. Hallas J, Harvald B, Gram LF, Grodum E, Brosen K, Haghfelt T, et al. Drug related hospital admissions: the role of definitions and intensity of data collection, and the possibility of prevention. J Intern Med 1990 Aug;228(2):83–90.

    Article  PubMed  CAS  Google Scholar 

  25. Rawlins MD, Thompson, J.W. Mechanism of adverse drug reaction. In: Davies DM, ed. Textbook of adverse drug reactions. Oxford: Oxford University Press, 1991: 18–45.

    Google Scholar 

  26. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977 Mar;33(1):159–174.

    Article  PubMed  CAS  Google Scholar 

  27. Barnhart HX, Williamson JM. Weighted Least-Squares Approach for Comparing Correlated Kappa. Biometrics 2002;58:1012–1019.

    Article  PubMed  Google Scholar 

  28. Van Doormaal JE, Mol PGM, van den Bemt PMLA, Zaal RJ, Egberts ACG, et al. Reliability of the assessment of preventable adverse drug events in daily clinical practice. Pharmacoepidemiol Drug Saf 2008;17:645–654.

    Article  PubMed  Google Scholar 

  29. Ferner RE, Aronson JK. Preventability of drug-related harms — part 1: A systematic review. Drug Saf 2010;33(11):985–994.

    Article  PubMed  Google Scholar 

  30. Hakkarainen KM, Sundell KA, Petzold M, Hägg S. Methods for assessing the preventability of adverse drug events. A systematic review. Drug Saf 2012: 35(2): 105–126.

    Article  PubMed  Google Scholar 

  31. Dubois RW, Brook RH. Preventable deaths: who, how often, and why? Ann Intern Med 1988;109:582–589.

    Article  PubMed  CAS  Google Scholar 

  32. Cung B, Dickman RL. Minimizing Adverse Drug Events in Older Patients. Am Fam Physician 2007;76: 1837–1844

    Google Scholar 

  33. Zwicker D, Fulmer T. Reducing adverse drug events. In: Capezuti E, Zwicker D, Mezey M, Fulmer T, editor(s). Evidence-based geriatric nursing protocols for best practice. 3rd ed. New York (NY): Springer Publishing Company; 2008. p. 257–308

    Google Scholar 

  34. American Society of Health-System Pharmacists. ASHP guidelines on adverse drug reaction monitoring and reporting. Am J Health-Syst Pharm 1995;52:417–419

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Discipline of Clinical Pharmacy, School of Pharmaceutical Sciences, Universiti Sains Malaysia, Minden, 11800, Pulau Pinang, Malaysia

    B. Tangiisuran

  2. Institute of Pharmaceutical Science, King’s College London, London, UK

    V. Auyeung

  3. School of Computing Engineering and Mathematics, University of Brighton, Brighton, UK

    L. Cheek

  4. Brighton and Sussex Medical School, University of Sussex, Sussex, UK

    C. Rajkumar

  5. Institute of Pharmaceutical Science, King’s College London, 5th Floor, Franklin-Wilkins Building, 150 Stamford Street, London, SE1 9NH, UK

    J. Graham Davies

Authors
  1. B. Tangiisuran
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. V. Auyeung
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. L. Cheek
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. C. Rajkumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. J. Graham Davies
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to J. Graham Davies.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tangiisuran, B., Auyeung, V., Cheek, L. et al. Inter-rater reliability of the assessment of adverse drug reactions in the hospitalised elderly. J Nutr Health Aging 17, 700–705 (2013). https://doi.org/10.1007/s12603-013-0011-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12603-013-0011-1

Key words

Search

Navigation