The ability to detect safety concerns from spontaneous adverse drug reaction reports in a timely and efficient manner remains important in public health.
This paper explores the behaviour of the Sequential Probability Ratio Test (SPRT) and ability to detect signals of disproportionate reporting (SDRs) in the Singapore context.
We used SPRT with a combination of two hypothesised relative risks (hRRs) of 2 and 4.1 to detect signals of both common and rare adverse events in our small database. We compared SPRT with other methods in terms of number of signals detected and whether labelled adverse drug reactions were detected or the reaction terms were considered serious. The other methods used were reporting odds ratio (ROR), Bayesian Confidence Propagation Neural Network (BCPNN) and Gamma Poisson Shrinker (GPS).
The SPRT produced 2187 signals in common with all methods, 268 unique signals, and 70 signals in common with at least one other method, and did not produce signals in 178 cases where two other methods detected them, and there were 403 signals unique to one of the other methods. In terms of sensitivity, ROR performed better than other methods, but the SPRT method found more new signals. The performances of the methods were similar for negative predictive value and specificity.
Using a combination of hRRs for SPRT could be a useful screening tool for regulatory agencies, and more detailed investigation of the medical utility of the system is merited.
This is a preview of subscription content, log in to check access.
Compliance with Ethical Standards
All data used in this study are anonymised, and ethical approval was not required.
The SAPhIRE (Surveillance and Pharmacogenomics Initiative for Adverse Drug Reactions) Project was funded by a Strategic Positioning Funds grant from the Biomedical Research Council of the Agency for Science, Technology and Research of Singapore (SPF2014/001).
Conflict of interest
Cheng Leng Chan, Sowmya Rudrappa, Pei San Ang, Shu Chuen Li and Stephen J.W. Evans have no conflicts of interest that are directly relevant to the content of this study.
Evans SJW, Waller PC, Davis S. Use of proportional reporting ratios (PRRs) for signal generation from spontaneous adverse drug reaction reports. Pharmacoepidemiol Drug Saf. 2001;10(6):483–6. doi:10.1002/pds.677.CrossRefPubMedGoogle Scholar
Szarfman A, Machado SG, O’Neill RT. Use of screening algorithms and computer systems to efficiently signal higher-than-expected combinations of drugs and events in the US FDA’s Spontaneous Reports Database. Drug Saf. 2002;25(6):381–92. doi:10.2165/00002018-200225060-00001.CrossRefPubMedGoogle Scholar
Spiegelhalter D, Grigg O, Kinsman R, Treasure T. Risk-adjusted sequential probability ratio tests: applications to Bristol, Shipman and adult cardiac surgery. Int J Qual Health Care. 2003;15(1):7–13.CrossRefGoogle Scholar
Roux E, Thiessard F, Fourrier A, Begaud B, Tubert-Bitter P. Evaluation of statistical association measures for the automatic signal generation in pharmacovigilance. IEEE Trans Inf Technol Biomed. 2005;9(4):518–27. doi:10.1109/TITB.2005.855566A.CrossRefPubMedGoogle Scholar
Stahl M, Lindquist M, Edwards IR, Brown EG. Introducing triage logic as a new strategy for the detection of signals in the WHO Drug Monitoring Database. Pharmacoepidemiol Drug Saf. 2004;13(6):355–63. doi:10.1002/pds.894.CrossRefPubMedGoogle Scholar
Safety reporting requirements for human drug and biological products; Federal Register. Department of Health and Human Services. US Food and Drug Administration. 14 March 2003. http://www.fda.gov/OHRMS/DOCKETS/98fr/03-5204.pdf. Accessed 19 Sept 2015.