Abstract
Objective
The objective of this study was to evaluate the performance of Standardised MedDRA® Queries (SMQs) in adverse drug reaction (ADR) identification.
Methods
ADR cases included in the last complete year of the French Pharmacovigilance database for research were used to test four SMQs (narrow and broad): agranulocytosis, demyelination, osteonecrosis and psychosis. Reference cases were identified by free-text search and validated by two authors. Sensitivity (Se), specificity (Sp), positive predictive value (PPV) and negative predictive value (NPV) of narrow and broad searches of each SMQ were calculated and reported as proportions with 95 % exact confidence interval (CI).
Results
Among 20,830 cases reported in 2009, 337 validated cases of agranulocytosis, 17 of demyelination, 52 of osteonecrosis and 230 of psychosis were included in the reference sets. Estimations of SMQ narrow search performance were as follows: Se 62.9 % (95 % CI 57.5–68.1) and PPV 46.8 % (95 % CI 42.1–51.5) for agranulocytosis; Se 88.2 % (95 % CI 63.6–98.5) and PPV 34.1 % (95 % CI 20.5–49.9) for demyelination; Se 94.2 % (95 % CI 84.1–98.8) and PPV 74.2 % (95 % CI 62.0–84.2) for osteonecrosis; and Se 75.1 % (95 % CI 69.0–80.6) and PPV 87.8 % (95 % CI 82.3–92.0) for psychosis. Results obtained using the broad search were similar except for PPV concerning osteonecrosis (52.7 % [95 % CI 42.1–63.1]) and psychosis (61.4 % [95 % CI 55.7–66.8]). For all selected SMQs, Sp and NPV were greater than 98 % for both narrow and broad searches.
Conclusion
Heterogeneous performance of SMQs for case retrieval was found and seems to be related to the characteristics of the condition of interest. It could therefore be expected that for other SMQs, performance may be affected in the same manner.
Similar content being viewed by others
Notes
MedDRA® terminology is the international medical terminology developed under the auspices of the International Conference on Harmonization of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH). MedDRA® trademark is owned by the International Federation of Pharmaceutical Manufacturers and Associations (IFPMA) on behalf of ICH.
Since 1998, MedDRA® has been managed by the MSSO.
References
Harrison J, Mozzicato P. MedDRA: The tale of a terminology: side effects of drugs essay. In: Aronson JK, editor. Side effects of drugs annual. Amsterdam: Elsevier; 2009. pp. 33–51.
Brown EG. Effects of coding dictionary on signal generation: a consideration of use of MedDRA compared with WHO-ART. Drug Saf. 2002;25(6):445–52.
Pearson RK, Hauben M, Goldsmith DI, Gould AL, Madigan D, O’Hara DJ, et al. Influence of the MedDRA hierarchy on pharmacovigilance data mining results. Int J Med Inform. 2009;78(12):e97–103. doi:10.1016/j.ijmedinf.2009.01.001.
Brown EG, Douglas S. The concept of searches with defined sensitivity and specificity was described in tabulation and analysis of pharmacovigilance data using MedDRA. Pharmacoepidemiol Drug Saf. 2000;9:479–89.
MedDRA Maintenance and Support Services Organization. Introductory Guide for Standardised MedDRA Queries (SMQs) Version 15.0. Chantilly (VA): International Federation of Pharmaceutical Manufacturers and associations; 2012. http://www.meddra.org/sites/default/files/guidance/file/smq_intguide_15_0_english.pdf. Accessed 1 May 2014
Mozzicato P. Standardised MedDRA queries: their role in signal detection. Drug Saf. 2007;30(7):617–9.
Andrews E, Moore N. Mann’s pharmacovigilance, 3rd ed. New York: Wiley; 2014.
SMQs: development and rational use of Standardised MedDRA queries. Report of CIOMS Working Group. Geneva: CIOMS; 2004.
Décret n° 2011-655 du 10 juin 2011 relatif aux modalités de signalement par les patients ou les associations agréées de patients d’effets indésirables susceptibles d’être liés aux médicaments et produits mentionnés à l’article L. 5121-1 du code de la santé publique. JORF. 2011;n°0136, 13.
Bénichou C. Adverse drug reactions: a practical guide to diagnosis and management. New York: Wiley; 1994.
Council for International Organizations of Medical Sciences (CIOMS). Reporting adverse drug reactions. Definitions of terms and criteria for their use. Geneva: CIOMS; 1999.
van Puijenbroek EP, Bate A, Leufkens HG, Lindquist M, Orre R, Egberts AC. A comparison of measures of disproportionality for signal detection in spontaneous reporting systems for adverse drug reactions. Pharmacoepidemiol Drug Saf. 2002;11(1):3–10. doi:10.1002/pds.668.
Bannwarth B. Drug-induced musculoskeletal disorders. Drug Saf. 2007;30:27–46.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders, 5th ed. Arlington: American Psychiatric Association; 2013. http://dsm.psychiatryonline.org. Accessed 1 Jan 2014.
Dupuch M, Dupuch L, Hamon T, Grabar N. Exploitation of semantic methods to cluster pharmacovigilance terms. J Biomed Semant. 2014;5:18. doi:10.1186/2041-1480-5-18.
Dupuch M, Dupuch L, Perinet A, Hamon T, Grabar N. Grouping the pharmacovigilance terms with a hybrid approach. Stud Health Technol Inform. 2012;180:235–9.
Dupuch M, Lerch M, Jamet A, Jaulent MC, Fescharek R, Grabar N. Grouping pharmacovigilance terms with semantic distance. Stud Health Technol Inform. 2011;169:794–8.
Jaulent MC, Alecu I. Evaluation of an ontological resource for pharmacovigilance. Stud Health Technol Inform. 2009;150:522–6.
List of SMQ topics for development by CIOMS Working Group for SMQs. 2013. http://www.meddra.org/sites/default/files/page/documents/list_of_smq_topics_for_website_sep_2013.pdf. Accessed 14 Feb 2014.
ICH Working Group. MedDRA® data retrieval and presentation: points to consider. ICH-endorsed guide for MedDRA users on data output. 2012. http://www.ich.org/fileadmin/Public_Web_Site/ICH_Products/MedDRA/MedDRA_Documents/MedDRA_Data_Retrieval_and_Presentation/Release_3.4_based_on_v.15.1/DataRetrieval_PTC_R3_4_October.2012.pdf. Accessed 13 Jan 2014.
Chen G, Shen D. Practice of SMQs for adverse events in analysis of safety data and pharmacovigilance. http://www.pharmasug.org/proceedings/2013/HO/PharmaSUG-2013-HO02.pdf Accessed 12 Jan 2014.
Disclosures
No sources of funding were used to assist in the preparation of this study. Hélène Géniaux, Denise Assaf, Ghada Miremont-Salamé, Bénédicte Raspaud, Amandine Gouverneur, Philip Robinson, Antoine Pariente and Francesco Salvo have no conflicts of interest that are directly relevant to the content of this study.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Géniaux, H., Assaf, D., Miremont-Salamé, G. et al. Performance of the Standardised MedDRA® Queries for Case Retrieval in the French Spontaneous Reporting Database. Drug Saf 37, 537–542 (2014). https://doi.org/10.1007/s40264-014-0187-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40264-014-0187-2