Avoid common mistakes on your manuscript.
In recent months, there has been extensive reporting of interim efficacy results of several COVID-19 vaccine randomized clinical trials. Considerably less attention has been placed on the safety outcomes of these trials. Before large-scale observational studies became available, individual patients and clinicians needed to make indirect comparisons between COVID-19 vaccines in regions, such as Hong Kong, where patients may choose among vaccine products. The early results of COVID-19 vaccines trials published in top medical journals [1,2,3,4] were some of the first publicly available data reporting vaccine safety outcomes, yet the reporting of these outcomes in journal articles should be more consistent, comprehensive, and transparent to allow for informed comparisons between different vaccines.
Ramasamy et al. reported local and systemic adverse reactions for Vaxzevria (COVID-19 Vaccine [ChAdOx1-S (recombinant)]; AstraZeneca AB, Stockholm, Sweden) vs the control (MenACWY vaccine) [3]. However, we note that the detailed adverse reaction data for the controls appear to be missing from the supplementary tables. In their studies of CoronaVac (COVID-19 Vaccine [Vero Cell], Inactivated; Sinovac Life Sciences, Beijing, China), Wu et al. and Zhang et al. define the primary safety endpoint as adverse reactions [1, 2]. The International Conference on Harmonisation defines adverse events as “Any untoward medical occurrence in a patient or clinical investigation subject administered a pharmaceutical product and which does not necessarily have to have a causal relationship with this treatment” [5]. In contrast, an adverse reaction is an event that is judged to be caused by the vaccine under study. In the published papers by Wu et al. and Zhang et al., there appears to be a lack of clarity in the reporting as both terms are used somewhat interchangeably. There are also discrepancies between the primary outcome of adverse reactions in the study protocols and adverse events in the statistical analysis plans.
To date, the Government of Hong Kong has purchased three COVID-19 vaccines that use three different vaccine platform technologies: Comirnaty (COVID-19 mRNA Vaccine [nucleoside-modified]; BioNTech Manufacturing GmbH, Mainz, Germany), CoronaVac, and Vaxzevria. To emphasize the importance of consistent, clear, and transparent reporting of safety outcomes in published articles of COVID-19 vaccine randomized clinical trials, a summary of the frequency of adverse events or reactions reported in clinical trials after the first dose of these three vaccines is shown in Table 1. Published rates of adverse reactions for CoronaVac appear to be lower when compared with Comirnaty and Vaxzevria. It is not clear to us whether the investigators of CoronaVac used different definitions or different processes to ascertain whether an adverse event qualified as an adverse reaction, which could have resulted in a much lower frequency of reported adverse reactions when compared with Comirnaty and Vaxzevria, but this is difficult to ascertain from the published article. Tools created by the Brighton Collaboration [6], which establishes consistent definitions for adverse events following immunization, have been endorsed and recommended by the World Health Organization’s Global Advisory Committee on Vaccine Safety [7]. If vaccine developers used the safety templates and reported accordingly, it would greatly facilitate this area of discussion.
Moreover, we encourage the authors and their sponsors to clearly report the frequency of pooled and stratified adverse events and adverse reactions for all COVID-19 vaccine trials. Similarly, we also encourage journal reviewers and editors to carefully assess the reporting of these safety data. By providing this much needed information, patients and clinicians will be able to meet the challenge of indirectly comparing vaccine safety profiles. This safety information will enhance informed decisions about vaccine selection at the individual level, taking into consideration not only efficacy, but also the overall frequency and severity of adverse events. We note that some regulatory authorities, such as the US Food and Drug Administration and the European Medicines Agency, have made detailed COVID-19 vaccine safety data publicly available. These data, in addition to the rapidly emerging evidence from large-scale observational studies and spontaneous reports, will enhance our understanding of the comparative safety of the available COVID-19 vaccines. Observational studies are essential for assessing COVID-19 vaccine safety in populations with limited inclusion in randomized clinical trials such as very old and frail adults, pregnant women, and patients who are immunocompromised. To better inform the public, clinicians, and policy makers about the real-world comparative safety of COVID-19 vaccines, the Department of Health of Hong Kong has commissioned the COVID-19 Vaccines Adverse Events Response & Evaluation (CARE) Programme: a comprehensive real-time surveillance study that aims to closely monitor the known and potential adverse events following immunization with COVID-19 vaccines in Hong Kong [8].
References
Wu Z, Hu Y, Xu M, et al. Safety, tolerability, and immunogenicity of an inactivated SARS-CoV-2 vaccine (CoronaVac) in healthy adults aged 60 years and older: a randomised, double-blind, placebo-controlled, phase 1/2 clinical trial. Lancet Infect Dis. 2021;21(6):803–12. https://doi.org/10.1016/S1473-3099(20)30843-4.
Zhang Y, Zeng G, Pan H, et al. Safety, tolerability, and immunogenicity of an inactivated SARS-CoV-2 vaccine in healthy adults aged 18–59 years: a randomised, double-blind, placebo-controlled, phase 1/2 clinical trial. Lancet Infect Dis. 2021;21(2):181–92. https://doi.org/10.1016/S1473-3099(20)30987-7.
Ramasamy MN, Minassian AM, Ewer KJ, et al. Safety and immunogenicity of ChAdOx1 nCoV-19 vaccine administered in a prime-boost regimen in young and old adults (COV002): a single-blind, randomised, controlled, phase 2/3 trial. Lancet. 2020;396(10267):1979–93. https://doi.org/10.1016/S0140-6736(20)32466-1.
Polack FP, Thomas SJ, Kitchin N, et al. Safety and efficacy of the BNT162b2 mRNA Covid-19 vaccine. N Engl J Med. 2020;383(27):2603–15. https://doi.org/10.1056/NEJMoa2034577.
International Conference on Harmonisation. E2A clinical safety data management: definitions and standards for expedited reporting. ICH harmonised tripartite guideline: international conference on harmonisation; 1994. Available from: https://ich.org/page/efficacy-guidelines. Accessed 8 Aug 2021.
Bonhoeffer J, Kohl K, Chen R, et al. The Brighton Collaboration: addressing the need for standardized case definitions of adverse events following immunization (AEFI). Vaccine. 2002;21(3):298–302. https://doi.org/10.1016/S0264-410X(02)00449-8.
World Health Organization. Covid-19 vaccines: safety surveillance manual. Geneva; 2020. Available from: https://www.who.int/publications/i/item/10665338400. Accessed 8 Aug 2021.
Department of Pharmacology and Pharmacy, The University of Hong Kong. COVID-19 Vaccines Adverse Events Response & Evaluation (CARE) Programme. 2021. Available from: https://www.hkcare.hku.hk/. Accessed 7 July 2021.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Funding
This review is funded by a Research Grant from the Food and Health Bureau, The Government of the Hong Kong Special Administrative Region (Ref. No. COVID19F01). The CARE Programme is a collaboration between the Hong Kong Department of Health and the Hospital Authority.
Conflict of interest
The authors have no conflicts of interest to disclose.
Ethics approval
Not applicable.
Consent to participate
Not applicable.
Consent for publication
Not applicable.
Availability of data and material
Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study.
Code availability
Not applicable.
Author contributions
JEB: literature search (English), writing (original draft and editing), conceptualization, and data extraction. YW: literature search (Chinese), writing (original draft and editing), data extraction, and data validation. CSLC: writing (editing), comments, and revision. EWC: conceptualization, writing (original draft and editing), and supervision. ICKW: comments and revision and supervision. All authors have read and approved the final version of this article.
Rights and permissions
About this article
Cite this article
Blais, J.E., Wei, Y., Chui, C.S.L. et al. Inconsistent Safety Outcome Reporting in Randomized Clinical Trials of COVID-19 Vaccines Complicates Informed Medical Decisions. Drug Saf 44, 1121–1123 (2021). https://doi.org/10.1007/s40264-021-01108-5
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40264-021-01108-5