Introduction

The coronavirus disease 2019 (COVID-19) pandemic caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) persists and the world is seeing another year of a global health emergency [1]. Extensive research over the past year has demonstrated that elderly patients as well as those with pre-existing conditions such as obesity, diabetes, and cancer are more susceptible to getting infected with SARS-CoV-2 and developing life threatening pneumonia [2,3,4]. Approximately 9.5% of the adult population in the USA have or have had a diagnosis of cancer of any type and 1 in 3 adults will be diagnosed with cancer at some point during their lifetimes [5, 6]. Protecting the health and safety of patients with cancer is vital and considered a major priority during the COVID-19 pandemic [7].

Mehta et al. reported that increased age, comorbidities, and poor performance status were associated with poor outcome to COVID-19 in patients with cancer [4]. Case fatality rates (CFR) were greater in patients with hematologic cancers compared to those with solid cancers (37% vs. 25%) [4]. These data suggest the need for prophylactic strategies in cancer patients, who are often immunosuppressed due to their underlying disease state and use of chemotherapy, radiation therapy, bone marrow or stem cell transplant, and/or immunotherapy. With the lack of effective treatments for COVID-19, prevention strategies including vaccination are of paramount importance in reducing the risk and mortality [8]. Vaccines against COVID-19 were rapidly developed and emerging data shows that mRNA-based COVID-19 vaccines are effective and safe in the general population. However, the efficacy of COVID-19 vaccines in patients with cancer is unknown as patients with active cancer or those treated with immunosuppressing therapies were excluded from regulatory vaccine trials [9]. Guidelines currently recommend that patients with cancer should be vaccinated against SARS-CoV-2 as long as any components of the vaccine are not contraindicated [10]. Data from other vaccine-preventable illnesses suggest an attenuated humoral response to vaccines in patients with solid cancer undergoing cytotoxic chemotherapy [11, 12]. Recent studies have reported that patients with hematologic malignancies, especially those receiving anti-CD20 therapies or those with a history of stem cell transplantation had attenuated immunogenicity to BNT162b2 or mRNA-1273 SARS-CoV-2 vaccines compared to those with solid tumors [13, 14]. Additional studies investigating the effectiveness of COVID-19 vaccines in cancer patients are limited and mostly are of small sample sizes.

Better understanding of the overall effectiveness of COVID-19 vaccines in patients with cancer would improve clinical care and protect these vulnerable patient population. In this systematic review and meta-analysis, our aim was to integrate findings across studies to determine the serologic response rate to COVID-19 vaccination in patients with cancer.

Methods

Search strategy and study selection

This meta-analysis was conducted according to a priori defined protocol that is in accordance with the PRISMA guideline [15]. The protocol of this meta-analysis has been submitted to the International Prospective Register of Systematic Reviews (PROSPERO) [16]. We searched PubMed/MEDLINE, EMBASE, and medRxiv (https://www.medrxiv.org/) from inception to August 1, 2021 to identify studies assessing the response to COVID-19 vaccination in patients with cancer.

We included observational studies reporting the outcomes of COVID-19 vaccination in patients with cancer. There were no restrictions regarding age, sex or duration of the study. Studies reporting outcomes in patients with active or history of cancer were eligible. We imposed no geographic or language restrictions. Two authors (AL, AS) independently screened each of the potential studies to determine whether they were eligible for inclusion. Areas of disagreement or uncertainty were resolved by consensus among the authors. Studies were identified with the following terms:”COVID-19″, “SARS-CoV-2″, “vaccine”, “cancer”, “malignancy”, “leukemia”, “lymphoma”, “immunosuppressed”, and “hematologic diseases”. A search was also performed of bibliographies of identified articles for additional references. The search was restricted to human studies. Manuscripts published in languages other than English were translated if necessary. Single case reports were excluded. Studies that reported only adverse outcomes to COVID-19 vaccination were excluded. The corresponding authors of studies were contacted to obtain additional information when needed. The search strategy is described in Fig. 1 and the Pubmed/MEDLINE, EMBASE, and medRxiv search strategies are shown in Additional file 1: Table S1.

Fig. 1
figure 1

Flowchart of the assessment of the studies identified in the meta-analysis

Data extraction and quality assessment

All data were independently abstracted in duplicate by two authors (AL, AS) by using a data extraction form. Data on the study characteristics including author name, year of publication, study design, duration, study location, sample size, diagnosis of cancer, concomitant medication use, age and gender of patients, type and frequency of vaccination, and type and outcome of serologic testing were collected. We divided diseases into the following two categories: (1) solid tumors, and (2) hematologic malignancies. Proportion of patients undergoing active cancer therapies and using glucocorticoids (GCs) were extracted when data was available.

We assessed the risk of bias of included studies using the Joanna Briggs Institute Critical Appraisal Checklist [17]. We rated the quality of evidence according to the Grades of Recommendation, Assessment, Development and Evaluation (GRADE) approach to assess the certainty of evidence obtained from the present meta-analysis [18].

Outcome assessment

The primary outcome was the rate of serologic response to COVID-19 vaccination in cancer patients. Response was separately assessed after one or two vaccinations. The secondary outcome of interest was the rate of serologic response in cancer patients compared to control patients. We extracted the number of patients who achieved an above cut-off antibody level among the total number of patients tested in each study. Applying a common cut-off value between studies was not possible because each study used a different serologic testing method. When tests were performed at multiple time points in a study, we chose the date closest to 4 weeks after the vaccination.

Subgroup analyses or meta-regression according to cancer type (hematological vs solid cancer), proportion of patients on anti-cancer medication/treatment, and age of subjects were undertaken when data were available. Anti-cancer medications/treatments included chemotherapy, monoclonal antibodies, immune check-point inhibitors, radiotherapy, hormonal therapy, etc. and were assessed separately.

Statistical analysis

We undertook a meta-analysis of the rate of serologic response to COVID-19 vaccination among individuals with cancers from observational studies by using a random effects model. The presence of heterogeneity across studies was assessed by using the I2 statistic. An I2 value of < 25% indicates low heterogeneity, 25–75% as moderate heterogeneity and > 75% as considerable heterogeneity [19]. Heterogeneity was evaluated by using Cochran’s Q-statistics with a significance level of P < 0.10 [20]. Begg’s and Egger’s tests were performed to assess publication bias and funnel plots were constructed to visualize asymmetry when ≥ 3 studies were available [21, 22]. A random effects meta-regression model was used to assess the contributions of each potential risk factors and medication class to the outcome of vaccine response. When the number of available studies for each analysis was less than 10, funnel plot construction and meta-regression analysis were undertaken for reference purpose due to its low reliability.

We included preprints because they form a substantial part of the available COVID-19 evidence, but due to their lack of peer-review, we conducted a sensitivity analysis by excluding preprints [23]. Four studies included non-mRNA type vaccines, so we conducted a sensitivity analysis by excluding them. We also performed one study removed analyses to assess whether the results are strongly influenced by any single study.

Statistical analyses were performed using the Comprehensive Meta Analysis Software (version 3; Biostat, Englewood, NJ, USA). All statistical tests except for the Q-statistics used a two-sided P value of 0.05 for significance.

Data sharing and access

Data will be made available upon request to the corresponding author. All authors had access to the study data and reviewed and approved the final manuscript.

Results

Study characteristics

We identified 1929 citations through the literature search, excluded 1863 after initial title and abstract screening, and assessed 66 studies for eligibility. Sixteen articles including 1453 patients met eligibility criteria (Fig. 1). As shown in Table 1, seven were full-text articles [13, 14, 24,25,26,27,28], seven were correspondence/letters [24, 29,30,31,32,33,34], and two were articles in a preprint [35, 36]. Four studies included only patients with solid organ cancers, nine included only hematologic cancers, and three studies included patients with both solid and hematologic cancers. The three studies that included both types of cancers reported seroconversion rates separately among the types of cancers, so we reported them separately. Eight studies used only BNT162b2 (Pfizer-BioNTech), four studies used BNT162b2 and mRNA-1273 (Moderna), two studies used ChAdOx1 nCoV-19 (Oxford-AstraZeneca) and BNT162b2, one study used ChAdOx1 nCoV-19, mRNA-1273, and BNT162b2, and one study used AD26.COV2.S (Janssen/Johnson & Johnson), mRNA-1273, and BNT162b2. The majority of the studies that used non-mRNA type vaccines did not report outcomes separately, so we reported them together with the mRNA vaccination strategies.

Table 1 Characteristics and outcomes of the included studies

For the analyses on the rate of serologic response to COVID-19 vaccination, nine and eleven studies were available for assessment after one and two doses, respectively. Six and eight studies compared outcomes after one or two doses of COVID-19 vaccine to a control population without cancers. A majority of the studies assessed serologic response 3–5 weeks post-vaccination. All studies included for the assessment of response after two doses did not delay the timing of the second dose. The summary of characteristics and outcomes of the included studies are summarized in Table 1. The risk of bias of included studies assessed using the Joanna Briggs Institute Critical Appraisal Checklist is shown in Additional file 1: Table S2. A majority of the studies were of medium to high quality.

Rate of serologic response after a single dose of COVID-19 vaccine

There were nine studies (11 reports) that assessed the serologic response after the first dose of COVID-19 vaccine in patients with cancer [14, 24, 25, 27, 29, 32,33,34] The studies by Monin et al. and Addedo et al. reported outcomes separately in hematologic and solid cancers [14, 25]. As shown in Fig. 2A, the pooled proportion of patients achieving a serologic response was 54.2% (95% confidence interval [CI] 41.0–66.9). Subgroup analysis demonstrated that the rate was numerically lower in solid cancers (49.6%) compared to hematologic cancers (56.0%).

Fig. 2
figure 2

A Meta-analysis of serological response after one dose of vaccine. B Meta-analysis of Serological response after two doses of vaccine

Heterogeneity was present (I2 = 88.9%) likely attributed to the difference in the reported rates among studies. Multivariate meta-regression was undertaken to further explore the cause of heterogeneity and demonstrated that the proportion of patients on anti-cancer therapy (coefficient − 0.029, 95% CI − 0.055 − (− 0.0016), P = 0.038) and the age of the subjects (coefficient − 0.10, 95% CI − 0.16 − (− 0.050), P < 0.001) were significant sources of heterogeneity, with studies with more patients on anti-cancer therapy and with older subjects presenting a lower serologic response rates to a single dose of COVID-19 vaccine (Additional file 1: Table S3).

Funnel plot of the studies included in the meta-analysis demonstrated no asymmetry and no publication bias was found (Begg’s P = 0.44, Egger’s P = 0.48) (Additional file 1: Fig. S1A).

Sensitivity analyses were carried out to assess whether individual studies influenced the results (Additional file 1: Fig. S1B). When individual studies were removed one at a time from the analyses, the corresponding pooled rates were not markedly altered by any single study confirming the stability of the results. Three studies included non-mRNA type vaccines [29, 32, 34] and a sensitivity analysis excluding them showed similar results (Additional file 1: Fig. S1C). No preprint studies were included for this analysis, so sensitivity analysis excluding preprints was not performed.

Subgroup analysis according to type of hematologic cancer demonstrated that rates were lower in chronic lymphocytic leukemia (CLL) (16.7%), and lymphoma (16.3%) compared to multiple myeloma (MM) (36.8%), myeloproliferative malignancies (MPM) (54.6%), and chronic myeloid leukemia (CML) (72.2%) (Additional file 1: Fig. S1D). In solid cancers, the rates were lower in thoracic cancers (21.4%) and skin cancers (22.2%) compared to women’s cancers (47.4%), gastrointestinal (GI) cancers (50.0%), and urological cancers (66.7%) (Additional file 1: Fig. S1E). Subgroup analysis according to type of vaccine showed that the rate was higher with mRNA-1273 (80.4%) compared to BNT162b2 (53.0%) and AZD1222 (58.5%) (Additional file 1: Fig. S1F). Subgroup analysis according to type of therapy demonstrated that the rate was lowest with anti-CD20 therapy (10.0%) compared to chemotherapy (55.0%), kinase inhibitors (61.6%), immune check-point inhibitors (84.6%), or no therapy (71.5%) (Additional file 1: Fig. S1G).

Rate of serologic response after two doses of COVID-19 vaccine

There were eleven studies (14 reports) that assessed the serologic response after two doses of COVID-19 vaccine [13, 14, 25,26,27,28, 30, 31, 33, 35, 36]. All studies did not delay the timing of the second dose including the one study reported from United Kingdom [25]. Three studies reported outcomes separately in hematologic and solid cancers [13, 14, 25]. As shown in Fig. 2B, the pooled proportion of patients achieving a serologic response was 87.7% (95% CI 82.5–91.5). Subgroup analysis demonstrated that the rate was numerically lower in hematologic cancers (63.7%) compared to solid cancers (94.9%). Surprisingly, the rates in patients with hematologic cancers after one and two doses were not considerably different (59.0–63.7%).

Heterogeneity was present (I2 = 94.2%) likely attributed to the difference in the reported rates between hematologic and solid cancers. Multivariate meta-regression was undertaken to further explore the cause of heterogeneity and demonstrated that the difference in study population (hematologic versus solid cancer) (coefficient − 2.16, 95% CI − 3.26 − (− 3.86), P < 0.001) was a significant source of heterogeneity (Additional file 1: Table S4).

Funnel plot of the studies included in the meta-analysis demonstrated no asymmetry, but publication bias was present by Egger’s (P = 0.014) but not Begg’s test (P = 0.27) (Additional file 1: Fig. S2A).

Sensitivity analysis was undertaken by excluding two preprint studies (Additional file 1: Fig. S2B). Exclusion of preprints demonstrated a serologic response rate similar to when they were included (87.7% vs. 91.6%). Remove one study analysis also showed that pooled rates were not markedly altered by any single study (Additional file 1: Fig. S2C). Excluding one study that included non-mRNA vaccines [13] demonstrated similar results (data not shown).

Similar to the results after one dose, subgroup analysis stratified by type of hematologic cancer demonstrated that rates were lower among conditions that mainly affect B-cells, such as CLL (41.9%), and lymphoma (52.4%), compared to MM (72.7%), AML/CML (75.0%), and MPM (88.0%) (Additional file 1: Fig. S2D). In solid cancers, the rates were slightly lower in women’s cancers (76.6%) and skin cancers (80.0%) compared to GI cancers (86.7%), urological cancers (87.5%), thoracic cancers (91.5%), and brain cancers (95.0%) (Additional file 1: Fig. S2E). Subgroup analysis according to type of vaccine showed that the rates were similar with mRNA-1273 (87.2%) and BNT162b2 (85.1%) (Additional file 1: Fig. S2F). Subgroup analysis according to type of therapy demonstrated that the rates were lower with chimeric antigen receptor (CAR) T-cell therapy (12.5%), anti-CD20 therapy (22.9%), kinase inhibitors (38.9%), daratumab (50.0%), and stem cell transplant (SCT) (73.1%) compared to chemotherapy (92.8%), protease inhibitors (92.9%), immune check-point inhibitors (95.2%), hormonal therapy (99.0%), or no therapy (82.3%) (Additional file 1: Fig. S2G).

Comparison of serologic response after a single dose of COVID-19 vaccine to controls

As shown in Fig. 3A, meta-analysis of 6 studies (7 reports) [25, 27, 29, 32,33,34] that included control patients demonstrated that a significantly lower proportion of cancer patients achieved a serologic response compared to control patients after a single dose of vaccine (odds ratio (OR) 0.073, 95% CI 0.026–0.20, P < 0.001). Subgroup analysis showed that both hematologic and solid cancers demonstrated lower response rates compared to controls (OR 0.052, 95% CI 0.008–0.33, P = 0.0016 and OR 0.085, 95% CI 0.024–0.29, P < 0.001, respectively).

Fig. 3
figure 3

A Meta-analysis of serological response compared to controls after one dose of vaccine. B Meta-analysis of serological response compared to controls after two doses of vaccine

Heterogeneity was present (I2 = 84.3%) likely attributed to the variable ratios reported among included studies (range 0.014–0.55), especially among studies included in hematologic cancers. Funnel plot of the studies included in the meta-analysis demonstrated no asymmetry (Begg’s P = 0.55, Egger’s P = 0.099) (Additional file 1: Fig. S3A).

Comparison of serologic response after two doses of COVID-19 vaccine to controls

As shown in Fig. 3B, meta-analysis of 8 studies (10 reports) [13, 25,26,27,28, 31, 33, 36] that included control patients demonstrated that a significantly lower proportion of cancer patients achieved a serologic response compared to control patients after two doses of vaccine (OR 0.10 (95% CI 0.039–0.26), P < 0.001). Subgroup analysis showed that both hematologic and solid cancers demonstrated lower response rates compared to controls (OR 0.044, 95% CI 0.012–0.16, P < 0.001 and OR 0.24, 95% CI 0.062–0.90, P = 0.035, respectively), but the OR was much smaller in hematologic cancer.

Heterogeneity was not present (I2 = 0%) and funnel plot of the studies included in the meta-analysis demonstrated no asymmetry (Begg’s P = 0.15, Egger’s P = 0.15) (Additional file 1: Fig. S3B).

Some studies reported data of absolute values of antibody titers (Table 1). Cancer patients had values that were 1/3 to 1/10 compared to controls.

Grading the quality of evidence

Based on the GRADE approach, an overall quality of evidence for this analysis was low as the data were obtained from observational studies and there were no specific factors to down- or up-grade the level of certainty (Additional file 1: Table S5).

Discussion

In the present meta-analysis, we assessed the serologic response to COVID-19 vaccination in patients with cancer. We demonstrated that only 54% of patients with cancer achieved a serologic response to a single dose of COVID-19 vaccine, which improved to 88% after two doses. The rates were significantly lower compared to controls at both stages, especially in patients with hematologic cancers, suggesting the urgent need for an improved vaccination strategy in this vulnerable patient population. Further studies assessing the response in patients with various types of cancers or to other types of vaccine are warranted.

Patients with cancer are known to have a greater mortality due to COVID-19 [37]. Patients with cancer are immunocompromised due to the immunosuppressive properties of cancer and the effects of chemotherapy and radiation therapy [38]. Chemotherapy may cause long-term changes in immune parameters including B and T cell functions that increases the risk of various infections as well as hampers the response to vaccines [39]. They might also have a dysfunctional immune responses to infections secondary to immunotherapeutics, such as programmed cell death 1 or programmed cell death ligand 1 inhibitors, or chimeric antigen receptor (CAR)-modified T cell therapy [38]. Furthermore, patients with cancer are often older and carry comorbidities placing them at greater risk for morbidity and mortality due to COVID-19 [40].

Due to the lack of effective therapies to treat COVID-19, it is important to know the effectiveness of COVID-19 vaccines in patients with cancer. Roeker et al. reported that seroconversion of anti-SARS-CoV-2 antibody after two doses of COVID-19 vaccine was 52% in leukemia patients whereas Massarweh et al. reported a 90% seroconversion rate in solid cancer patients [28, 30]. A majority of studies have reported an attenuated response in patients with cancer, but the seroconversion rates varied largely and most studies were of small sample sizes. Therefore, it was important to integrate findings across studies to determine the serologic response rate to COVID-19 vaccination in patients with both hematologic and solid cancers.

Shroti et al. reported that nearly all patients developed antibodies after one or two doses of BNT162b2 or ChAdOx1 nCoV-19 vaccines (96.42% and 99.08%, respectively). However, they reported that elderly people and those with comorbidities such as diabetes, cardiovascular disease, and cancer had lower antibody levels [41]. Our study showed that the proportion of patients achieving a serologic response after a single or two doses of COVID-19 vaccine was 54% and 88%, respectively, which are much lower than the rates reported by Shroti et al. Among studies that included control patients without cancer, the OR of achieving serologic response among patients with cancer was significantly lower after the first and second dose. The results of our study are consistent with recent meta-analyses reporting lower response rates in hematological cancers vs. solid cancers or controls [42, 43].

The proportion of patients on anti-cancer therapy and older age were factors associated with lower vaccine response rates after the first dose whereas diagnosis of hematologic cancer was the only factor associated with lower response after the second dose. This supports the recommendations to prioritize cancer patients for additional measures such as booster vaccinations. We also analyzed vaccine response in different types of cancer as well as in patients receiving different treatments. Patients with CLL and lymphoma, which are mainly of B-cell origin, had lower serologic response rates compared to MM, AML/CML and MPM patients and therapies such as CAR-T therapy, anti-CD20 therapy, and kinase inhibitors were associated with lower rates. In contrast, most solid cancers had serologic response rates in 80–95% range after two doses of vaccine and therapies mostly used for these conditions such as chemotherapy, immune check-point inhibitors, and hormonal therapy had higher response rates.

Limitations

Ten months have passed since the UK first approved BNT162b2, but available studies in cancer patients was still limited. There are currently 9 different vaccines on the global market, but nearly all of the included studies used only mRNA vaccines: either BNT162b2 (or mRNA-1273, and only a few studies included ChAdOx1 nCoV-19 or AD26.COV2.S in a small proportion of patients. Further research is needed whether the results of our study can be generalized to other types of vaccines. We assessed humoral responses to vaccination, but the extent to which cell-mediated immunity, such as spike-specific T cell response, is involved remains unclear. However, recent real-world studies have shown that antibody levels are associated/predictive of infection risk and that immunosuppressed patients were at risk for breakthrough infections [44, 45]. We undertook subgroup analyses according to different diseases or therapies, but the number of studies reporting detailed data were limited. Included studies mainly used one of the three commercially available antibody tests (Roche, DiaSorin, or Abbott), which all have excellent sensitivity (98–100%) [46]. As a result, they correlate well with each other in terms of seroprevalence. Some early studies delayed the timing of the second dose, but all of the studies included in our meta-analysis for the assessment following two doses administered the second dose without delay. Serologic response rates were similar after two doses of BNT162b2 or mRNA-1273 vaccines, but further studies are needed to assess the difference in degree of waning antibody levels in cancer patients [47]. Furthermore, we were not able to assess the vaccine effectiveness in preventing infections or hospitalizations in cancer patients.

Conclusion

In the present comprehensive meta-analysis, we analyzed the rate of seroconversion to COVID-19 vaccines in patients with cancer. Our meta-analysis demonstrated that 54% and 88% of patients with cancer achieved a serologic response after one and two doses of COVID-19 vaccine, respectively, which were statistically lower compared to controls. Cancer patients should receive the series of two dose vaccines without delay and should continue to follow safety measures including mask-wearing after vaccination. Certain conditions and therapy were associated with lower response rates, so further studies assessing optimal prophylactic strategy in patients with cancer will be warranted.