Abstract
Global Human papillomavirus (HPV) vaccination rates remain low despite available WHO-approved vaccines. Digital interventions for promoting vaccination uptake offer a scalable and accessible solution to this issue. Here we report a systematic review and meta-analysis examining the efficacy of digital interventions, comparing educational and reminder approaches, for promoting HPV vaccination uptake (HVU). This study also identifies factors influencing the effectiveness of these interventions. We searched PubMed, PsycInfo, Web of Science, and the Cochrane Library from each database’s inception to January 2023. Three raters independently evaluate the studies using a systematic and blinded method for resolving disagreements. From 1929 references, 34 unique studies (281,280 unique participants) have sufficient data. Client reminder (OR, 1.41; 95% CI, 1.23–1.63; P < 0.001), provider reminder (OR, 1.39; 95% CI, 1.11–1.75; P = 0.005), provider education (OR, 1.18; 95% CI, 1.05–1.34; P = 0.007), and client education plus reminder interventions (OR, 1.29; 95% CI, 1.04–1.59; P = 0.007) increase HVU, whereas client education interventions do not (OR, 1.08; 95% CI, 0.92–1.28; P = 0.35). Digital intervention effectiveness varies based on participants’ gender and the digital platform used. Interventions targeting male or mixed-gender participants demonstrate greater benefit, and reminder platforms (SMS, preference reminders, or electronic health record alerts) are more effective in increasing HVU. Digital interventions, particularly client and provider reminders, along with provider education, prove significantly more effective than client education alone. Incorporating digital interventions into healthcare systems can effectively promote HPV vaccination uptake. Reminder interventions should be prioritized for promoting HVU.
Similar content being viewed by others
Introduction
Cervical cancer is the fourth most common cancer among women worldwide1, with an estimated 600,000 new cases diagnosed each year2. The majority of cases occur in developing countries, where access to preventive measures is often limited3. Preventive measures for cervical cancer include vaccination against human papilloma virus (HPV), regular screening tests, and safe sexual practices4. Scale-up of HPV vaccination uptake (HVU) for adolescent girls will have a significant effect in preventing cervical cancer and its associated mortality5. The World Health Organization has set the goal of having 90% of girls vaccinated against HPV by the time they turn 15 as part of its global strategy to eliminate cervical cancer. More than 45 million deaths from cervical cancer and other HPV-related cancers, such as vaginal cancer, laryngeal cancer, and anal cancer, could be prevented if the WHO’s 2030 target for delivering prophylactic HPV vaccination were met6.
Yet, the coverage of HPV vaccination varies widely around the world with 33.6% in developed regions, but only 2.7% in less developed regions7,8. There are several factors that can influence the HVU. These include the availability and accessibility of the vaccine, the cost of the vaccine, the recommendations and policies of national and local health authorities, and cultural and societal attitudes towards vaccination9,10,11.
School-based vaccination programs12,13, education about HPV and the vaccine at the outpatient clinic14,15, reminder letters to students and parents about upcoming vaccination appointments16,17, and incentives for vaccination can promote HVU18,19. However, these existing strategies face several obstacles, including undervaluation, misunderstanding, attitudinal barriers20,21,22,23, structural barriers such as scheduling challenges12,13, and expensive incentives16,17,20. Digital interventions leveraging technology and online platforms offer solutions to these challenges24,25,26,27.
Digital interventions can be utilized to enhance vaccination uptake through both client and provider-based interventions. For clients, these interventions can furnish education about the importance of vaccination26 and dispel prevalent myths27. They can also send reminders and alerts for upcoming vaccination appointments17, track vaccination records, and facilitate the easy scheduling of vaccination appointments28,29. For healthcare providers, digital tools not only support in delivering vaccination services but also provide education through websites or webinars30. This education can include clinical decision support tools that aid in making informed decisions about vaccination31, and methods for remotely monitoring patients’ vaccination status32,33.
Previous systematic reviews have identified several commonly used interventions for increasing vaccination rates, including client education, client reminders, client education plus reminders, provider education, and provider reminders. These interventions have been widely implemented across various health systems and incorporate digital tools such as mobile phone messaging, applications, websites, and social media platforms. Their effectiveness in improving vaccination uptake has been well-documented14,15,16,17,22,25,26. These methods have been rigorously tested through Randomized Clinical Trials (RCTs)34,35,36,37,38,39,40,41,42,43, and although the results are promising, the implementation of guidelines for health promotion practice presents challenges. Specifically, these challenges arise from the lack of a direct meta-analytic comparison of these five key interventions, complicating the clear assessment of their individual effectiveness.
Here we present a systematic review and meta-analysis with the primary objectives to: (1) obtain a comprehensive estimate of effect sizes for digital client education (i.e., website, social media, or texting), client reminder (i.e., SMS, email, or both), the combination of client education and reminder, provider education (i.e., webinar or email), and provider reminder (i.e., electronic medical records or texting); (2) determine which of these five digital interventions significantly increase HVU; and (3) compare the magnitudes of increasing HVU produced by each digital intervention type. The secondary objective is to identify independent variables associated with digital intervention efficacy for promoting HVU. This data can enhance a customized digital intervention strategy and inform future research.
Results
Study selection and characteristics
Studies
We selected 1087 titles and abstracts for initial review. We selected 210 articles for full review. One hundred and seventy-six articles did not meet inclusion criteria (e.g., nonrandomization, ineligible intervention method) and were eliminated. Ultimately, we analyzed 34 unique studies (Supplementary Table 1) and calculated 41 effect sizes (6 articles had multiple intervention arms). Of these 41 effect sizes, 11 evaluated client education interventions, 9 evaluated client reminder interventions, 9 evaluated the combination of client education and reminder interventions, 4 evaluated provider education interventions, and 8 evaluated provider reminder interventions. Figure 1 displays the PRISMA study selection flowchart.
Participants
A total of 281,280 unique participants were drawn from the 34 included studies27,32,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65. Twenty-five studies were conducted on parents and/or adolescents (73.5%), while the remaining studies were conducted on healthcare providers. Thirteen studies only included women, while three only included men. In all studies, the mean age of participants was 15 (range: 9–45). All included studies were conducted in high-income countries (k = 28 for the United States, k = 1 for Australia, k = 1 for Israel, k = 1 for the Netherlands, and k = 1 for Japan) and an upper-middle income country (k = 2 for China).
Intervention and control conditions
The average duration of interventions was 8 months (range, 1–24). Concerning control conditions, 23 studies (66.7%) utilized usual care or no intervention, while 11 studies (32.3%) utilized an attention or education control. Five studies on client education examined client education via website, three DVDs or Videos, one Facebook, and one email or SMS. Seven studies on client reminders evaluated SMS, email, autodialed phone, or Facebook messenger, and two evaluated an electronic health record alert system. Four combined intervention studies (client education plus client reminder) tested SMS or email, two websites, and two mobile applications. Two studies on provider education examined provider education via webinar and website. An electronic health record reminder system was evaluated in five provider reminder studies. Twenty-eight studies employed a traditional 2-arm RCT design (i.e., intervention vs. control), five studies employed a 3-arm RCT design (i.e., intervention 1 vs. intervention 2 vs. control), and one study employed a 4-arm RCT design (i.e., intervention 1 vs intervention 2 vs intervention 3 vs control). The primary outcomes of the 30 included studies were vaccine initiation, whereas the primary outcomes of the remaining studies (k = 4) were vaccine series completion. The majority (k = 27) of primary study outcomes utilized provider-validated measures or electronic medical records that were evaluated at baseline and post-assessment. Supplementary Table 1 provides a comprehensive summary of all studies included.
Quality of studies
Supplementary Figs. 1, 2 presents the methodological quality of the 34 included studies. Overall, no study satisfied all ROB 2.0 criteria and was deemed low risk for all five domains. More than half of the studies were judged as having some concerns as there were issues with the randomization process and deviation from the intended intervention. Twelve trials failed to provide information on the generation and concealment of random allocation sequences. Nine studies lacked information regarding blinding of participants and interventionists. Due to the nature of certain interventions, it was not possible to blind interventionists. Such occurrences in clinical trials were viewed as contextual deviations that were unlikely to affect trial outcomes. The ROB 2.0 algorithm determined that these trials posed a low risk of bias.
Main results
Vaccination uptake by intervention type
We found significant increase in HVU (odds ratio [OR], 1.25; 95% CI, 1.16–1.34; P < 0.001; I2 = 57%) across all 41 comparisons from 34 studies, including all 5 intervention types (i.e., client education [k = 11], client reminder [k = 9], client education plus reminder [k = 9], provider education [k = 4], and provider reminder [k = 8]). Studies that intervened with client reminder demonstrated the largest overall improvements in HVU, with significant effects (OR, 1.41; 95% CI, 1.23–1.63; P < 0.001; I2 = 42%). Studies using provider reminder interventions exhibited similar improvements in HVU (OR, 1.39; 95% CI, 1.11–1.75; P = 0.005; I2 = 59%). Studies that delivered the combination of client education plus reminder interventions also exhibited similar improvements in HVU (OR, 1.29; 95% CI, 1.04–1.59; P = 0.007; I2 = 50%). Provider education interventions yielded significant but small improvements in HVU (OR, 1.18; 95% CI, 1.05–1.34; P = 0.007; I2 = 0%). Client education interventions yielded non-significant improvements in HUV (OR, 1.08; 95% CI, 0.92–1.28; P = 0.35; I2 = 15%). Comparisons across all 5 intervention types revealed that client reminder, client education plus reminder, provider education, and provider reminder interventions produced significantly greater improvements in HVU compared with client education interventions. (Fig. 2 and Supplementary Fig. 3 depict forest plots).
Independent variables associated with intervention effectiveness
We tested whether each of 8 variables listed in the Methods section was associated with the effectiveness of all 5 intervention types for improving HVU per their effect sizes (for all data and P values, see Table 1). Results suggest that intervention effectiveness is associated with 2 variables: gender (only female, only male, or mixed), and digital platform used. Although improvements in HVU were reported by both genders, studies targeting only male or mixed gender participants reported the greater benefit. Reminder platforms (SMS, preference reminders, or electronic health record alert) had a greater impact on increasing HVU compared to education platforms (website, webinar, or Facebook) alone.
The following variables were not associated with intervention effectiveness: age group, intervention targets (patients, parents, or providers), intervention site (clinic or non-clinic), vaccination uptake outcome (initiation and completion), minority participants, or type of control conditions. Patients of all ages equally experienced improvements in HVU. Interventions targeting patients, parents or providers were equally effective for increasing HVU. However, the combination of parents plus provider intervention target was most effective. Participants were also equally likely to report improvements in HVU regardless of intervention site, vaccination uptake outcome, minority participants, and type of control conditions.
Small study effects and publication bias
Visual inspection of the funnel plot (Fig. 3) showed no evidence for publication bias. Distribution of effect sizes was fairly symmetrical. Most effect sizes fell in the funnel; effect sizes falling outside the funnel did so symmetrically. Egger’s regression intercept test was statistically significant (intercept = 1.35, 95% CI 0.78–1.92, p < 0.001). It suggests that publication bias may be influencing the observed results. The Duval and Tweedie’s trim and fill procedure was conducted to assess publication bias. Fourteen missing studies were imputed during the analysis to account for potential bias. The pooled odds ratio for the included studies was 1.14 (95% CI 1.09–1.18), indicating a significant association. After adjustment with imputed studies, the odds ratio was slightly attenuated to 1.08 (95% CI: 1.03–1.12). No evidence of a small study effect was observed, and the effect of the interventions remained statistically significant after adjusting for potential publication bias. In conclusion, although the visual inspection of the funnel plot showed no evidence of publication bias and a symmetrical distribution of effect sizes, the statistically significant result of Egger’s regression intercept test suggests the influence of publication bias. However, after conducting the Duval and Tweedie’s trim and fill procedure, the adjusted analysis yielded a slightly attenuated odds ratio, while maintaining statistical significance. Although publication bias may have affected the observed results, no evidence of a small study effect was found.
Discussion
This meta-analysis is, to our knowledge, the most comprehensive and rigorous examination to date of the efficacy of digital interventions in promoting HVU. This meta-analysis is also the first to calculate odds ratios across 34 RCTs investigating the efficacy of the five most common intervention categories for promoting vaccination uptake. Our findings indicate that digital interventions are effective in promoting HVU. Specifically, client reminder, client education plus reminder, provider education, and provider reminder digital interventions are beneficial in promoting HVU, whereas client education strategies studied to date are ineffective.
The magnitude of our effects, particularly for reminder interventions (OR = 1.41 for client reminder and OR = 1.39 for provider reminder), is not substantially different from the effect sizes identified in meta-analyses of face-to-face clinic-based (OR = 1.14) or school-based (OR = 1.46) interventions for promoting HVU66. These similarities suggest that digital and face-to-face interventions might be similar in their effectiveness.
Client education without reminder system did not improve HVU, which is consistent with findings from the literature on face-to-face interventions. For example, Ampofo and colleagues reported no association between school-based education interventions and HVU in a small meta-analysis of interventions67. Similarly, Mohamed and colleagues investigated the idea that parent reminder interventions might be more effective in increasing HVU than non-reminder parental interventions in a subgroup analysis68. They examined 13 RCTs and found a statistically significant increase in HVU of 19% for studies that included reminders (e.g., postal, telephone, and digital reminders) but no statistically significant difference for education interventions that did not include reminders. We hypothesized that improving HPV vaccination knowledge and attitude is not directly linked to HPV vaccination behavior. There are likely to be differences in the composition of HPV vaccination behavior in direct and indirect studies that might affect these findings. This finding is also comparable to that of a previous meta-analysis focusing primarily on early childhood vaccination uptake that found that reminder systems were efficacious for improving vaccination uptake17. The present meta-analysis however, conducted separate meta-analyses for digital interventions specific to HPV vaccination and found that reminder interventions were more effective than education interventions. Hence digital reminders are recommended for use in primary care to improve HVU.
Moreover, we found that client reminder and client education did not have an additive impact on HVU; their combined use was not associated with a greater increase HVU than the use of client reminder alone. These combinations could be counterproductive owing to insufficient reminder prescriptions and added complexity and time demands leading to reduced adherence. The effect of education intervention for increasing vaccination uptake was driven by two factors: (a) the study occurring in a low- and middle-income country (LMIC) and (b) parents having a discussion with a professional expert, rather than receiving self-directed information67. The characteristics of the participants (conducted in high income countries) and education interventions (almost all are self-directed) reported in the included studies may explain the non-significant effect of digital education interventions. Interventions that raise the basic level of parental knowledge are therefore more effective in areas where understanding and awareness is low compared to countries where it is comparatively higher and educational barriers to HPV vaccination may be more subtle and linked to vaccine belief23,26,67. The utility of educational strategies within standard practice may be further questioned when examined alongside the results of trials that provided parents with both vaccination education and reminders. This finding has implications for policy as it suggests that reminder systems may be sufficient facilitators of HPV vaccination uptake.
The identification of family-level factors associated with digital intervention effectiveness on promoting HVU can help to streamline the vaccination promotion strategies by prioritizing for or matching interventions to those who will benefit most from digital interventions. Similarly, identifying program-level factors helps to highlight the barriers and components of the interventions that are important for effectiveness, and thus can inform and improve the future development and delivery of digital interventions. This meta-analysis is the first to demonstrate that the effectiveness of digital vaccination promotion interventions is related to one family-level factor (gender) and one program-level factor (digital platform). Studies targeting only male participants reported the greatest benefit. It may be that digital education and reminder interventions are as relevant for the unique challenges faced by male adolescents and parents of male adolescents (lower knowledge and awareness)69. Interventions were more effective for increasing HVU when delivered using reminder platforms (SMS, preference reminders, or electronic health record alert). It has been suggested that educational platforms are not as important for digital intervention effectiveness as it is for face-to-face vaccination promotion intervention, and that reminder platform may be sufficient for digital interventions. However, it is possible that certain program-level factors only moderate digital intervention effects for certain family-level factors, thus necessitating a further analysis of their interplay.
The non-significance of target (patients, parents or providers) as a moderator indicates that even digital interventions specifically designed for adolescent’s needs and/or improve parent or provider awareness have a benefit of promoting HVU. Future research is warranted to examine the potential pathways, including whether increasing awareness of providers may lead to increase vaccination uptake and/or whether increases in patient’s awareness may increase provider vaccine prescription. Digital interventions did not yield significant effects if the interventions targeted on children through young adults (9–26 years), suggesting that more specific intervention target, such as children or adolescents, should be developed.
Although our study primarily focused on the efficacy of digital interventions, it is important to consider the cost-effectiveness of implementing these strategies. Some studies have suggested that digital interventions, particularly those involving client reminders and provider reminders, can be more cost-effective than traditional, face-to-face interventions70. Digital reminders can reduce costs associated with printing and mailing, and can be more easily scaled up for large populations. Furthermore, provider reminders that leverage electronic health record systems can be integrated into existing workflows with minimal additional investment71. However, we recommend future research to conduct a comprehensive cost-effectiveness analysis of these digital interventions for promoting HVU, to better inform policy decisions and healthcare system integration.
Our study highlights some limitations that must be considered. There was considerable variation in the control groups used across the studies, with some employing usual controls and others using specific attention control conditions. This variation has led to greater differences between the studies, complicating direct comparisons. Furthermore, there is an evident disparity in intervention approaches, delivery techniques, and vaccination uptake measurement methods, though the less than 50% heterogeneity in vaccination uptake somewhat mitigates this concern. Most of the included studies focused on high-income countries, leaving a gap in understanding the effectiveness of digital interventions in low- and middle-income regions. This underscores an important gap in knowledge and points toward the necessity for further exploration in diverse geographic contexts. Additionally, the lack of studies assessing outcomes beyond a 2-year post-intervention period highlights the need for long-term evaluations.
Future studies of digital interventions to promote HVU might standardize outcome measures to compare with other interventions, and trial longitudinal designs. Large implementation trials that iteratively test models of user engagement in real-world settings are now needed to accelerate growth in this area. At scale, such trials can examine factors that mediate efficacy, to understand the conditions required to optimize the potency of these interventions.
Digital interventions with client reminder systems showed the largest overall improvements in HVU. Provider reminder interventions also exhibited substantial improvements in HVU. While other interventions like client education plus reminder and provider education showed significant improvements in HVU as well, the magnitude of their effects was comparatively smaller. The results suggest that client reminder and provider reminder interventions may be the most effective types of digital interventions for promoting HVU. We recommend that digital interventions with reminder system can, and should, be promoted and integrated into healthcare systems. However, there is also the need to extend and test their use in LMICs. This meta-analysis further indicates that client education intervention might be less effective than the other types of digital interventions for increasing HVU, raising important questions about the generalizability of vaccine education intervention in cancer prevention and the mechanisms underlying change.
Methods
This systematic review protocol was registered in the PROSPERO database (CRD42023389004), and the review findings were conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta Analyses (PRISMA) guidelines72 and the Cochrane Handbook for Systematic Reviews of Interventions73.
Eligibility criteria
We included peer-reviewed articles published in English that met the PICOS strategy eligibility criteria:
Population (P): The study population consisted of children, adolescents, and young adults aged 9 to 26 who were eligible for the WHO-recommended HPV vaccine, as well as their parents or healthcare providers.
Intervention (I): The intervention intended to utilize digital technologies (e.g., SMS, Email, DVD, website, webinar, application) to remind or educate clients (children, adolescents, and young adults and/or parents) or healthcare providers about HPV vaccination. These interventions were designed and implemented with the specific intent of promoting HVU.
Comparison (C): Eligible studies were required to employ a control group, such as the usual condition or an alternative control. The meta-analysis excluded studies with only two digital interventions and no control group (i.e., non-inferiority trials).
Outcome (O): The studies examined the influence of digital interventions on HVU, including vaccination initiation and completion. We defined initiation as receiving a minimum of one dose of the HPV vaccine. We defined completion as receiving all of the recommended vaccine doses. Self-report (i.e., parent or patient) and provider-verified vaccination status were both acceptable methods for assessing vaccination coverage (i.e., medical records, immunization registries). Studies that provided only knowledge, attitudes, or intentions regarding HPV vaccination were excluded.
Study design (S): The studies were randomized controlled trials (RCTs).
Search strategy
In January 2023, a systematic literature search was completed in PubMed, PsycInfo, Web of Science, and Cochrane Central Register of Controlled Trials. We used key words relating to (i) digital intervention (SMS, Email, DVD, website), (ii) HPV vaccine (e.g., HPV, cervical cancer vaccine) and (iii) vaccination uptake (e.g., initiation, completion, coverage). (search string for PubMed Supplementary Methods).
Study selection
We examined the reference lists or relevant systematic reviews and primary studies that were identified. Titles and abstracts of retrieved reports were screened in Rayyan, independently by NC and TT to identify potentially eligible studies (90% overlap; disagreements resolved through discussion). The full-texts of these potentially eligible studies were independently assessed for meeting the criteria by research assistant, NC, and TT (85% overlap; disagreements resolved through discussion).
Data extraction
For each study, we extracted information regarding (i) general study characteristics (e.g., year of publication), (ii) intervention characteristics (e.g., whether the intervention was client education, client reminder, provider education, or provider reminder), (iii) sample characteristics (e.g., children’s age), and (iv) data for calculation of effect sizes (i.e., sample size, vaccination uptake for both groups). In instances where studies reported both intention-to-treat and per-protocol analyses, we utilized the intention-to-treat data due to its inherent advantages in preserving the randomized treatment assignment and accounting for potential deviations from the protocol. By including all participants as originally assigned, regardless of adherence or protocol violations, intention-to-treat analysis provides a more conservative and unbiased estimate of treatment effects. Before entering data into statistical software, sample sizes for cluster sampling studies were reduced using the reported design effect and intracluster correlation coefficient74. Microsoft Excel was used to organise extracted data from included studies. All data items were coded by research assistant, NC, and TT with excellent reliability (84% to 100% agreement; mean per item 95%). If data was not retrievable from publication, study authors were contacted for clarification.
Statistical analysis
We calculated the effect size OR, 95% confidence interval (95%CI), and P-value (P) for each comparison based on the post-assessment HVU (vaccination initiation or vaccine series completion) representing the difference between the two groups (digital intervention group versus control group) at post-assessment. Due to the anticipated heterogeneity between trials, a random effects model was used for all analyses. If trials were multi-armed and reported two comparisons to one, the sample size was divided to avoid inflating the power. Specifically, half of the total sample size was allocated to the control arm, while the remaining half was evenly distributed among the two comparison arms. This approach ensures unbiased estimation of treatment effects and is commonly employed in meta-analyses to account for the unbalanced nature of such trials73.
We log transformed the ORs, combined them using random-effects meta-analysis, and then exponentiated the pooled result to yield a pooled OR. Statistical heterogeneity was reported using the I2 statistic. We tested if findings were different if we only included trials providing client education, client reminder, the combination of client education plus reminder, provider education, provider reminder75 by using subgroup analysis. The subgroup analyses were conducted according to the mixed-effect model, in this model subgroups are pooled with the random-effects model while tests for significant differences between subgroups are conducted with the fixed-effects model. We included all relevant effect sizes and dealt with their dependency by conducting meta-analysis in Comprehensive Meta-Analysis Software (CMA) 3.076. We conducted subgroup analyses using the CMA software, which allows for the exploration of differences in effect sizes across subgroups. This approach involves conducting separate meta-analyses within each subgroup and comparing the results to assess potential subgroup effects. The CMA software allowed us to conduct separate meta-analyses for each selected effect size, while appropriately handling the dependency between effect sizes from the same study. CMA software includes a robust method to address the presence of multiple effect sizes per study and deals with the dependency among these effect sizes during the meta-analysis process. We ensured that all relevant effect sizes were included and appropriately accounted for their dependencies.
Quality assessment
Two authors (TT and NC) independently used Cochrane’s Risk of Bias (ROB) 2.0 tool77 for assessing risk of bias to assess included RCTs and their respective protocols and trial registry records for risk of bias in five domains: (1) bias arising from the randomization process, (2) bias due to deviations from intended interventions, (3) bias due to missing outcome data, (4) bias in measurement of the outcome and (5) bias in selection of the reported result. The ROB 2.0 tool employs a comprehensive and standardized algorithm that considers specific criteria within each domain to calculate the overall risk of bias. Disagreements between the authors were resolved through discussion. We assessed publication bias by visually examining a funnel plot for the main outcome and conducting Egger’s test78,79. To obtain an estimation of the pooled effect when accounting for missing studies, the Duval and Tweedie trim-and-fill analysis was performed in ref. 79.
Reporting summary
Further information on research design is available in the Nature Research Reporting Summary linked to this article.
Data availability
The data used in this meta-analysis are available upon request. Researchers interested in accessing the data can contact us via email. We are committed to promoting transparency and facilitating further research in the field of HPV vaccination uptake. Therefore, we welcome inquiries regarding the data used in this study and will provide the requested information to the best of our ability.
References
Cohen, P. A., Jhingran, A., Oaknin, A. & Denny, L. Cervical cancer. Lancet 393, 169–182 (2019).
Sung, H. et al. Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA Cancer J. Clin. 71, 209–249 (2021).
Brüggmann, D. et al. Global cervical cancer research: A scientometric density equalizing mapping and socioeconomic analysis. PLoS One 17, e0261503–e0261503 (2022).
Bennett, C. et al. Which interventions improve HPV vaccination uptake and intention in children, adolescents and young adults? An umbrella review. Sex. Transm. Infect. 98, 599–607 (2022).
Rahangdale, L., Mungo, C., O’Connor, S., Chibwesha, C. J. & Brewer, N. T. Human papillomavirus vaccination and cervical cancer risk. BMJ. 379, e070115–e070115 (2022).
Singh, D. et al. Global estimates of incidence and mortality of cervical cancer in 2020: a baseline analysis of the WHO Global Cervical Cancer Elimination Initiative. Lancet Glob. Health 11, e197–e206 (2023).
Bruni, L. Global estimates of human papillomavirus vaccination coverage by region and income level: a pooled analysis. Lancet Glob. Health 4, e453–e463 (2016).
Loke, A. Y., Kwan, M. L., Wong, Y. & Wong, A. K. Y. The uptake of human papillomavirus vaccination and its associated factors among adolescents: a systematic review. J. Prim. Care Community Health 8, 349–362 (2017).
Gallagher, K. E. et al. Human papillomavirus (HPV) vaccine coverage achievements in low and middle-income countries 2007–2016. Papillomavirus Res. 4, 72–78 (2017).
Gallagher, K. E., LaMontagne, D. S. & Watson-Jones, D. Status of HPV vaccine introduction and barriers to country uptake. Vaccine 36, 4761–4767 (2018).
Fullman, N. et al. Measuring routine childhood vaccination coverage in 204 countries and territories, 1980–2019: a systematic analysis for the Global Burden of Disease Study 2020, Release 1. Lancet 398, 503–521 (2021).
Davies, C. et al. Effect of a school-based educational intervention about the human papillomavirus vaccine on psychosocial outcomes among adolescents analysis of secondary outcomes of a cluster randomized trial. JAMA Netw. Open 4, e2129057–e2129057 (2021).
Cory, L. et al. Effects of educational interventions on human papillomavirus vaccine acceptability: a randomized controlled trial. Obstet. Gynecol. 134, 376–384 (2019).
Mavundza, E. J. et al. A systematic review of interventions to improve HPV vaccination coverage. Vaccines (Basel) 9, 687 (2021).
Fu, L. Y., Bonhomme, L., Cooper, S. C., Joseph, J. G. & Zimet, G. D. Educational interventions to increase HPV vaccination acceptance: a systematic review. Vaccine 32, 1901–1920 (2014).
Jacobson Vann, J. C., Jacobson, R. M., Coyne-Beasley, T., Asafu-Adjei, J. & Szilagyi, P. G. Patient reminder and recall interventions to improve immunization rates. Cochrane Database Syst. Rev. 1, CD003941–CD003941 (2018).
Harvey, H., Reissland, N. & Mason, J. Parental reminder, recall and educational interventions to improve early childhood immunisation uptake: A systematic review and meta-analysis. Vaccine 33, 2862–2880 (2015).
Mantzari, E., Vogt, F. & Marteau, T. M. Financial incentives for increasing uptake of HPV vaccinations: a randomized controlled trial. Health Psychol. 34, 160–171 (2015).
Forster, A. S. et al. A cluster randomised feasibility study of an adolescent incentive intervention to increase uptake of HPV vaccination. Br. J. Cancer 117, 1121–1127 (2017).
Gualano, M. R., Stillo, M., Mussa, M. V. & Zotti, C. M. Cross sectional study investigating the differences in knowledge and behaviors about HPV between vaccinated and non-vaccinated girls. J. Prev. Med. Hyg. 57, E121–E127 (2016).
Karafillakis, E. et al. HPV vaccination in a context of public mistrust and uncertainty: a systematic literature review of determinants of HPV vaccine hesitancy in Europe. Hum. Vaccin. Immunother. 15, 1615–1627 (2019).
Guzman-Holst, A., DeAntonio, R., Prado-Cohrs, D. & Juliao, P. Barriers to vaccination in Latin America: A systematic literature review. Vaccine 38, 470–481 (2020).
Alarcão, V. & Zdravkova, B. Attitudes and practices towards HPV vaccination and its social processes in Europe: an equity-focused scoping review. Societies (Basel) 12, 131 (2022).
Parsons, J. E., Newby, K. V., French, D. P., Bailey, E. & Inglis, N. The development of a digital intervention to increase influenza vaccination amongst pregnant women. Digit. Health 7, 20552076211012128–20552076211012128 (2021).
Oh, S. S. et al. Effectiveness of digital interventions for preventing alcohol consumption in pregnancy: systematic review and meta-analysis. J. Med. Internet Res. 24, e35554–e35554 (2022).
Atkinson, K. M. et al. Effectiveness of digital technologies at improving vaccine uptake and series completion – A systematic review and meta-analysis of randomized controlled trials. Vaccine 37, 3050–3060 (2019).
Shegog, R. et al. AVPCancerFree: Impact of a digital behavior change intervention on parental HPV vaccine -related perceptions and behaviors. Hum. Vaccin. Immunother. 18, 2087430–2087430 (2022).
Eze, P., Agu, S. A., Agu, U. J. & Acharya, Y. Acceptability of mobile-phone reminders for routine childhood vaccination appointments in Nigeria - a systematic review and meta-analysis. BMC Health Serv. Res. 21, 1–1276 (2021).
Mekonnen, Z. A., Gelaye, K. A., Were, M. C., Gashu, K. D. & Tilahun, B. C. Effect of mobile text message reminders on routine childhood vaccination: a systematic review and meta-analysis. Syst. Rev. 8, 154–154 (2019).
Chaudhry, R. et al. Improving rates of herpes zoster vaccination with a clinical decision support system in a primary care practice: improved herpes zoster vaccination rate. J. Eval. Clin. Pract. 19, 263–266 (2013).
Chen, J. et al. Development, implementation, and evaluation of a personalized machine learning algorithm for clinical decision support: case study with shingles vaccination. J. Med. Internet Res. 22, e16848–e16848 (2020).
Zimmerman, R. K. et al. Improving adolescent HPV vaccination in a randomized controlled cluster trial using the 4 Pillars™ practice Transformation Program. Vaccine 35, 109–117 (2016).
Kaufmann, J. et al. Association of parent influenza vaccination and early childhood vaccinations using linked electronic health record data. Vaccine 40, 7097–7107 (2022).
Suzuki, Y. et al. The effect of a web-based cervical cancer survivor’s story on parents’ behavior and willingness to consider human papillomavirus vaccination for daughters: randomized controlled trial. JMIR Public Health Surveill. 8, e34715–e34715 (2022).
Hopfer, S. Effects of a narrative HPV vaccination intervention aimed at reaching college women: a randomized controlled trial. Prev. Sci. 13, 173–182 (2012).
Kempe, A. et al. Parental choice of recall method for HPV vaccination: a pragmatic trial. Pediatrics 137, e20152857–e20152857 (2016).
Rand, C. M., Vincelli, P., Goldstein, N. P. N., Blumkin, A. & Szilagyi, P. G. Effects of phone and text message reminders on completion of the human papillomavirus vaccine series. J. Adolesc. Health 60, 113–119 (2016).
Rand, C. M. et al. Effectiveness of centralized text message reminders on human papillomavirus immunization coverage for publicly insured adolescents. J. Adolesc. Health 56, S17–S20 (2015).
Pot, M. et al. Effectiveness of a web-based tailored intervention with virtual assistants promoting the acceptability of HPV vaccination among mothers of invited girls: randomized controlled trial. J. Med. Internet Res. 19, e312–e312 (2017).
Richman, A. R., Maddy, L., Torres, E. & Goldberg, E. J. A randomized intervention study to evaluate whether electronic messaging can increase human papillomavirus vaccine completion and knowledge among college students. J. Am. Coll. Health 64, 269–278 (2016).
Richman, A. R. et al. Text and email messaging for increasing human papillomavirus vaccine completion among uninsured or medicaid-insured adolescents in rural eastern North Carolina. J. Health Care Poor Underserved 30, 1499–1517 (2019).
Dixon, B. E. et al. An educational intervention to improve HPV vaccination: a cluster randomized trial. Pediatrics 143, e20181457 (2019).
Zimet, G. et al. Simple and elaborated clinician reminder prompts for human papillomavirus vaccination: a randomized clinical trial. Acad. Pediatr. 18, S66–S71 (2018).
Bennett, A. T. et al. Human papillomavirus vaccine uptake after a tailored, online educational intervention for female university students: a randomized controlled trial. J. Womens Health (Larchmt) 24, 95–957 (2015).
Chodick, G. et al. The impact of a Facebook campaign among mothers on HPV vaccine uptake among their daughters: a randomized field study. Gynecol. Oncol. 160, 106–111 (2021).
Dempsey, A. F. et al. Effect of a health care professional communication training intervention on adolescent human papillomavirus vaccination: a cluster randomized clinical trial. JAMA Pediatr. 172, e180016–e180016 (2018).
Dempsey, A. F., Maertens, J., Sevick, C., Jimenez-Zambrano, A. & Juarez-Colunga, E. A randomized, controlled, pragmatic trial of an iPad-based, tailored messaging intervention to increase human papillomavirus vaccination among Latinos. Hum. Vaccin. Immunother. 15, 1577–1584 (2019).
DiClemente, R. J., Murray, C. C., Graham, T. & Still, J. Overcoming barriers to HPV vaccination: A randomized clinical trial of a culturally-tailored, media intervention among African American girls. Hum. Vaccin. Immunother. 11, 2883–2894 (2015).
Fiks, A. G. et al. Effectiveness of decision support for families, clinicians, or both on HPV vaccine receipt. Pediatrics 131, 1114–1124 (2013).
Gerend, M. A. et al. Evaluation of a text messaging-based human papillomavirus vaccination intervention for young sexual minority men: results from a pilot randomized controlled trial. Ann. Behav. Med. 55, 321–332 (2021).
Gilkey, M. B. et al. Increasing provision of adolescent vaccines in primary care: a randomized controlled trial. Pediatrics 134, e346–e353 (2014).
Harry, M. L. et al. Human Papillomavirus vaccination clinical decision support for young adults in an upper midwestern healthcare system: a clinic cluster-randomized control trial. Hum. Vaccin. Immunother. 18, 2040933–2040933 (2022).
Henrikson, N. B. et al. Outreach and reminders to improve human papillomavirus vaccination in an integrated primary care system. Clin. Pediatr. 57, 1523–1531 (2018).
Kim, M. M. et al. A storytelling intervention in a mobile, web-based platform: a pilot RCT to evaluate the preliminary effectiveness to promote HPV vaccination in Korean American college women. Health Educ. Behav. 47, 258–263 (2020).
Lee, H. et al. Using narrative intervention for HPV vaccine behavior change among Khmer mothers and daughters: a pilot RCT to examine feasibility, acceptability, and preliminary effectiveness. Appl. Nurs. Res. 40, 51–60 (2018).
Patel, A. et al. Staying on track: A cluster randomized controlled trial of automated reminders aimed at increasing human papillomavirus vaccine completion. Vaccine 32, 2428–2433 (2014).
Reiter, P. et al. Increasing human papillomavirus vaccination among young gay and bisexual men: a randomized pilot trial of the outsmart HPV intervention. LGBT Health 5, 325–329 (2018).
Suh, C. A. et al. Effectiveness and net cost of reminder/recall for adolescent immunizations. Pediatrics 129, e1437–e1445 (2012).
Szilagyi, P. G. et al. Effect of provider prompts on adolescent immunization rates: a randomized trial. Acad. Pediatr. 15, 149–157 (2015).
Szilagyi, P. G. et al. Effect of training pediatric clinicians in human papillomavirus communication strategies on human papillomavirus vaccination rates: a cluster randomized clinical trial. JAMA Pediatr. 175, 901–910 (2021).
Tiro, J. A. et al. Promoting HPV vaccination in safety-net clinics: a randomized trial. Pediatrics 136, 850–859 (2015).
Tull, F. et al. Short message service reminders to parents for increasing adolescent Human Papillomavirus vaccination rates in a secondary school vaccine program: a randomized control trial. J. Adolesc. Health 65, 116–123 (2019).
Wang, Z. et al. Two web-based and theory-based interventions with and without brief motivational interviewing in the promotion of Human Papillomavirus vaccination among Chinese men who have sex with men: randomized controlled trial. J. Med. Internet Res. 23, e21465–e21465 (2021).
Woodall, W. G. et al. Vacteens.org: A mobile web app to improve HPV vaccine uptake. Front. Digit. Health 3, 693688–693688 (2021).
Zhang, X. et al. Impact of web-based health education on HPV vaccination uptake among college girl students in Western and Northern China: a follow-up study. BMC Womens Health 22, 46–46 (2022).
Siddiqui, F. A. et al. interventions to improve immunization coverage among children and adolescents: a meta-analysis. Pediatrics (Evanston) 149, S1 (2022).
Ampofo, A. G., Boyes, A. W., Khumalo, P. G. & Mackenzie, L. Improving knowledge, attitudes, and uptake of cervical cancer prevention among female students: A systematic review and meta-analysis of school-based health education. Gynecol. Oncol. 164, 675–690 (2022).
Mohamed, R., Kelly, K. M., Nili, M. & Kelley, G. A. A systematic review with meta-analysis of parental interventions for human papillomavirus vaccine uptake. J. Am. Pharm. Assoc. (2003) 62, 1142–1153 (2022).
Xie, L. et al. Knowledge, attitude, and perception regarding HPV-related diseases and vaccination among the general public in Guizhou Province of China. Vaccine 41, 1119–1131 (2023).
Jacob, V. et al. Economics of mass media health campaigns with health-related product distribution: a community guide systematic review. Am. J. Prev. Med. 47, 348–359 (2014).
Kawakatsu, Y., Oyeniyi Adesina, A., Kadoi, N. & Aiga, H. Cost-effectiveness of SMS appointment reminders in increasing vaccination uptake in Lagos, Nigeria: A multi-centered randomized controlled trial. Vaccine 38, 6600–6608 (2020).
Page, M. J. et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 372, n71–n71 (2021).
Cumpston, M. et al. Updated guidance for trusted systematic reviews: a new edition of the Cochrane Handbook for Systematic Reviews of Interventions. Cochrane Database Syst. Rev. 10, ED000142–ED000142 (2019).
Konnyu, K. J., Taljaard, M., Ivers, N. M., Moher, D. & Grimshaw, J. M. Imputing intracluster correlation coefficients from a posterior predictive distribution is a feasible method of dealing with unit of analysis errors in a meta-analysis of cluster RCTs. J. Clin. Epidemiol. 139, 307–318 (2021).
Borenstein, M. & Higgins, J. P. T. Meta-Analysis and Subgroups. Prev. Sci. 14, 134–143 (2013).
Borenstein, M. In: Egger, M. & Higgins, J. (eds). Smith Systematic Reviews in Health Research. John Wiley & Sons, Hoboken, NJ, 2022, pp. 535–548.
Sterne, J. A. C. et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ 366, l4898–l4898 (2019).
Mavridis, D. & Salanti, G. How to assess publication bias: funnel plot, trim-and-fill method and selection models. Evid. Based Ment. Health 17, 30–30 (2014).
Lin, L. & Chu, H. Quantifying publication bias in meta‐analysis. Biometrics 74, 785–794 (2018).
Acknowledgements
We would like to thank all of the authors we have contacted for their prompt and cordial assistance in providing original outcome data. This study was registered in the International Prospective Register of Systematic Reviews of the National Institute for Health Research (https://www.crd.york.ac.uk/prospero/) under the ID CRD42023389004. The authors received no specific funding for this work.
Author information
Authors and Affiliations
Contributions
N.C.: Methodology, Investigation, Data Curation, Writing – Original Draft, Writing – Review & Editing; T.T.: Conceptualization, Methodology, Investigation, Resources, Data Curation, Writing – Original Draft, Writing – Review & Editing, Project administration.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Chandeying, N., Thongseiratch, T. Systematic review and meta-analysis comparing educational and reminder digital interventions for promoting HPV vaccination uptake. npj Digit. Med. 6, 162 (2023). https://doi.org/10.1038/s41746-023-00912-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41746-023-00912-w
- Springer Nature Limited