Background

The human papillomavirus (HPV) is the most common infection that can lead to cancer later in life. There are 570,000 incident cancer cases per year in females and 60,000 incident cancer cases in males attributable to HPV globally [1].HPV can lead to cancers of the cervix, vagina, and vulva for females, penis cancer for males, and anus and oropharyngeal cancers for both [1]. The World Health Organization has a vision to eliminate HPV-related cancers, particularly cervical cancer, worldwide by 2030 [2]. Similarly, in the U.S., Healthy People 2030 has an objective to increase the proportion of adolescents who receive recommended doses of the HPV vaccine from a baseline of 48.0% to 80.0% [3].

HPV vaccination can prevent more than 90% of cancers due to HPV infections [4, 5]. Vaccination starts at age 9 and the catch up is recommended through age 26. If not adequately vaccinated, persons up to the age of 45 can be considered for vaccination but with shared decision-making between the patient and provider [6]. Primary prevention is from ages 9–14 globally [7]. The HPV vaccine is commonly recommended during routine vaccinations to children ages 11–12 and there is a push from public health professionals and providers to start as early as 9 in the U.S [8]. Globally, an estimated 15% of girls are fully vaccinated against HPV [9]. In the U.S., about 58.5% of adolescents were up-to-date on HPV vaccination in 2020, with 61% of females being fully vaccinated versus 56% of males [10]. Public health efforts are needed to increase the global rates of HPV vaccination.

Worldwide, there have been a few reviews of interventions focused on improving HPV vaccination rates [11,12,13,14,15]. Interventions to promote HPV vaccination have typically targeted parents, adolescents, young adults, and providers.. HPV vaccination interventions have targeted various socio-ecological levels that influence HPV vaccination to ultimately effect change. Some focus only on the individual level (e.g., via education such as informational text included with reminders), whereas others may include changes to policy (e.g., via formalized requirements, such as school mandates). Multi-level and multi-component interventions are increasingly used [12, 13, 15] and address health disparities [16, 17]. Multi-level interventions target two or more levels of influence at or around the same time; the approaches implemented at each level typically may vary in type (e.g., behavioral, health systems, or policy) [16, 18]. It is important to understand the wide range of levels that can be utilized in interventions from single-level to multi-level and how those levels can impact the desired outcome of vaccination.

This study aimed to conduct a systematic review of HPV interventions by synthesizing literature published from May 2015 to March 2020, related to promoting HPV vaccine uptake and/or completion in the U.S and internationally. A previous systematic review and meta-analysis in the United States found a combination of provider- and community-level interventions were effective [11]. Our review was intended to update this review of interventions for HPV vaccine promotion with more rigorous methodology, including exploration of sources of heterogeneity and quality assessment. Another purpose of the study was to improve the understanding of multi-level interventions for HPV vaccine promotion. The review questions included: 1) What are the targeted audiences and levels of intervention for HPV vaccination interventions?, 2) What are common components of the interventions?, 3) What were facilitators and barriers to implementation of the vaccination interventions?, and 4) What are the study outcomes measured including the rates of HPV vaccination initiation and completion and their effectiveness? Our resulting study provides a strong contribution to the literature that can be used to inform future promotion efforts that aim to increase HPV vaccine uptake.

Methods

We conducted a systematic review of the peer-reviewed published literature, using methods following the PRISMA guidelines [19]. The team included cancer control researchers and master’s and doctoral students in public health and nursing fields.

Search strategy

The lead author, in collaboration with a health sciences librarian, created a search strategy using text and MeSH terms (Supplemental Table 1). We searched for relevant articles in six bibliographic databases, including Medline, CINAHL, Embase, Web of Science, Cochrane Reviews, and SCOPUS. Some of the keywords searched alone or in combination were children, pediatric, young adult, parent, behavioral therapy, prevention, and human papilloma virus. An additional manual search was performed of the bibliographies of relevant studies identified from the database search. The team reviewed the articles found in the search and removed duplicates.

Inclusion criteria

To be included in the review, an article had to: a) aim to increase HPV vaccination through at least one intervention; b) report an outcome based on the intervention (e.g., increase knowledge of HPV, report on HPV vaccine outcomes determined either by self-report or medical records; c) be published between May 2015 through March 2020; and d) be published in English. Studies that tested single or multi-level interventions were included. Screening was conducted in two stages with the initial stage evaluating titles and abstracts reviewed by 3 authors (CE, CA, and MD), and a second stage screening full text articles independently reviewed by the same 3 authors. Discrepancies were resolved through discussion at team meetings. Studies were excluded if they did not describe a primary intervention aimed at increasing HPV vaccination, were systematic reviews or articles with just a program description, or had no study outcomes. Those that met eligibility through abstract review were included in the full-text review. After the full article review, the articles were examined further to see if they met the eligibility criteria, and 33 were excluded.

Data extraction

We retrieved the full text of eligible studies for review and abstraction. We then created a detailed codebook for data collection. Data extraction tables for the article and quality assessment were developed and maintained in an Excel database. They were modified following discussions between three reviewers before data extraction. Data extracted included study location, target population, sample description, and setting; intervention details consisted of study design, description of the intervention (e.g., control group components, if applicable), level(s) of intervention, delivery and barriers to implementation and vaccination, and outcomes of the study. We piloted the forms with five studies and made refinements to the codebook and Excel database. We invited cancer and implementation science researchers from the Cancer Prevention and Control Research Network [20] and doctoral and MPH students from the participating institutions to be trained as data abstractors and abstract data from the final included articles. There were a total of 15 reviewers (CA, CP, CE, MD, SS, CB, MF, AE, LS, ED, GR, KY, SL, TV, and PM). For quality control, we had 2 abstractors for each study, and we merged the data when consensus was reached for each article. The abstractors also performed study quality assessment for the articles they abstracted. The pair of abstractors came to an agreement if there were discrepancies. If there was a disagreement or question about a study quality answer, then the core team (CA, CP, and CE) had a discussion and came to an agreement on the study quality question.

Quality assessment

For this assessment, we employed the NCI Quality Rating assessment for Pre and Posttest Designs to conduct quality assessment of the included articles [21]. This assessment included 12 items which included: whether the objectives, intervention, and eligibility requirements were clearly stated, had a sample adequate for confidence in the data, had a loss to follow-up of 20% or less, and measured changes in outcomes of interest before and after the intervention.

Synthesis of the results

We compiled all article abstractions into one database. We ran descriptive statistics and created summary scores for study setting and program component descriptions. The Community Guide categories (education, technology, vaccine access, incentive, provider education, health system change, community wide campaign, and policy) were used to organize the interventions into informational; behavioral change for participants, providers or both; or environmental (small-no government involvement such as organizational policy change or large policy-formal laws, rules or regulations, national or local government involvement). These categories also were applied in the Walling et al. systematic review [12]. We also created summary tables for study characteristics, outcomes, and quality ratings. The primary outcome was HPV vaccine initiation and/or completion, although we reported on other outcomes related to HPV vaccination determinants, or factors to increase vaccination (i.e., parental knowledge, awareness, self-efficacy, acceptability, attitudes and beliefs, and vaccine intention). We examined the range of HPV vaccine initiation and completion for adolescents and/or young adults.

Results

The search identified 1,201 studies after removing duplicates. As a result of the title and abstract screen, 1,045 studies were excluded due to not being an intervention study or not reporting outcomes. The full-text of the remaining 152 articles were reviewed, leading to the exclusion of an additional 72 articles that did not have descriptions of the intervention or outcome data. This resulted in 79 articles included in the review for data extraction (Fig. 1). Table 1 shows the main characteristics of the included studies published between 2015 and 2020.

Fig. 1
figure 1

HPV Vaccination intervention systematic review flowchart

Table 1 Summary characteristics of included studies

Study setting and design

Of the 79 intervention articles, 57 (72.2%) were conducted in the U.S. Other studies were conducted in Europe (n = 10, 12.7%), Africa (n = 4, 5.1%), Asia (3, 3.80%), Australia (3, 3.80%), Central/South America (1, 1.27%), and Canada (1, 1.27%). Forty-five studies (57.0%) employed an experimental design, 18 (22.8%) used a quasi-experimental design, and 16 (20.3%) employed a non-experimental design.

Setting and population focus

Intervention settings included clinics (32, 40.5%), schools (26, 32.9%), communities (10, 12.7%), an organization (1, 1.3%), a health insurance system, and online (10, 11.4%). Study samples ranged from 36 to 8,062.

Of the 79 studies, most interventions targeted adolescents only (39 studies, 49%) [22, 25, 27, 29, 31, 32, 34,35,36, 40, 43, 44, 46, 48, 50,51,52,53,54,55, 60,61,62,63,64,65, 68, 69, 72,73,74,75, 85, 90,91,92, 94, 98, 100], of which 15 (38%) included girls only, 17 (44%) included both boys and girls, 3 (8%) included boys only, and 4 (10%) did not report. Other interventions focused on young adults ages 18–34 years (20 studies, 25%) [22,23,24,25,26, 28, 34, 38, 47, 49, 57, 58, 69, 73, 78, 83, 89, 93, 97, 99], parents (27 studies, 34%) [25, 33, 41, 43, 45, 50,51,52, 56, 61, 63, 66, 70, 75, 76, 78, 79, 81, 82, 84, 86, 90,91,92,93, 96, 100], healthcare providers (13 studies, 17%) [30, 37, 39, 47, 59, 66, 67, 69, 71, 80, 87, 88, 95], or did not report (1 study, 1%) [77].

Twenty-one interventions included multiple target populations as participants. Common combinations of participants included parents and adolescents (11 studies) [43, 50,51,52, 61, 63, 75, 90,91,92, 100], adolescents and young adults (4 studies) [22, 26, 34, 73], clinicians and young adults (1 study) [47], parents and young adults (3 studies) [25, 78, 93], parents and clinicians (1 study) [66], and clinicians, adolescents, and young adults (1 study) [69]. Only three studies included only male adolescents or young adult study populations (2 were adolescents only, and the last one was both adolescents and young adults).

Eight of the 79 studies (10.1%) included a large proportion of parents from diverse racial and ethnic identities (defined as ≥ 50% other races than White) [33, 45, 56, 70, 76, 79, 81, 100], 6 (7.6%) included adolescents from diverse groups [27, 40, 64, 65, 74, 98], 8 (10.1%) included both parents and children from diverse groups [38, 51, 52, 61, 63, 75, 90, 91], 6 (7.6%) included young adults from diverse groups [26, 35, 57, 60, 80, 97], and 1 included both young adults and children from diverse groups (1.3%) [34].

Socio-ecological levels

Based on a review of the reported intervention components, the audiences they targeted, and the socio-ecological model, most studies were conducted at the individual level (44, 55.7%), followed by interpersonal level (10, 12.7%), community level (3, 3.8%), and clinic level (4, 5.0%).

Multi-level interventions

Although most interventions were directed at a single level of the socio-ecologicl level (n = 61, 76.3%), 23.7% (n= 18) were multi-level. Sixteen (88.9%) combined two levels [27, 32, 39, 42, 43, 55, 63, 66, 69, 71, 73, 75, 77, 82, 98, 100], and 2 (9.1%) combined three levels (Fig. 2) [47, 67]. Common combinations of the levels included provider and clinical (5 studies) [66, 69, 71, 73, 82], interpersonal and clinical (4 studies) [27, 39, 43, 77], individual and interpersonal (2 studies) [32, 100], individual and clinical (2 studies) [42, 98], and individual and community (2 studies) [55, 75]. Meyer et. al aimed to use an electronic point-of-care prompt and 2-h lecture for providers to increase HPV vaccine uptake in retail clinics (provider and clinical interventions) [73]. Staras et al. sought to increase HPV vaccine initiation among publicly insured Florida adolescents ages 11–17 using a quasi-experimental factorial design with four study arms: 1) postcard campaign, 2) in-clinic Health Information Technology (HIT) system, 3) postcard campaign and in-clinic HIT system, and 4) usual care (individual and clinical interventions) [98]. Paskett et al. developed a program focused on HPV vaccine uptake among parents who have adolescent girls ages 9–17 who have not received the HPV vaccine, which would include vaccinations (individual and provider interventions) [82]. The 3-level combinations included: 1 study with individual, interpersonal, and clinical interventions [67], and 1 study with individual, clinical, and community interventions [47]. For example, Malo et al. created a 3-level intervention for parents to analyze which messages were most motivating to persuade them to administer the HPV vaccine to their child, for educating and training physicians, physician assistants, nurse practitioners and nurses who serve at primary clinics specialized in pediatrics or family medicine about the most persuasive messages in speaking to parents about the HPV vaccine for their children (individual, interpersonal, and clinical interventions) [67].

Fig. 2
figure 2

Levels of Interventions among Included Studies

Intervention components

The duration of interventions ranged from 10 min to 18 months among the studies reporting intervention time frames. Twenty-seven interventions (33.8%) reported using theory in intervention development [23, 24, 31, 35, 36, 40, 45, 47, 48, 50, 53, 54, 58, 61, 63, 67, 70, 72, 74,75,76, 81,82,83, 86, 100]. Theories or frameworks referenced included the Elaboration Likelihood Model, Culture-centric narrative theory, Health Belief Model, Theory of Reasoned Action/Planned Behavior, Moral Norm and Social Cognitive Theory.

Intervention components varied from education to offering vaccination (vaccine access). The most common intervention components were individual education of parents and/or adolescents (60, 76.0%); use of technology such as websites, PowerPoints, and text messages (21, 26.6%); and provider education (16, 20.3%). Examples of educational messaging were: expressing the benefit of the HPV vaccine, providing cervical and breast cancer prevention education, supplying educational handouts at an eighth-grade reading level, and displaying facts on posters about HPV and the HPV vaccine (i.e. both genders can receive the vaccine). The websites provided factual information on HPV and the HPV vaccine including statistics on the incidence of HPV infection and cervical cancer, risks associated with HPV infection, costs of vaccination, safety and efficacy of the HPV vaccine, and suggestions for how to talk to a doctor about the vaccine. Other components included patient reminders (13, 16.5%) [27, 50, 51, 62, 63, 70, 71, 74, 77, 83, 89, 90, 99], improving access to the HPV vaccine (6, 7.6%) [29, 55, 64, 75, 85, 89], health systems change (6, 7.6%) [43, 69, 75, 77, 81, 98], incentives (4, 5.1%) [46, 62, 68, 92], and community-wide campaigns or outreach (3, 3.8%) [32, 45, 75]. Patient reminders included phone calls, text messages, mailing reminders, and reminder-recall letters prompting adolescents to sign up for an appointment via a website. Several ways to improve access to the HPV vaccine consisted of utilizing school-based programs and expanding HPV vaccination programs in countries where there were no existing HPV vaccine programs. For incentives, gift cards (e.g., general merchandise and department stores, fashion and footwear retailers, bookstores, jewelry shops, motoring stores, and home improvement stores) and vaccine vouchers were used. Some studies combined two components (29, 36.7%) [24, 27,28,29, 31,32,33,34,35, 39, 40, 44, 45, 47, 50, 55, 65, 66, 71, 72, 81, 83, 85,86,87,88, 90, 97, 98], three components (6, 7.6%) [51, 62, 63, 69, 74, 82] or four components (3, 3.8%) [75, 77, 89]. Common intervention combinations included education and technology (18 studies, 23%) [24, 28, 31, 33,34,35, 40, 44, 51, 63, 65, 72, 74, 82, 86, 88, 89, 97], education and reminders (9 studies, 11%) [50, 51, 62, 63, 74, 77, 83, 89, 90], education and vaccine access (5 studies) [29, 55, 75, 85, 89], and provider education and technology (4 studies, 5%) [39, 69, 82, 87].

Community guide intervention categorization

We reported on the categorization of the interventions based on the Community Guide’s categorization framework to assess the design and execution of health-related evidence-based interventions [12]. The most common type of HPV vaccination interventions were informational interventions (25, 31.7%). Of the behavioral interventions, 23 (29.1%) [24, 26, 32, 34,35,36, 38, 40, 44, 46, 48, 51, 52, 55, 61, 68, 76, 79, 81, 91, 92, 97, 100] were patient-targeted decision support, 9 (11.4%) [50, 62, 63, 70, 74, 83, 89, 90, 99] were patient-targeted reminders, 12 (15.2%) [22, 30, 37, 39, 43, 59, 67, 69, 71, 73, 87, 95] were provider-targeted, 8 (10.1%) [27, 47, 66, 75, 77, 82, 85, 98] were both patient and provider targeted interventions. Only 2 (2.5%) [29, 64] were related to environmental interventions related to small policies (i.e., organizational guidelines, no government involvement) (Fig. 3).

Fig. 3
figure 3

Intervention component categorizations based on community guide among included studies. Note. Interventions may have more than one intervention components

Facilitators and barriers to intervention implementation

Several studies reported facilitators (13 studies, 16.5%) [26, 27, 29, 30, 32, 36, 37, 40, 45, 47, 48, 63, 65] and barriers (22 studies, 27.58%) [24, 26, 27, 30, 36, 37, 40, 43, 44, 50, 61, 67, 68, 73, 74, 77, 79, 87, 89, 93, 98, 99] to intervention implementation. Facilitators included use of patient navigators and user-friendly resources [26, 27, 36], interactive information sessions [29, 30, 37], low-cost interventions [30, 40, 47], and quality improvement initiatives [30, 37]. Barriers to implementation were related to cost [24, 27, 93, 99], time constraints with the given intervention [30, 36, 43, 67, 87] and integrating the intervention into clinical workflow [37, 73, 87, 98]. Other barriers included mobility of parents and technology challenges.

HPV Intervention outcomes

Forty-two studies (53.2%) [22, 24, 26, 27, 29, 32, 34, 37,38,39,40, 44, 47, 48, 50,51,52,53, 55, 61,62,63, 68, 69, 71, 73,74,75,76,77, 79, 81,82,83, 85, 89,90,91, 97,98,99,100] reported on HPV vaccination outcomes, with 38 (48.1%) [22, 24, 26, 27, 29, 32, 34, 37,38,39,40, 44, 47, 50,51,52,53, 55, 61, 62, 68, 69, 71, 73,74,75,76,77, 79, 81,82,83, 85, 91, 97,98,99,100] reporting HPV vaccine initiation and 26 (32.9%) [22, 26, 27, 29, 34, 37,38,39,40, 48, 50, 52, 55, 63, 68, 71, 74,75,76,77, 81, 89,90,91, 97, 99, 100] reporting vaccine series completion. Post-intervention vaccine initiation ranged from 5% to 99.2%, while series completion ranged from 6.8% to 93%. For the experimental studies (n= 47), 11 (23.4%) measured vaccine initiation [24, 34, 38, 48, 51, 54, 61, 82, 83, 85, 86], and 3 (6.4%) measured completion [89, 90, 99]. Eleven (23.4%) assessed initiation and completion as outcomes (Table 2) [39, 40, 44, 50, 52, 53, 68, 71, 81, 91, 100]. Of the interventions that only measured vaccine initiation, 3 out of 11 (27%) found a significant increase in vaccine initiation [48, 82, 85]. For the interventions that measured both as an outcome, 3 out of the 11 (27%) found a significant increase in vaccine initiation [50, 71, 100]. Therefore, a total of 6 (12.8%) interventions demonstrated a significant increase in vaccine initiation [48, 50, 71, 82, 85, 100]. For the interventions that measured both vaccine initiation and completion, 1 (9.1%) reported a significant increase in completion only [81] and 2 (18.2%) in both vaccine initiation and completion [39, 68]. Of the interventions with quasi-experimental studies (n = 16), 5 (31.3%) were studies with comparison groups [30, 55, 62, 69, 98] and 11 (68.8%) were studies with pre and post intervention data collection (Table 3) [22, 25, 47, 59, 63, 73, 76, 79, 93, 95, 97]. Out of the quasi-experimental interventions with comparison groups (n= 5), 3 (60%) measured vaccine initiation [62, 69, 98], and 1 (20%) assessed both initiation and completion [55]. Of those, 2 (40%) demonstrated significant increase in vaccine initiation [62, 98], 0 in completion, and 1 (20%) in both as an outcome [55]. Out of the quasi-experimental interventions with pre and post-intervention designs (n= 11), 2 (18.2%) measured initiation [47, 79], 1 (9.1%) measured completion [63], and 4 (36.4%) assessed both as outcomes [22, 73, 76, 97]. One (9.1%) reported a significant increase in vaccine initiation [47] 1 (9.1%) in completion [63]; and 2 (18.2%) in both [73, 76].

Table 2 Significant HPV vaccine outcomes among experimental interventions
Table 3 Significant HPV vaccine outcomes among quasi-experimental interventions

Other common intervention outcomes included measures of parental knowledge (18, 32.1%), self-efficacy (7, 12.5%), acceptability (7, 12.5%), and attitudes and beliefs (6, 10.7%). For adolescents, other outcome measures were knowledge (8, 34.5%), awareness (3, 13.0%), and attitudes and beliefs (3, 13.0%). For young adults, these measures included knowledge (14, 35.9%), attitudes and beliefs (7, 17.9%), and self-efficacy (4, 10.3%). Out of 79 studies, 15 (19%) measured vaccine intention.

Quality assessment

The study quality (SQ) assessment included 12 criteria items with response options as 0 = no or 1 = yes. The results showed that SQ1 (the study had a clear objective) was the most common criterion met, with 79 (98.8%) studies meeting this criterion. This was followed by SQ3 (participants in the study are representative of those who would be eligible), which was met by 68 (85%) studies. SQ2 (eligibility criteria clearly described) and SQ6 (delivered consistently across the study population) were tied for third place, with 67 (83.75%) studies meeting these criteria. On the other hand, SQ8 (people assessing the outcomes blinded to participants' exposures/interventions) was the least met criterion, with only 9 (11.25%) studies meeting this criterion. SQ12 (the study took into account the use of individual-level data to determine effects at the group level) was met by 15 (18.75%) studies. SQ11 (outcome measured multiple times) was met by 19 (23.75%) studies, while SQ9 (loss to follow-up after baseline 20% or less) was met by 30 (37.50%) studies. Overall, 60% (n = 48) and 32.5% (n = 26)were rated as Good or Fair in quality, respectively. Six (0.75%) studies were rated as Poor. For a detailed presentation of the quality elements and overall quality scores, please refer to Supplementary Table 2.

Discussion

We conducted a systematic review to assess interventions for HPV vaccine promotion. Our goal was to better describe common target populations of HPV vaccine interventions, common intervention levels and components, barriers and facilitators to intervention implementation, and the relationship between types of interventions and HPV-vaccine related outcomes. Previous systematic reviews have identified the breadth of intervention designs and contributed to our understanding of relative effectiveness of different intervention types [12, 14, 101]; however, given the advances in HPV vaccination research over the last several years, an update to these reviews was warranted. Moreover, previous systematic reviews have had a limited scope in terms of study settings, study designs, or topics and our goal here was to conduct a global and comprehensive review of interventions [14, 15, 102, 103]. We reported on the level of socio-ecological that each intervention targets, barriers and facilitators to the implementation of these interventions, and intervention with outcomes such as initiation and completion rates from the U.S. and other countries. In our update to these reviews, we found that while intervention components were described thoroughly to contribute to our knowledge of types of interventions being implemented, fewer details about barriers and facilitators and HPV vaccine-related outcomes (particularly vaccination rates) were included. There were few patterns to be discerned in which types of interventions were found to be most effective, and in fact, among those that did report, only 20.3% reported significant increases in either initiation or completion or both. Despite this, our findings offer six key insights into the types of interventions being implemented that make effective interventions.

From intervention research, we know that there are certain “components” that can help to promote successful intervention implementation and outcomes. For HPV vaccination specifically, we know that working with healthcare providers is an effective strategy [11]. More broadly, literature suggests that interventions are more effective when they focus on implementation at multiple levels [82] and use theory in intervention development [104]. However, in our review, we found that overall, many of the interventions identified did not adhere to these best practices; only 23% of the interventions were multi-level (18 total) and 34% employed theory (27 total).

We used the Community Guide and the Walling et al. systematic review classification of interventions such as informational, behavioral, and environmental to categorize and rank interventions [11]. Firstly, our review revealed the most commonly implemented interventions were not the types of interventions that had previously been shown to have the greatest impact. For example, while the success of behavioral provider and clinic-focused interventions (particularly ones that promote changes to systems like utilizing reminder-recall and encouraging strong recommendations) is well-documented [11], in our study we found other types of interventions were more often used. For example, information-providing interventions (used to increase knowledge of HPV, HPV-associated cancers and the HPV vaccine [11]) were most common (31.7%) followed by patient decision support interventions (29.1%). Among these intervention categories, the intensity of the activities ranged widely. For example, in our study among information-providing interventions some studies employed a passive approach by offering pamphlets and educational materials [60] whereas others were more active and included live presentations [57, 65]. Yet, educational, or information-giving interventions have been found to be less effective in increasing uptake or completion [103]. The interventions being implemented are not the types that have been shown to be most effective, which is consistent with other research that has identified a discrepancy between the implementation of interventions or strategies that are most effective compared to interventions that may be deemed “easiest” to implement [105, 106].

Secondly, despite extensive research showing the increased effectiveness of multi-level interventions [82], there were limited interventions included in this review that were multi-level (23%). For example, The Community Guide has found insufficient evidence for provider or patient education alone to increase vaccination, but it has found that using education in combination with provider-focused interventions (i.e. provider reminders; assessment and feedback) has been successful [107]. In this review, 75% of the interventions reported intervening on only a single level, most commonly in clinical or school-based settings focused on individuals or providers. Future interventions to promote HPV vaccination should prioritize intervening at multiple levels to more effectively improve vaccine outcomes and discern which combination of levels results in higher vaccination.

Thirdly, using theory is well-documented as a best practice in intervention development and implementation [104, 108]; however only one-third of the interventions in this review used theory in the design of their program strategies. It is highly possible that some of these interventions did in fact use theory or theoretical constructs to guide their research, but did not report it explicitly. The Health Belief Model, Theory of Planned Behavior, Social Cognitive Theory and the Elaboration Likelihood Model were the most commonly utilized; this is consistent with a recent systematic review exploring the use of theory in HPV vaccine interventions [102]. Using theory allows for understanding why specific interventions may be effective (or not effective) and for comparison across multiple studies. Thus, future HPV vaccine interventions should report more broadly on the use of theory in their intervention development and how constructs are employed in their design of intervention components or assessed in evaluation.

Fourthly, the effectiveness of these interventions was difficult to discern due to heterogeneity in measurement, outcomes, and study designs. Unfortunately, it is difficult to speak to what types of interventions were most effective as only about half reported on vaccine initiation (48%) and less than a third (32%) reported on vaccine series completion. Other commonly assessed outcomes included parental knowledge [33, 90, 91, 100], self-efficacy [35, 48, 54, 70, 72, 75, 76, 82, 86, 96], attitudes/beliefs [23, 31, 48, 49, 51, 54, 58, 65, 72, 75, 80, 82, 86, 97, 100], and acceptability [28, 34, 41, 43, 50, 72, 78, 79, 92]. There is mixed evidence on whether these outcomes are associated with uptake. For example, one meta-analysis found that parents’ beliefs, attitudes and intentions were positively associated with HPV vaccine uptake [109], while other studies have found intention to be unrelated to uptake, particularly in multivariable models, other factors seem to attenuate the effect of intention [110]. Moreover, many of the studies included in this review were quasi- or non-experimental, making it difficult to draw inferences about the effectiveness of any of the outcomes reported. Only about half focused on vaccine series initiation and completion. There are promising findings that a proportion of the interventions that reported significant changes in vaccination uptake or completion are multi-level and multi-component. Future intervention studies should focus on using rigorous methods to assess the effectiveness of different types of interventions, including investigating vaccination outcomes of series initiation or completion, and having longer-term follow-up to be able to assess longer-term outcomes. In addition, evaluation of multi-level interventions for the promotion of HPV vaccination should be conducted to contribute to their evidence of effectiveness.

Fifthly, related to the lack of reporting on intervention outcomes was a lack of reporting on implementation barriers and facilitators. Less than 20% of studies reported on facilitators and less than 30% reported on barriers. This is a similar finding to the review conducted by Smulian et al. (2016), who also reported a lack of reporting on barriers and facilitators [11]. This kind of information is critical in understanding program implementation, adaptation, and tailoring for different settings [24, 68, 93]. Recently, the use of hybrid trials, which can be used to assess both effectiveness and implementation outcomes, is emerging among implementation research [111, 112]. In the future, researchers could prioritize conducting these hybrid trials so that we can not only identify those interventions that are most effective, but also important implementation determinants that can inform sustainability and scalability in multiple types of healthcare settings.

Finally, it is important to note that it is a critical time, in the era of the COVID-19 pandemic to disseminate effective cancer prevention interventions. HPV vaccination rates have fallen during the pandemic [113, 114] and competing priorities have led to less time for clinics to devote to vaccine promotion [115]. Coupled with recent data suggesting that concerns about HPV vaccine safety are rising [116], this is indicative of a need to identify what works and how to implement it to prevent future generations from being susceptible to HPV-associated cancers. Overall, increased reporting of both vaccine outcomes as well as barriers and facilitators to vaccination will move the field forward and provide data to help researchers determine which types of interventions to prioritize.

Strengths and limitations

Our study was strengthened by the inclusion of interventions globally and our focus on understanding multi-level intervention strategies. By categorizing interventions at different levels (e.g., individual, interpersonal, clinical) we have added to the growing literature on multi-level interventions. Additionally, almost 30% of the studies included were conducted outside of the United States. This finding helps to add to the growing global literature on HPV vaccine interventions and allows for comparability between the U.S. and other countries that continue to struggle with low HPV vaccination rates [2]. However, this should simultaneously be recognized as a potential limitation, as results may not be generalizable across all global geographies. While studies from North and South America, Europe, Africa, Asia, and Australia were included, there were only several from each continent (other than North America) which limits the generalizability of results. Similarly, less than 15% of studies included parents or children from diverse racial and ethnic identities (defined as ≥ 50% other races than White). This makes it hard to assess the impact of interventions for HPV vaccination on racially and ethnically diverse populations. Future HPV vaccination research should focus on these populations to test intervention effectiveness. We also were limited by only reporting on articles written in English and may be missing HPV vaccination interventions written in other languages.

Another key limitation is the lack of reporting vaccine-related outcomes in studies. Just over 50% reported either initiation and/or completion outcomes. This fact with varying study designs makes it difficult to collectively assess intervention effectiveness through data synthesis. Moreover, 40% of the studies were rated as “fair” or “poor” quality in our quality assessment, primarily due to studies not including multiple time points for outcome measures, not blinding participants in intervention studies, and for group-level studies not reporting on individual-level data to determine group-level effects. These limitations identify key gaps in the literature and that future research should focus on including more diverse populations in interventions, employing more rigorous study designs, and including vaccine initiation and completion rates.

Conclusions

In 2020, the World Health Organization adopted a Global Strategy to eliminate cervical cancer, aiming for 90% of girls to be fully vaccinated by age 15 [2]. Given that males can suffer from HPV-associated cancers as well, many countries have expanded their vaccination programs to include males. However, worldwide, most countries fall far short of this 90% goal. Therefore, there is a strong need to expand implementation of HPV-vaccine promotion interventions beyond education alone and at a single level and use rigorous intervention designs. Inclusion of longer-term interventions and more evaluations focusing on vaccine initiation and/or completion would be helpful to truly understand what is most effective in improving HPV vaccination rates. Many of the interventions included in this review did not report vaccine uptake data; relied on strategies found to be less effective (e.g., education alone); did not use or not report on use of theory; did not report on barriers and facilitators to implementation; or addressed a single level for intervention. Improving on the design and evaluation of HPV vaccination interventions is particularly critical at this moment as many adolescents missed vaccinations during the COVID-19 pandemic and vaccine hesitancy is growing. Improving our understanding of which interventions to prioritize for implementation will be important to ensure future generations of adolescents are protected against HPV-associated cancers.