Background

Influenza-related disease burden among children is high globally. According to a recent systematic review, in 2018 there were 63.1–190.6 million influenza virus infections and 543,000–1,415,000 influenza-virus-associated hospital admissions due to acute lower respiratory infection among children aged under 5 years globally [1]. Vaccination is one of the most effective interventions to prevent influenza [2, 3]. Approximately one-third of 194 World Health Organization (WHO) Member States recommend influenza vaccination for children [4]. Seasonal influenza vaccination of children has been incorporated into the National Immunization Program (NIP) of many developed countries (e.g., the United Kingdom, Australia, and Republic of Korea) and some upper middle-income countries (e.g., Mexico) and lower middle-income countries (e.g., Bhutan) [5,6,7,8,9].

In China, there were more than 250 million children aged under 15 years in 2021, accounting for 12.5% of all children in that age group globally [10]. One study estimated that the average number of influenza cases among children aged 0–14 years in China was 3.6 million annually between 2010 and 2020 [11]. Childhood vaccination programs in China are divided into the Expanded Program on Immunization (EPI) and the non-EPI [12]. EPI vaccines are free and mandatory, while non-EPI vaccines, including influenza vaccine, also known are optional and billed. Children are prioritized to receive influenza vaccination [13]; however, under the current self-paid policy, influenza vaccination coverage among children in China is low, remaining at approximately 25% [14, 15]. Influenza vaccination uptake was higher in cities with stronger health resources, and that vaccination coverage was lower in less-developed provinces [16].

Additionally, as a non-EPI vaccine, the influenza vaccine is provided by the private sector [17, 18]. After a series of massive illegal private sector vaccine sales, which sharply decreased public trust in vaccines [19, 20], a new vaccine administration law was introduced in China in 2019, which recommended the gradual incorporation of vaccines sold on the private market into the NIP [21]. In the interim, provincial health authorities could introduce new vaccines to the immunization programs in their respective regions before they were included in the NIP at the national level [21]. Currently, at the local level, some cities (e.g., Beijing and Karamay) provide free influenza vaccination to children [17]. Evidence from Beijing has shown that a government-funded vaccination policy can improve influenza vaccine uptake (from 2 to 40%) [22, 23].

A government-funded vaccination policy could not only ease influenza burden by improving vaccine uptake, but could also increase public trust in vaccines. Importantly, a cost-effectiveness evaluation is needed to inform decision-makers of whether to publicly fund influenza vaccination at the national and provincial levels. Policy decisions at various levels are driven by uncertainties regarding the burden of influenza, as well as an unclear picture of the populations’ demographic structure and socioeconomic level [16]. Hence, the aim of this study was to evaluate the impact and cost-effectiveness of introducing influenza vaccination to children (fully-funded policy) compared with the status quo (self-paid policy) at the national and provincial levels in China.

Methods

We compared the cost-effectiveness of government-funded influenza vaccination (fully-funded policy) with the status quo (self-paid policy) for children aged 6 months to 14 years in Chinese mainland from the societal perspective. In our study, we made the assumption that government-funded influenza vaccination would be free and optional for the pediatric population. This study was reported according to the updated Consolidated Health Economic Evaluation Reporting Standards Statement recommendations for reporting health economic evaluations.

Decision tree model

A static decision-tree model (Fig. 1) was developed to estimate the cost and health outcomes that would result from using the alternative policy. The model was built using TreeAge Pro 2019 (TreeAge Software, Inc., Williamstown, MA, USA). In the model, children who are vaccinated are assumed to be at lower risk of developing influenza than unvaccinated children. Children who are vaccinated against influenza are at risk of developing side effects, including fever, site reactions, and anaphylaxis [24]. Of those children who are infected with influenza virus and become symptomatic, a proportion seek healthcare, including self-medication, outpatient visits, and hospitalization [16, 25]. Potential complications include pneumonia, neurological disorders, and death following hospitalization.

Fig. 1
figure 1

Simplified Decision Tree. Chance nodes labelled with the same number have the same subtree

The time horizon of one influenza season (one year, starting in the 14th week of each year and ending in the 13th week of the following year) [26] was used in the model because most costs and outcomes caused by influenza, other than death due to influenza or its complications, occur within one influenza season. All life-years lost due to influenza-related deaths were included in the analysis. The unit costs were valued in 2019 Chinese Yuan (CNY). Where appropriate, unit costs were adjusted to 2019 values using the Consumer Price Index in China, then converted into 2019 US dollars (USD) (1 USD = 6.908 CNY) [27, 28]. Costs and quality-adjusted life-years (QALYs) were not discounted due to the short time horizon.

Data sources

Study population

The US Centers for Disease Control and Prevention Advisory Committee on Immunization Practices has identified children aged < 5 years as being particularly vulnerable to influenza complications [24]. In China, different influenza vaccines are given to children aged < 3 years and ≥ 3 years [13]. The vaccine given to children aged < 3 years is named the “children’s type” and the vaccine given to children aged ≥ 3 years is named the “adults’ type.” We thus divided children under 5 years: 6 months to 2 years and 3–4 years to avoid the impact of differences of vaccines’ prices. These two age groups shared the same cost and epidemiological data except cost of vaccine. The population size of each age group was obtained from the National Bureau of Statistics in China [29]. Additionally, children were stratified according to urban and rural area of residence, in consideration of urban–rural differences in economic status and healthcare-seeking behaviors [16]. The proportion of children living in urban areas was obtained from the 2020 Population Census of China [30]. Population data are provided in the Additional file 1: Tables S1, S2.

According to the WHO influenza vaccination guidelines, children with underlying medical conditions, such as chronic respiratory disease and chronic cardiac disease, are at increased risk of hospitalization and death from influenza [31]. Hence, children were grouped into high-risk and low-risk groups in our model. The risk proportion was estimated using the method suggested by Clark et al., using data on the prevalence of each disease from the Global Burden of Diseases, Injuries, and Risk Factors Study 2017, to estimate the proportion of children with at least one underlying condition [32]. The detailed methods are reported in the Additional file 1: eMethods 1 and Tables S3).

Epidemiological data

Recently, Wang et al. estimated that, between 2010 and 2020, the mean incidence of influenza infection and symptomatic illness among children aged 0–14 years was 15.86 and 10.50 per 1000 person-seasons, respectively [11]. We applied this method to estimate rates of symptomatic influenza by age group and province in the model. The symptomatic rates for children aged < 5 years and aged ≥ 5 years were estimated to be 0.0586 and 0.0155, respectively, in the 2019–2020 season in China. Further details are provided in the Additional file 1: eMethods 2 and Table S4.

The healthcare-seeking rate among symptomatic cases was derived from a survey conducted in eastern China between 2011 and 2014 [25]. We used a healthcare-seeking rate of 84.4% in municipal districts as a proxy of that rate in urban areas, and a rate of 79.1% in counties as a proxy in rural areas. The proportions of different healthcare-seeking behaviors were obtained from a national survey conducted in 2017–2018 [33]. The proportions of complications after hospitalization were derived from two epidemiological surveys [34, 35]. Li et al. reported the influenza-associated excess respiratory mortality by provinces in China [36]. The case fatality ratio of hospitalization was calculated using influenza-associated mortality and other parameters. Detailed description was provided in the Additional file 1: eMethods 3 and Table S5.

According to one systematic review, children with influenza and underlying conditions have an increased risk of hospitalization [odds ratio (OR) = 3.39] and death (OR: = 2.04) compared to children with influenza without underlying conditions [37].

Vaccine related parameters

The cost of vaccination included the cost of vaccines, cost of administration, and cost of parent’s time taking children to be vaccinated [24, 38]. We searched the price of influenza vaccines on national and provincial official procurement websites from 2018 to 2021 (Additional file 1: Table S6). The prices of the child and adult influenza vaccine were estimated to be 4.56 USD and 6.66 USD, respectively, using bootstrap sampling of the data [16]. The cost of administration was derived from a national survey [39]. Additionally, the economic loss for parents due to taking their children to be vaccinated included productivity loss and transportation costs [39]. Productivity loss was estimated through multiplying the mean hourly wage of Chinese workers by average hour (1.43 h) spent [24, 39]. Detailed data regarding this calculation are provided in the supplementary material (Additional file 1: Table S7). We used the clinical effectiveness of influenza vaccine estimates of Tricco et al. in the model [40]. In China, most child and adult vaccines are inactivated split vaccines [13]. The odds ratios of the matched and mismatched trivalent inactivated influenza vaccine (TIV) effectiveness among the population were estimated to be 0.35 and 0.44, respectively. To obtain a conservative estimate of the effectiveness of vaccination, we used mismatched TIV effectiveness data among the general population as a proxy of effectiveness data for children.

Side-effect data were derived from the Chinese national surveillance system of adverse events of seasonal influenza vaccine during the 2015–2018 influenza season [41]. The cost of fever was assumed to be equal to the cost of self-medication. It was assumed that fever and site reaction do not cause health utility loss because of their short duration. The cost and utility loss due to anaphylaxis was obtained from published literature [24].

According to Yang et al. [17], we estimated influenza vacciantion coverage among children using number of vaccine doses supply (Additional file 1: eMethods 4 and Table S8). The influenza vaccination coverage among children in 2019–2020 season was estimated to 0.0695. Extrapolating from the experience in Beijing, vaccination coverage under the fully-funded policy was assumed to be 0.40.

Influenza-related disease burden

The cost of self-medication for pediatric influenza was derived from a survey in Jiangsu Province, China [42]. We assumed the cost of self-medication is the same for children aged < 5 years and ≥ 5 years. The cost of outpatient and inpatient services were based on a national survey, and included direct and indirect medical costs [43]. The cost of self-medication, outpatient services, and inpatient services for other provinces and at the national level were adjusted using the local ratio of gross domestic product (GDP) per capita in 2019.

The national- and provincial-level costs of influenza-related complications were obtained from a previous study [38]. The cost per inpatient case of Hib pneumonia was used as a proxy of the cost of an inpatient case of influenza pneumonia, and the cost per inpatient case of meningitis was used as a proxy of the cost of per inpatient case of neurologic disorder. The cost of death was assumed to be ten times the cost of one inpatient stay, according to a previous study [24]. The lifetime productivity loss caused by death was estimated using the human capita method [38]. The retirement age was set at 60 years. An annual discount rate of 3% was used in the estimation of lifetime productivity (Additional file 1: Table S9) [44].

The healthy utility loss for outpatients and inpatients was calculated using the method suggested by Yang et al. [16, 45]:

$${\text{QALY loss }} = \, \left( {{\text{utility of the general population }}{-}{\text{ utility of patients with influenza}}} \right) \, \times \, \left( {{\text{duration of illness}}/{365}.{25}} \right).$$

The utility of the general population was obtained from the National Health Services Surveys between 2008 and 2013 [46]. The utility of outpatients and inpatients with influenza aged < 5 years were estimated to be 0.6286 and 0.5900, respectively; those aged ≥ 5 years were estimated to be 0.6216 and 0.6132, respectively [45]. The mean duration of an influenza episode for outpatients and inpatients was assumed to be 6.2 days and 11.8 days, respectively [45]. The QALY loss for self-medicated patients was assumed to be 0.005. The QALY losses for pneumonia and neurologic disorders were derived from published literature [24].

Outcome measures

The primary outcomes of this study were total cost, effectiveness (QALY gained), and cost-effectiveness (incremental cost per QALY gained). The incremental cost-effectiveness ratio (ICER), defined as the incremental costs per QALY gained, was used to compare the fully-funded policy with the self-paid policy at the national and provincial levels (Additional file 1: eMethods 5). In the base-case analysis, the willingness-to-pay (WTP) threshold was set to USD 10,144, the GDP per capita in 2019 [47]. The GDP of each province is provided in the Additional file 1: Table S1. Additionally, we tested a WTP threshold estimated by University of York for China, which is between USD 1162 and USD 4595 per QALY [48].

Sensitivity analysis

To explore the drivers of the results, deterministic sensitivity analyses were performed of the base-case scenario at a national level. Probabilistic sensitivity analyses (PSA) were performed to examine the joint impact of parameter uncertainty on ICER using Monte Carlo simulation. The median values and the 95% uncertainty range (UR) (centiles 2.5–97.5) were estimated based on 10,000 simulations. The distributions of parameters are shown in Table 1. The cost-effectiveness acceptability curves were constructed under various WTP thresholds at a national and provincial level.

Table 1 Input parameters of the model

Additionally, we explored various scenarios in sensitivity analyses. In Scenario 1, we estimated the indirect effect of providing children with influenza vaccination based on previous epidemiological and modelling studies [49,50,51,52]. We used a conservative assumption that, when compared to a 0.0695 coverage (self-paid policy), symptomatic cases among children who were unvaccinated would decrease by 4% due to the indirect effect of a 40% vaccination coverage (fully-funded policy). We also analyzed the outcomes using a range of possible indirect effect values in the sensitivity analysis (1% and 10%). In Scenario 2, we used a conservative (30%) estimate of vaccination coverage under the fully-funded policy. In Scenario 3, we tested a higher probability of adverse events of vaccination based on a study conducted in the United States [24]. In Scenario 4, we tested the impact of switching to a healthcare sector perspective, as opposed to the societal perspective used in the base-case analysis. The influenza-related cost only included direct medical costs. The cost of parents taking their children to be vaccinated and the lifetime productivity loss were not considered in this scenario. In Scenario 5, we estimated the clinical effectiveness of vaccination based on the assumption of matched, rather than mismatched vaccines. In Scenario 6, we tested the joint impact of the indirect effect, higher probability of side effects, and mismatched vaccine effectiveness. A detailed description of the different scenarios is shown in Additional file 1: Table S10.

Results

Health and economic outcomes

Under implementation of a fully-funded policy, an estimated 98.95 million children aged 6 months to 14 years would be vaccinated against influenza nationally. Compared to the self-paid policy, the implementation of a fully-funded policy could prevent 1,444,768 (95% UR: 1,203,446–1,719,761) symptomatic cases, 92,110 (95% UR: 66,953–122,226) influenza-related hospitalizations, and 6494 (95% UR: 4590–8962) influenza-related deaths nationally in one influenza season (Table 2). We compared the incidence of hospitalization and death captured with the previous epidemiological data (Additional file 1: Table S11). Nationally, of the six scenarios, Scenario 1 (indirect effect) and Scenario 5 (matched vaccine) could avert a considerable number of symptomatic cases, hospitalizations, and deaths due to influenza compared to the base-case assumption (Table 2; Additional file 1: Table S12).

Table 2 Results of base case analysis and scenario analysis (fully-funded policy vs self-paid policy) (95% uncertainty range)

Of the 31 provincial-level administrative divisions (PLADs) in Chinese mainland, Guangdong Province was associated with the largest number of symptomatic cases averted (412,410, 95% UR: 344,986–488,711), hospitalizations averted (25,797, 95% UR: 19,752–33,482), and deaths averted (471, 95% UR: 347–637) (Fig. 2).

Fig. 2
figure 2

Health outcomes of fully-funded policy vs self-paid policy in different PLADs. PLADs: Provincial-level administrative divisions

Cost-effectiveness analysis outcomes

Compared with the self-paid policy, the fully-funded policy could save 15,051 (95% UR: 8499–25,205) QALYs with an additional cost of USD 123 million (95%UR: − 350–485 million) (Table 2). The median ICER was estimated to be USD 7964 per QALY gained. Under the fully-funded policy, the economic cost and QALYs loss associated with death attributing to influenza accounted for the largest proportion of total economic cost (57%) and QALYs loss (44%) (Additional file 1: Fig. S1). The median ICER was lower than the GDP per capita in Scenario 1, 2 (low coverage under fully-funded policy), 3 (high proportion of side effects), 5, and 6 (mixed assumptions). The median ICER of the funded policy compared to the status quo was estimated to be USD 44,673 per QALY gained using a healthcare perspective (Scenario 4).

Among the 31 PLADs, the total cost of the fully-funded vaccination policy ranged from USD 22 million (Tibet) to USD 894 million (Guangdong Province) (Additional file 1: Table S13). The incremental QALYs gained from the fully-funded policy compared to the status quo ranged from 61 (Jilin Province) to 2693 (Guangdong Province). The fully-funded policy was associated with a cost-saving in 10 of 31 PLADs (Table 3). The ICER of the fully-funded policy was higher than the provincial GDP per capita in 18 PLADs, indicating that a fully-funded vaccination policy strategy would not be cost-effective in these PLADs.

Table 3 Cost-effectiveness analysis of influenza vaccination among children in various PLADs. PLADs: Provincial-level administrative divisions

The impact of variables changing on cost-effectiveness analysis

The results of the one-way sensitivity analyses are summarized in Additional file 1: Fig. S2. The results were sensitive to the assumptions regarding the symptomatic influenza rate among children, vaccination effectiveness, influenza-associated excess respiratory mortality, vaccine price, proportion of high-risk children, proportion of children with influenza seeking healthcare, and cost of administration. Implementing a fully-funded policy would not be considered cost-effective if the symptomatic influenza rate among children aged < 5 years falls below 0.0520.

For most of PLADs, the cost-effective results were highly sensitive to the range of province-specific influenza-associated mortality and symptomatic influenza rate among children (Additional file 1: Table S14). At a provincial level, the probability of a fully-funded policy being cost-effective was > 75% in 9 of 31 PLADs, and < 50% in 20 PLADs, based on a WTP threshold of the provincial GDP per capita (Fig. 3). Moreover, the probability of a fully-funded vaccination policy being cost-effective was < 1% in Jilin, Heilongjiang, Jiangxi, Henan, Hunan, Hebei, and Shanxi Provinces. The detailed PSA results at a provincial level using the WTP threshold of Woods et al. are shown in Additional file 1: Fig. S3.

Fig. 3
figure 3

Cost-effectiveness acceptability curves at national and provincial level. One unit is 0.5 times GDP per capita

Cost-effective probability of the fully-funded policy

The PSA showed that the probability of a fully-funded vaccination policy being cost-effective was 56.5% at a WTP threshold of GDP per capita, and 41.1% at a WTP threshold of USD 4595 suggested by Woods et al. (Additional file 1: Figs. S3, S4). The PSA indicated that, with the threshold of GDP per capita, the probability of the fully-funded vaccination policy being cost-effective in Scenarios 1, 5, and 6 was more than 60% (Additional file 1: Figs. S4, S5). The probability of the fully-funded policy being cost-effective was similar to that of the base case, in Scenarios 2 and 3 at a WTP threshold of the GDP per capita.

Discussion

This study comprehensively evaluated the cost-effectiveness of introducing a fully-funded influenza vaccination program to Chinese children at the national and provincial levels. The results show that, at a WTP threshold of the GDP per capita, a policy of influenza vaccination funded by the government would be cost-effective nationally and for 42% (13/31) of PLADs.

Three previous studies have assessed the cost-effectiveness of influenza vaccination for children in China, and all of them found influenza vaccination to be cost-effective [53,54,55]. However, none of the previous studies assessed the cost-effectiveness of fully-funded influenza vaccine for children under 15 years old in all PLADs in China. Zhou et al. reported that, from a healthcare perspective, compared with no vaccination, the cost-effective ratio of influenza vaccination for children aged 6–59 months and 60 months to 14 years would be USD 0 and 37 per case averted, respectively, in four provinces [53]. Another study demonstrated that, at the WTP of three-fold GDP per capita, quadrivalent influenza vaccine would be more cost-effective than TIV for school children in Beijing City [54]. A study by Xiang et al. showed that providing two doses of vaccine to preschool children in child nursery settings would cost 178.77 CNY (25.88 USD) per influenza case averted [55]. However, some limitations, including simple model assumptions, did exist in these studies. To our knowledge, this study is the first comprehensive evaluation of the cost-effectiveness of influenza vaccination of children in China.

Our findings show that, at the national level, providing free influenza vaccination to children aged 6 months to14 years would be cost-effective compared to the current self-paid policy. At the provincial level, fully-funded influenza vaccination would be cost-effective in 13 PLADs. Moreover, less socioeconomically developed PLADs, including Tibet, Qinghai, Xinjiang, and Ningxia, could benefit from the implementation of the fully-funded policy. We suggest that, given the limited opportunities to access vaccines in the private sector and the high influenza-associated burden of these less-developed regions, providing an influenza vaccination to children that is fully-funded by the government would provide a valuable opportunity to promote health equity.

Cost-effectiveness outcomes varied by PLAD. The probability of a fully-funded vaccination policy being cost-effective was > 50% in nearly one-third of PLADs, which might result from the high influenza burden. The intensive influenza virus activities (high symptomatic rate) or insufficient medical resources (high influenza-associated mortality) might explain the high influenza burden in these PLADs. However, the probability of a fully-funded vaccination policy being cost-effective was < 1% in Jilin, Heilongjiang, Jiangxi, Henan, Hunan, Hebei, and Shanxi Provinces. We believe that the relatively low symptomatic influenza rate estimation and low influenza-associated excess respiratory mortality in these provinces might be the main factors making them less likely to benefit from a fully-funded influenza vaccination policy. Currently, the implementation of government-funded influenza policy is not likely to be recommended in these PLADs, given the cost-effective results. However, the symptomatic influenza rate and low influenza-associated mortality might vary across influenza seasons; therefore, enhancing influenza surveillance, particularly in less-developed PLADs, is a priority that should be given greater attention to provide more available and reliable evidence. Additionally, low economic cost associated with outpatient and inpatient services in these PLADs might contribute to the low probability of being cost-effective.

Various scenarios were explored to test the robustness of these findings. Noticeably, the analysis from a healthcare sector perspective (Scenario 4) found that the probability of the fully-funded policy being cost-effective was low under WTP threshold. This is because the study population were pediatric population, which indicated the discounted lifetime productivity loss associated with death might account for a large proportion of economic cost.

This study has some limitations, and most are related to the limited evidence availability. For example, if there was a lack of data at the provincial level, we either applied national data across different PLADs (e.g., symptomatic rate and healthcare-seeking rate), or adjusted national data based on the local GDP (e.g., treatment cost). Second, all influenza-related deaths were assumed to occur in hospitals. It is likely that this underestimated the ICER because some influenza-related deaths occur outside health facilities. Third, due to low coverage, we assumed that none of the children in the target cohort have received vaccination previously, and therefore would require two doses of vaccines; in reality, some children might have already received one dose of vaccine when then entered into our model and therefore would only require one dose of vaccine [13]. Fourth, the retirement age used to calculate the discounted lifetime productivity loss was set at 60 years, which might be influenced by sex and type of jobs. Fifth, dynamic transmission modelling might be technically more appropriate in modelling the disease transmission process for infectious diseases. Recent cost-effectiveness evaluations of influenza vaccination have placed significant emphasis on the indirect effects that arise when a population is vaccinated [56, 57]. The parameter has been estimated and applied using a dynamic transmission model [56, 57]. Zhang et al. estimated the effectiveness indirectly using a regression model based on various rates of Hib vaccination [38]. However, a lack of data limited our ability to estimate the indirect effect of influenza vaccination in the present study. We conservatively used a fixed value as a proxy of the indirect effectiveness at 0.40 coverage compared with 0.0695 coverage. Additionally, we performed sensitivity analyses of the indirect effects, which indicated that small indirect effects could increase the cost-effectiveness of a fully-funded policy. Sixth, our analysis encountered limitations as we were unable to explore the healthcare payer or patient perspective, primarily due to the unavailability of data on reimbursement rates for pediatric flu vaccines at the national and provincial levels. Finally, our findings from this model were sensitive to the assumptions, especially symptomatic influenza rates, vaccination effectiveness, and influenza-associated excess respiratory mortality, which meant fully-funded policy being cost-effective should be interpreted cautiously.

Conclusions

Our study, using national and province-specific influenza disease burden and demographic information, found that a fully funded influenza vaccination policy for Chinese children would be cost-effective, both nationally and in 13 of 31 PLADs. For less socioeconomically developed provinces with limited vaccine accessibility and a high burden of influenza-associated disease, implementing a fully funded influenza vaccination policy would provide a valuable opportunity to promote health equity.