Introduction

Health-related quality of life (HRQoL) is a multi-dimensional concept that measures self-reported well-being in physical, mental, and social functioning. It captures the impacts of health problems and diseases on quality of life [1,2,3,4]. HRQoL has been widely used for assessing outcomes of medical interventions as well as serving as a population health indicator, guiding health policy development and resources allocation [5, 6]. It puts a quality perspective into the measurement of years of life [7, 8]. In combination with traditional health indicators such as mortality and morbidity, a comprehensive indicator (e.g. quality-adjusted life years or QALYs) can be calculated to inform clinical, funding, public policy and management decisions on health products and technologies [9,10,11,12,13].

Over the past few decades, significant progress has been made in measuring HRQoL. The EuroQol Group Five-Dimensional (EQ-5D) series is perhaps one of the most simple and frequently used instruments since early 1990s [14]. The EQ-5D consists of a descriptive system and a visual analogue scale (VAS). The descriptive system comprises five dimensions. Problems related to these dimensions were measured either at three levels (EQ-5D-3 L) or five levels (EQ-5D-5 L) [14]. The combination of reported problems can be converted into a single summary utility index by applying the value sets based on public preferences. The EQ-5D has been recommended by the National Institute for Health and Care Excellence in the UK [8] and the 2011 Guidelines for Pharmacoeconomic Evaluations in China [15].

The EQ-5D-3 L instrument has been validated in Chinese populations [16, 17] and is increasingly being used for assessing HRQoL in the general population [18,19,20], people with special demographic characteristics [21,22,23,24,25], and people living with chronic conditions [4, 26,27,28,29,30,31,32,33,34]. Approaches to studies in China using the EQ-5D-3 L evolved over time. The first stage (before 2014) is featured with studies applying the value sets developed in the UK and Japan due to a lack of Chinese value sets [22, 35]. Researchers soon noticed significant differences in public preferences on health status that would result in varied EQ-5D-3 L value sets across nations [36, 37]. In 2014, Liu GG et al. [15] published the EQ-5D-3 L value sets derived from a sample of urban Chinese residents, triggering a wave of second stage studies [20, 38,39,40]. The localised value sets generated significant different EQ-5D-3 L utility results compared with those derived from the UK and Japanese populations [41]. Unfortunately, the EQ-5D-3 L value sets developed by Liu GG suffer from some major limitations due to the biased sampling: participants were selected conveniently from a few big cities. The authors themselves suggested a need for further refinement of the EQ-5D-3 L value sets in China based on a more inclusive and representative sample [15]. Indeed, there exist great socioeconomic and health disparities between urban and rural populations in China [19]. Public preferences on health status also vary between urban (especially those living in big cities) and rural residents [42]. Such an urban-rural difference in public preferences on health remains even after controlling for variations in socioeconomic status [18]. This highlights the importance of the development of the national representative EQ-5D-3 L value sets in China [15, 43]. In 2018, the national value sets derived from a large representative sample were eventually made available in China [15, 43].

This study aimed to identify changes in the EQ-5D-3 L results over time in China and their determinants. The study was undertaken using the EQ-5D-3 L instead of the EQ-5D-5 L for two reasons. First, two surveys five years apart (2008 and 2013) were available. Over this period of time, China experienced dramatic changes in social and economic development, including reforms of the health system. In this context, changes in HRQoL are likely to occur. Second, the EQ-5D-3 L generates a utility index based on the national value sets derived from public preferences, as well as a VAS indicating individual ratings on their own conditions [44,45,46]. This enables us to compare changing trends reflected by the two indicators and identify the determinants of contradictions, if any exist.

Data and methods

Study design and data collection

Data source and sampling method

Data were obtained from the 2008 and 2013 National Health Services Surveys (NHSS), the largest national wide health surveys in China. The NHSS have been conducted every five years since 1993 with coordination from the Centre for Health Statistics and Information under the Ministry of Health [47]. The EQ-5D-3 L has been validated in various populations in China [16,17,18, 28,29,30,31,32,33,34, 48] and incorporated into the NHSS since 2008 [19].

A four-stage stratified cluster probability sampling strategy was adopted to select representative participants in the NHSS [49, 50]. Each stage involved a systematic random sampling approach. In the first stage, urban cities and rural counties (94 in 2008 and 156 in 2013) were selected from the 31 provinces in mainland China in proportion to their population size. In the second stage, five sub-districts/townships in each selected city/county were identified. The third stage narrowed the sample down to two residential communities/villages in each district/township. Finally, 60 households from each residential community/village were invited to participate in the NHSS. All family members in a sampled household were eligible to participate in the NHSS. However, the EQ-5D-3 L was only administered to those who were 15 years or older. This resulted in a final sample size of 120,709 individual respondents in 2008 (excluding 24,921 questionnaires with a proxy respondent and 601 returned questionnaires containing missing values in the EQ-5D-3 L) and 188,720 individual respondents in 2013 (excluding 41,148 questionnaires with a proxy respondent and 196 returned questionnaires containing missing values in the EQ-5D-3 L) for data analyses in this study. The questionnaires with a proxy respondent were excluded because their VAS ratings were unlikely reliable.

Questionnaire survey

The questionnaires were administered through face-to-face household interviews conducted by trained local medical workers. The interviewers were rigorously selected considering their qualifications, professional knowledge, sense of responsibility, attitudes, and communication skills. Pre-survey training workshops were offered to all of the interviewers following a standardised protocol. Eligible interviewers had to demonstrate their proper understanding about the purpose of the NHSS and ability to meet data collection standards developed by the Centre for Health Statistics and Information. They also needed to follow pre-defined instructions when problems arose during data collection [49,50,51].

The face-to-face interviews occurred in the households of participants. Prior to the interviews, the interviewers explained the purpose and procedure of the survey and obtained oral informed consent from each participant. Family members were allowed to serve as a proxy respondent only when the selected participant was younger than 15 years, absent from home, or unable to communicate at the time of the survey. Overall, less than 18% of the returned questionnaire (17% in 2008 and 18% in 2013) were completed by a proxy respondent [50, 52].

A quality assurance team was established in each participating sub-district/township. The returned questionnaires were checked by the quality assurance officers for completeness at the end of each day. Missing data, if any, were addressed through a second interview by the same interviewers. The sampled households were not allowed to be replaced unless three interview attempts failed or the sample size of the residential community/village did not reach 60 [19]. The survey supervisors in each city/county re-interviewed 5% of their local participating households for selected key questions (eight in 2008 and fourteen in 2013) through telephone interviews or field visits. The repeated interviews showed over 95% of consistency with the original ones [49, 52]. The representativeness of the sample was evident in terms of Myer’s Index, DELTA dissimilarity coefficient and GINI concentration ratio for age structure and household size [49, 50, 52, 53].

Measurements

Dependent variables

Three indicators were calculated: percentage of reported problems, utility index and VAS scores.

The descriptive system of EQ-5D comprises five dimensions: mobility (MO), self-care (SC), usual activities (UA), pain/discomfort (PD) and anxiety/depression (AD). This study used the EQ-5D-3 L, measuring problems at three levels: no problem, moderate problem, severe problem.

The combination of reported problems on the five dimensions for each individual was converted into a summarised utility index (U). The conversion was based on the value sets developed by Zhuo et al. [43]. It assigns a value to each of the 243 health states classified by the EQ-5D-3 L:

$$ {\displaystyle \begin{array}{l}U=1-\Big({0.0766}^{\ast } MO2+{0.2668}^{\ast } MO3+{0.0441}^{\ast } SC2+{0.2912}^{\ast } SC3+{0.0370}^{\ast } UA2\\ {}+{0.0538}^{\ast } UA3+{0.0274}^{\ast } PD2+{0.0409}^{\ast } PD3+{0.0359}^{\ast } AD2+{0.1771}^{\ast } AD3\Big)\end{array}} $$

where MO2, SC2, UA2, PD2 and AD2 were given a value of 1 if a “moderate problem” presented in the respective dimension, or 0 otherwise. Similarly, MO3, SC3, UA3, PD3 and AD3 were given a value of 1 if an “extreme problem” presented in the respective dimension, or 0 otherwise. This resulted in a possible utility index ranging from 0.1702 to 1.0000 [43].

There exist two value sets in China for the EQ-5D-3 L derived from the Time Trade-Off (TTO) technique: one developed by Liu et al. and another by Zhuo et al. [15, 43]. Both value sets showed smaller disutility for the PD dimension than that from some other countries such as the UK. However, in both cases, linear correlations between the disutility values and the seriousness of health problems remained evident. Some researchers argued that Chinese people, in particular those living in rural areas, are more tolerant to pain problems than the western populations, which may result in smaller disutility for the PD dimension in China [54]. In this study, we chose to adopt the value sets developed by Zhuo and colleagues for several reasons. Firstly, there exist some differences between Liu’s and Zhuo’s value sets. Secondly, Liu’s value sets failed to consider the preference of rural residents in China. But urban-rural disparities in health, social and economic development were still large in China. Finally, Zhuo’s value sets were derived from a nationally representative sample.

The EQ-5D-3 L also contains a VAS, asking respondents to rate their overall health on a scale ranging from ‘worst imaginable health state’ (0) to ‘best imaginable health state’ (100). VAS reflects individual ratings on their own health [18, 19].

Independent variables

Changes in HRQoL are determined by a variety of factors at the individual, family, community and society levels [55,56,57]. There exist several models describing the social and ecological determinants of health [58,59,60,61,62]. In this study, we used the widely cited Dahlgren-Whitehead rainbow model to guide the selection of independent variables. The NHSS covered five broad categories of determinants of health [19, 63]:

Demographic variables: Gender and age represent the basic biological feature of respondents.

Behavioral variables: The NHSS collected data regarding the current status of smoking (past week), drinking (past 12 months), and physical exercise (past 6 months) of the respondents. Respondents were asked whether and how frequent they had engaged in the aforementioned behaviors at the time of the survey. Respondents were deemed to be physically active if they engaged in regular physical activities at least once a week over the past 6 months.

Socioeconomic variables: Socioeconomic status was measured by educational attainment and household income. Respondents were asked to indicate the highest level of school education they had attained. Household income was estimated based on self-reported average income per capita and converted into quintiles (from the lowest 20% to the highest 20%).

Residential variables: Respondents were divided into two groups, urban or rural, based on their geographical location in three regions: eastern, central and western. There exist great geographic disparities in socioeconomic development in China. Urban residents enjoy a higher level of entitlement than their rural counterparts. Overall, the eastern coastal region of China is highly developed, whereas the western region lags far behind, with the central region being somewhere in between.

Time variable: China’s most recent health system reform started in 2009. The reform achieved great progress in a few years in terms of universal coverage of health insurance and improved access to medical care [49, 64]. We expected that the two rounds of NHSS would capture potential changes resulting from the reform.

Statistical analyses

We presented the percentages of reported problems on the five dimensions of EQ-5D-3 L. Reported “extreme problems” were rare, and thus were merged with the category of “moderate problems” [38, 47]. Differences in the percentages of reported problems were tested using χ2 tests. Logistic regression models were established to determine the changes over the two years after controlling for the influence of other independent variables. A p value of less than 0.01 was considered statistically significant in line with the Bonferroni adjustment method for multiple comparisons [65].

Means of the utility index and VAS scores were calculated and compared using student t tests or analysis of variance (ANOVA). Linear regression models were established to determine changes in VAS scores over the two years after controlling for variations in other independent variables. Because the utility index is bounded to 1, Tobit regression models were established to determine changes in the utility index after controlling for variations in other independent variables [4]. A p value of 0.05 was considered statistically significant in the linear and Tobit regression analyses.

The importance of changes in the utility index and VAS scores were also estimated using the indicator of effect size: average change divided by baseline standard deviation (SD), which was proposed by Cohen [66]. The Cohen effect size has now been widely used in identifying the importance of changes: 0.2 small; 0.5 medium; 0.8 large. A medium effect size is usually considered as a difference with clinical meaning [67]. In this study, the medium effect size (0.5) was considered as a threshold for minimal importance of changes in the utility index and VAS scores.

All statistical analyses were performed using STATA 14.0 for Windows.

Results

Characteristics of respondents

Slightly less than half of the respondents were male (47.83%). Elderly respondents accounted for less than 20% of respondents (16.45%). More than half of the respondents resided in rural areas (58.79%). Compared with 2008, the 2013 respondents were older (p < 0.001), more likely to smoke (p < 0.05), drink (p < 0.001) and exercise (p < 0.001); they also reported higher levels of education (p < 0.001). There was a dramatic increase (p < 0.001) in the proportion of urban respondents: 49.84% in 2013 compared with 27.71% in 2008 (Table 1).

Table 1 Characteristics of respondents

Changes in health-related quality of life

Reported health problems

Pain/discomfort was the most frequently reported problem (11.3%), followed by anxiety/depression (5.7%) and mobility (5.6%). Problems in self-care were least reported (3.1%). Compared with 2008, reported problems increased in pain/discomfort (by 3.3 percentage points) and mobility (by 0.7 percentage points) in 2013. By contrast, reported problems in anxiety/depression, self-care and usual activities decreased by 1.2, 0.2 and 0.2 percentage points, respectively (Table 2).

Table 2 Reported health problems of respondents

Utility index and VAS scores

Respondents who were male, younger, richer and had higher educational attainments reported lower health problems than the others, resulting in a higher utility index and VAS scores. Smoking, drinking and regular exercise were associated with less reported health problems and a higher utility index and VAS scores. Compared with rural respondents, urban respondents reported less health problems and consequently had a higher utility index, but they rated lower in VAS (Table 3).

Table 3 Reported problems, health utility index and VAS scores stratified by independent variables

Overall, the respondents had an average utility index around 0.985 and an average VAS score around 80. Compared with 2008, there was a significant decrease (p < 0.001) in the utility index, but an increase (p < 0.001) in VAS scores in 2013, albert in very small effect sizes (− 0.01 and 0.06, respectively). However, some subgroups stratified by age and region defied the overall trends, showing an increase in both the utility index and VAS scores (Table 3). Nonetheless, neither changes in the utility index (effect sizes ranging from − 0.31 to 0.03) nor changes in VAS scores (effect sizes ranging from − 0.01 to 0.17) reached the threshold of minimal clinical importance (Table 3).

Findings of multivariate regression models

Changes in reported health problems, the utility index and VAS scores over time remained significant after controlling for the influence of other independent variables.

Factors associated with reported health problems

The logistic regression models confirmed that there was an increased likelihood of reporting problems in 2013 in pain/discomfort (AOR = 1.34) and mobility (AOR = 1.07), but a decreased likelihood of reporting problems in self-care (AOR = 0.90), usual activity (AOR = 0.92), and anxiety/depression (AOR = 0.80) compared with 2008 (Table 4).

Table 4 Multiple logistic regression analyses on reported health problems

Factors associated with the utility index and VAS scores

The multiple linear and Tobit regression models confirmed the contradictory changing trends over time: decreased (β = − 0.01, p < 0.001) utility index vs increased (β = 1.61, p < 0.001) VAS scores, after adjustment for variations in the other independent variables. But the effect sizes of those changes over time did not reach the threshold of minimal clinical importance (Table 5). Age, education, income and residential location were significant predictors of the utility index and VAS scores. Their effect sizes reached the threshold of minimal clinical importance for the utility index. But for VAS scores, only the age effect reached the threshold of minimal clinical importance.

Table 5 Multiple linear and Tobit regression analyses on the health utility index and VAS scores

Discussion

Changes in HRQoL over time in the Chinese populations between 2008 and 2013 are minimal, if ever exist, according to this study. Compared with 2008, reported problems in mobility and pain/discomfort increased in 2013, but reported problems in anxiety/depression, self-care and usual activities decreased. The mixture of changing health problems resulted in a small decline in utility index. However, VAS scores defied the trend, showing a slight increase over time. It is worth noting that the time changes in both indicators were small and failed to reach the threshold of clinical importance in this study. Further studies are needed to verify the contradictory changing trends and their policy and clinical implications. There is evidence that these two indicators measure quite different constructs of HRQoL [68]. VAS scores capture real-time individual ratings, whereas the utility index applies past population preferences to value the current health status. Certain populations (for example women) may have higher than average expectations on health, leading to relatively lower ratings on VAS [18, 19].

Age is a significant predictor of HRQoL. Older people are more likely to experience health problems than their younger counterparts as indicated in this study and others [4, 6, 18, 20, 45, 69,70,71,72,73,74,75], resulting in significant lower utility index and VAS scores. The effect sizes of age are the largest among all of the independent variables assessed. This indicates a great challenge to China as its population is ageing rapidly. Previous studies reported consistent lower utility index and VAS scores in women compared with men [4, 6, 45, 71,72,73, 75,76,77]. But interestingly, gender differences in both the utility index and VAS scores were found to be too small to be deemed clinically important in this study and there is no evidence to support a claim of lower utility index in women. In line with in studies conducted elsewhere in China [78,79,80], this study also provides additional evidence on the associations between behavioral factors (smoking, drinking, and exercise) and HRQoL.

Socioeconomic disparities in HRQoL deserve a serious concern in China. Low socioeconomic status appeared to be associated with lower HRQoL regardless of which indicator was applied in this study. Those who were wealthier and had higher educational attainments had higher scores in both utility and VAS scores. In line with regional disparities in socioeconomic development in China, higher scores in utility and VAS scores were also found for those who resided in the more developed eastern region. These results are consistent with findings of other studies [4, 6, 18,19,20, 45, 69,70,71,72, 74, 81]. Between 2008 and 2013, China’s wealth increased exponentially, which was accompanied by dramatic improvement of people’s living standards. Life expectancy increased from 74.8 to 76.3 years over the period of time [82]. Unfortunately, this development had not translated into a higher HRQoL as indicated in the crude utility index and VAS scores results.

China experienced rapid urbanisation process over the past few decades. But rural residents still comprised 46.27% of the total population in 2013 [82]. This study adopted the value sets derived from a sample inclusive of rural residents. It showed that rural residents reported more health problems compared with their urban counterparts, but they had higher scores in the utility index and VAS scores after controlling for other factors. Clearly, urbanisation is unlikely to offer a silver bullet to improving the HRQoL of Chinese people. Future studies should explore whether rural residents in China hold different perceptions and values on health problems. Many young people in rural and undeveloped regions chose to leave their villages, hoping to live a better life [22, 24, 83,84,85]. This may have significant implications on both individual ratings and population preferences on health.

Limitations

There are several limitations in this study. Although the study sample is large and representative of the nation, we do not have control over the choice of data and questions definitions [18, 19]. The two rounds of cross-sectional surveys were not undertaken using the same pool of participants [65, 86], which prevents us from drawing casual conclusions. In addition, the EQ-5D-3 L used in the NHSS has more significant ceiling effects than the EQ-5D-5 L. However, the comparison of the two large national cross-sectional surveys provides valuable indications on the overall changing trends of HRQoL, which is important to inform future studies.

Conclusions

The changing trend (decrease) of the utility index is contradictory to that (increase) of the VAS in China over the period between 2008 and 2013, although neither is deemed clinically important. Such a change (or lack of) cannot be fully explained by the changing demographic and socioeconomic status in China. Further studies are warranted to explore the underlining reasons, in particular the role of health reforms [64]. Meanwhile, it is important to note that socioeconomic and regional disparities in HRQoL are increasing in China. The rapid socioeconomic transition and demographic changes in China may also have some potential impacts on public preferences on health status.