Background

The rates of obesity among children and adults in the United States are alarming [1, 2] and are responsible for staggering medical costs [3]. Elsewhere, the World Health Organization has declared obesity a global epidemic [4]. Considerable research has been conducted on the complex etiology of obesity, with environmental factors now thought to play an important role in influencing physical activity and diet [57]. Given the rapid pace of environmental change, urban development, and Westernization that is occurring in second and third world countries, there is great urgency to better understand the effect of the built environment on obesity and its behavioral risk factors in developing regions of the world. Indeed, in China, obesity rates among children have tripled in just two decades, from 1982 to 2002, reaching rates comparable to those in Western countries [8]. While some well-established larger cities in China already have high rates of obesity [8, 9], medium sized cities that are still rapidly developing and currently have relatively lower rates of obesity are opportune sites for place-based research to understand the associations between the changing built environment and obesity. According to epidemiological studies conducted in one such medium sized Chinese city, Kunming, in 2008, it was estimated that 26% of the adults were overweight [10]. Moreover, in Kunming, the childhood obesity rate in 2008 was 36% higher than it was in 1996, and three times higher than it was found to be in 1986 [11].

Chinese adolescents who grew up in the 1990s during a period of rapid social and environmental change had increasing access to Western fast food and exposure to new technologies and media that market such food, including the Internet and smartphones. Nearly all were born under China’s one-child policy, and were the center of the attention of two generations, giving them the ability to concentrate on their education, but also enormous pressure to meet their parents’ and grandparents’ high expectations. At the same time, students at this age are highly susceptible to peer pressure [1115], which influences their dietary patterns and other aspects of their behavior.

Numerous studies have reported associations between food-related aspects of the environment and obesity risk [1620]. In the U. S. and other Western countries, this research has largely relied on the existence of business, land use, and tax record databases from governmental and commercial sources to characterize the food environment [17, 21]. However, similar databases are not readily available for rapidly developing countries like China. Moreover, even if such databases were available, their validity would need to be assessed using field surveys.

Field survey instruments can be used to obtain detailed food environment data and to ground-truth food establishment databases. Such instruments allow for quantification of the number of food establishments in neighborhoods, as well as characterization of various aspects of the food offered by these establishments, including the availability and price of fresh and prepared foods that make up typical diets [22, 23]. Field survey instruments need to be both reliable and valid. They need to be reliable in that ratings made by different surveyors need to be consistent. Also, among various validity measurements, construct validity is particularly important as it considers how the measures of the instrument relate to the overall theoretical hypotheses [24] – in our case, that the food environment is associated with weight status.

While reliable field survey instruments exist within the Western context [2528], to our knowledge, no equivalent instruments currently exist to assess the food environment in China. Due to cultural differences in food availability and eating habits, survey instruments used in Western countries cannot be readily applied to China without modification. The development of a culturally appropriate and constructively valid survey instrument for characterizing the Chinese food environment is a critical step toward future studies on the evolution of food environments in a rapidly developing economy and its effects on the health of populations.

The objectives of this study are to: (1) develop a survey instrument for assessing the food environment in China; (2) assess its reliability in a rapidly developing Chinese city; (3) assess its construct validity for the hypothesis that the amount of fast food and packaged food in a Chinese community is positively associated with adolescent weight status; and (4) describe the density and types of food establishments in socioeconomically contrasting neighborhoods in such a city.

Methods

Survey instrument development

We developed two survey instruments: one to assess retail food stores and another to assess restaurants. To determine appropriate survey items, we reviewed the literature on food environment assessments via Google Scholar and PubMed, supplemented with a “snowballing” method to search for other relevant information. We found no existing tools appropriate for use in China, as the surveys that are used to assess food environment in United States were culturally inappropriate for the Chinese food environment, specifically the types of foods that are typically on restaurant menus and in food stores. However, the Nutrition Environment Measures Survey (NEMS) instrument used in the U.S. [25, 28] provided ideas for conceptualizing the survey instruments, which we created with the assistance of our local Chinese collaborators at the Kunming Medical University. Both instruments (for store and restaurant assessment) were designed so that they could be completed within 10 minutes for a single food establishment by surveyors working independently, without disturbing the store or restaurant staff. The survey items and rationale for their inclusion are described in Tables 1 and 2. The two instruments were pretested for wording and content at restaurants, grocery stores and wet markets (open markets where stalls of fresh and prepared foods are sold by different vendors) in Kunming, and then finalized for pilot testing in three socio-demographically contrasting neighborhoods.

Table 1 Items captured by the survey instrument for assessing stores
Table 2 Items captured by the survey instrument for assessing restaurants

Study area

Kunming is a rapidly developing city that is the capital of Yunnan province, located in the southwest region of China neighboring Tibet, Laos, Vietnam and Burma. Yunnan province has an ethnically diverse population consisting of Han and numerous ethnic minority groups. Because of its geographic location and recently recognized potential to serve as an international logistics center, Kunming has begun to link China with other Southeast Asian countries and is undergoing faster and more dramatic urbanization and environmental change than Beijing or Shanghai did during their peak development periods. Moreover, recent studies suggest that the prevalence of adult overweight and childhood obesity is becoming an increasing problem in Kunming [15, 30]. Unless effective intervention strategies are applied, obesity-related chronic disease rates are expected to increase dramatically [10, 31].

Neighborhood selection

Three neighborhoods varying in distance from the center of Kunming were selected. Like many other Chinese cities, Kunming has concentric ring roads, which radiate from the city center and divide the neighborhoods of the city. Similar to the spatial urban development patterns in many Chinese cities, Kunming was developed according to proximity to the city center. Our study’s first neighborhood was situated within the first ring road, the second between the first ring road and the second ring road, and the third outside of the second ring road (Figure 1). These three neighborhoods vary in real estate prices, development histories, and land use characteristics (Table 3). In general, the more central areas of the city are older, with higher real estate and living costs, while the less costly outer areas consist of mixtures of urban slums, migrant worker areas, and newer developments that are rapidly replacing older communities. Because socio-demographic data at the neighborhood level was unavailable, we used the average neighborhood real estate prices as a proxy. In each neighborhood, the food environment assessments were carried out on a 1-km stretch of street with visibly high food establishment density. After areas in each neighborhood with high food establishment densities were identified by searching key terms (food establishments, restaurants, food stores, convenience stores, supermarkets and wet markets) at Google and Baidu Maps, 3 streets with highest food establishment densities were identified visually and ranked from first choice to third choice. Distances of 1-km were measured using built-in rulers in Google and Baidu Maps. Prior to conducting surveys, researchers visited the identified streets in each neighborhood to verify the existence and density of the food establishments, and made the final selection of a 1-km stretch of street in each neighborhood.

Figure 1
figure 1

Neighborhood locations.

Table 3 Neighborhood characteristics[32]

Reliability

To assess the inter-rater reliability of the instrument, two pairs of trained student researchers, attempted to survey all food stores and restaurants on each of the pre-selected 1-km stretches of street in the three neighborhoods. Surveys were conducted on weekdays between 10 am and 6:30 pm in July of 2011, with the two pairs of researchers surveying different neighborhoods on a given day to blind each pair to the other pair’s activities. If there was any discrepancy between the two researchers within a pair, both returned to the store or restaurant to make another observation and come to a mutual decision before completing the survey instrument. Having two researchers in a team permitted more efficient and accurate data collection in the field. The student researchers also measured the geographic location of each food establishment by using a GPS unit (Garmin 62S). This paper did not use the geographic location data collected; however, these data may be useful in the future to validate web-based secondary data sources on the food environment such as Google and Baidu Maps. The observations of the two pairs of researchers were compared using appropriate statistical methods as described below.

Evaluation/validity

To evaluate and assess the construct validity of the instrument, measured heights and weights, as well as approximate home addresses of 575 adolescents from year 2011 were obtained from a local high school. These data were from the high school’s routine annual physical assessments of students. The selected high school was located between the first ring and second ring road, but has a wide catchment for students, who lived in various regions of the city. Home addresses were identified by neighborhood, which allowed us to categorize each adolescent’s home location in terms of the ring roads. Subjects with missing addresses were excluded from the analysis. Using both the data from the food environment surveys and this cohort’s data, we determined the extent to which the prevalence of western-style fast food restaurants and convenience stores (both tending to sell high fat and high caloric foods) is associated with higher prevalence of adolescent overweight and obesity. Adolescents’ weights, heights and approximate home addresses were recorded by the researchers without personal identifiers. Use of these de-identified data was approved by the Ethics Committees at Kunming Medical University and the University of California, Berkeley.

The weight statuses of the 575 adolescents were determined by calculating their body mass index (BMI) using their weight in kilograms divided by height in meters, squared. The BMIs were categorized into underweight, normal, overweight and obese. Because there was no single gold standard for BMI criteria for a Chinese population, we used five different BMI cutoffs to demonstrate different distributions of overweight and obese in the cohort. The five BMI cutoffs included those established by the Capital Institute of Pediatrics (CIP) and Working Group on Obesity in China (WGOC), International Obesity Task Force (IOTF), World Health Organization (WHO) and Center for Disease Control (CDC) [3341]. Additionally, IOTF has two cutoffs, one specifically for Asians. Mean BMI and percentage of overweight adolescents were tabulated by different ring road locations for different genders and ages.

Data analysis

Differences in counts of different types of food establishments and numbers of overweight or obese by neighborhood were assessed via Fisher’s exact test. For comparisons between dichotomous variables, chi-square test was used. The inter-rater reliability of categorical variables was assessed by calculating the percentage of agreement and Cohen’s kappa statistic:

% agreement = A / N × 100
κ = Pr A Pr E 1 Pr E

where A is the number of times an item was categorized similarly by the two teams, and N is the number of stores/restaurants survey by both teams; and kappa is the probability of agreement Pr(A), adjusted by the probability of chance agreement Pr(E). Differences in the means of continuous variables estimated by the two teams were assessed with Student’s t-test. All tests used statistical significance level of p value less or equal to 0.05, and data analyses were conducted using STATA 11.2 (StataCorp, College Station, TX, 2012).

Results

Neighborhood comparison

A total of 273 food establishments including 163 restaurants and 110 retail stores were located on the 3 pre-selected 1-km stretches of street; data were obtained by both teams on 141 restaurants and 84 retail food stores, and these data were used to calculate inter-rater reliability. The unmatched 48 food establishments that were surveyed by only one of the teams were attributed to food establishments that were not open at the time of survey, as well as food establishments located at the intersection of the selected survey streets and adjacent streets. Sit-down restaurants accounted for almost 40% of restaurants, while take-out restaurants accounted for 21%. Fast food restaurants (both Western and Chinese) accounted for 19% of restaurants.

Among retail food stores, tobacco and alcohol shops accounted for nearly 25% of all stores, while take-out stores, convenience stores, and supermarkets accounted for 14%, 12% and 11% of all stores surveyed, respectively. In addition, there were just two wet markets (open markets that sell fresh produce and meats) in the three neighborhoods surveyed.

With only one street in each of the three neighborhoods sampled, our main objective was not to explore the relationship between neighborhood characteristics and food establishment counts. Nevertheless, we noted that the types and distributions of food establishments varied among the three neighborhoods (Tables 4 and 5). A restaurant or store could be classified into more than one category. For example, a sit-down restaurant selling western fast food would be classified as a sit-down restaurant and also a western fast food outlet. Neighborhood I (the oldest and most expensive neighborhood in the center of the city) had the highest restaurant count, while Neighborhood III (the newest and least expensive neighborhood on the city outskirts) had the second highest restaurant count. Interestingly, the neighborhood that had the highest restaurant count (Neighborhood I) also had the lowest store count. It was also observed that that in the city center, western-style fast food restaurants were prevalent (13 in Neighborhood I vs. 0 and 2 in Neighborhoods II and III respectively), while on the city outskirts, Chinese-style fast food restaurants were relatively more common than western-style fast food restaurants (9 in Neighborhood I vs. 15 and 7 in Neighborhoods II and III). Further, bars and cafes serving snacks/pastries were much more prevalent in Neighborhood I than in the other neighborhoods.

Table 4 Distribution of restaurants by neighborhood
Table 5 Distribution of retail food stores by neighborhood

Characteristics of foods available

Selected characteristics of the most common foods offered by restaurants and stores are summarized in Tables 6 and 7. In restaurants, meat dishes tended to be more expensive than vegetable dishes, except at western fast food restaurants. Western fast food restaurants were more likely to offer deep-fried foods than Chinese sit-down, take-out, or even Chinese fast food restaurants. Interestingly, they were also more likely to offer dim-sum (bite-sized foods such as Chinese dumplings) than the other 3 common restaurant types. Chinese fast food consisted mainly of regional cuisine and noodle establishments. In terms of beverages, soda was available at most restaurants whereas bottled water was seldom available. Alcohol of various sorts was available at most restaurants except at sit-down restaurants. Most of the restaurants did not participate in any type of advertising although 3-13% had websites. Messages that encourage overeating such as “all-you-can-eat” promotions were visibly absent from the restaurants surveyed.

Table 6 Characteristics of four restaurant types
Table 7 Characteristics of four food store types

The survey revealed the wide variety of food stores available in Kunming (Table 7). Wet markets were few in number but, when present, they typically carried fresh fruits and vegetables and meat. In contrast, neighborhood supermarkets and convenience stores mostly sold packaged and processed foods and beverages; few carried fresh fruits, vegetables and meats.

Reliability

Inter-rater reliability between the two survey teams for restaurant and store-related categorical variables is reported in Tables 8 and 9, respectively. In general, the percentage of agreement was high (>75%) for all categorical variables, and the average kappa statistics ranged from 0.162 to 0.648. Most kappa scores were between 0.4 to 0.6, indicating moderate agreement. The poorer kappa statistics tended to be associated with survey items that were not immediately observable (i.e., required questioning a person from the restaurant or store), such as whether the restaurant advertises or has a website. Thus, these person-reported surveys responses may reflect the varying degrees of knowledge of the restaurant staff versus managers or owners. We found no statistically significant differences between teams for any of the continuous variables (Table 10).

Table 8 Inter-rater reliability for categorical items: restaurants
Table 9 Inter-rater reliability for categorical items: food stores
Table 10 Reliability statistics for restaurant and store continuous variables

Adolescent BMI distributions

The distribution of 575 adolescents’ BMIs is illustrated in Figure 2 with mean BMI of 21.1 kg/m2 and standard deviation of 3.2 kg/m2. The percentage distribution of BMI categories for five different cutoffs is reported in Figure 3 and Additional file 1. Mean BMIs and percentages of overweight adolescents at categorized locations, adjusted for gender and age, are reported in Tables 11 and 12. More than 85% of the students were between ages 16 and 17. At age 16, IOTF Asian cutoffs generated the highest percentage (35.6% for male and 21.8% for female) of overweight (combined overweight and obese) adolescents; WGOC cutoffs generated 21.0% for males and 11.1% for females; IOTF regular cutoffs generated 19.8% for males and 9.9% for females; WHO cutoffs generated 20.9% for males and 9.9% for females, and CDC cutoffs generated the lowest percentage (18.6% for males and 9.5% for females). There was higher prevalence of overweight and obesity in males than females. In terms of underweight, CIP’s below-5th-percentile cutoff and WHO cutoff generated 2.3% and 2.0% of underweight male and female adolescents, IOTF cutoff generated 6.2% for males and 12.3% for females, and CDC cutoff generated 5.1% for males and 3.6% for females.

Figure 2
figure 2

BMI distributions of 575 students.

Figure 3
figure 3

Percentage distributions of BMI categories among 5 different BMI cutoffs adjusting for gender and age for students aged 16 to 18.

Table 11 Numbers and percentage of cohort and their average BMIs in different regions of the city adjusting for gender and age
Table 12 Numbers and percentage of cohort that is overweight or obese in different regions of the city for various BMI cutoffs

Evaluation/validity

Construct validity of the survey instruments is reported in Tables 11 and 12. There were 30 students with missing home addresses; therefore, a total of 545 students were included in the validity tabulation. In general, regardless of the cutoffs used, the percentages of overweight adolescents were highest for those who lived within the 1st ring. And, those who lived between the 1st and 2nd ring had higher percentages of overweight than those who lived outside the 2nd ring. Although the differences were small and only marginally statistically significant (Student’ t-test p = 0.077 to 0.131 between within 1st and outside of 2nd ring groups depending on which cutoff is used), there was consistency with differences in mean BMI between categories for students aged 16 to 17. The mean BMIs of those who lived at three locations were 21.7, 21.4 and 21.3 kg/m2 (SD 3.58, 3.97, and 3.83) for males, and 21.6, 20.5 and 20.8 kg/m2 (SD 3.11, 2.78, and 3.55) for females, respectively. This was also consistent with the distribution of western-style fast food restaurants and convenience stores in three neighborhoods, with the neighborhood within the 1st ring having the highest count of western-style fast food restaurants and convenience stores illustrated in Tables 4 and 5. This provides indication of validity that the survey is adequately sampling food environments relevant to adolescent obesity.

Discussion

The development and validation of culturally-specific food environment survey instruments is an important step towards the conduct of studies of changing food availability, access, and pricing in second and third world countries, where obesity rates are rising rapidly. Here, we present the results of an effort, motivated by the use of the NEMS instrument within the American context to study food environments, to develop and validate an instrument for surveying restaurants and food stores in a rapidly developing city in southwest China. Overall, both the restaurant and store food environment instruments were found to have excellent percentage of agreement and moderate kappa scores, as well as well-founded construct validity.

There are limitations to our survey. In particular, restriction to a 1-km stretch of street in only 3 neighborhoods is clearly not representative of all of China or even of all the neighborhoods of Kunming, and by limiting our surveys to 10 minutes, there were many aspects of the food environment that were not recorded. For example, we were unable to properly assess the prices of all food items. We were also unable to properly measure shelf space and instead, developed a rapid assessment technique that involved the counting of floor tiles that were measured at each store. However, our experience during rounds of pilot testing suggested that surveyor fatigue and store/restaurant’s unwillingness to cooperate significantly impacted the survey qualities when the surveys were longer than 10 minutes. Despite these limitations, our study of three socio-demographically contrasting neighborhoods provides a fairly rich glimpse of the types of food environment changes that may be occurring as a result of ongoing globalization and the introduction of western-style fast food into other countries’ food environments. Unhealthy qualities attributed to fast food were found in our study. In particular, high percentages of deep-fried foods, soda, and snack-like meals were found in restaurants and food stores, and prices of vegetables tended to be higher than those of meat products. Clearly, there is a need for more systematic longitudinal assessments of changing food environments in this cultural context, which could advance understanding of the influences of rapidly changing environments on non-communicable disease risk. Since the development of this instrument in 2011, we have conducted surveys in 2012 and 2013. While it is not the goal of this paper to describe longitudinal changes that may be occurring, as they are multi-faceted and complex, based on our preliminary analyses, the food environment instrument does seem to be sensitive in detecting certain key changes within neighborhoods such as changes in the numbers of sit-down and take-out restaurants, dessert shops, as well as convenience stores.

In contrast to the changes in the prevalence of certain foods that may be occurring with the proliferation of western fast food, some aspects of the food environment remain characteristically Chinese. For example, we found that traditional wet markets remain important places for people in the city to buy fresh fruits, vegetables and meat. In fact, none of the local supermarkets and convenience stores in our three neighborhoods sold these fresh foods. A point of concern is that supermarkets and convenience stores are ubiquitous, with one on nearly every street block, which makes packaged and processed foods and beverages more readily accessible than fresh food from the wet markets. We also observed that wet markets had limited operating hours. The wet market stalls are independently rented and operated, and hence may only be open during early morning and late afternoons, or only on certain days. This may affect food accessibility for some populations, such as workers and students. Further, the era of the wet market may be coming to an end. During our field study in Kunming we visited a few internationally owned ‘mega supermarkets.’ In the summer of 2011, there were three Wal-Mart and six Carrefour mega stores in the city. These mega stores all allocated a large proportion of their shelves to food products. Although we were not allowed by management to conduct our survey in their stores, we observed food delis that served many different types of cooked foods. Additionally, we observed aisle after aisle of packaged and fresh foods. Fresh fruits and vegetables were sold individually as well as in convenience packages – prewashed (Figure 4) and bundled for quick meal preparation. The prices were comparable to the wet markets, and the stores were packed with customers when we visited.

Figure 4
figure 4

Vegetables sold in the wet market (left) compared to those sold in the mega-supermarket (right).

Our study is one of the few that present data on adolescent BMIs for middle-sized cities in western China. Adolescents who lived in the inner neighborhoods of Kunming tended to have higher percentage of overweight indicating the surveys were valid in assessing food environment – obesity relationships. Specifically, adolescents who live within the 1st ring tended to have higher western-style fast food and packaged food exposures or unhealthy food environment exposures than those who live between the 1st and 2nd ring and those who live outside the 2nd ring. While obesity is complex and affected by many factors such as built environment characteristics and socio-demographic status, even when unadjusted for confounding factors, differences in the food environment tended to be associated with observed differences in the rates of adolescent overweight and obese between neighborhoods. Additional research is needed to determine whether this association may be due to potential confounding factors (e.g., access to physical activity environments, environmental stress, etc.), rather than the food environment. As we consider future multivariate analyses of the associations between neighborhood-level differences and BMI, there may be value in considering BMI as a continuous variable in regression analyses to avoid loss of information through the tricotomization of BMI into underweight, normal, and overweight categories. Moreover, there would be considerable value in collecting actual data on dietary patterns as a mediator between the food environment and obesity. Ongoing research by our group aims to further explore the linkages between the food environment, dietary behavior, and weight status for adolescents. Nevertheless, our current findings are consistent with several studies that demonstrated that proximity to fast foods is positively associated with diet and higher BMI in Western contexts [23, 4250].

Different BMI cutoffs generated slight to moderate differences in the distributions of overweight and obese categories. IOTF Asian cutoff generated the highest percentages of overweight adolescents (35.6% for males and 21.8% for females) whereas CDC cutoffs only generated 18.6% for males and 9.5% for females, less than half of the IOTF Asian cutoff. In terms of underweight adolescents, CIP and WHO cutoffs generated around 2.0% of underweight males and females, whereas IOTF cutoff generated 6.2% for males and 12.3% for females, about three times and six times higher than the WHO percentage, respectively. Therefore, it is important for researchers to consider different cutoffs, and their use on particular populations. Choosing appropriate cutoffs will be extremely important in developing intervention strategies and making policy recommendations. Regardless of the BMI cutoffs used, however, we found the prevalence of overweight adolescents worrying, especially for male adolescents. Should these findings be reinforced by other larger studies in Chinese cities, action in the form of new obesity prevention strategies may be warranted to combat this problem.

Conclusions

The rates of overweight and obesity among Chinese adolescents deserves immediate attention, and requires the development of reliable, valid, and culturally-appropriate instruments to track risk factors for obesity. To our knowledge, this is the first food environment survey instrument developed to specifically assess changing food availability, accessibility and pricing in China. Moreover, this is one of the few studies that provide insights into rates of adolescent overweight/obesity in a middle-sized city in western China. This instrument can be used for conducting systematic longitudinal assessments of the changing food environment in rapidly developing Chinese cities where there is an urgent need to monitor changing disease risk.