Systematic self-report bias in health data: impact on estimating cross-sectional and treatment effects
- 382 Downloads
This paper examines the effect of systematic self-report bias, the non-random deviation between the self-reported and true values of the same measure. This bias may be constant or variable, and can mislead empirical analyses based on descriptive statistics, program evaluation and instrumental variables estimation. I illustrate these issues with data on self-reported and measured overweight/obesity status, and BMI, height and weight z-scores of public school students in California from 2004 to 2006. I find that the prevalence of overweight/obesity is 2.4–7.6% points lower in self-reported data relative to measured data in the cross-section. A school nutrition policy changed the bias differentially in the treatment and control groups so that program evaluations could find spurious positive or null impacts of the intervention. Potential channels for this effect include improved information and stigma.
KeywordsMeasurement error Program evaluation Instrumental variables Survey data Obesity
JEL classificationI10 C10
I am grateful to Alberto Abadie, Eliana Carranza, David Cutler, Caroline Hoxby, Holger Kern, James O’Malley, Thomas McGuire, Manoj Mohanan, Joseph Newhouse, Alan Zaslavsky and an anonymous referee for helpful suggestions; and to Kiku Annon, Jerry Bailey and Julie Williams for assistance with the PFT and CHKS data.
- Bauhoff, S.: The Effect of School Nutrition Policies in California on Dietary Intake and Obesity: A Synthetic Control Approach. Working Paper (2010)Google Scholar
- Bound, J., Brown, C., Mathiowetz, N.: Measurement error in survey data. In: Heckman, J., Leamer, E. (eds.) Handbook of Econometrics, vol. 5, chap. 59, pp. 3705–3843. Elsevier, Amsterdam (2001)Google Scholar
- Cawley, J.: Rational Addiction, the Consumption of Calories, and Body Weight, Ph.D. thesis (1999)Google Scholar
- CDC: YRBS 2007 Data User Manual. Technical Report, Centers for Disease Control and Prevention (2007)Google Scholar
- Samuels, S.E., Craypo, L., Boyle, M., Stone-Francisco, S., Schwarte, L.: Improving School Food Environments Through District-Level Policies: Findings from Six California Case Studies. Technical Report, Samuels and Associates (2006)Google Scholar
- StataCorp: Stata Statistical Software: Release 11 (2009)Google Scholar
- Vidmar, S., Carlin, J., Hesketh, K., Cole, T.: Standardizing anthropometric measures in children and adolescents with new functions for egen. Stata J. 4, 50–55 (2004)Google Scholar