Abstract
Objectives
Field substitution and post-stratification adjustment have been proposed to reduce non-response bias in population surveys. We investigated if variables involved in those techniques in the Belgian health interview survey 2004 are associated with non-response and assessed the impact of field substitution and post-stratification adjustment on the survey results.
Methods
Data were obtained from all selected households (n = 12.204). The association between non-response and the selected variables was explored through multilevel logistic regression models with municipality and statistical sector as random effects.
Results
All investigated variables were significantly related with non-response. Especially households that could not be contacted differed substantially from those who participated. Only post-stratification had a clear impact on the survey results.
Conclusions
Even if variables used in the field substitution procedure of health surveys are strongly associated with non-response, the impact of field substitution on the survey results may be minimal, either because there was no bias of relevance or it was not captured. The usefulness of field substitution to correct for non-response bias in population health surveys seems to be quite limited.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aromaa A, Koponen P, Tafforeau J, Vermeire C (2003) Evaluation of health interview surveys and health examination surveys in the European Union. Eur J Publ Health 13(3 Suppl):67–72
Barriball KL, While AE (1999) Non-response in survey research: a methodological discussion and development of an explanatory model. J Adv Nurs 30(3):677–686
Burzykowski T, Molenberghs G, Tafforeau J, Van Oyen H, Demarest S, Bellamammer L (1999) Missing data in the health interview survey 1997 in Belgium. Arch Public Health 57:107–129
Company Stata (2007) Stata statistical software: release 10. StataCorp, College Station
Demarest S, Van der Heyden J, Charafeddine R, Tafforeau J, Van Oyen H, Van Hal G (2012) Socio-economic differences in participation of households in a Belgian national health survey. Eur J Public Health. doi:10.1093/eurpub/cks158
Drivsholm T, Eplov LF, Davidsen M, Jorgensen T, Ibsen H, Hollnagel H et al (2006) Representativeness in population-based studies: a detailed description of non-response in a Danish cohort study. Scand J Public Health 34(6):623–631
Ekholm O, Hesse U, Davidsen M, Kjoller M (2009) The study design and characteristics of the Danish national health interview surveys. Scand J Public Health 37(7):758–765
Ekholm O, Gundgaard J, Rasmussen NK, Hansen EH (2010) The effect of health, socio-economic position, and mode of data collection on non-response in health interview surveys. Scand J Public Health 38(7):699–706
Galea S, Tracy M (2007) Participation rates in epidemiologic studies. Ann Epidemiol 17(9):643–653
Goodman A, Gatward R (2008) Who are we missing? Area deprivation and survey participation. Eur J Epidemiol 23(6):379–387
Groves R, Couper M (1998) Nonresponse in household interview surveys. Wiley, New York
Groves R, Dillman D, Eltinge J, Little R (2002) Survey nonresponse. Wiley, New York
Groves R, Fowler F, Couper M, Lepkowski J, Singer E, Tourangeau R (2004) Survey methodology. Wiley, Hoboken
Heerwegh K, Abts K, Loosveldt G (2007) Minimizing survey refusal and noncontact rates: do our efforts pay off? Surv Res Methods 1(1):3–10
Helasoja V, Prattala R, Dregval L, Pudule I, Kasmel A (2002) Late response and item nonresponse in the Finbalt Health Monitor survey. Eur J Public Health 12(2):117–123
Kessler RC, Little RJ, Groves RM (1995) Advances in strategies for minimizing and adjusting for survey nonresponse. Epidemiol Rev 17(1):192–204
Kilpeläinen K, Aromaa A, ECHIM Core Group (2008) European health indicators: development and initial implementation. Final report of the ECHIM project. National Public Health Institute, Helsinki
Kish L, Frankel MR (1974) Inference from complex samples. J Roy Stat Soc B 36:1–37
Korkeila K, Suominen S, Ahvenainen J, Ojanlatva A, Rautava P, Helenius H et al (2001) Non-response and related factors in a nation-wide health survey. Eur J Epidemiol 17(11):991–999
Larsen K, Merlo J (2005) Appropriate assessment of neighborhood effects on individual health: integrating random and fixed effects in multilevel logistic regression. Am J Epidemiol 161(1):81–88
Lorant V, Demarest S, Miermans PJ, Van Oyen H (2007) Survey error in measuring socio-economic risk factors of health status: a comparison of a survey and a census. Int J Epidemiol 36(6):1292–1299
Lynn P, Clarke P (2002) Separating refusal bias and non-contact bias: evidence from UK national surveys. J Royal Stat Soc Ser D (The Stat) 51(3):319–333
MacDonald SE, Newburn-Cook CV, Schopflocher D, Richter S (2009) Addressing nonresponse bias in postal surveys. Public Health Nurs 26(1):95–105
Mannetje A, Eng A, Douwes J, Ellison-Loschmann L, McLean D, Pearce N (2011) Determinants of non-response in an occupational exposure and health survey in New Zealand. Aust N Z J Public Health 35(3):256–263
Marcus B, Schutz A (2005) Who are the people reluctant to participate in research? Personality correlates of four different types of nonresponse as inferred from self- and observer ratings. J Pers 73(4):959–984
Merlo J, Chaix B, Ohlsson H, Beckman A, Johnell K, Hjerpe P et al (2006) A brief conceptual tutorial of multilevel analysis in social epidemiology: using measures of clustering in multilevel logistic regression to investigate contextual phenomena. J Epidemiol Community Health 60(4):290–297
Schneider KL, Clark MA, Rakowski W, Lapane KL (2012) Evaluating the impact of non-response bias in the behavioral risk factor surveillance system (BRFSS). J Epidemiol Community Health 66(4):290–295
Scientific Institute of Public Health (2005) Health Interview Survey 2004. Research Protocol, Belgium. Scientific Institute of Public Health, Brussels, Belgium
Scientific Institute of Public Health (2012) Highlights of the Belgian Health Interview Survey 2008, Brussels
Van Loon AJ, Tijhuis M, Picavet HS, Surtees PG, Ormel J (2003) Survey non-response in the Netherlands: effects on prevalence estimates and associations. Ann Epidemiol 13(2):105–110
Van Oyen H, Tafforeau J, Hermans H, Quataert P, Schiettecatte E, Lebrun L et al (1997) The Belgian health interview survey. Arch Public Health 55:1–13
Vehovar V (1999) Field substitution and unit nonresponse. J Official Stat 15(2):335–350
Vives A, Ferreccio C, Marshall G (2009) A comparison of two methods to adjust for non-response bias: field substitution and weighting non-response adjustments based on response propensity. Gac Sanit 23(4):266–271
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Van der Heyden, J., Demarest, S., Van Herck, K. et al. Association between variables used in the field substitution and post-stratification adjustment in the Belgian health interview survey and non-response. Int J Public Health 59, 197–206 (2014). https://doi.org/10.1007/s00038-013-0460-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00038-013-0460-7