The effects of survey mode and sampling in Belgian election studies: a comparison of a national probability face-to-face survey and a nonprobability Internet survey
National probability election surveys are more and more abandoned. Decreasing response rates and the escalating costs of face-to-face and telephone interviews have strengthened election scholars’ reliance on nonprobability internet samples to conduct election surveys online. In a number of countries, experiments with alternative ways of recruiting respondents and different interview modes have been well documented. For other countries, however, substantially less is known about the consequences of relying on nonprobability internet panels. In this paper, we investigate the effects of survey mode and sampling method in the Belgian context. This is a particularly important and relevant case study because election researchers in Belgium can draw a sample of voters directly from the National Register. In line with previous studies, we find important differences in the marginal distributions of variables measured in the two surveys. When considering vote choice models and the inferences that scholars would draw, in contrast, we find minor differences.
KeywordsElection study Belgium Survey mode effects Representativeness Nonprobability sample
A previous version of this paper was presented during the Making Electoral Democracy Work mini-conference at the 113th Annual Meeting of the American Political Science Meeting, San Francisco, August 31-September 3, 2017. We thank Filip Kostelka for providing technical information on the MEDW-survey and Fernando Feitosa for research assistance. We are grateful to Shane Singh and Dieter Stiers for commenting on previous drafts of the papers and the anonymous reviewers of this journal for excellent suggestions.
- Cameron, Sarah M., and Ian McAllister. 2016. Trends in Australian Political Opinion: Results from the Australian Election Study 1987–2016. Canberra: Australian National University.Google Scholar
- Converse, Philip, John Meisel, Maurice Pinard, Peter Regenstreif, and Mildred Schwartz. 2002. Canadian National Election Study, 1965. ICPSR 7225 [Data file]. Ann Arbor (MI): Inter-University Consortium for Political and Social Research [distributor].Google Scholar
- Deschouwer, Kris (ed.). 2018. Mind the Gap. Political Participation and Representation in Belgium. Lanham, MD: Rowman & Littlefield.Google Scholar
- Dillman, Don A. 2000. Mail and Internet Surveys: The Tailored Design Method. New York: Harper & Row.Google Scholar
- Fieldhouse, Ed, Jane Green, Geoffrey Evans, Herman Schmitt, Cees van der Eijk, Jonathan Mellon, and Chris Prosser. 2016. British Election Study, 2015: Face-to-Face Post-Election Survey [data collection]. UK Data Service. SN: 7972. https://doi.org/10.5255/UKDA-SN-7972-1.
- Fieldhouse, Ed, Jane Green, Geoffrey Evans, Herman Schmitt, Cees van der Eijk, Jonathan Mellon, and Chris Prosser. 2017. British Election Study Internet Panel Waves 1-13 [datafile]. https://doi.org/10.15127/1.293723.
- Foucault, Martial. 2017. L’enquête électorale française (www.enef.fr). Paris: CEVIPOF SciencesPo.Google Scholar
- Manfreda, Katja Lozar, Jernej Berzelak, Vasja Vehovar, Michael Bosnjak, and Iris Haas. 2008. Web Surveys Versus Other Survey Modes: A Meta-Analysis Comparing Response Rates. International Journal of Market Research 50 (2): 269–291.Google Scholar
- MEDW, Making Electoral Democracy Work. 2014. Making Electoral Democracy Work. Belgium Regional, National and European Election-Brussels, Flanders and Wallonia. Technical Report. Montréal.Google Scholar
- Motta, Matthew P., Timothy H. Callaghan, and Brianna Smith. 2016. Looking for Answers: Identifying Search Behavior and Improving Knowledge-Based Data Quality in Online Surveys. International Journal of Public Opinion Research 29 (4): 575–603.Google Scholar
- Northrup, David. 2016. The 2015 Canadian Election Study. Toronto: Institute for Social Research, York University.Google Scholar
- PartiRep. 2014. PartiRep Voter Panel Survey 2014. Technical Report. Brussels.Google Scholar
- Yeager, David S., Jon A. Krosnick, Chang LinChiat, Harold S. Javitz, Matthew S. Levendusky, Alberto Simpser, and Rui Wang. 2011. Comparing the Accuracy of RDD Telephone Surveys and Internet Surveys Conducted with Probability and Non-Probability Samples. Public Opinion Quarterly 75 (4): 709–747.CrossRefGoogle Scholar