Abstract
Online surveys are one of the most prominent data collection methods in Europe and the USA. Not only are they fast and cheap, data quality in well-designed online surveys is high, especially when sensitive questions are asked. Disadvantages are the threat of undercoverage, as not everyone has Internet access, and high nonresponse. In order to overcome these disadvantages, mixed-mode designs are used in which multiple data collection methods are combined. The strength of mixed-mode surveys is their potential to reduce coverage and nonresponse error at affordable costs. However, survey modes may differ in the effect they have on measurement error, and one critical question is how data from different modes may be combined. A special form of mixed mode design is a mixed-device survey. Web surveys are increasingly completed on a range of different devices. Mobile phones, tablets, and even smart watches are being used in addition to regular desktop PCs. The question arises whether or not answers obtained via smartphones or tablets are comparable to answers via regular desktop PCs. Screen sizes are very different and also the mode of response entry varies between devices. Survey software increasingly adapts to mobile survey responding via responsive survey design. The software detects the device used for completing the survey and adapts the format accordingly. This chapter discusses the most common designs for mixed mode surveys and summarizes the empirical evidence for reducing coverage and nonresponse error and then focuses on measurement error. We pay special attention to careful design and provide rules for doing web surveys that are in fact mixed-device surveys.
This is a preview of subscription content, log in via an institution to check access.
References
Buskirk, T. D. (2015) “The Rise of Mobile Devices: From Smartphones to Smart Surveys.” The Survey Statistician, 72, 25–35. Available at http://isi-iass.org/home/wp-content/uploads/N72.pdf
Couper, M. P., Antoun, C., & Mavletova, A. (2017). Mobile Web Surveys: A Total Survey Error Perspective. In P. P. Biemer, E. de Leeuw, S. Eckman, B. Edwards, F. Kreuter, L. E. Lyberg, N.C. Tucker, & B. T. West (eds.), Total Survey Error in Practice (Chapter 7). New York: Wiley.
De Leeuw, E. D. (2005). To Mix or Not to Mix Data Collection Modes in Surveys. Journal of Official Statistics, 21(2), 233–255. Freely available at http://www.jos.nu/Articles/abstract.asp?article=212233.
De Leeuw, E. D., Hox, J. J., & Boeve, A. (2016). Handling Do-Not-Know Answers: Exploring New Approaches in Online and Mixed-Mode Surveys. Social Science Computer Review, 34(1), 116–132.
De Leeuw, E. D., & Berzelak, N. (2016). Survey Mode or Survey Modes?. In C. Wolf, D. Joye, T. W. Smith, & Y.-C. Fu (eds.) The Sage Handbook of Survey Methodology (Chapter 11). Los Angeles: Sage.
Hox, J. J., De Leeuw, E. D., & Klausch, T. (2017). Mixed mode Research: Issues in Design and Analysis. In P. P. Biemer, E. de Leeuw, S. Eckman, B. Edwards, F. Kreuter, L. E. Lyberg, N.C. Tucker, & B. T. West (eds.), Total Survey Error in Practice (Chapter 24). New York: Wiley.
Lugtig, P., & Toepoel, V. (2015). The Use of PCs, Smartphones and Tablets in a Probability Based Panel Survey. Effects on Survey Measurement Error. Social Science Computer Review, 34 (1), 78–94.
Lynn, P., & Kaminska, O. (2013). The Impact of Mobile Phones on Survey Measurement Error. Public Opinion Quarterly, 77 (2), 586–605.
Peterson, G., Griffin, J., LaFrance, J., & Li, J. J. (2017). Smartphone Participation in Web Surveys: Choosing Between the Potential for Coverage, Nonresponse, and Measurement Error. In P. P. Biemer, E. de Leeuw, S. Eckman, B. Edwards, F. Kreuter, L. E. Lyberg, N.C. Tucker, & B. T. West (eds.), Total Survey Error in Practice (Chapter 10). New York: Wiley.
Toepoel, V., & Lugtig, P. (2014). What Happens if You Offer a Mobile Option to Your Web Panel? Evidence From a Probability-Based Panel of Internet Users. Social Science Computer Review, 32 (4), 544–560.
Tourangeau, R. (2017). Mixing Modes: Tradeoffs among Coverage, Nonresponse, and Measurement Error. In P. P. Biemer, E. de Leeuw, S. Eckman, B. Edwards, F. Kreuter, L. E. Lyberg, N.C. Tucker, & B. T. West (eds.), Total Survey Error in Practice (Chapter 6). New York: Wiley.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 The Author(s)
About this chapter
Cite this chapter
de Leeuw, E.D., Toepoel, V. (2018). Mixed-Mode and Mixed-Device Surveys. In: Vannette, D., Krosnick, J. (eds) The Palgrave Handbook of Survey Research . Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-319-54395-6_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-54395-6_8
Published:
Publisher Name: Palgrave Macmillan, Cham
Print ISBN: 978-3-319-54394-9
Online ISBN: 978-3-319-54395-6
eBook Packages: Political Science and International StudiesPolitical Science and International Studies (R0)