Feasibility of Using Web-based Questionnaires in Large Population-based Epidemiological Studies
Accepted: 20 December 2005 DOI:
Cite this article as: Ekman, A., Dickman, P.W., Klint, Å. et al. Eur J Epidemiol (2006) 21: 103. doi:10.1007/s10654-005-6030-4 Abstract
To date, few large web-based epidemiological studies have been performed in a population-based setting. Sweden has optimal prerequisites for web-based studies with more than 80% of the general population having access to the Internet. Our aim was to investigate (I) response rates in an epidemiological study using primarily the web as a tool for data collection and (II) whether socio-demographic patterns vary between responders to a web and a paper questionnaire. In 2003, we invited 47,859 women to complete a web questionnaire. Two reminders were sent to non-responders; in the first a random sample received a paper questionnaire and in the second the majority received a paper questionnaire. All other non-responders received web questionnaires. Differences in response rates between responders to web and paper questionnaires with regard to socio-demographic and other variables were analyzed, and estimates of the bias introduced by these differences were estimated. In total, 41% of the women responded to the web questionnaire and 31% to the paper questionnaire (overall response rate 72%). The web-, paper- and non-responders respectively did not differ significantly in age, physical activity levels, and body mass index. Women answering web or paper questionnaires had a higher level of education and income and a lower level of smoking than non-responders. The bias associated with collecting information using web questionnaires was not greater than that caused by paper questionnaires. We conclude that web-based questionnaires are a feasible tool for data collection in large population based epidemiological studies in Sweden.
Key words Cohort studies Epidemiology Internet Questionnaire Abbreviations BMI
Body Mass Index
Hormone Replacement Therapy
Portable Document Format
Uniform Resource Locator
Statistics Sweden. Use of computers and the Internet by private persons in 2004. Stockholm: Statistics Sweden; 2004. Report No.: 91-618-1260-9.
Statistics Sweden. Use of computers and the Internet by private persons in 2002. Örebro: Statistics Sweden; 2002 January 28.
The National Board of Health and Welfare. The Cancer Registry. 2005 [cited; Available from: http://www.sos.se/epc/cancer/introcan.htm.
Statistics Sweden. Longitudinal database for education, income and occupation. 2005 2003-05-23 [cited 2005; Available from: http://www.scb.se/templates/Standard_22868.asp.
Leece, P, Bhandari, M, Sprague, S, et al. 2004 Internet versus mailed questionnaires: A randomized comparison (2) J Med Internet Res. 6 e30 CrossRef PubMed Google Scholar
Braithwaite, D, Emery, J, Lusignan, S, Sutton, S. 2003 Using the Internet to conduct surveys of health professionals: A valid alternative? Fam. Pract. 20 545 551 CrossRef PubMed Google Scholar
McMahon, SR, Iwamoto, M, Massoudi, MS, et al. 2003 Comparison of e-mail, fax, and postal surveys of pediatricians Pediatrics 111 e299 e303 PubMed Google Scholar
Crawford S, McCabe S, Couper MP, Boyd C. From Mail to Web: Improving Response Rates and Data Collection Efficiencies. In: International Conference on Improving Surveys. Copenhagen, Denmark, 2002.
Baer, A, Saroiu, S, Koutsky, LA. 2002 Obtaining sensitive data through the Web: An example of design and methods Epidemiology 13 640 645 CrossRef PubMed Google Scholar
Houston, TK, Cooper, LA, Vu, HT, Kahn, J, Toser, J, Ford, DE. 2001 Screening the public for depression through the Internet Psychiatr Serv 52 362 367 CrossRef PubMed Google Scholar
Baker, L, Wagner, TH, Singer, S, Bundorf, MK. 2003 Use of the Internet and E-mail for Health Care Information: Results From a National Survey JAMA 289 2400 2406 CrossRef PubMed Google Scholar
Gosling, SD, Vazire, S, Srivastava, S, John, OP. 2004 Should we trust web-based studies? A comparative analysis of six preconceptions about Internet questionnaires Am Psychol 59 93 104 CrossRef PubMed Google Scholar
Truell, AD, Bartlett, JE, II, Alexander, MW. 2002 Response rate, speed, and completeness: A comparison of Internet-based and mail surveys Behav Res Methods Instrum Comput 34 46 49 PubMed Google Scholar
Schleyer, TK, Forrest, JL. 2000 Methods for the design and administration of web-based surveys J Am Med Inform Assoc 7 416 425 PubMed Google Scholar
Wyatt, JC. 2000 When to use web-based surveys J Am Med Inform Assoc 7 426 429 PubMed Google Scholar
The Data Inspection Board. Personal Data Act (1998:204). In; 1998.
Wacholder, S. 1986 Binomial regression in GLIM: estimating risk ratios and risk differences Am J Epidemiol 123 174 184 PubMed Google Scholar
Pettit, FA. 2002 A comparison of World-Wide Web and paper-and-pencil personality questionnaires Behav Res Methods Instrum Comput 34 50 54 PubMed Google Scholar
Kypri, K, Gallagher, SJ, Cashell-Smith, ML. 2004 An Internet-based survey method for college student drinking research Drug and Alcohol Dependence 76 45 53 CrossRef PubMed Google Scholar
Miller, ET, Neal, DJ, Roberts, LJ, et al. 2002 Test–retest reliability of alcohol measures: Is there a difference between internet-based assessment and traditional methods? Psychol Addict Behav 16 56 63 CrossRef PubMed Google Scholar
O’Neil, KM, Penrod, SD. 2001 Methodological variables in web-based research that may affect results: Sample type, monetary incentives, and personal information Behav Res Methods Instrum Comput 33 226 233 PubMed Google Scholar
Dillman D, Tortora RL, Conradt J, Bowker D. Influence of plain vs. fancy design on response rates for web surveys. In: Joint Statistical Meetings. Alexandria, Egypt, 1998.
Couper, MP, Traugott, MW, Lamias, MJ. 2001 Web survey design and administration Public Opin Q 65 230 253 CrossRef PubMed Google Scholar
Internet World Stats, Usage and Population Statistics. 2005 [cited 2005 13th of June]; Available from: http://www.internetworldstats.com/stats.htm.
Nua Internet Surveys. How Many Online? 2005 [cited 2005 13th of June]; Available from: http://www.nua.ie/surveys/.
Solomon DJ. Conducting web-based surveys. Pract. Assess. Res. Eval. 2001; 7(19).
Buchanan, T, Tarick, A, Heffernan, TM, et al. 2005 Nonequivalence of on-line and paper-and-pencil psychological tests: The case of the prospective memory questionnaire Behav Res Methods 37 148 154 PubMed Google Scholar
Ross, MW, Mansson, SA, Daneback, K, Cooper, A, Tikkanen, R. 2005 Biases in Internet sexual health samples: Comparison of an internet sexuality survey and a national sexual health survey in Sweden Soc Sci Med 61 245 252 CrossRef PubMed Google Scholar