Skip to main content
Log in

How survey administration can affect response in electronic surveys

  • Published:
Quality & Quantity Aims and scope Submit manuscript

Abstract

Electronic surveys have become one of the most popular methods of data collection in research. In order to obtain satisfactory results, good response rates are needed. We examine response rates to a survey administered in a face-to-face class-based setting collected using an electronic survey tool. The electronic survey was administered in four separate instances where each instance involved the survey administrator using either an active or passive administrative approach, and either offering or declining to offer extra credit. While no significant difference was found in actual responses to questions between the four groups, a significant difference was found in response rates between respondents who were offered extra credit and those who were not, and between surveys that were administered using active versus passive approaches. Other expected findings include higher responses in individual groups using the active approach and offering extra credit. An unexpected result occurred in the groups where no extra credit was offered: No significant difference was found between the active and passive administrations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Amar, A.F., Alexy, E.M.: Coping with stalking. Issues Mental Health Nurs. 31(1), 8–14 (2010)

    Article  Google Scholar 

  • Baxter, L.A., Bylund, C.L., Imes, R., Routsong, T.: Parent-child perceptions of parental behavioral control through rule-setting for risky health choices during adolescence. J. Fam. Commun. 9(4), 251–271 (2009)

    Article  Google Scholar 

  • Bekkering, E., Hutchison, D.: A follow-up study of using remote desktop applications in education. Inf. Systems Educ. J. 7(55), 13 (2009)

    Google Scholar 

  • Buchanan, E.A., Hvizdak, E.E.: Online survey tools: ethical and methodological concerns of human research ethics committees. J. Empir. Res. Hum. Res. Ethics 4(2), 37–48 (2009)

    Article  Google Scholar 

  • Church, A.H.: Estimating the effect of incentives on mail survey response rates: a meta-analysis. Public Opin. Q. 57(1), 62–79 (1993)

    Article  Google Scholar 

  • Cocco, M., Tuzzi, A.: New data collection modes for surveys: a comparative analysis of the influence of survey mode on question-wording effects. Qual. Quant. 47(6), 3135–3152 (2013)

    Article  Google Scholar 

  • Cook, C., Heath, F., Thompson, R.L.: A meta-analysis of response rates in web-or internet-based surveys. Educ. Psychol. Meas. 60(6), 821–836 (2000)

    Article  Google Scholar 

  • Couper, M.P.: Web surveys: a review of issues and approaches. Public Opin. Q. 64, 464–494 (2000)

    Article  Google Scholar 

  • Edwards, P., Roberts, I., Clarke, M., DiGuiseppi, C., Pratap, S., Wentz, R., Kwan, I.: Increasing response rates to postal questionnaires: systematic review. Br. Med. J. 324(7347), 1183–1185 (2002)

    Article  Google Scholar 

  • Fan, W., Yan, Z.: Factors affecting response rates of the web survey: a systematic review. Comput. Hum. Behav. 26(2), 132–139 (2010)

    Article  Google Scholar 

  • Fraze, S.D., Hardin, K.K., Brashears, M.T., Haygood, J.L., Smith, J.H.: The effects of delivery mode upon survey response rate and perceived attitudes of Texas agri-science teachers. J. Agric. Educ. 44(2), 27–37 (2003)

    Article  Google Scholar 

  • Fricker, R.D., Schonlau, M.: Advantages and disadvantages of Internet research surveys: evidence from the literature. Field Methods 14, 347–367 (2002)

    Article  Google Scholar 

  • Hair Jr, J.F., Black, W.C., Babin, B.J., Anderson, R.E., Tatham, R.L.: Multivariate data analysis. Pearson, New Jersey (2006)

    Google Scholar 

  • Hawley, K., Cook, J., Jensen-Doss, A.: Do noncontingent incentives increase survey response rates among mental health providers? A randomized trial comparison. Adm. Policy Mental Health Mental Health Services Res. 36(5), 343–348 (2009)

    Article  Google Scholar 

  • Johnson, T.: Online student ratings: Will students respond? New Dir. Teach. Learn. 96, 49–59 (2003)

    Article  Google Scholar 

  • Manfreda, K.L., Bosnjak, M., Berzelak, J., Haas, I., Vehovar, V.: Web surveys versus other survey modes. Int. J. Mark. Res. 50, 79–104 (2008)

    Google Scholar 

  • McColl, E., Jacoby, A., Thomas, L., Soutter, J., Bamford, C., Steen, N., Thomas, R., Harvey, E., Garratt, A., Bond, J.: Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. Health Technol. Assess. 5(31), 1–256 (2001)

    Article  Google Scholar 

  • Munoz-Leiva, F., Sanchez-Fernandez, J., Montoro-Rios, F., Ibanez-Zapata, J.: Improving the response rate and quality in web-based surveys through the personalization and frequency of reminder mailings. Qual. Quant. 44(5), 1037–1052 (2010)

    Article  Google Scholar 

  • Sanchez-Fernandez, J., Munoz-Leiva, F., Montoro-Rios, F., Ibanez-Zapata, J.A.: An analysis of the effect of pre-incentives and post-incentives based on draws on response to web surveys. Qual. Quant. 44(2), 357–373 (2010)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michael J. Magro.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Magro, M.J., Prybutok, V.R. & Ryan, S.D. How survey administration can affect response in electronic surveys. Qual Quant 49, 2145–2154 (2015). https://doi.org/10.1007/s11135-014-0098-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11135-014-0098-4

Keywords

Navigation