Skip to main content

Advertisement

Log in

An Analysis of Response Rate and Economic Costs Between Mail and Web-Based Surveys Among Practicing Dentists: A Randomized Trial

  • Original Paper
  • Published:
Journal of Community Health Aims and scope Submit manuscript

Abstract

This study explored the economic costs and response rate of mail and web-based surveys with practicing dentists. A random sample of 6,000 practicing dentists was randomly assigned into three groups of 2,000: choice (mail or web-based), postal mail, or web-based. The Florida Tobacco Control Survey 2009, which is composed of 28 questions (including subject demographic questions), served as the survey instrument. A total of 1,232 surveys were returned by the three different groups (21% overall response rate). Response rates were best for the mail (26%) with the worst response rate coming from the Web group (11%). However, a cost-effectiveness analysis revealed that web surveys were 2.68 times more cost effective.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

References

  1. Galea, M., & Tracy, S. (2007). Participation rates in epidemiological studies. Annals of Epidemiology, 17, 643–653.

    Article  PubMed  Google Scholar 

  2. Krosnick, J. A. (1999). Survey research. Annual Review of Psychology, 50, 537–567.

    Article  PubMed  CAS  Google Scholar 

  3. Shih, T. H., & Fan, X. (2007). Response rates and mode preferences in web-mail mixed-mode surveys: A meta-analysis. International Journal of Internet Science, 2, 59–82.

    Google Scholar 

  4. Robling, M. R., Ingledew, D. K., Greene, G., Sayers, A., Shaw, C., Sander, L., et al. (2010). Applying an extended theoretical framework for data collection mode to health services research. BMC Health Services Research, 10, 180.

    Article  PubMed  Google Scholar 

  5. Millar, M. M., O’Neill, A. C., & Dillman, D. A. (2009). Are mode preferences real? Pullman, WA: Washington State University, Social & Economic Sciences Research Center (SESRC). 2009 February. Technical report: 09-003. Retrieved from http://www.sesrc.wsu.edu/dillman/papers/Tech%20Report%20FINAL%20Feb%2023.pdf.

  6. Manfreda, K. L., Bosnjak, M., Berzelak, J., Haas, I., & Vehovar, V. (2008). Web surveys versus other survey modes: A meta-analysis comparing response rates. International Journal of Market Research, 50, 79–104.

    Google Scholar 

  7. Diment, K., & Sam, G. J. (2007). How demographic characteristics affect mode preference in a postal/web mixed-mode survey of Australian researchers. Social Science Computer Review, 25, 410–417.

    Article  Google Scholar 

  8. Cobanoglu, C., Warde, B., & Moreo, P. J. (2001). A comparison of mail, FAX and web-based survey methods. International Journal of Marketing, 18, 405–410.

    Google Scholar 

  9. Fiset, L., Milgrom, P., & Tamai, J. (2007). Dentists’ response to financial incentives in a mail survey of malpractice liability experience. Journal of Public Health Dentistry, 54, 68–72.

    Article  Google Scholar 

  10. Rikard-Bell, G., & Ward, J. (2000). Maximizing response rates to a survey of dentists: A randomized trial. Australian Dental Journal, 45, 46–48.

    Article  PubMed  CAS  Google Scholar 

  11. Shih, T., & Fan, X. (2008). Comparing response rates from web and mail surveys: A meta-analysis. Field Methods, 20, 249–271.

    Article  Google Scholar 

  12. Watt, J. H. (1999). Internet systems for evaluation research. In G. Gay & T. Bennington (Eds.), Information technologies in evaluation: social, moral, epistemological and practical implications. San Francisco, CA: Josey-Bass.

    Google Scholar 

  13. Quigley, B., Riemer, R. A., Cruzen, D. E., & Rosen, S. (2000). Internet versus paper survey administration: Preliminary findings on response rates. Paper presented at: The annual conference of the international military testing association, 2000 November 7–9, Edinburgh, Scotland, UK.

  14. Brogger, J., Nystad, W., Cappelen, I., & Bakke, P. (2007). No increase in response rate by adding a web response option to a postal population survey: A randomized trial. Journal of Medical Internet Research, 9, e40.

    Article  PubMed  Google Scholar 

  15. Landry, C. F. (2006). Work roles, tasks, and the information behavior of dentists. Journal of the American Society for Information Science & Technology, 57, 1896–1908.

    Article  Google Scholar 

  16. Birnbaum, M. H. (2004). Human research and data collection via the internet. Annual Review of Psychology, 55, 803–832.

    Article  PubMed  Google Scholar 

  17. Lozar, M. K., & Vehovar, V. (2002). Do mail and web surveys provide same results? In A. M. Ferligov & A. Mrvar (Eds.), Development in social science methodology. Ljubljana, Slovenia: Metodoloski Zvezki.

    Google Scholar 

  18. Lozar, M. K., Bosnjak, M., Berzelak, J., Haas, I., & Vehovar, V. (2008). Web surveys versus other survey modes—a meta-analysis comparing response rates. International Journal of Market Research, 50, 79–104.

    Google Scholar 

  19. Kaplowitz, M. D., Hadlock, T. D., & Levine, R. (2004). A comparison of web and mail survey response rates. Public Opinion Quarterly, 68, 94–101.

    Article  Google Scholar 

  20. Im, E., Cheeb, W., Bender, M., Cheng, C., Tsai, H., Kang, N. M., et al. (2005). The psychometric properties of pen-and-pencil and internet versions of the midlife women’s symptom index (MSI). International Journal of Nursing Studies, 42, 167–177.

    Article  PubMed  Google Scholar 

  21. Barrios, M., Villarroya, A., Borrego, A., & Ollé, C. (2010). Response rates and data quality in web and mail surveys administered to PhD holders. Social Science Computer Review. Published online 2010 May 10 [cited 2011 Mar 2]. Available from http://ssc.sagepub.com/content/early/2010/04/21/0894439310368031.full.pdf.

Download references

Acknowledgments

The study would not have been possible without the dentists who gave of their time to complete the survey. Thank you. The corresponding author would like to thank Ms. Kathleen Hagen for her work in proofreading this document.

Conflict interests

The authors declare that they have no competing interests.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Patrick C. Hardigan.

Appendix

Appendix

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hardigan, P.C., Succar, C.T. & Fleisher, J.M. An Analysis of Response Rate and Economic Costs Between Mail and Web-Based Surveys Among Practicing Dentists: A Randomized Trial. J Community Health 37, 383–394 (2012). https://doi.org/10.1007/s10900-011-9455-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10900-011-9455-6

Keywords

Navigation