Abstract
In this study some of the challenges of conducting online research with couples and families were considered. Of particular concern with internet samples are the high percentages of individuals who have invalid email addresses and the low response rates to research requests. Using a sample of 2,049 individuals from whom we had extensive information, we invited them to participant in a short survey on their couple relationship. We explored whether participants who had invalid email addresses were different from those who had valid addresses and we compared those who completed the survey with those who did not. Also we explored the influence of different monetary incentives on response rates. The findings indicated that when evaluating 18 different areas including background measures, personality measures, family of origin measures, and couple measures, there were only minor differences between those with valid and invalid email addresses, and only one difference between those who completed the survey and those who did not. Also a lottery type monetary incentive showed promise in improving response rates compared to no incentive and a standard $20 incentive.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bosnjak, M., & Batinic, B. (2002). Understanding the willingness to participate in online surveys: The case of email questionnaires. In B. Batinic, U.-D. Reips, & M. Bosnak (Eds.), Online social sciences (pp. 81–92). Seattle, WA: Hogrefe & Huber.
Bosnjak, M., & Tuten, T. L. (2003 ). Prepaid and promised incentives in web surveys. Social Science Computer Review, 21, 208–217.
Bradley, N. (2009). Sampling for Internet Surveys. An examination of respondent selection for Internet research. Downloaded February 6, 2009, from http://www2.wmin.ac.uk/~bradlen/papers/sam06.html.
Brenner, V. (2002). Generalizability issues in internet-based survey research: Implications for the internet addiction controversy. In B. Batinic, U.-D. Reips, & M. Bosnak (Eds.), Online social sciences (pp. 93–113). Seattle, WA: Hogrefe & Huber.
Busby, D. M., Gardner, B. C., & Taniguchi, N. (2005). The family of origin parachute model: Landing safely in adult romantic relationships. Family Relations, 54, 254–264.
Busby, D. M., Holman, T. B., & Taniguchi, N. (2001). RELATE: Relationship evaluation of the individual, family, cultural, and couple contexts. Family Relations, 50, 308–316.
Cantrell, M. A., & Lupinacci, P. (2007). Methodological issues in online data collection. Journal of Advanced Nursing, 60, 544–549.
Carroll, A. E., Rivara, F. P., Ebel, B., Zimmerman, F. J., & Christakis, D. A. (2005). Household computer and Internet access: The digital divide in a pediatric clinic population. AMIA Annual Symposium Proceedings, 2005, 111–115.
Church, A. H. (1993). Estimating the effect of incentives on mail survey response rates: A meta-analysis. Public Opinion Quarterly, 57, 62–79.
Draper, T. W., & Holman, T. B. (2005). Locating the big five personality factors in the RELATE relationship evaluation measures. Psychological Reports, 97, 877–886.
Godwin, R. K. (1979). The consequences of large monetary incentives in mail surveys of elites. Public Opinon Quarterly, 43, 378–387.
Goritz, A. S. (2006). Incentives in web studies: Methodological issues and a review. International Journal of Internet Science, 1, 58–70.
Goritz, A. S., & Luthe, S. C. (2013). How do lotteries and study results influence response behavior in online panel? Social Science Computer Review, 31, 371–385.
Holman, T. B., et al. (2001). Premarital prediciton of maritla quality or breakup: Research, theory, and practice. New York: Bluwer Academic/Plenum Publishers.
Hopkins, K. D., & Podolak, J. (1983). Class of mail and the effects of monetary gratuity on the response rate of mail. Journal of Experimental Education, 51, 160–170.
Houston, M. J., & Nevin, J. (1977). The effects of source and appeal on mail survey response patterns. Journal of Marketing Research, 14, 374–378.
James, J. M., & Bolstein, R. (1992). Large monetary incentives and their effect on mail survey response rate. Public Opinion Quarterly, 56(4), 442–453.
LaCoursiere, S. (2003). Research methodology for the internet: External validity (generalizability). Advances in Nursing Science, 26, 257–273.
Larson, J. H., & Holman, T. B. (1994). Premarital predictors of marital quality and stability. Family Relations, 43, 228–237.
Nederhof, A. J. (1983). The effects of material incentives in mail surveys: Two studies. Public Opinion Quarterly, 47, 103–111.
PEW Internet and American Life Project. (2009). Who’s Online. Downloaded February 6, 2009, from http://www.pewinternet.org/trends.asp.
Rogelberg, S. G., Conway, J. M., Sederburg, M. E., Spitzmuller, C., Aziz, S., & Knight, W. E. (2003). Profiling active and passive nonrespondents to an organizational survey. Journal of Applied Psychology, 88, 1104–1114.
Sachoff, M. (2008). Eighteen percent of US households have no internet access. Downloaded January 27, 2009, from http://www.webpronews.com/topnews/2008/05/14/18-of-us-households-have-no-internet-access.
Schoeni, R. F., Stafford, F., McGonagle, K. A., & Andreski, P. (2013). Response rates in national panel surveys. Annals of the American Academy of Political and Social Science, 645, 60–87.
Schonland, A., & Williams, P. (1996). Using the internet for travel and tourism survey research: Experiences from the Net traveler survey. Journal of Travel Research, 35, 81–87.
Schwarz, N., Groves, R. M., & Schuman, H. (1998). Survey methods. In D. T. Gilbert, S. T. Fiske, & L. Gardner (Eds.), The handbook of social psychology (4th ed., Vol. 1, pp. 143–179). New York: McGraw-Hill.
Singer, E., & Ye, C. (2013). The use and effects of incentives in surveys. Annals of the American Academy of Political and Social Science, 645, 112–141.
Sundberg-Cohon, J & Peacock, J (1998). Projectable internet panels. Using traditional “best practices” in an untraditional environment. ESOMAR Internet Conference, Paris, Jan 1998 Papers 219–232.
Szelenyi, K., Bryant, A., & Lindholm, J. A. (2005). What money can buy: Examining the effects of prepaid monetary incentives on survey response rates among college students. Educational Research and Evaluation, 11(4), 385–404.
Tourangeau, R. (2004). Survey research and societal change. Annual Review of Psychology, 55, 775–801.
Tuten, T. L., Urban, D. J., & Bosnjak, M. (2002). Internet surveys and data quality: A review. In B. Batinic, U.-D. Reips, & M. Bosnak (Eds.), Online social sciences (pp. 7–26). Seattle, WA: Hogrefe & Huber.
White, P. R. (1988). A buck for your thoughts? Even top execs can’t resist. Marketing News, 22, 24.
Whitmore, W. J. (1976). Mail survey premiums and response bias. Journal of Marketing Research, 13, 46–50.
Zickuhr, K., Smith, A., PEW Internet and American Life Project. (2012). Digital Differences. Downloaded May 29, 2013, from http://www.pewinternet.org/Reports/2012/Digital-differences/Main-Report/Internet-adoption-over-time.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Busby, D.M., Yoshida, K. Challenges with Online Research for Couples and Families: Evaluating Nonrespondents and the Differential Impact of Incentives. J Child Fam Stud 24, 505–513 (2015). https://doi.org/10.1007/s10826-013-9863-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10826-013-9863-6