Abstract
Internet interventions often rely on convenience sampling, yet convenience samples may differ in important ways from systematic recruitment approaches. The purpose of this study was to evaluate potential demographic, medical, and psychosocial differences between Internet-recruited and registry-recruited cancer survivors in an Internet-based intervention. Participants were recruited from a cancer registry (n = 80) and via broad Internet outreach efforts (n = 160). Participants completed a set of self-report questionnaires, and both samples were compared to a population-based sample of cancer survivors (n = 5,150). The Internet sample was younger, better educated, more likely to be female, had longer time since diagnosis, and had more advanced stage of disease (p’s < .001), and the registry-sample was over-represented by men and those with prostate or other cancer types (p’s < .001). The Internet sample also exhibited lower quality of life and social support and greater mood disturbance (p’s < .001). Understanding how convenience and systematic samples differ has important implications for external validity and potential for dissemination of Internet-based interventions.
Similar content being viewed by others
References
Baker, F., Denniston, M., Zabora, J., Polland, A., & Dudley, W. N. (2002). A POMS short form for cancer patients: Psychometric and structural evaluation. Psycho-Oncology, 11, 273–281.
Bennett, G. G., & Glasgow, R. E. (2009). The delivery of public health interventions via the Internet: Actualizing their potential. Annual Review of Public Health, 30, 273–292.
Berman, R. L., Iris, M. A., Bode, R., & Drengenberg, C. (2009). The effectiveness of an online mind-body intervention for older adults with chronic pain. Journal of Pain, 10, 68–79.
Beskow, L. M., Sandler, R. S., & Weinberger, M. (2006). Research recruitment through US central cancer registries: Balancing privacy and scientific issues. American Journal of Public Health, 96, 1920–1926.
Boehmer, U., Clark, M., Glickman, M., Timm, A., Sullivan, M., Bradford, J., et al. (2010). Using cancer registry data for recruitment of sexual minority women: Successes and limitations. Journal of Women’s Health, 19, 1289–1297.
Brady, M. J., Cella, D. F., Mo, F., Bonomi, A. E., Tulsky, D. S., Lloyd, S. R., et al. (1997). Reliability and validity of the functional assessment of cancer therapy-breast quality-of-life instrument. Journal of Clinical Oncology, 15, 974–986.
Brooks, R. (1996). EuroQuol: The current state of play. Health Policy, 37, 53–72.
Butler, L. D., Koopman, C., Classen, C., & Spiegel, D. (1999). Traumatic stress, life events, and emotional support in women with metastatic breast cancer: Cancer-related traumatic stress symptoms associated with past and current stressors. Health Psychology, 18, 555–560.
Cadmus Bertram, L. A., Chung, G., Yu, H., Salovey, P., & Irwin, M. (2011). Feasibility of institutional registry-based recruitment for enrolling newly diagnosed breast cancer patients in an exercise trial. Journal of Physical Activity and Health, 8, 955–963.
Cella, D. (1997). FACIT manual. Chicago, IL: Center on Outcomes, Research, and Education, Evanston Northwestern Healthcare and Northwestern University.
Chou, W. Y., Liu, B., Post, S., & Hesse, B. (2011). Health-related Internet use among cancer survivors: Data from the health information national trends survey, 2003–2008. Journal of Cancer Survivorship, 5, 263–270.
David, N., Schlenker, P., Prudlo, U., & Larbig, W. (2011). Online counseling via e-mail for breast cancer patients on the German internet: Preliminary results of a psychoeducational intervention. Psychosocial Medicine, 8, 1–13.
Devinini, T., & Blanchard, E. B. (2005). A randomized controlled trial of an internet-based treatment for chronic headache. Behaviour Research and Therapy, 43, 277–292.
Edgar, L., Rosberger, Z., & Nowlis, D. (1992). Coping with cancer during the first year after diagnosis. Cancer, 69, 817–828.
Fogel, J., Albert, S. M., Schnabel, F., Ditkoff, B. A., & Neugut, A. I. (2002). Internet use and social support in women with breast cancer. Health Psychology, 21, 398–404.
Gessler, S., Low, J., Daniells, E., Willams, R., Brough, V., Tookman, A., et al. (2008). Screening for distress in cancer patients: Is the distress thermometer a valid measure in the UK and does it measure change over time? A prospective validation study. Psycho-Oncology, 17, 538–547.
Glasgow, R. E., Kurz, D., King, D., Dickman, J. M., Faber, A. J., Halterman, E., et al. (2010). Outcomes of minimal and moderate support versions of an internet-based diabetes self-management support program. Journal of General Internal Medicine, 25, 1315–1322.
Glasgow, R. E., Vinson, C., Chambers, D., Khoury, M. J., Kaplan, R. M., & Hunter, C. (2012). National Institutes of Health approaches to dissemination and implementation science: Current and future directions. American Journal of Public Health, 102, 1274–1281.
Gorlick, A., Lewallen, A., Regts, G., & Owen, J. E. (2011). A systematic review of behavioral engagement in Internet-based interventions for lung cancer. In 8th Annual conference on abstracts from the American Psychosocial Oncology Society, Anaheim, CA, USA, 17–19 Feb 2011. Charlottesville, VA: APOS.
Gross, C. P., Mallory, R., Heiat, A., & Krumholz, H. M. (2002). Reporting the recruitment process in clinical trials: Who are these patients and how did they get there? Annals of Internal Medicine, 137, 10–16.
Gustafson, D. H., Hawkins, R., Pingree, S., McTavish, F., Arora, N. K., Mendenhall, J., et al. (2001). Effect of computer support on younger women with breast cancer. Journal of General Internal Medicine, 16, 435–445.
Hann, D., Winter, K., & Jacobsen, P. (1999). Measurement of depressive symptoms in cancer patients: Evaluation of the Center for Epidemiological Studies Depression Scale (CES-D). Journal of Psychosomatic Research, 46, 437–443.
Harlan, L. C., Greene, A. L., Clegg, L. X., Mooney, M., Stevens, J. L., & Brown, M. L. (2005). Insurance status and the use of guideline therapy in the treatment of selected cancers. Journal of Clinical Oncology, 23, 9079–9088.
Haug, S., Meyer, C., & John, U. (2011). Efficacy of an internet program for smoking cessation during and after inpatient rehabilitation treatment: A quasi-randomized controlled trial. Addictive Behaviors, 36, 1369–1372.
Hill, W. G., & Weinert, C. (2004). An evaluation of an online intervention to provide social support and health education. Computers Informatics Nursing, 22, 282–288.
Hoffman, K. E., McCarthy, E. P., Recklitis, C. J., & Ng, A. K. (2009). Psychological distress in long-term cancer survivors of adult-onset cancer: Results from a national survey. Archives of Internal Medicine, 169, 1274–1281.
Hoybe, M. T., Dalton, S. O., Deltour, I., Bidstrup, P. E., Frederiksen, K., & Johansen, C. (2010). Effect of Internet peer-support groups on psychosocial adjustment to cancer: A randomised study. British Journal of Cancer, 102, 1348–1354.
Jacobsen, P. B., Donovan, K. A., Trask, P. C., Fleishman, S. B., Zabora, J., Baker, F., et al. (2005). Screening for psychologic distress in ambulatory cancer patients. Cancer, 103, 1494–1502.
Kaiser, N. C., Hartoonian, N., & Owen, J. E. (2010). Toward a cancer-specific model of psychological distress: Population data from the 2003–2005 National Health Interview Surveys. Journal of Cancer Survivorship, 4, 291–302.
Kendall, J., Glaze, K., Oakland, S., Hansen, J., & Parry, C. (2011). What do 1,281 distress screeners tell us about cancer patients in a community cancer center? Psycho-Oncology, 20, 594–600.
Kessler, D., Lewis, G., Kaur, S., Wiles, N., King, M., Weich, S., et al. (2009). Therapist-delivered Internet psychotherapy for depression in primary care: A randomised controlled trial. Lancet, 374, 628–634.
Lee, S. Y., & Hawkins, R. (2010). Why do patients seek an alternative channel? The effects of unmet needs on patients’ health-related Internet use. Journal of Health Communication, 15, 152–166.
Lepore, S. J. (2001). A social-cognitive processing model of emotional adjustment to cancer. In A. Baum & B. Andersen (Eds.), Psychosocial interventions for cancer (pp. 99–118). Washington, DC: American Psychological Association.
Lepore, S. J., & Ituarte, P. H. G. (1999). Optimism about cancer enhances mood by reducing negative social interactions. Cancer Research, Therapy and Control, 8, 165–174.
Lieberman, M. A., Golant, M., Giese-Davis, J., Winzelberg, A., Benjamin, H., Humphreys, K., et al. (2003). Electronic support groups for breast carcinoma: A clinical trial of effectiveness. Cancer, 97, 920–925.
Lintvedt, O. K., Griffiths, K. M., Sorenson, K., Ostvik, A. R., Wang, C. E., Eisemann, M., et al. (2012). Evaluating the effectiveness and efficacy of unguided internet-based self-help intervention for the prevention of depression: A randomized clinical trial. Clinical Psychology and Psychotherapy. doi:10.1002/cpp.770 (Epub ahead of print July 6, 2012)
Llach, X. B., Herdman, M., & Schiaffino, A. (1999). Determining correspondence between scores on the EQ-5D “thermometer” and a 5-point categorical rating scale. Medical Care, 37, 671–677.
Lorig, K., Ritter, P., Dost, A., Plant, K., Laurent, D. D., & McNeil, I. (2008). The expert patients programme online, a 1-year study of an Internet-based self-management programme for people with long-term conditions. Chronic Illness, 4, 247–256.
McTavish, F. M., Gustafson, D. H., Owens, B. H., Hawkins, R., Pingree, S., Wise, M., et al. (1995). CHESS (comprehensive health enhancement support system): An interactive computer system for women with breast cancer piloted with an underserved population. Journal of Ambulatory Care Management, 18, 35–41.
Owen, J. E., Boxley, L., Goldstein, M. S., Lee, J. H., Breen, N., & Rowland, J. H. (2010). Use of health-related online support groups: Population data from the California Health Interview Survey Complementary and Alternative Medicine Study. Journal of Computer-Mediated Communication, 15, 427–446.
Owen, J. E., Goldstein, M. S., Lee, J. H., Breen, N., & Rowland, J. H. (2007). Use of health-related and cancer-specific support groups among adult cancer survivors. Cancer, 109, 2580–2589.
Owen, J. E., Klapow, J. C., Roth, D. L., Shuster, J. L., Jr., Bellis, J., Meredith, R., et al. (2005). Randomized pilot of a self-guided internet coping group for women with early-stage breast cancer. Annals of Behavioral Medicine, 30, 54–64.
Patrick, K., Calfas, K. J., Norman, G. J., Rosenberg, D., Zabinski, M. F., Sallis, J. F., et al. (2011). Outcomes of a 12-month web-based intervention for overweight and obese men. Annals of Behavioral Medicine, 42, 391–401.
Radloff, L. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 3, 385–401.
Ransom, S., Jacobsen, P. B., & Booth-Jones, M. (2006). Validation of the distress thermometer with bone marrow transplant patients. Psycho-Oncology, 15, 604–612.
Roth, A. J., Kornblith, A. B., Batel-Copel, L., Peabody, E., Scher, H. I., & Holland, J. C. (1998). Rapid screening for psychological distress in men with prostate carcinoma: A pilot study. Cancer, 82, 1907–1908.
Rowland, J. H., Mariotto, A., Alfano, C. M., Pollack, L. A., Weir, H., K., & White, A. (2012). Cancer survivors: United States, 2007. Morbidity and Mortality Weekly Report (MMWR). www.cdc.gov/mmwr/preview/mmwrhtml/mm6009a1.htm. Accessed 6 July, 2012.
Salzer, M. S., Palmer, S. C., Kaplan, K., Brusilovskiy, E., Ten Have, T., Hampshire, M., et al. (2010). A randomized controlled study of Internet peer-to-peer interactions among women newly diagnosed with breast cancer. Psycho-Oncology, 19, 441–446.
Seeman, T. E., & Berkman, L. F. (1988). Structural characteristics of social networks and their relationship with social support in the elderly: Who provides support? Social Science and Medicine, 26, 737–749.
Strom, L., Pettersson, R., & Andersson, G. (2000). A controlled trial of self-help treatment of recurrent headache conducted via the Internet. Journal of Consulting and Clinical Psychology, 68, 722–727.
van der Meer, V., Bakker, M. J., van den Hout, W. B., Rabe, K. F., Sterk, P. J., Kievit, J., et al. (2009). Internet-based self-management plus education compared with usual care in asthma. Annals of Internal Medicine, 151, 110–120.
Weiss, D., & Marmar, C. (1997). The impact of event scale—revised. In J. Wilson & T. Keane (Eds.), Assessing psychological trauma and PTSD. New York: Guildford.
Winzelberg, A. J., Classen, C., Alpers, G. W., Roberts, H., Koopman, C., Adams, R. E., et al. (2003). Evaluation of an internet support group for women with primary breast cancer. Cancer, 97, 1164–1173.
Wright, J. R., Bouma, S., Dayes, I., Sussman, J., Simunovic, M. R., Levine, M. N., et al. (2006). The importance of reporting patient recruitment details in phase III trials. Journal of Clinical Oncology, 24, 843–845.
Zickuhr, K., & Madden, M. (2012). Older adults and internet use. Washington, DC: Pew Research Center’s Internet and American Life Project. http://pewinternet.org/Reports/2012/Older-adults-and-internet-use.aspx. Accessed July 6, 2012.
Acknowledgments
The authors would also like to acknowledge the contributions of Dr. Mitch Golant, Natalie Kaiser, Laura Boxley, Laura Testerman, Kristen Richards, Ketlyne Sol, Susan Lee, and Suranee Abeyesinhe. This research was funded by NCI Grant Number 1R03CA137391-01A1.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Owen, J.E., Bantum, E.O., Criswell, K. et al. Representativeness of two sampling procedures for an internet intervention targeting cancer-related distress: a comparison of convenience and registry samples. J Behav Med 37, 630–641 (2014). https://doi.org/10.1007/s10865-013-9509-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10865-013-9509-6