Skip to main content

Advertisement

Log in

Representativeness of two sampling procedures for an internet intervention targeting cancer-related distress: a comparison of convenience and registry samples

  • Published:
Journal of Behavioral Medicine Aims and scope Submit manuscript

Abstract

Internet interventions often rely on convenience sampling, yet convenience samples may differ in important ways from systematic recruitment approaches. The purpose of this study was to evaluate potential demographic, medical, and psychosocial differences between Internet-recruited and registry-recruited cancer survivors in an Internet-based intervention. Participants were recruited from a cancer registry (n = 80) and via broad Internet outreach efforts (n = 160). Participants completed a set of self-report questionnaires, and both samples were compared to a population-based sample of cancer survivors (n = 5,150). The Internet sample was younger, better educated, more likely to be female, had longer time since diagnosis, and had more advanced stage of disease (p’s < .001), and the registry-sample was over-represented by men and those with prostate or other cancer types (p’s < .001). The Internet sample also exhibited lower quality of life and social support and greater mood disturbance (p’s < .001). Understanding how convenience and systematic samples differ has important implications for external validity and potential for dissemination of Internet-based interventions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Baker, F., Denniston, M., Zabora, J., Polland, A., & Dudley, W. N. (2002). A POMS short form for cancer patients: Psychometric and structural evaluation. Psycho-Oncology, 11, 273–281.

    Article  PubMed  Google Scholar 

  • Bennett, G. G., & Glasgow, R. E. (2009). The delivery of public health interventions via the Internet: Actualizing their potential. Annual Review of Public Health, 30, 273–292.

    Article  PubMed  Google Scholar 

  • Berman, R. L., Iris, M. A., Bode, R., & Drengenberg, C. (2009). The effectiveness of an online mind-body intervention for older adults with chronic pain. Journal of Pain, 10, 68–79.

    Article  PubMed  Google Scholar 

  • Beskow, L. M., Sandler, R. S., & Weinberger, M. (2006). Research recruitment through US central cancer registries: Balancing privacy and scientific issues. American Journal of Public Health, 96, 1920–1926.

    Article  PubMed Central  PubMed  Google Scholar 

  • Boehmer, U., Clark, M., Glickman, M., Timm, A., Sullivan, M., Bradford, J., et al. (2010). Using cancer registry data for recruitment of sexual minority women: Successes and limitations. Journal of Women’s Health, 19, 1289–1297.

    Article  PubMed  Google Scholar 

  • Brady, M. J., Cella, D. F., Mo, F., Bonomi, A. E., Tulsky, D. S., Lloyd, S. R., et al. (1997). Reliability and validity of the functional assessment of cancer therapy-breast quality-of-life instrument. Journal of Clinical Oncology, 15, 974–986.

    CAS  PubMed  Google Scholar 

  • Brooks, R. (1996). EuroQuol: The current state of play. Health Policy, 37, 53–72.

    Article  CAS  PubMed  Google Scholar 

  • Butler, L. D., Koopman, C., Classen, C., & Spiegel, D. (1999). Traumatic stress, life events, and emotional support in women with metastatic breast cancer: Cancer-related traumatic stress symptoms associated with past and current stressors. Health Psychology, 18, 555–560.

    Article  CAS  PubMed  Google Scholar 

  • Cadmus Bertram, L. A., Chung, G., Yu, H., Salovey, P., & Irwin, M. (2011). Feasibility of institutional registry-based recruitment for enrolling newly diagnosed breast cancer patients in an exercise trial. Journal of Physical Activity and Health, 8, 955–963.

    PubMed  Google Scholar 

  • Cella, D. (1997). FACIT manual. Chicago, IL: Center on Outcomes, Research, and Education, Evanston Northwestern Healthcare and Northwestern University.

    Google Scholar 

  • Chou, W. Y., Liu, B., Post, S., & Hesse, B. (2011). Health-related Internet use among cancer survivors: Data from the health information national trends survey, 2003–2008. Journal of Cancer Survivorship, 5, 263–270.

    Article  PubMed  Google Scholar 

  • David, N., Schlenker, P., Prudlo, U., & Larbig, W. (2011). Online counseling via e-mail for breast cancer patients on the German internet: Preliminary results of a psychoeducational intervention. Psychosocial Medicine, 8, 1–13.

    Google Scholar 

  • Devinini, T., & Blanchard, E. B. (2005). A randomized controlled trial of an internet-based treatment for chronic headache. Behaviour Research and Therapy, 43, 277–292.

    Article  Google Scholar 

  • Edgar, L., Rosberger, Z., & Nowlis, D. (1992). Coping with cancer during the first year after diagnosis. Cancer, 69, 817–828.

    Article  CAS  PubMed  Google Scholar 

  • Fogel, J., Albert, S. M., Schnabel, F., Ditkoff, B. A., & Neugut, A. I. (2002). Internet use and social support in women with breast cancer. Health Psychology, 21, 398–404.

    Article  PubMed  Google Scholar 

  • Gessler, S., Low, J., Daniells, E., Willams, R., Brough, V., Tookman, A., et al. (2008). Screening for distress in cancer patients: Is the distress thermometer a valid measure in the UK and does it measure change over time? A prospective validation study. Psycho-Oncology, 17, 538–547.

    Article  CAS  PubMed  Google Scholar 

  • Glasgow, R. E., Kurz, D., King, D., Dickman, J. M., Faber, A. J., Halterman, E., et al. (2010). Outcomes of minimal and moderate support versions of an internet-based diabetes self-management support program. Journal of General Internal Medicine, 25, 1315–1322.

    Article  PubMed Central  PubMed  Google Scholar 

  • Glasgow, R. E., Vinson, C., Chambers, D., Khoury, M. J., Kaplan, R. M., & Hunter, C. (2012). National Institutes of Health approaches to dissemination and implementation science: Current and future directions. American Journal of Public Health, 102, 1274–1281.

    Article  PubMed Central  PubMed  Google Scholar 

  • Gorlick, A., Lewallen, A., Regts, G., & Owen, J. E. (2011). A systematic review of behavioral engagement in Internet-based interventions for lung cancer. In 8th Annual conference on abstracts from the American Psychosocial Oncology Society, Anaheim, CA, USA, 17–19 Feb 2011. Charlottesville, VA: APOS.

  • Gross, C. P., Mallory, R., Heiat, A., & Krumholz, H. M. (2002). Reporting the recruitment process in clinical trials: Who are these patients and how did they get there? Annals of Internal Medicine, 137, 10–16.

    Article  PubMed  Google Scholar 

  • Gustafson, D. H., Hawkins, R., Pingree, S., McTavish, F., Arora, N. K., Mendenhall, J., et al. (2001). Effect of computer support on younger women with breast cancer. Journal of General Internal Medicine, 16, 435–445.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Hann, D., Winter, K., & Jacobsen, P. (1999). Measurement of depressive symptoms in cancer patients: Evaluation of the Center for Epidemiological Studies Depression Scale (CES-D). Journal of Psychosomatic Research, 46, 437–443.

    Article  CAS  PubMed  Google Scholar 

  • Harlan, L. C., Greene, A. L., Clegg, L. X., Mooney, M., Stevens, J. L., & Brown, M. L. (2005). Insurance status and the use of guideline therapy in the treatment of selected cancers. Journal of Clinical Oncology, 23, 9079–9088.

    Article  PubMed  Google Scholar 

  • Haug, S., Meyer, C., & John, U. (2011). Efficacy of an internet program for smoking cessation during and after inpatient rehabilitation treatment: A quasi-randomized controlled trial. Addictive Behaviors, 36, 1369–1372.

    Article  PubMed  Google Scholar 

  • Hill, W. G., & Weinert, C. (2004). An evaluation of an online intervention to provide social support and health education. Computers Informatics Nursing, 22, 282–288.

    Article  Google Scholar 

  • Hoffman, K. E., McCarthy, E. P., Recklitis, C. J., & Ng, A. K. (2009). Psychological distress in long-term cancer survivors of adult-onset cancer: Results from a national survey. Archives of Internal Medicine, 169, 1274–1281.

    Article  PubMed  Google Scholar 

  • Hoybe, M. T., Dalton, S. O., Deltour, I., Bidstrup, P. E., Frederiksen, K., & Johansen, C. (2010). Effect of Internet peer-support groups on psychosocial adjustment to cancer: A randomised study. British Journal of Cancer, 102, 1348–1354.

    Article  Google Scholar 

  • Jacobsen, P. B., Donovan, K. A., Trask, P. C., Fleishman, S. B., Zabora, J., Baker, F., et al. (2005). Screening for psychologic distress in ambulatory cancer patients. Cancer, 103, 1494–1502.

    Article  PubMed  Google Scholar 

  • Kaiser, N. C., Hartoonian, N., & Owen, J. E. (2010). Toward a cancer-specific model of psychological distress: Population data from the 2003–2005 National Health Interview Surveys. Journal of Cancer Survivorship, 4, 291–302.

    Article  PubMed  Google Scholar 

  • Kendall, J., Glaze, K., Oakland, S., Hansen, J., & Parry, C. (2011). What do 1,281 distress screeners tell us about cancer patients in a community cancer center? Psycho-Oncology, 20, 594–600.

    Article  PubMed  Google Scholar 

  • Kessler, D., Lewis, G., Kaur, S., Wiles, N., King, M., Weich, S., et al. (2009). Therapist-delivered Internet psychotherapy for depression in primary care: A randomised controlled trial. Lancet, 374, 628–634.

    Article  PubMed  Google Scholar 

  • Lee, S. Y., & Hawkins, R. (2010). Why do patients seek an alternative channel? The effects of unmet needs on patients’ health-related Internet use. Journal of Health Communication, 15, 152–166.

    Article  PubMed  Google Scholar 

  • Lepore, S. J. (2001). A social-cognitive processing model of emotional adjustment to cancer. In A. Baum & B. Andersen (Eds.), Psychosocial interventions for cancer (pp. 99–118). Washington, DC: American Psychological Association.

    Chapter  Google Scholar 

  • Lepore, S. J., & Ituarte, P. H. G. (1999). Optimism about cancer enhances mood by reducing negative social interactions. Cancer Research, Therapy and Control, 8, 165–174.

    Google Scholar 

  • Lieberman, M. A., Golant, M., Giese-Davis, J., Winzelberg, A., Benjamin, H., Humphreys, K., et al. (2003). Electronic support groups for breast carcinoma: A clinical trial of effectiveness. Cancer, 97, 920–925.

    Article  PubMed  Google Scholar 

  • Lintvedt, O. K., Griffiths, K. M., Sorenson, K., Ostvik, A. R., Wang, C. E., Eisemann, M., et al. (2012). Evaluating the effectiveness and efficacy of unguided internet-based self-help intervention for the prevention of depression: A randomized clinical trial. Clinical Psychology and Psychotherapy. doi:10.1002/cpp.770 (Epub ahead of print July 6, 2012)

  • Llach, X. B., Herdman, M., & Schiaffino, A. (1999). Determining correspondence between scores on the EQ-5D “thermometer” and a 5-point categorical rating scale. Medical Care, 37, 671–677.

    Article  Google Scholar 

  • Lorig, K., Ritter, P., Dost, A., Plant, K., Laurent, D. D., & McNeil, I. (2008). The expert patients programme online, a 1-year study of an Internet-based self-management programme for people with long-term conditions. Chronic Illness, 4, 247–256.

    Article  PubMed  Google Scholar 

  • McTavish, F. M., Gustafson, D. H., Owens, B. H., Hawkins, R., Pingree, S., Wise, M., et al. (1995). CHESS (comprehensive health enhancement support system): An interactive computer system for women with breast cancer piloted with an underserved population. Journal of Ambulatory Care Management, 18, 35–41.

    Article  CAS  PubMed  Google Scholar 

  • Owen, J. E., Boxley, L., Goldstein, M. S., Lee, J. H., Breen, N., & Rowland, J. H. (2010). Use of health-related online support groups: Population data from the California Health Interview Survey Complementary and Alternative Medicine Study. Journal of Computer-Mediated Communication, 15, 427–446.

    Article  Google Scholar 

  • Owen, J. E., Goldstein, M. S., Lee, J. H., Breen, N., & Rowland, J. H. (2007). Use of health-related and cancer-specific support groups among adult cancer survivors. Cancer, 109, 2580–2589.

    Article  PubMed  Google Scholar 

  • Owen, J. E., Klapow, J. C., Roth, D. L., Shuster, J. L., Jr., Bellis, J., Meredith, R., et al. (2005). Randomized pilot of a self-guided internet coping group for women with early-stage breast cancer. Annals of Behavioral Medicine, 30, 54–64.

    Article  PubMed  Google Scholar 

  • Patrick, K., Calfas, K. J., Norman, G. J., Rosenberg, D., Zabinski, M. F., Sallis, J. F., et al. (2011). Outcomes of a 12-month web-based intervention for overweight and obese men. Annals of Behavioral Medicine, 42, 391–401.

    Article  PubMed  Google Scholar 

  • Radloff, L. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 3, 385–401.

    Article  Google Scholar 

  • Ransom, S., Jacobsen, P. B., & Booth-Jones, M. (2006). Validation of the distress thermometer with bone marrow transplant patients. Psycho-Oncology, 15, 604–612.

    Article  PubMed  Google Scholar 

  • Roth, A. J., Kornblith, A. B., Batel-Copel, L., Peabody, E., Scher, H. I., & Holland, J. C. (1998). Rapid screening for psychological distress in men with prostate carcinoma: A pilot study. Cancer, 82, 1907–1908.

    Article  Google Scholar 

  • Rowland, J. H., Mariotto, A., Alfano, C. M., Pollack, L. A., Weir, H., K., & White, A. (2012). Cancer survivors: United States, 2007. Morbidity and Mortality Weekly Report (MMWR). www.cdc.gov/mmwr/preview/mmwrhtml/mm6009a1.htm. Accessed 6 July, 2012.

  • Salzer, M. S., Palmer, S. C., Kaplan, K., Brusilovskiy, E., Ten Have, T., Hampshire, M., et al. (2010). A randomized controlled study of Internet peer-to-peer interactions among women newly diagnosed with breast cancer. Psycho-Oncology, 19, 441–446.

    Article  PubMed  Google Scholar 

  • Seeman, T. E., & Berkman, L. F. (1988). Structural characteristics of social networks and their relationship with social support in the elderly: Who provides support? Social Science and Medicine, 26, 737–749.

    Article  CAS  PubMed  Google Scholar 

  • Strom, L., Pettersson, R., & Andersson, G. (2000). A controlled trial of self-help treatment of recurrent headache conducted via the Internet. Journal of Consulting and Clinical Psychology, 68, 722–727.

    Article  CAS  PubMed  Google Scholar 

  • van der Meer, V., Bakker, M. J., van den Hout, W. B., Rabe, K. F., Sterk, P. J., Kievit, J., et al. (2009). Internet-based self-management plus education compared with usual care in asthma. Annals of Internal Medicine, 151, 110–120.

    Article  PubMed  Google Scholar 

  • Weiss, D., & Marmar, C. (1997). The impact of event scale—revised. In J. Wilson & T. Keane (Eds.), Assessing psychological trauma and PTSD. New York: Guildford.

    Google Scholar 

  • Winzelberg, A. J., Classen, C., Alpers, G. W., Roberts, H., Koopman, C., Adams, R. E., et al. (2003). Evaluation of an internet support group for women with primary breast cancer. Cancer, 97, 1164–1173.

    Article  PubMed  Google Scholar 

  • Wright, J. R., Bouma, S., Dayes, I., Sussman, J., Simunovic, M. R., Levine, M. N., et al. (2006). The importance of reporting patient recruitment details in phase III trials. Journal of Clinical Oncology, 24, 843–845.

    Article  PubMed  Google Scholar 

  • Zickuhr, K., & Madden, M. (2012). Older adults and internet use. Washington, DC: Pew Research Center’s Internet and American Life Project. http://pewinternet.org/Reports/2012/Older-adults-and-internet-use.aspx. Accessed July 6, 2012.

Download references

Acknowledgments

The authors would also like to acknowledge the contributions of Dr. Mitch Golant, Natalie Kaiser, Laura Boxley, Laura Testerman, Kristen Richards, Ketlyne Sol, Susan Lee, and Suranee Abeyesinhe. This research was funded by NCI Grant Number 1R03CA137391-01A1.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jason E. Owen.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Owen, J.E., Bantum, E.O., Criswell, K. et al. Representativeness of two sampling procedures for an internet intervention targeting cancer-related distress: a comparison of convenience and registry samples. J Behav Med 37, 630–641 (2014). https://doi.org/10.1007/s10865-013-9509-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10865-013-9509-6

Keywords

Navigation