Attrition and HIV Risk Behaviors: A Comparison of Young Men Who Have Sex with Men Recruited from Online and Offline Venues for an Online HIV Prevention Program
In addition to offline venue-based and time–space sampling, recruitment of young men who have sex with men (YMSM) into HIV surveillance and prevention studies has expanded over time to include Internet-based approaches. Despite broadening recruitment strategies, enrolling racially and ethnically diverse YMSM who are disproportionately impacted by HIV continues to be challenging. Additionally, there is little literature on the impact of recruitment venue on participant characteristics and likelihood to enroll YMSM into online randomized control trials (RCT). This study used data from the multisite RCT, Keep It Up! 2.0, to examine the impact of recruitment venue on participant demographics, behavioral HIV risks, and enrollment. A total of 2984 participants were screened for eligibility from community-based organizations, Facebook, dating apps, and outreach events. There were significant differences by venue in age (χ2 = 54.38, p < .001), race/ethnicity (χ2 = 110.78, p < .001), sexual orientation (χ2 = 7.85, p < .05), relationship status (χ2 = 27.71, p < .001), and region of recruitment (χ2 = 1480.51, p < .001). There were no significant differences by venue in attrition during the enrollment process. The only difference in attrition was by race/ethnicity. Compared to White participants, eligible Black (OR: 0.35, p < .01) and Latino (OR: 0.46, p < .05) participants were significantly less likely to enroll in the intervention. There were also no significant differences by recruitment venue in sexual risk behaviors among enrolled participants. These findings suggest that recruitment into online HIV interventions from a variety of venues is feasible for diverse YMSM who are at similar risk for HIV infection.
KeywordsMen who have sex with men HIV Sexually transmitted infections eHealth Sexual orientation
This study was funded by the National Institute on Drug Abuse and National Institute of Mental Health (Grant Number R01DA035145). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institute on Drug Abuse or the National Institute of Mental Health.
Compliance with Ethical Standards
Conflict of interest
All authors received grants from the National Institute on Drug Abuse (NIDA) and National Institute of Mental Health (NIMH) in support of the work under consideration for publication.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants in the study.
- CDC. (2015a). Diagnoses of HIV infection in the United States and dependent areas, 2014. HIV Surveillance Report, 26, 1–123.Google Scholar
- CDC. (2015b). HIV among gay and bisexual men. Retrieved from http://www.cdc.gov/hiv/group/msm/index.html
- CDC. (2015c). HIV surveillance—Men who have sex with men (MSM). Retrieved from http://www.cdc.gov/hiv/library/slideSets/index.html
- CDC. (2016). Trends in U.S. HIV Diagnoses, 2005–2014. Retrieved from https://www.cdc.gov/nchhstp/newsroom/docs/factsheets/hiv-data-trends-fact-sheet-508.pdf
- CDC. (2017). Compendium of evidence-based interventions and best practices for HIV prevention. Retrieved from http://www.cdc.gov/hiv/prevention/research/compendium/rr/complete.html
- CDC. (2017). National HIV Behavioral Surveillance (NHBS). Retrieved from https://urldefense.proofpoint.com/v2/url?u=https-3A__www.cdc.gov_hiv_statistics_systems_nhbs_index.html&d=DwIFAw&c=vh6FgFnduejNhPPD0fl_yRaSfZy8CWbWnIf4XJhSqx8&r=cijxKIUfIjh6xB35XSxKelnSNfz2185wGO_qFr-DFH8&m=2IrUTNhVibWPFfFza9JLhTMjcoVp4VLNLh1xI7EPViQ&s=w7q__hMpgArkL7e5qncaI4nxSNhkV6jIVzJGeRTtFsM&e=.
- Chiasson, M. A., Hirshfield, S., Remien, R. H., Humberstone, M., Wong, T., & Wolitski, R. J. (2007). A comparison of on-line and off-line sexual risk in men who have sex with men: An event-based on-line survey. Journal of Acquired Immune Deficiency Syndromes, 44(2), 235–243.CrossRefPubMedGoogle Scholar
- Clark, R. C., & Mayer, R. E. (2003). E-Learning and the science of instruction: proven guidelines for consumers and designers of multimedia learning. San Francisco, CA: Jossey-Bass/Pfeiffer.Google Scholar
- Du Bois, S. N., Johnson, S. E., & Mustanski, B. (2012). Examining racial and ethnic minority differences among YMSM during recruitment for an online HIV prevention intervention study. AIDS and Behavior, 16(6), 1430–1435. https://doi.org/10.1007/s10461-011-0058-0.CrossRefPubMedPubMedCentralGoogle Scholar
- Fisher, J. D., & Fisher, W. A. (2002). The information-motivation-behavioral skills model. In R. J. DiClemente, R. A. Crosby, & M. C. Kegler (Eds.), Emerging theories in health promotion practice and research: Strategies for improving public health (pp. 40–70). San Francisco: Jossey-Bass.Google Scholar
- Frandsen, M., Thow, M., & Ferguson, S. G. (2016). The effectiveness of social media (Facebook) compared with more traditional advertising methods for recruiting eligible participants to health research studies: A randomized, controlled clinical trial. JMIR Research Protocols, 5(3), e161. https://doi.org/10.2196/resprot.5747.CrossRefPubMedPubMedCentralGoogle Scholar
- Greene, G. J., Madkins, K., Andrews, K., Dispenza, J., & Mustanski, B. (2016). Implementation and evaluation of the Keep It Up! Online HIV prevention intervention in a community-based setting. AIDS Education and Prevention, 28(3), 231–245. https://doi.org/10.1521/aeap.2016.28.3.231.CrossRefPubMedGoogle Scholar
- Grov, C., Cain, D., Rendina, H. J., Ventuneac, A., & Parsons, J. T. (2016a). Characteristics associated with urethral and rectal Gonorrhea and Chlamydia diagnoses in a US national sample of gay and bisexual men: Results from the One Thousand Strong Panel. Sexually Transmitted Diseases, 43(3), 165–171. https://doi.org/10.1097/OLQ.0000000000000410.CrossRefPubMedPubMedCentralGoogle Scholar
- Grov, C., Cain, D., Whitfield, T. H., Rendina, H. J., Pawson, M., Ventuneac, A., & Parsons, J. T. (2016b). Recruiting a U.S. national sample of HIV-negative gay and bisexual men to complete at-home self-administered HIV/STI testing and surveys: Challenges and Opportunities. Sexuality Research and Social Policy, 13(1), 1–21. https://doi.org/10.1007/s13178-015-0212-y.CrossRefPubMedGoogle Scholar
- Grov, C., Rendina, H. J., Jimenez, R., & Parsons, J. T. (2016c). Using online settings to identify gay and bisexual men willing to take or with experience taking PrEP: Implications for researchers and providers. AIDS Education and Prevention, 28(5), 378–392. https://doi.org/10.1521/aeap.2016.28.5.378.CrossRefPubMedPubMedCentralGoogle Scholar
- Grov, C., Rendina, H. J., & Parsons, J. T. (2014). Comparing three cohorts of MSM sampled via sex parties, bars/clubs, and Craigslist.org: Implications for researchers and providers. AIDS Education and Prevention, 26(4), 362–382. https://doi.org/10.1521/aeap.2014.26.4.362.CrossRefPubMedPubMedCentralGoogle Scholar
- Hatfield, L. A., Ghiselli, M. E., Jacoby, S. M., Cain-Nielsen, A., Kilian, G., McKay, T., & Rosser, B. R. (2010). Methods for recruiting men of color who have sex with men in prevention-for-positives interventions. Prevention Science, 11(1), 56–66. https://doi.org/10.1007/s11121-009-0149-6.CrossRefPubMedPubMedCentralGoogle Scholar
- Hernandez-Romieu, A. C., Sullivan, P. S., Sanchez, T. H., Kelley, C. F., Peterson, J. L., Del Rio, C., … Rosenberg, E. S. (2014). The comparability of men who have sex with men recruited from venue-time-space sampling and facebook: A cohort study. JMIR Research Protocols, 3(3), e37. https://doi.org/10.2196/resprot.3342.CrossRefPubMedPubMedCentralGoogle Scholar
- Huang, E., Marlin, R. W., Young, S. D., Medline, A., & Klausner, J. D. (2016). Using Grindr, a smartphone social-networking application, to increase HIV self-testing among Black and Latino Men who have sex with men in Los Angeles, 2014. AIDS Education and Prevention, 28(4), 341–350. https://doi.org/10.1521/aeap.2016.28.4.341.CrossRefPubMedPubMedCentralGoogle Scholar
- Landovitz, R. J., Tseng, C. H., Weissman, M., Haymer, M., Mendenhall, B., Rogers, K., … Shoptaw, S. (2013). Epidemiology, sexual risk behavior, and HIV prevention practices of men who have sex with men using GRINDR in Los Angeles, California. Journal of Urban Health, 90(4), 729–739. https://doi.org/10.1007/s11524-012-9766-7.CrossRefPubMedGoogle Scholar
- Lemp, G. F., Hirozawa, A. M., Givertz, D., Nieri, G. N., Anderson, L., Lindegren, M. L., … Katz, M. (1994). Seroprevalence of HIV and risk behaviors among young homosexual and bisexual men. The San Francisco/Berkeley Young Men’s Survey. Journal of the American Medical Association, 272(6), 449–454.CrossRefPubMedGoogle Scholar
- Mustanski, B., Feinstein, B. A., Madkins, K., Sullivan, P., & Swann, G. (2017a). Prevalence and risk factors for rectal and urethral sexually transmitted infections in self-collected samples among young men who have sex with men participating in the Keep It Up! 2.0 randomized controlled trial. Sexually Transmitted Diseases, 44(8), 483–488. https://doi.org/10.1097/OLQ.0000000000000636.CrossRefPubMedPubMedCentralGoogle Scholar
- Mustanski, B., Garofalo, R., Monahan, C., Gratzer, B., & Andrews, R. (2013). Feasibility, acceptability, and preliminary efficacy of an online HIV prevention program for diverse young men who have sex with men: The Keep It Up! intervention. AIDS and Behavior, 17(9), 2999–3012. https://doi.org/10.1007/s10461-013-0507-z.CrossRefPubMedGoogle Scholar
- Mustanski, B., Madkins, K., Greene, G. J., Parsons, J. T., Johnson, B. A., Sullivan, P., … Abel, R. (2017b). Internet-based HIV prevention with at-home sexually transmitted infection testing for young men having sex with men: Study protocol of a randomized controlled trial of Keep It Up! 2.0. JMIR Research Protocols, 6(1), e1. https://doi.org/10.2196/resprot.5740.CrossRefPubMedPubMedCentralGoogle Scholar
- Mustanski, B., Newcomb, M., Du Bois, S. N., Garcia, S. C., & Grov, C. (2011). HIV in young men who have sex with men: A review of epidemiology, risk and protective factors, and interventions. Journal of Sex Research, 48(2–3), 218–253. https://doi.org/10.1080/00224499.2011.558645.CrossRefPubMedPubMedCentralGoogle Scholar
- Parsons, J. T., Vial, A. C., Starks, T. J., & Golub, S. A. (2013). Recruiting drug using men who have sex with men in behavioral intervention trials: A comparison of internet and field-based strategies. AIDS and Behavior, 17(2), 688–699. https://doi.org/10.1007/s10461-012-0231-0.CrossRefPubMedPubMedCentralGoogle Scholar
- Pequegnat, W., Simon Rosser, B. R., Bowen, A. M., Bull, S. S., DiClemente, R. J., Bockting, W. O., … Zimmerman, R. (2007). Conducting Internet-based HIV/STD prevention survey research: Considerations in design and evaluation. AIDS and Behavior, 11(4), 505–521. https://doi.org/10.1007/s10461-006-9172-9.CrossRefPubMedGoogle Scholar
- Prescott, T. L., Phillips Ii, G., DuBois, L. Z., Bull, S. S., Mustanski, B., & Ybarra, M. L. (2016). Reaching adolescent gay, bisexual, and queer men online: Development and refinement of a national recruitment strategy. Journal of Medical Internet Research, 18(8), e200. https://doi.org/10.2196/jmir.5602.CrossRefPubMedPubMedCentralGoogle Scholar
- Raymond, H. F., Rebchook, G., Curotto, A., Vaudrey, J., Amsden, M., Levine, D., & McFarland, W. (2010). Comparing internet-based and venue-based methods to sample MSM in the San Francisco Bay Area. AIDS and Behavior, 14(1), 218–224. https://doi.org/10.1007/s10461-009-9521-6.CrossRefPubMedGoogle Scholar
- Rendina, H. J., Jimenez, R. H., Grov, C., Ventuneac, A., & Parsons, J. T. (2014). Patterns of lifetime and recent HIV testing among men who have sex with men in New York City who use Grindr. AIDS and Behavior, 18(1), 41–49. https://doi.org/10.1007/s10461-013-0573-2.CrossRefPubMedPubMedCentralGoogle Scholar
- Sullivan, P. S., Khosropour, C. M., Luisi, N., Amsden, M., Coggia, T., Wingood, G. M., & Diclemente, R. J. (2011). Bias in online recruitment and retention of racial and ethnic minority men who have sex with men. Journal of Medical Internet Research, 13(2), e38.CrossRefPubMedPubMedCentralGoogle Scholar
- U.S. Census Bureau. (2015). Census regions and divisions of the United States. Retrieved from https://www2.census.gov/geo/pdfs/maps-data/maps/reference/us_regdiv.pdf