Abstract
Experiences of heterosexism are rampant online, where bias and harassment against LGBTQ+ individuals spread conveniently and widely. Yet, research has been limited in understanding the exposure to online heterosexism among LGBTQ+ individuals partly due to the lack of a quantitative measure to advance this research. Thus, the current study developed and examined the psychometric properties of the Perceived Online Heterosexism Scale (POHS). Items were developed via a literature review, a survey of social media platforms, and an expert review. Exploratory (N = 288) and confirmatory (N = 653) factor analyses yielded a 4-factor structure and produced a 20-item scale with the following subscales: (1) Heterosexist Cyberaggression (4 items), (2) Online Heterosexist Stereotyping (4 items), (3) Online Exposure to Systemic Heterosexism (8 items), and (4) Heterosexist Online Media (four items). Internal consistency estimates ranged from .91 to .96, and the POHS accounted for 65.9% of the variance. Examination of a second-order model suggested that a total scale score can also be used. Initial construct validity was evidenced as POHS scores were associated with an existing heterosexism measure, anxiety and depressive symptoms, internalized heterosexism, and LGBTQ+ community connectedness in line with theory and empirical evidence. Implications for research practice are discussed.
Similar content being viewed by others
Data availability
Data are available upon reasonable request.
Notes
Both LGBTQ+ and LGBQ+ are used throughout this article. If a referenced study did not mention transgender or nonbinary people, LGBQ+ was used. Further, when referencing only sexual orientation, not gender identity, LGBQ+ was used. Additional explanations of the use of these two acronyms are included in different sections of this article.
References
Abreu, R. L., & Kenny, M. C. (2018). Cyberbullying and LGBTQ youth: A systematic literature review and recommendations for prevention and intervention. Journal of Child & Adolescent Trauma, 11(1), 81–97. https://doi.org/10.1007/s40653-017-0175-7
Andalibi, N., Lacombe-Duncan, A., Roosevelt, L., Wojciechowski, K., & Giniel, C. (2022). LGBTQ persons’ use of online spaces to navigate conception, pregnancy, and pregnancy loss: An intersectional approach. ACM Transactions on Computer-Human Interaction, 29(1), 1–46. https://doi.org/10.1145/3474362
Baker, A. M., Jahn, J. L., Tan, A. S. L., Katz-Wise, S. L., Viswanath, K., Bishop, R. A., & Agénor, M. (2021). Sexual health information sources, needs, and preferences of young adult sexual minority cisgender women and non-binary individuals assigned female at birth. Sexuality Research & Social Policy, 18(3), 775–787. https://doi.org/10.1007/s13178-020-00501-6
Balsam, K. F., Beadnell, B., & Molina, Y. (2013). The Daily Heterosexist Experiences Questionnaire: Measuring minority stress among lesbian, gay, bisexual, and transgender adults. Measurement and Evaluation in Counseling and Development, 46(1), 3–25. https://doi.org/10.1177/0748175612449743
Barnett, A. P., Molock, S. D., Nieves-Lugo, K., & Zea, M. C. (2019). Anti-LGBT victimization, fear of violence at school, and suicide risk among adolescents. Psychology of Sexual Orientation and Gender Diversity, 6(1), 88–95. https://doi.org/10.1037/sgd0000309
Barrett, D. C., & Pollack, L. M. (2005). Whose gay community? Social class, sexual self-expression, and gay community involvement. Sociological Quarterly, 46(3), 437–456. https://doi.org/10.1111/j.1533-8525.2005.00021.x
Bauman, S., & Baldasare, A. (2015). Cyber aggression among college students: Demographic differences, predictors of distress, and the role of the university. Journal of College Student Development, 56(4), 317–330. https://doi.org/10.1353/csd.2015.0039
Burnham, K. P., & Anderson, D. R. (2004). Multimodel inference: Understanding AIC and BIC in model selection. Sociological Methods & Research, 33(2), 261–304. https://doi.org/10.1177/0049124104268644
Center for Countering Digital Hate. (2022). Digital hate: Social media’s role in amplifying dangerous lies about LGBTQ+ people. https://hrc-prod-requests.s3-us-west-2.amazonaws.com/CCDH-HRC-Digital-Hate-Report-2022-single-pages.pdf
Chan, R. C. H. (2022). Effects of online heterosexist experiences on physical and mental health in sexual minorities: An examination of the cognitive and affective mechanisms. Journal of Interpersonal Violence, 37(17–18), 16206–16235. https://doi.org/10.1177/08862605211021962
Child, D. (2006). The essentials of factor analysis (3rd ed.). A&C Black.
Cohen, J., Cohen, P., West, S., & Aiken, L. (2002). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Routledge. https://doi.org/10.4324/9780203774441
Collins, K. M., & Levitt, H. M. (2021). Heterosexism and the self: A systematic review informing LGBQ-affirmative research and psychotherapy. Journal of Gay & Lesbian Social Services, 33(3), 376–405. https://doi.org/10.1080/10538720.2021.1919275
DeVellis, R. F. (2012). Scale development: Theory and applications (Vol. 26). Sage Publications.
Enders, C. K., & Bandalos, D. L. (2001). The relative performance of full information maximum likelihood estimation for missing data in structural equation models. Structural Equation Modeling, 8(3), 430–457. https://doi.org/10.1207/S15328007SEM0803_5
Escobar-Viera, C., Whitfield, D., Wessel, C., Shensa, A., Sidani, J., Brown, A., Chandler, C., Hoffman, B., Marshal, M., & Primack, B. (2018). For better or for worse? A systematic review of the evidence on social media use and depression among lesbian, gay, and bisexual minorities. JMIR Mental Health, 5(3). https://doi.org/10.2196/10496
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272
Fish, J. N., Williams, N. D., McInroy, L. B., Paceley, M. S., Edsall, R. N., Devadas, J., Henderson, S. B., & Levine, D. S. (2022). Q chat space: Assessing the feasibility and acceptability of an internet-based support program for LGBTQ youth. Prevention Science, 23(1), 130–141. https://doi.org/10.1007/s11121-021-01291-y
Fox, J., & Ralston, R. (2016). Queer identity online: Informal learning and teaching experiences of LGBTQ individuals on social media. Computers in Human Behavior, 65, 635–642. https://doi.org/10.1016/j.chb.2016.06.009
Frost, D. M., & Meyer, I. H. (2012). Measuring community connectedness among diverse sexual minority populations. Journal of Sex Research, 49(1), 36–49. https://doi.org/10.1080/00224499.2011.565427
Hatzenbuehler, M. L. (2009). How does sexual minority stigma “get under the skin”? A psychological mediation framework. Psychological Bulletin, 135(5), 707–730. https://doi.org/10.1037/a0016441
Hatzenbuehler, M. L., & Pachankis, J. E. (2016). Stigma and minority stress as social determinants of health among lesbian, gay, bisexual, and transgender youth: Research evidence and clinical implications. Pediatric Clinics of North America, 63(6), 985–997. https://doi.org/10.1016/j.pcl.2016.07.003
Herek, G. M., Cogan, J. C., Gillis, J. R., & Glunt, E. K. (1998). Correlates of internalized homophobia in a community sample of lesbians and gay men. Journal of the Gay & Lesbian Medical Association, 2(1), 17–25.
Herek, G. M., Gillis, J. R., & Cogan, J. C. (2009). Revised Internalized Homophobia Scale. APA PsycTests. https://doi.org/10.1037/t10966-000
Holland, S. (2019). Constructing queer mother-knowledge and negotiating medical authority in online lesbian pregnancy journals. Sociology of Health & Illness, 41(1), 52–66. https://doi.org/10.1111/1467-9566.12782
Hoy-Ellis, C. P. (2021). Minority stress and mental health: A review of the literature. Journal of Homosexuality, 70(5), 806–830. https://doi.org/10.1080/00918369.2021.2004794
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
James, S. E., Herman, J. L., Rankin, S., Mottet, L., & Anafi, M. (2016). The Report of the 2015 U.S. Transgender Survey. https://transequality.org/sites/default/files/docs/usts/USTS-Full-Report-Dec17.pdf
Jun, H. (2010). Social justice, multicultural counseling, and practice: Beyond a conventional approach. Sage Publications.
Kassing, F., Casanova, T., Griffin, J. A., Wood, E., & Stepleman, L. M. (2021). The effects of polyvictimization on mental and physical health outcomes in an LGBTQ sample. Journal of Traumatic Stress, 34(1), 161–171. https://doi.org/10.1002/jts.22579
Keating, L., & Muller, R. T. (2020). LGBTQ+ based discrimination is associated with PTSD symptoms, dissociation, emotion dysregulation, and attachment insecurity among LGBTQ+ adults who have experienced trauma. Journal of Trauma & Dissociation, 21(1), 124–141. https://doi.org/10.1080/15299732.2019.1675222
Keighley, R. (2022). Hate hurts: Exploring the impact of online hate on LGBTQ+ young people. Women & Criminal Justice, 32(1–2), 29–48. https://doi.org/10.1080/08974454.2021.1988034
Kerridge, B. T., Pickering, R. P., Saha, T. D., Ruan, W. J., Chou, S. P., Zhang, H., Jung, J., & Hasin, D. S. (2017). Prevalence, sociodemographic correlates and DSM-5 substance use disorders and other psychiatric disorders among sexual minorities in the United States. Drug and Alcohol Dependence, 170, 82–92. https://doi.org/10.1016/j.drugalcdep.2016.10.038
Keum, B. T., & Miller, M. J. (2017). Racism in digital era: Development and initial validation of the Perceived Online Racism Scale (PORS v1.0). Journal of Counseling Psychology, 64, 310–324. https://doi.org/10.1037/cou0000205
Keum, B. T., & Miller, M. J. (2018). Racism on the Internet: Conceptualization and recommendations for research. Psychology of Violence, 8(6), 782–791. https://doi.org/10.1037/vio0000201
Keum, B. T., Hong, C., Beikzadeh, M., Cascalheira, C. J., & Holloway, I. W. (2023). Mpox stigma, online homophobia, and the mental health of gay, bisexual, and other men who have sex with men. LGBT Health, 10(5), 408–410. https://doi.org/10.1089/lgbt.2022.0281
Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606–613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x
Meyer, I. H. (2003). Prejudice, social stress, and mental health in lesbian, gay, and bisexual populations: Conceptual issues and research evidence. Psychological Bulletin, 129, 674–697. https://doi.org/10.1037/0033-2909.129.5.674
Meyer, I. H. (2015). Resilience in the study of minority stress and health of sexual and gender minorities. Psychology of Sexual Orientation and Gender Diversity, 2(3), 209–213. https://doi.org/10.1037/sgd0000132
Moradi, B., Wiseman, M. C., DeBlaere, C., Goodman, M. B., Sarkees, A., Brewster, M. E., & Huang, Y.-P. (2010). LGB of color and white individuals’ perceptions of heterosexist stigma, internalized homophobia, and outness: Comparisons of levels and links. The Counseling Psychologist, 38(3), 397–424. https://doi.org/10.1177/0011000009335263
O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments, & Computers, 32(3), 396–402. https://doi.org/10.3758/BF03200807
Peer, E., Rothschild, D., Gordon, A., Evernden, Z., & Damer, E. (2022). Data quality of platforms and panels for online behavioral research. Behavior Research Methods, 54(4), 1643–1662. https://doi.org/10.3758/s13428-021-01694-3
Pew Research Center. (2013). A survey of LGBT Americans. Pew Research Center’s Social & Demographic Trends Project. https://www.pewresearch.org/social-trends/2013/06/13/a-survey-of-lgbt-americans/
Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696. https://doi.org/10.1080/00273171.2012.715555
Schlomer, G. L., Bauman, S., & Card, N. A. (2010). Best practices for missing data management in counseling psychology. Journal of Counseling Psychology, 57(1), 1–10. https://doi.org/10.1037/a0018082
Small, N. J. H. (1980). Marginal skewness and kurtosis in testing multivariate normality. Journal of the Royal Statistical Society Series C, 29(1), 85–87. https://doi.org/10.2307/2346414
Smith, E. R., Perrin, P. B., & Sutter, M. E. (2020). Factor analysis of the Heterosexist Harassment, Rejection, and Discrimination Scale in lesbian, gay, bisexual, transgender, and queer people of colour. International Journal of Psychology, 55(3), 405–412. https://doi.org/10.1002/ijop.12585
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166(10), 1092–1097. https://doi.org/10.1001/archinte.166.10.1092
Szymanski, D. M., Kashubeck-West, S., & Meyer, J. (2008). Internalized heterosexism: Measurement, psychosocial correlates, and research directions. The Counseling Psychologist, 36(4), 525–574. https://doi.org/10.1177/0011000007309489
Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate (6th ed.). Pearson Education.
Tenbarge. (2022). False online accusations of “grooming” against LGBTQ people are spiking, experts say. NBC News. https://www.nbcnews.com/tech/internet/lgbtq-abuse-spikes-online-fueled-intensifying-culture-war-rcna24904
Vargas, S. M., Huey, S. J., & Miranda, J. (2020). A critical review of current evidence on multiple types of discrimination and mental health. American Journal of Orthopsychiatry, 90(3), 374–390. https://doi.org/10.1037/ort0000441
Vogels, E. (2021). The state of online harassment. Pew Research Center. https://www.pewresearch.org/internet/2021/01/13/the-state-of-online-harassment/
Williams, A. J., Jones, C., Arcelus, J., Townsend, E., Lazaridou, A., & Michail, M. (2021). A systematic review and meta-analysis of victimisation and mental health prevalence among LGBTQ+ young people with experiences of self-harm and suicide. PLoS ONE, 16(1), e0245268. https://doi.org/10.1371/journal.pone.0245268
Worthington, R. L., & Whittaker, T. A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34(6), 806–838. https://doi.org/10.1177/0011000006288127
Ybarra, M. L., Mitchell, K. J., Palmer, N. A., & Reisner, S. L. (2015). Online social support as a buffer against online and offline peer and sexual victimization among U.S. LGBT and non-LGBT youth. Child Abuse & Neglect, 39, 123–136. https://doi.org/10.1016/j.chiabu.2014.08.006
Funding
Not applicable.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
All authors declare that they have no conflict of interest.
Ethical Approval
The study was approved by the Human Research Ethics committee of the University of California, Los Angeles (IRB#22-000119).
Informed Consent
All participants provided online consent prior to participation in the study survey.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Keum, B.T., Maurin-Waters, E. & Chong, E.S.K. The Mental Health Costs of Online Heterosexism Among LGBTQ+ Individuals: Development and Initial Validation of the Perceived Online Heterosexism Scale. Arch Sex Behav 53, 525–541 (2024). https://doi.org/10.1007/s10508-023-02733-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10508-023-02733-0