Skip to main content

Face Validity Ratings of Sexual Orientation Scales by Sexual Minority Adults: Effects of Sexual Orientation and Gender Identity

Archives of Sexual Behavior volume 47, pages 1241–1250 (2018)Cite this article

Abstract

The present research explored sexual minority individuals’ ratings of two traditional (Kinsey and Klein Sexual Orientation Grid [KSOG]) and two novel (Sexual-Romantic and Gender Inclusive) sexual orientation scales with regard to how well they capture their sexuality. Participants included 363 sexual minority individuals who identified as lesbian, gay, bisexual, pansexual, or queer, and included individuals who identified as transgender (n = 85) and cisgender (n = 278). The findings indicated clear patterns of responses across both sexual orientation and gender identity, where participants differed in the degree to which they felt the scales captured their sexuality. A main effect of sexual orientation was found for all four scales, where participants endorsing monosexual (lesbian/gay) identities rated the scales more positively than did participants endorsing plurisexual (bisexual and pansexual/queer) identities. Bisexual individuals had a unique pattern of ratings, which sometimes aligned with those of lesbian/gay participants and sometimes aligned with pansexual/queer participants. A main effect of gender identity was found for the Kinsey, KSOG, and Sexual-Romantic (but not Gender Inclusive) scales, where cisgender individuals rated the scales more positively than did transgender individuals. There were no significant interaction effects between sexual orientation and gender identity for any of the four scales. The present findings can be used to understand sexual minority individuals’ assessment of the face validity of four sexual orientation measures. Discussion focused on the implications for using traditional measures of sexual orientation in research as well as for the development of new measures that better capture the range of sexual minority experience.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price includes VAT (USA)
Tax calculation will be finalised during checkout.

Notes

  1. We use plurisexual to refer to identities that are not explicitly based on attraction to one sex and leave open the potential for attraction to more than one sex/gender (e.g., bisexual, pansexual, queer, and fluid). Plurisexual is used instead of non-monosexual because it does not linguistically assume monosexual as the ideal conceptualization of sexuality (see Galupo et al., 2014b).

  2. Gender identity is typically described as an individual’s private understanding of themselves as male, female, both, or neither (Tate, 2014). Cisgender and transgender are labels that can be used to describe the relationship between an individual’s gender identity and sex assigned at birth (SAB); cisgender individuals have a gender identity that is the same as their SAB, and transgender individuals have a gender identity that is different from their SAB.

  3. Although pansexual and queer participants did not significantly differ on their validity ratings for any the scales, queer participants (M = 27.14) were significantly older than pansexual participants (M = 24.44) and were more likely to identify as transgender (55 vs. 38%).

References

  • Anzaldua, G. (1990). Bridge, drawbridge, sandbar or island: Lesbians-of-color hacienda alianzas. In L. Albrecht & R. M. Brewer (Eds.), Bridges of power: Women’s multicultural alliances (pp. 216–231). Philadelphia, PA: New Society.

    Google Scholar 

  • Bailey, J. M. (2009). What is sexual orientation and do women have one? In D. A. Hope (Ed.), Contemporary perspectives on lesbian, gay, and bisexual identities (pp. 43–63). Berlin: Springer Science.

    Chapter  Google Scholar 

  • Callis, A. S. (2014). Bisexual, pansexual, queer: Non-binary identities and the sexual borderlands. Sexualities, 17, 63–80. doi:10.1177/1363460713511094.

    Article  Google Scholar 

  • Collins, P. H. (2000). It’s all in the family: Intersections of gender, race and nation. In U. Narayan & S. Harding (Eds.), Decentering the center: Philosophy for a multicultural, postcolonial, and feminist world (pp. 156–176). Bloomington, IN: Indiana University Press.

    Google Scholar 

  • Crenshaw, K. (1991). Mapping the margins: Intersectionality, identity politics and violence against women of color. Stanford Law Review, 43, 1241–1299.

    Article  Google Scholar 

  • Devor, H. (1993). Sexual orientation identities, attractions, and practices of female-to-male transsexuals. Journal of Sex Research, 30, 303–315.

    Article  Google Scholar 

  • Diamond, L. M. (2003). What does sexual orientation orient? A biobehavioral model distinguishing romantic love and sexual desire. Psychological Review, 110(1), 173–192. doi:10.1037/0033-295X.110.1.173.

    Article  PubMed  Google Scholar 

  • Dillman, D., Smyth, J., & Christian, L. M. (2008). Internet, mail, and mixed-mode surveys: The tailored design method. New York: Wiley.

    Google Scholar 

  • Dozier, R. (2005). Beards, breasts, and bodies: Doing sex in a gendered world. Gender & Society, 19, 297–316. doi:10.1177/0891243204272153.

    Article  Google Scholar 

  • Flanders, C. E. (2017). Introduction to the special issue: Under the bisexual umbrella of identity and experience. Journal of Bisexuality, 17, 1–6. doi:10.1080/15299716.2017.1297145.

    Article  Google Scholar 

  • Flanders, C. E., Lebreton, M. E., Robinson, M., Bian, J., & Caravaca-Morera, J. A. (2017). Defining bisexuality: Young bisexual and pansexual people’s voices. Journal of Bisexuality, 17, 39–57. doi:10.1080/15299716.2016.1227016.

    Article  Google Scholar 

  • Flore, J. (2014). Mismeasures of asexual desires. In K. J. Cerankowski & M. Milks (Eds.), Asexualities: Feminist and queer perspectives (pp. 17–34). New York, NY: Routledge.

    Google Scholar 

  • Futty, J. T. (2010). Challenges posed by transgender-passing within ambiguities and interrelations. Graduate Journal of Social Science, 7(2), 57–75.

    Google Scholar 

  • Galupo, M. P., Bauerband, L. A., Gonzalez, K. A., Hagen, D. B., Hether, S., & Krum, T. (2014a). Transgender friendship experiences: Benefits and barriers of friendships across gender identity and sexual orientation. Feminism & Psychology, 24, 183–215. doi:10.1177/0959353514526218.

    Article  Google Scholar 

  • Galupo, M. P., Davis, K. S., Grynkiewicz, A. L., & Mitchell, R. C. (2014b). Conceptualization of sexual orientation identity among sexual minorities: Patterns across sexual and gender identity. Journal of Bisexuality, 14, 433–456. doi:10.1080/15299716.2014.933466.

    Article  Google Scholar 

  • Galupo, M. P., Henise, S. B., & Mercer, N. L. (2016). “The labels don’t work very well”: Transgender individuals’ conceptualizations of sexual orientation and sexual identity. International Journal of Transgenderism, 17, 1–12. doi:10.1080/15532739.2016.1189373.

    Article  Google Scholar 

  • Galupo, M. P., Lomash, E., & Mitchell, R. C. (2017a). “All of my lovers fit into this scale”: Sexual minority individuals’ responses to two novel measures of sexual orientation. Journal of Homosexuality, 64, 145–165. doi:10.1080/00918369.2016.1174027.

    Article  PubMed  Google Scholar 

  • Galupo, M. P., Mitchell, R. C., & Davis, K. S. (2015). Sexual minority self-identification: Multiple identities and complexity. Psychology of Sexual Orientation and Gender Identity, 2, 355–364. doi:10.1037/sgd0000131.

    Article  Google Scholar 

  • Galupo, M. P., Mitchell, R. C., Grynkiewicz, A. L., & Davis, K. S. (2014c). Sexual minority reflections on the Kinsey Scale and the Klein Sexual Orientation Grid: Conceptualization and measurement. Journal of Bisexuality, 14, 404–432. doi:10.1080/15299716.2014.929553.

    Article  Google Scholar 

  • Galupo, M. P., Ramirez, J. L., & Pulice-Farrow, L. (2017b). “Regardless of their gender”: Descriptions of sexual identity among bisexual, pansexual, and queer identified individuals. Journal of Bisexuality, 17, 108–124. doi:10.1080/15299716.2016.1228491.

    Article  Google Scholar 

  • Hines, S. (2010). Sexing gender/gendering sex: Towards an intersectional analysis of transgender. In Y. Taylor, S. Hines, & M. Casey (Eds.), Theorising intersectionality and sexuality (pp. 140–162). Basingstoke, UK: Palgrave Macmillan.

    Chapter  Google Scholar 

  • Keppel, B., & Hamilton, A. (1998). Using the Klein Scale to teach about sexual orientation. Boston: Bisexual Resource Center. Retrieved from http://www.qrd.org/qrd/orgs/BRC/1994/klein.txt-07.94

  • King, D. (1990). Multiple jeopardy, multiple consciousness: The context of a Black feminist ideology. In M. Malson, E. Mudimbe-Boyi, J. F. O’Barr, & M. Wyer (Eds.), Black women in America: Social science perspectives (pp. 265–296). Chicago: University of Chicago Press.

    Google Scholar 

  • Kinsey, A. C., Pomeroy, W. B., & Martin, C. E. (1948). Sexual behavior in the human male. Philadelphia: Saunders.

    Google Scholar 

  • Kinsey, A. C., Pomeroy, W. B., Martin, C. E., & Gebhard, P. H. (1953). Sexual behavior in the human female. Philadelphia: Saunders.

    Google Scholar 

  • Klein, F., Sepekoff, B., & Wolf, T. (1985). Sexual orientation: A multivariate dynamic process. Journal of Homosexuality, 11, 35–49. doi:10.1300/J082v11n01_04.

    Article  PubMed  Google Scholar 

  • Kuper, L. E., Nussbaum, R., & Mustanski, B. (2012). Exploring the diversity of gender and sexual orientation identities in an online sample of transgender individuals. Journal of Sex Research, 49, 244–254. doi:10.1080/00224499.2011.596954.

    Article  PubMed  Google Scholar 

  • Lapointe, A. A. (2017). “It’s not pans, it’s people”: Student and teacher perspectives on bisexuality and pansexuality. Journal of Bisexuality, 17, 88–107. doi:10.1080/15299716.2016.1196157.

    Article  Google Scholar 

  • Laumann, E. O., Gagnon, J. H., Michael, R. T., & Michaels, S. (1994). The social organization of sexuality: Sexual practices in the United States. Chicago: University of Chicago Press.

    Google Scholar 

  • Lev, A. (2004). Transgender emergence: Therapeutic guidelines for working with gender-variant people and their families. New York: Haworth Clinical Practice Press.

    Google Scholar 

  • McCabe, S. E., Hughes, T. L., Bostwick, W., Morales, M., & Boyd, C. J. (2012). Measurement of sexual identity in surveys: Implications for substance abuse research. Archives of Sexual Behavior, 41, 649–657. doi:10.1007/s10508-011-9768-7.

    Article  PubMed  Google Scholar 

  • McCall, L. (2005). The complexity of intersectionality. Signs: Journal of Women in Culture and Society, 30, 1771–1800. doi:10.1086/426800.

    Article  Google Scholar 

  • Meier, S. C., Pardo, S. T., Labuski, C., & Babcock, J. (2013). Measures of clinical health among female-to-male transgender persons as a function of sexual orientation. Archives of Sexual Behavior, 42, 463–474. doi:10.1007/s10508-012-0052-2.

    Article  PubMed  Google Scholar 

  • Mereish, E. H., Katz-Wise, S. L., & Woulfe, J. (2017). We’re here and we’re queer: Sexual orientation and sexual fluidity differences between bisexual and queer women. Journal of Bisexuality, 17, 125–139. doi:10.1080/15299716.2016.1217448.

    Article  PubMed  Google Scholar 

  • Mitchell, R. C., Davis, K. S., & Galupo, M. P. (2015). Comparing perceived experiences of sexual prejudice among plurisexual individuals. Psychology & Sexuality, 6, 245–257. doi:10.1080/19419899.2014.940372.

    Article  Google Scholar 

  • Monro, S., & Richardson, D. (2010). Intersectionality and sexuality: The case of sexuality and transgender equalities work in UK local government. In Y. Taylor, S. Hines, & M. Casey (Eds.), Theorizing intersectionality and sexuality (pp. 99–118). Basingstoke, UK: Palgrave MacMillan.

    Chapter  Google Scholar 

  • Morandini, J., Blaszczynski, A., & Dar-Nimrod, I. (2016). Who adopts queer and pansexual identities. Journal of Sex Research. doi:10.1080/00224499.2016.1249332.

    PubMed  Google Scholar 

  • Morgan, E. M. (2012). Not always a straight path: College students’ narratives of heterosexual identity development. Sex Roles, 66, 79–93. doi:10.1007/s11199-011-0068-4.

    Article  Google Scholar 

  • Morgan, E. M. (2013). Contemporary issues in sexual orientation and identity development in emerging adulthood. Emerging Adulthood, 1, 52–66. doi:10.1037/a0014572.

    Article  Google Scholar 

  • Morgan, E. M., & Thompson, E. M. (2006). Young women’s sexual experiences within same-sex friendships: Discovering and defining bisexual and bi-curious sexual identity. Journal of Bisexuality, 6, 7–34. doi:10.1300/J159v06n03_02.

    Article  Google Scholar 

  • Nagoshi, J. L., & Brzuzy, S. (2010). Transgender theory: Embodying research and practice. Affilia: Journal of Women and Social Work, 25, 431–443. doi:10.1177/0886109910384068.

    Article  Google Scholar 

  • Pega, F., Gray, A., Veale, J. F., Binson, D., & Sell, R. L. (2013). Toward global comparability of sexual orientation data in official statistics: A conceptual framework of sexual orientation for health data collection in New Zealand’s official statistics system. Journal of Environmental and Public Health, 8, 1–8. doi:10.1155/2013/473451.

    Article  Google Scholar 

  • Przybylo, E. (2013). Producing facts: Empirical asexuality and the scientific study of sex. Feminism & Psychology, 23, 221–242. doi:10.1177/0959353512443668.

    Article  Google Scholar 

  • Riggle, E. D. B., Rostosky, S. S., & Reedy, C. S. (2005). Online surveys for BGLT research. Journal of Homosexuality, 49, 1–21. doi:10.1300/J082v49n01-01.

    Article  PubMed  Google Scholar 

  • Rosario, M., & Schrimshaw, E. W. (2014). Theories and etiologies of sexual orientation. In D. L. Tolman & L. M. Diamond (Eds.), APA handbook of sexuality and psychology. Person-based approaches (Vol. 1, pp. 555–596). Washington, DC: American Psychological Association.

    Chapter  Google Scholar 

  • Rust, P. C. (2000). Too many and not enough: The meaning of bisexual identities. Journal of Bisexuality, 1, 31–68. doi:10.1300/J159v01n01_04.

    Article  Google Scholar 

  • Savin-Williams, R. C. (2010). Sexual orientation label (7-point). Retrieved from http://www.human.cornell.edu/hd/sexgender/research.cfm.

  • Savin-Williams, R. C. (2014). An exploratory study of the categorical versus spectrum nature of sexual orientation. Journal of Sex Research, 51, 446–453. doi:10.1080/00224499.2013.871691.

    Article  PubMed  Google Scholar 

  • Savin-Williams, R. C., & Vrangalova, Z. (2013). Mostly heterosexual as a distinct sexual orientation group: A systematic review of the empirical evidence. Developmental Review, 33, 58–88. doi:10.1016/j.dr.2013.01.001.

    Article  Google Scholar 

  • Sell, R. L. (1997). Defining and measuring sexual orientation: A review. Archives of Sexual Behavior, 26, 643–658. doi:10.1023/A:1024528427013.

    Article  PubMed  Google Scholar 

  • Sell, R. L., & Perulio, C. (1996). Sampling homosexuals, bisexuals, gays and lesbians for public health research: A review of the literature from 1990 to 1992. Journal of Homosexuality, 30, 31–47. doi:10.1300/J082v30n04_02.

    Article  PubMed  Google Scholar 

  • Shields, S. A. (2008). Gender: An intersectionality perspective. Sex Roles, 59, 301–311. doi:10.1007/s11199-008-9501-8.

    Article  Google Scholar 

  • Storms, M. D. (1980). Theories of sexual orientation. Journal of Personality and Social Psychology, 38, 783–792. doi:10.1037/0022-3514.38.5.783.

    Article  Google Scholar 

  • Tate, C. C. (2014). Gender identity as a personality process. In B. L. Miller (Ed.), Gender identity: Disorders, developmental perspectives, and social implications (pp. 1–22). Hauppauge, NY: Nova Science Publishers.

    Google Scholar 

  • Thompson, E. M., & Morgan, E. M. (2008). “Mostly straight” young women: Variations in sexual behavior and identity development. Developmental Psychology, 44, 15–21. doi:10.1037/0012-1649.44.1.15.

    Article  PubMed  Google Scholar 

  • Trujillo, C. (1991). Chicana lesbians: The girls our mothers warned us about. Berkeley, CA: Third Woman Press.

    Google Scholar 

  • van Anders, S. M. (2015). Beyond sexual orientation: Integrating gender/sex and diverse sexualities via sexual configurations theory. Archives of Sexual Behavior, 44, 1177–1213. doi:10.1007/s10508-015-0490-8.

    Article  PubMed  Google Scholar 

  • Vrangalova, Z., & Savin-Williams, R. C. (2012). Mostly heterosexual and mostly gay/lesbian: New sexual orientation identities. Archives of Sexual Behavior, 41, 85–101. doi:10.1007/s10508-012-9921-y.

    Article  PubMed  Google Scholar 

  • Weinrich, J. D., & Klein, F. (2002). Bi-gay, bi-straight, and bi-bi. Journal of Bisexuality, 2, 109–139. doi:10.1300/J159v02n04_07.

    Article  Google Scholar 

  • Worthington, R. L., & Reynolds, A. L. (2009). Within-group differences in sexual orientation and identity. Journal of Counseling Psychology, 56, 44–55. doi:10.1037/a0013498.

    Article  Google Scholar 

Download references

Funding

This study was funded by the American Institute of Bisexuality awarded to M. Paz Galupo.

Author information

Authors and Affiliations

  1. Psychology Department, Towson University, 8000 York Road, Towson, MD, 21252-0001, USA

    M. Paz Galupo, Renae C. Mitchell & Kyle S. Davis

Authors
  1. M. Paz Galupo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Renae C. Mitchell
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kyle S. Davis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. Paz Galupo.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Appendix: Novel Measures of Sexual Orientation

Appendix: Novel Measures of Sexual Orientation

Sexual-Romantic scale a
I am sexually attracted to individuals of the same-sex
I am romantically attracted to individuals of the same-sex
I am sexually attracted to individuals of the other-sex
I am romantically attracted to individuals of the other-sex
Gender Inclusive scale a
I am attracted to individuals of the same-sexb
I am attracted to individuals of the same-sexb
I am attracted to masculine individuals
I am attracted to feminine individuals
I am attracted to androgynous individuals
I am attracted to gender non-conforming individuals
  1. aBoth scales are rated on a 7-point scale between 1 = Almost Never True to 7 = Almost Always True
  2. bThe first two items on the scale would have better resonated with sexual minority participants had they read: “I am attracted to women,” and “I am attracted to men.” This is the suggested wording for use of this scale in future work (see Galupo, Lomash, & Mitchell, 2017)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Galupo, M.P., Mitchell, R.C. & Davis, K.S. Face Validity Ratings of Sexual Orientation Scales by Sexual Minority Adults: Effects of Sexual Orientation and Gender Identity. Arch Sex Behav 47, 1241–1250 (2018). https://doi.org/10.1007/s10508-017-1037-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10508-017-1037-y

Keywords

  • Cisgender
  • Intersectionality
  • Monosexual
  • Plurisexual
  • Sexual orientation
  • Transgender