Abstract
Introduction
A reliable and valid measure of sexual minority (SM)-inclusivity is needed to support the development and evaluation of SM-inclusive sex education programs. We designed a 10-item scale that measures sexual minority-inclusivity in sex education and rigorously evaluated the scale’s psychometric properties.
Methods
The study team developed an initial set of items that was revised according to feedback received from 9 sex education experts and interviews with 12 SM youth. Next the items were administered as a survey to 186 SM youth ages 18–23 years. Psychometric analysis included internal consistency, dimensionality assessment, and item response theory (Rasch) calibration. Data was collected from October 2021 to February 2022.
Results
The 10-item scale (SMISES) measures key elements of SM-inclusivity in sex education: support, visibility, and relevant information. The SMISES demonstrated high content validity and strong psychometric properties, including unidimensionality, high internal consistency, and measurement precision. Rasch analysis suggested that receiving instruction about SM-related topics indicates a higher level of SM-inclusivity, while affirmation of SM-identities without instruction in SM-related topics reflects lower levels of SM-inclusivity.
Conclusions
This study is the first rigorous psychometric evaluation of a scale measuring SM-inclusivity in the sex education classroom. The SMISES is based on a clear, comprehensive definition of SM-inclusivity that was confirmed by expert review. Further study is required to examine the validity of the SMISES.
Policy Implications
The SMISES provides a promising measurement tool to inform the development and evaluation of SM-inclusive sex education programs. Rasch analysis is an important, underutilized methodology for improving and shortening scales.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
Data is publicly available on the figshare website.
Code Availability
STATA 16.0 and Winsteps 5.2.1
References
Agnew-Brune, C. B., Balaji, A. B., Mustanski, B., Newcomb, M., Prachand, N., Braunstein, S. L., Brady, K., Hoots, B. E., Smith, J. S., Paz-Bailey, G., & Broz, D. (2019). Mental health, social support, and HIV-related sexual risk behaviors among HIV-negative adolescent sexual minority males: Three U.S. cities, 2015. AIDS and Behavior, 23(12), 3419–3426. https://doi.org/10.1007/s10461-019-02525-5
Andrich, D. (1988). Rasch models for measurement. (Sage University Paper series on Quantitative Applications in the Social Sciences 07–068). Sage.
Andrich, D. A. (1996). Category ordering and their utility. Rasch Measurement Transactions, 9, 464. Retrieved November 4, 2021, from https://www.rasch.org/rmt/rmt94f.htm
Bible, J., Kaplan, A., Lieberman, L., & Goldfarb, E. (2020). A retrospective analysis of sex education messages received by LGB youth. Journal of LGBT Youth, 19, 287–306. https://doi.org/10.1080/19361653.2020.1819509
Blake, S. M., Ledsky, R., Lehman, T., Goodenow, C., Sawyer, R., & Hack, T. (2001). Preventing sexual risk behaviors among gay, lesbian, and bisexual adolescents: The benefits of gay-sensitive HIV instruction in schools. American Journal of Public Health, 91, 940–946.
Boyce, K. S., Travers, M., Rothbart, B., Santiago, V., & Bedell, J. (2018). Adapting evidence-based teen pregnancy programs to be LGBT-inclusive: Lessons learned. Health Promotion Practice, 19, 445–454. https://doi.org/10.1177/1524839918756888
Centers for Disease Control & Prevention. (2019a). Health considerations for LGBTQ youth. Retrieved September 19, 2021, from https://www.cdc.gov/healthyyouth/disparities/health-considerations-lgbtq-youth.htm
Centers for Disease Control and Prevention. (2019b). School health profiles 2018: Characteristics of health programs among secondary schools. Retrieved September 10, 2021, from https://www.cdc.gov/healthyyouth/data/profiles/pdf/2018/CDC-Profiles-2018.pdf
Centers for Disease Control & Prevention. (2020). What works: Sexual health education. Retrieved October 12, 2021, from https://www.cdc.gov/healthyyouth/whatworks/what-works-sexual-health-education.htm
Centers for Disease Control & Prevention. (2021). HIV and youth: The numbers. Retrieved June 23, 2021, from https://www.cdc.gov/hiv/group/age/youth/index.html
Dank, M., Lachman, P., Zweig, J. M., & Yahner, J. (2014). Dating violence experiences of lesbian, gay, bisexual, and transgender youth. Journal of Youth and Adolescence, 43, 846–857. https://doi.org/10.1007/s10964-013-9975-8
de Ayala, R. J. (2009). The theory and practice of item response theory. Guilford Press.
DeVellis, R. F. (2017). Scale development: Theory and applications. Sage Publications, Inc.
Eisenberg, M. E., Madsen, N., Oliphant, J. A., & Sieving, R. E. (2013). Barriers to providing the sexuality education that teachers believe students need. The Journal of School Health, 83, 335–342. https://doi.org/10.1111/josh.12036
Fisher, J. D., & Fisher, W. A. (1992). Changing AIDS-risk behavior. Psychological Bulletin, 111(3), 455–474. https://doi.org/10.1037/0033-2909.111.3.455
Future of Sex Education Initiative. (2020). National sex education standards: Core content and skills, K-12 (2nd ed.). Retrieved February 17, 2021, from https://advocatesforyouth.org/wp-content/uploads/2020/03/NSES-2020-web.pdf
Gordon, R. A. (2015). Measuring constructs in family science: how can item response theory improve precision and validity? Journal of Marriage and Family, 77, 147–176. http://www.jstor.org/stable/24582798
Gothwal, V. K., Wright, T. A., Lamoureux, E. L., & Pesudovs, K. (2009). Rasch analysis of the quality of life and vision function questionnaire. Optometry and Vision Science, 86, E836–E844. https://doi.org/10.1097/OPX.0b013e3181ae1ec7
Gowen, L. K., & Winges-Yanez, N. (2014). Lesbian, gay, bisexual, transgender, queer, and questioning youths’ perspectives of inclusive school-based sexuality education. Journal of Sex Research, 51, 788–800. https://doi.org/10.1080/00224499.2013.806648
Guttmacher Institute. (2022). Sex and HIV education. Retrieved April 2, 2022, from https://www.guttmacher.org/state-policy/explore/sex-and-hiv-education
Hobaica, S., & Kwon, P. (2017). This is how you hetero: Sexual minorities in heteronormative sex education. American Journal of Sexuality Education, 12, 423–450. https://doi.org/10.1080/15546128.2017.1399491
Jaccard, J., Dittus, P. J., & Gordon, V. V. (1998). Parent-adolescent congruency in reports of adolescent sexual behavior and in communications about sexual behavior. Child Development, 69, 247–261.
Jarpe-Ratner, E. (2020). How can we make LGBTQ+-inclusive sex education programmes truly inclusive? A case study of Chicago Public Schools’ policy and curriculum. Sex Education, 20, 283–299. https://doi.org/10.1080/14681811.2019.1650335
Kann, L., Olsen, E. O., McManus, T., Harris, W. A., Shanklin, S. L., Flint, K. H., & Zaza, S. (2016). Sexual identity, sex of sexual contacts, and health-related behaviors among students in grades 9–12 — United States and selected sites, 2015. Morbidity and Mortality Weekly Report: Surveillance Summaries, 65, 1–202. https://doi.org/10.15585/mmwr.ss6509a1
Keiser, G. H., Kwon, P., & Hobaica, S. (2019). Sex education inclusivity and sexual minority health: The perceived inclusivity of sex education scale. American Journal of Sexuality Education, 14, 388–415. https://doi.org/10.1080/15546128.2019.1600448
Kirby, D. B. (2008). The impact of abstinence and comprehensive sex and STD/HIV education programs on adolescent sexual behavior. Sexuality Research & Social Policy, 5, 18–27. https://doi.org/10.1525/srsp.2008.5.3.18
Kosciw J. G., Greytak, E. A., Zongrone, A. D., Clark, C. M., & Truong, N. L. (2018). The 2017 National School Climate Survey: The experiences of lesbian, gay, bisexual, transgender, and queer youth in our nation’s schools. Gay, Lesbian & Straight Education Network (GLSEN). https://www.glsen.org/sites/default/files/2019-10/GLSEN-2017-National-School-Climate-Survey-NSCS-Full-Report.pdf
Linacre, J. M. (2002). What do Infit and Outfit, mean-square and standardized mean? Rasch Measurement Transactions, 16, 878. Retrieved March 15, 2022, from https://www.rasch.org/rmt/rmt162f.htm
Linacre, J. M. (n.d.a). Andrich thresholds: Disordered rating or partial credit structures (categories or Andrich thresholds). Retrieved March 15, 2022, from https://www.winsteps.com/winman/disorder.htm
Linacre, J. M. (n.d.b). Reliability and separation of measures. Retrieved March 17, 2022, from https://www.winsteps.com/winman/reliability.htm
Lindau, S. T., Tetteh, A. S., Kasza, K., & Gilliam, M. (2008). What schools teach our patients about sex: Content, quality, and influences on sex education. Obstetrics and Gynecology, 111, 256–266. https://doi.org/10.1097/01.AOG.0000296660.67293.bf
Lindberg, L. D., Maddow-Zimet, I., & Boonstra, H. (2016). Changes in adolescents’ receipt of sex education, 2006–2013. Journal of Adolescent Health, 58, 621–627. https://doi.org/10.1016/j.jadohealth.2016.02.004
Ludlow, L. H., Enterline, S. E., & Cochran-Smith, M. (2008). Learning to teach for social justice-beliefs scale: An application of Rasch measurement principles. Measurement and Evaluation in Counseling and Development, 40, 194–214. https://doi.org/10.1080/07481756.2008.11909815
Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741–749. https://doi.org/10.1037/0003-066X.50.9.741
Meyer, I. H. (2003). Prejudice, social stress, and mental health in lesbian, gay, and bisexual populations: Conceptual issues and research evidence. Psychological Bulletin, 129(5), 674–697.
Morgado, F., Meireles, J., Neves, C. M., Amaral, A., & Ferreira, M. (2017). Scale development: Ten main limitations and recommendations to improve future research practices. Psicologia: Reflexão e Crítica, 30, 3. https://doi.org/10.1186/s41155-016-0057-1
Nash, E., Keller, L. H., & Naide, S. (2019). State and federal lawmakers promote sexual consent, LGBTQ+ inclusivity in sex education. Guttmacher Institute. Retrieved April 5, 2021, from https://www.guttmacher.org/print/article/2019/05/state-and-federal-lawmakers-promote-sexual-consent-lgbtq-inclusivity-sex-education
Nguyen, T. H., Paasche-Orlow, M. K., Kim, M. T., Han, H., & Chan, K. S. (2015). Modern measurement approaches to health literacy scale development and refinement: Overview, current uses, and next steps. Journal of Health Communication, 20(sup2), 112–115. https://doi.org/10.1080/10810730.2015.1073408
Pallant, J. F., Miller, R. L., & Tennant, A. (2006). Evaluation of the Edinburgh post natal depression scale using Rasch analysis. BMC Psychiatry, 6, 28. https://doi.org/10.1186/1471-244X-6-28
Petrillo, J., Cano, S. J., McLeod, L. D., & Coon, C. D. (2015). Using classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: A comparison of worked examples. Value in Health, 18, 25–34. https://doi.org/10.1016/j.jval.2014.10.005
Philliber, A. (2021). The IN·clued program: A randomized control trial of an effective sex education program for lesbian, gay, bisexual, transgender, queer, and questioning youths. Journal of Adolescent Health, 69, 636–643. https://doi.org/10.1016/j.jadohealth.2021.04.002
Pingel, E., Thomas, L., Harmell, C., & Bauermeister, J. (2013). Creating comprehensive, youth centered, culturally appropriate sex education: What do young gay, bisexual, and questioning men want? Sexuality Research & Social Policy, 10, 293–301. https://doi.org/10.1007/s13178-013-0134-5
Proulx, C. N., Coulter, R. W. S., Egan, J. E., Matthews, D. D., & Mair, C. (2019). Associations of lesbian, gay, bisexual, transgender, and questioning–inclusive sex education with mental health outcomes and school-based victimization in U.S. high school students. Journal of Adolescent Health, 64, 608–614. https://doi.org/10.1016/j.jadohealth.2018.11.012
Raju, D., Su, X., & Patrician, P. A. (2014). Using item response theory models to evaluate the practice environment scale. Journal of Nursing Measurement, 22, 323–341. https://doi.org/10.1891/1061-3749.22.2.323
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Danmarks Paedagogiske Institut.
Roberts, C., Shiman, L. J., Dowling, E. A., Tantay, L., Masdea, J., Pierre, J., & Bedell, J. (2020). LGBTQ+ students of colour and their experiences and needs in sexual health education: ‘You belong here just as everybody else.’ Sex Education, 20, 1–16. https://doi.org/10.1080/14681811.2019.1648248
Rosario, M., Schrimshaw, E. W., & Hunter, J. (2006). A model of sexual risk behaviors among young gay & bisexual men: Longitudinal associations of mental health, substance abuse, sexual abuse, & the coming-out process. AIDS Education and Prevention, 18(5), 444–460. https://search.proquest.com/docview/61394775
Snapp, S. D., McGuire, J. K., Sinclair, K. O., Gabrion, K., & Russell, S. T. (2015). LGBTQ-inclusive curricula: Why supportive curricula matter. Sex Education, 15, 580–596. https://doi.org/10.1080/14681811.2015.1042573
Sondag, K. A., Johnson, A. G., & Parrish, M. E. (2020). School sex education: Teachers’ and young adults’ perceptions of relevance for LGBT students. Journal of LGBT Youth, 19, 247–267. https://doi.org/10.1080/19361653.2020.1789530
Steed, H., Stratford, B., & Gabriel, A. (2021). Only 17 states and DC report LGBTQ-inclusive sex ed curricula in at least half of schools, despite recent increases. Child Trends. Retrieved November 4, 2022, from https://www.childtrends.org/blog/only-17-states-and-dc-report-lgbtq-inclusive-sex-ed-curricula-in-at-least-half-of-schools-despite-recent-increases
Underwood, J. M., Brener, N., Thornton, J., Harris, W. A., Bryan, L. N., Shanklin, S. L., & Dittus, P. (2020). Overview and methods for the Youth Risk Behavior Surveillance System—United States, 2019. Morbidity and Mortality Weekly Report, 69, 1–10. Retrieved April 5, 2021, from https://www.cdc.gov/mmwr/volumes/69/su/su6901a1.htm?s_cid=su6901a1_w#suggestedcitation
von Davier, M. (2016). Rasch model. In W. J. van der Linden (Ed.), Handbook of item response theory, Volume 1: Models (pp. 31–50). Chapman & Hall/CRC. https://doi.org/10.1201/9781315374512
Wilkerson, J. M., Rybicki, S., Barber, C. A., & Smolenski, D. J. (2011). Creating a culturally competent clinical environment for LGBT patients. Journal of Gay & Lesbian Social Services, 23, 376–394. https://doi.org/10.1080/10538720.2011.589254
Wilson, K. L., Rosen, B. L., Thompson, E. L., & Maness, S. (2018). High-risk adolescents’ sexuality education preferences based on sexual orientation. Journal of Adolescent Health, 62, S78–S79.
Wilson, M. (2005). Constructing measures: An item response modeling approach. Lawrence Erlbaum Associates.
Wright, B. D., & Masters, G. N. (1982). Rating scale analysis. MESA Press.
Wright, B. D., & Stone, M. H. (1999). Measurement Essentials. Wide Range, Inc.
Wynd, C. A., Schmidt, B., & Schaefer, M. A. (2003). Two quantitative approaches for estimating content validity. Western Journal of Nursing Research, 25(5), 508–518. https://doi.org/10.1177/0193945903252998
Acknowledgements
The authors thank Larry Ludlow for his support.
Funding
This study was supported by the Doug Kirby Adolescent Sexual Health Research grant from the Rural Center for AIDS/STD Prevention, Indiana University School of Public Health-Bloomington.
Author information
Authors and Affiliations
Contributions
(1) Conception and design: Elizabeth McKay, Matias Placencio-Castro, Holly Fontenot (2) Data collection: Elizabeth McKay, Matias Placencio-Castro, Holly Fontenot (3) Data analysis and interpretation: Elizabeth McKay, Matias Placencio-Castro, Holly Fontenot (4) Initial Manuscript Drafting: Elizabeth McKay (5) Manuscript revision and editing: All authors (6) Final approval of manuscript: All authors.
Corresponding author
Ethics declarations
Ethics Approval
Institutional Review Board approval was granted by Boston College on May 25, 2021.
Consent to Participate
Informed consent was obtained from all participants included in the study.
Consent for Publication
Not applicable.
Competing Interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
McKay, E.A., Placencio-Castro, M., Harris, A. et al. Development and Psychometric Testing of a Scale to Measure Sexual Minority-Inclusivity in Sex Education (SMISES). Sex Res Soc Policy 20, 1483–1497 (2023). https://doi.org/10.1007/s13178-023-00794-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13178-023-00794-3