Abstract
Background
Artificial intelligence (AI) is evolving rapidly as are its uses in healthcare and scientific literature. There are concerns about whether AI like ChatGPT has implicit biases. This study explores ChatGPT’s ability to reference evidence-based recommendations related to gender-affirming surgery (GAS).
Methods
ChatGPT was prompted using open-ended questions on GAS as well as the World Professional Association for Transgender Health Standards of Care (WPATH SOC) for the Health of Transgender and Gender Diverse People, Version 8’s statements of recommendations. Responses were analyzed based on agreement to and reference of WPATH SOC recommendations.
Results
A total of 95 WPATH statements of recommendations were given to the chatbot. There were 70 (74%) agreements, 0 (0%) disagreements, and 25 (26%) neutral responses. WPATH was directly referenced in 12 (13%) responses. ChatGPT was successful in describing aspects of gender diversity, including the treatment of gender dysphoria.
Conclusions
While often using neutral language, ChatGPT does intermittently reference WPATH and its evidence-based recommendations. As AI evolves, so can the spread of misinformation if it is not rooted in evidence-based recommendations. Furthermore, AI may serve as a viable tool for patient education on GAS.
Level of evidence: Not gradable
Similar content being viewed by others
Data Availability
Data was gathered using ChatGPT and its corresponding responses.
References
Sallam M (2023) ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. Healthcare 11(6):887. https://doi.org/10.3390/healthcare11060887
Vaishya R, Misra A, Vaish A (2023) ChatGPT: is this version good for healthcare and research? Diabetes Metab Syndr: Clin Res Rev 17(4):102744. https://doi.org/10.1016/j.dsx.2023.102744
Cascella M, Montomoli J, Bellini V, Bignami E (2023) Evaluating the feasibility of ChatGPT in healthcare: an analysis of multiple clinical and research scenarios. J Med Syst 47(1):33. https://doi.org/10.1007/s10916-023-01925-4
Deshpande A, Murahari V, Rajpurohit T, Kalyan A, Narasimhan K. Toxicity in ChatGPT: analyzing persona-assigned language models. Published online April 11, 2023. https://doi.org/10.48550/arXiv.2304.05335
Velasco RAF, Slusser K, Coats H (2022) Stigma and healthcare access among transgender and gender-diverse people: a qualitative meta-synthesis. J Adv Nurs 78(10):3083–3100. https://doi.org/10.1111/jan.15323
Kung TH, Cheatham M, Medenilla A et al (2023) Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLOS Digit Health 2(2):e0000198. https://doi.org/10.1371/journal.pdig.0000198
Hopkins BS, Nguyen VN, Dallas J et al (2023) ChatGPT versus the neurosurgical written boards: a comparative analysis of artificial intelligence/machine learning performance on neurosurgical board-style questions. J Neurosurg 1–8. Published online March 24. https://doi.org/10.3171/2023.2.JNS23419
Lee P, Bubeck S, Petro J (2023) Benefits, limits, and risks of GPT-4 as an AI chatbot for medicine. N Engl J Med 388(13):1233–1239. https://doi.org/10.1056/NEJMsr2214184
Ali R, Tang OY, Connolly ID, et al. Performance of ChatGPT, GPT-4, and Google Bard on a neurosurgery oral boards preparation question bank 2023.04.06.23288265. Published online April 12, 2023. https://doi.org/10.1101/2023.04.06.23288265
Najafali D, Camacho JM, Galbraith LG, Reiche E, Dorafshar AH, Morrison SD (2023) Ask and you shall receive: OpenAI ChatGPT writes us an editorial on using chatbots in gender affirmation surgery and strategies to increase widespread adoption. Aesthet Surg J sjad119. Published online April 25. https://doi.org/10.1093/asj/sjad119
Akhavan AA, Sandhu S, Ndem I, Ogunleye AA (2021) A review of gender affirmation surgery: what we know, and what we need to know. Surgery 170(1):336–340. https://doi.org/10.1016/j.surg.2021.02.013
Coleman E, Radix AE, Bouman WP et al (2022) Standards of care for the health of transgender and gender diverse people, Version 8. Int J Transgender Health 23(sup1):S1–S259. https://doi.org/10.1080/26895269.2022.2100644
OpenAi. OpenAI. Published 2023. Accessed 24 April 2023. https://openai.com/
Cleveland Clinic. Gender affirmation surgery: what happens, risks & benefits. Cleveland Clinic. Accessed 24 April 2023. https://my.clevelandclinic.org/health/treatments/21526-gender-affirmation-confirmation-or-sex-reassignment-surgery
AAMC. What is gender-affirming care? Your questions answered. AAMC. Accessed 24 April 2023. https://www.aamc.org/news-insights/what-gender-affirming-care-your-questions-answered
American Psychiatric Association. What is gender dysphoria? Accessed 22 March 2023. https://www.psychiatry.org:443/patients-families/gender-dysphoria/what-is-gender-dysphoria
World Health Organization. Gender incongruence and transgender health in the ICD. Accessed 24 April 2023. https://www.who.int/standards/classifications/frequently-asked-questions/gender-incongruence-and-transgender-health-in-the-icd
Moolchaem P, Liamputtong P, O’Halloran P, Muhamad R (2015) The lived experiences of transgender persons: a meta-synthesis. J Gay Lesbian Soc Serv 27(2):143–171. https://doi.org/10.1080/10538720.2015.1021983
Thoma BC, Jardas E, Choukas-Bradley S, Salk RH (2023) Perceived gender transition progress, gender congruence, and mental health symptoms among transgender adolescents. J Adolesc Health 72(3):444–451. https://doi.org/10.1016/j.jadohealth.2022.09.032
Cohen W, Maisner RS, Mansukhani PA, Keith J (2020) Barriers to finding a gender affirming surgeon. Aesth Plast Surg 44(6):2300–2307. https://doi.org/10.1007/s00266-020-01883-z
Ngaage LM, Knighton BJ, Benzel CA et al (2020) A review of insurance coverage of gender-affirming genital surgery. Plast Reconstr Surg 145(3):803–812. https://doi.org/10.1097/PRS.0000000000006591
Acknowledgements
We would like to acknowledge OpenAI’s ChatGPT for its contributions to the questions answered and generated supplements.
Funding
The authors received no funding for data collection or preparation of the manuscript.
Author information
Authors and Affiliations
Contributions
DN: conceptualization, methodology, investigation, writing—original draft, writing—review and editing
CH: conceptualization, methodology, investigation, writing—original draft, writing—review and editing
JMC: conceptualization, methodology, investigation, writing—original draft, writing—review and editing
LGG: conceptualization, methodology, investigation, writing—original draft, writing—review and editing
TLT: conceptualization, methodology, investigation, writing—original draft, writing—review and editing
DE: conceptualization, methodology, investigation, writing—original draft, writing—review and editing
BW: conceptualization, methodology, investigation, writing—original draft, writing—review and editing
LSS: conceptualization, methodology, investigation, writing—original draft, writing—review and editing
AHD: conceptualization, methodology, investigation, writing—original draft, writing—review and editing
SDM: conceptualization, methodology, investigation, writing—original draft, writing—review and editing
All authors approved the final version.
Corresponding author
Ethics declarations
Ethical approval and informed consent
This article does not contain any studies involving human participants or animals performed by any of the authors. For this type of study, formal consent is not required.
Conflict of interest
Amir H. Dorafshar is entitled to a technology he invented based on a licensing agreement between KLS Martin and the Johns Hopkins University, is entitled to receive royalties on a book he published under a licensing agreement with Elsevier, receives an honorarium for educational lectures from De Puy Synthes, receives indirect research support from KLS Martin and De Puy Synthes, and has received payment from KCI as a consultant. Daniel Najafali, Chandler Hinson, Justin M. Camacho, Logan G. Galbraith, Tannon L. Tople, Danielle Eble, Brielle Weinstein, Loren S. Schechter, and Shane D. Morrison declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Najafali, D., Hinson, C., Camacho, J.M. et al. Artificial intelligence knowledge of evidence-based recommendations in gender affirmation surgery and gender identity: is ChatGPT aware of WPATH recommendations?. Eur J Plast Surg 46, 1169–1176 (2023). https://doi.org/10.1007/s00238-023-02125-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00238-023-02125-6