Abstract
The launch of Open AI’s chatbot, ChatGPT, has generated a lot of attention and discussion among professionals in several fields. Many concerns and challenges have been brought up by researchers from various fields, particularly in relation to the harm that using these tools for medical diagnosis and treatment recommendations can cause. In addition, it has been debated if ChatGPT is dependable, efficient, and helpful for clinicians and medical professionals. Therefore, in this study, we assess ChatGPT’s effectiveness in providing mental health support, particularly for issues related to anxiety and depression, based on the chatbot’s responses and cross-questioning. The findings indicate that there are significant inconsistencies and that ChatGPT’s reliability is low in this specific domain. As a result, care must be used when using ChatGPT as a complementary mental health resource.
References
Balas, M., and E. B. Ing. Conversational AI models for ophthalmic diagnosis: comparison of ChatGPT and the Isabel Pro differential diagnosis generator. JFO Open Ophthalmol. 1:100005, 2023. https://doi.org/10.1016/J.JFOP.2023.100005.
Chisholm, D., A. Flisher, C. Lund, V. Patel, S. Saxena, G. Thornicroft, and M. Tomlinson. Scale up services for mental disorders: a call for action. Lancet 370(9594):1241–1252, 2007. https://doi.org/10.1016/S0140-6736(07)61242-2.
Farhat, F., S. S. Sohail, and D. Ø. Madsen. How trustworthy is ChatGPT? The case of bibliometric analyses. Cogent Eng. 10(1):2222988, 2023. https://doi.org/10.1080/23311916.2023.2222988.
Hill-Yardin, E. L., M. R. Hutchinson, R. Laycock, and S. J. Spencer. A Chat(GPT) about the future of scientific publishing. Brain Behav. Immun. 110:152–154, 2023. https://doi.org/10.1016/J.BBI.2023.02.022.
Kung, T. H., M. Cheatham, A. Medenilla, C. Sillos, L. De Leon, C. Elepaño, M. Madriaga, R. Aggabao, G. Diaz-Candido, J. Maningo, and V. Tsengid. Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLoS Digit. Health 2(2):e0000198, 2023. https://doi.org/10.1371/JOURNAL.PDIG.0000198.
Lahat, A., E. Shachar, B. Avidan, Z. Shatz, B. S. Glicksberg, and E. Klang. Evaluating the use of large language model in identifying top research questions in gastroenterology. Sci. Rep. 13(1):1–6, 2023. https://doi.org/10.1038/s41598-023-31412-2.
Luca Masala, G., G. De Pietro, T. Hirosawa, Y. Harada, M. Yokose, T. Sakamoto, R. Kawamura, and T. Shimizu. Diagnostic accuracy of differential-diagnosis lists generated by generative pretrained transformer 3 chatbot for clinical vignettes with common chief complaints: a pilot study. Int. J. Environ. Res. Public Health 20(4):3378, 2023. https://doi.org/10.3390/IJERPH20043378.
Mbakwe, A. B., I. Lourentzou, L. A. Celi, O. J. Mechanic, and A. Dagan. ChatGPT passing USMLE shines a spotlight on the flaws of medical education. PLoS Digit. Health 2(2):e0000205, 2023. https://doi.org/10.1371/JOURNAL.PDIG.0000205.
Surameery, N. M. S., and M. Y. Shakor. Use Chat GPT to solve programming bugs. Int. J. Inf. Technol. Comput. Eng. 3(01):17–22, 2023. https://doi.org/10.55529/IJITC.31.17.22.
Tlili, A., B. Shehata, M. A. Adarkwah, A. Bozkurt, D. T. Hickey, R. Huang, and B. Agyemang. What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learn. Environ. 2023. https://doi.org/10.1186/S40561-023-00237-X.
Wainberg, M. L., P. Scorza, J. M. Shultz, L. Helpman, J. J. Mootz, K. A. Johnson, Y. Neria, J. M. E. Bradford, M. A. Oquendo, and M. R. Arbuckle. Challenges and opportunities in global mental health: a research-to-practice perspective. Curr. Psychiatry Rep. 19(5):1–10, 2017. https://doi.org/10.1007/S11920-017-0780-Z/METRICS.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
There is no conflict of interest.
Additional information
Associate Editor Stefan M. Duma oversaw the review of this article.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Farhat, F. ChatGPT as a Complementary Mental Health Resource: A Boon or a Bane. Ann Biomed Eng 52, 1111–1114 (2024). https://doi.org/10.1007/s10439-023-03326-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10439-023-03326-7