Technological advances, such as virtual reality (VR) platforms, have created new mechanisms that can be used to enhance exposure-based treatments targeting anxiety and posttraumatic stress disorders. In tandem with rapidly changing technologies, researchers and clinicians must consider the methodological strengths and limitations of VR platforms. Similarly, the application of novel technologies in clinical research requires a re-examination of the core principles of research ethics (i.e., respect for persons, beneficence, and justice). Despite the complex methodological and ethical considerations associated with VR technology, limited guidance is available. This paper uses a pilot study examining the development of a mobile VR intervention for social anxiety disorder among student veterans to examine methodological and ethical decision points for researchers and clinicians interested in using VR technologies to treat psychological disorders. Specifically, this paper highlights the decision-making process used by a multidisciplinary research team to maximize data usability related to treatment outcomes and minimize risks to the participant.
This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Price excludes VAT (USA)
Tax calculation will be finalised during checkout.
The data presented in this paper is limited in scope (e.g., related to reasons for participant attrition). Data is available through communication with the Principal Investigator of the project.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Publisher https://doi.org/10.1176/appi.books.9780890425596.744053
Amin, A.M., Tong, X., Gromala, D., & Shaw, C.D. (2017). Cardboard mobile virtual reality as an approach for pain distraction in clinical settings: Comparison, exploration and evaluation with Oculus Rift. Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, p. 2345–2351. https://doi.org/10.1145/3027063.3053234
Anderson, M., & Kumar, M. (2019, June 20). Digital divide persists even as Americans with lower incomes make gains in tech adoption. Pew Research Center. Retrieved at https://www.pewresearch.org/fact-tank/2021/06/22/digital-divide-persists-even-as-americans-with-lower-incomes-make-gains-in-tech-adoption/
Author. (2017). A new era of ethics: The use of virtual reality interventions in social work ethics. The International Journal of Continuing Social Work Education, 20(2), 5–24.
Author. (2019). Virtual treatment for veteran social anxiety disorder: A comparison of 360° video and 3D virtual reality. Journal of Technology in Human Services. https://doi.org/10.1080/15228835.2019.1692760
Baer, R. A., Smith, G. T., Hopkins, J., Krietemeyer, J., & Toney, L. (2006). Using self-report assessment methods to explore facets of mindfulness. Assessment, 13, 27–45.
Bibri, S. E., & Allam, Z. (2022). The Metaverse as a virtual form of data-driven smart cities: The ethics of the hyper-connectivity, datafication, algorithmization, and platformization of urban society. Computational Urban Science, 2(1), 1–22. https://doi.org/10.1007/s43762-022-00050-1
Blevins, C. A., Weathers, F. W., Davis, M. T., Witte, T. K., & Domino, J. L. (2015). The posttraumatic stress disorder checklist for DSM-5 (PCL-5): Development and initial psychometric evaluation. Journal of Traumatic Stress, 28(6), 489–498. https://doi.org/10.1002/jts.22059
Bryan, C. J., Bryan, A. O., Hinkson, K., Jr., Bichrest, M., & Ahern, D. A. (2014). Depression, posttraumatic stress disorder, and grade point average among student service members and veterans. Journal of Rehabilitation Research and Development, 51, 1035–1046. https://doi.org/10.1682/JRRD.2014.01.0012
Carl, E., Stein, A. T., Levihn-Coon, A., Pogue, J. R., Rothbaum, B., Emmelkamp, P., Asmundson, G. J. G., Carlbring, P., & Powers, M. B. (2019). Virtual reality exposure therapy for anxiety and related disorders: A meta-analysis of randomized controlled trials. Journal of Anxiety Disorders, 61, 27–36. https://doi.org/10.1016/j.janxdis.2018.08.003
Campbell, R., & Riggs, S. A. (2015). The role of psychological symptomatology and social support in the academic adjustment of previously deployed student veterans. Journal of American College Health, 63, 473–481. https://doi.org/10.1080/07448481.2015.1040408
Credé, M., & Niehorster, S. (2012). Adjustment to college as measured by the student adaptation to college questionnaire: A quantitative review of its structure and relationships with correlates and consequences. Educational Psychology Review, 24, 133–165. https://doi.org/10.1007/s10648-011-9184-5
Derogatis, L. R., & Savitz, K. L. (1999). The SCL-90-R, brief symptom inventory, and matching clinical rating scales. In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes assessment (pp. 679–724). Lawrence Erlbaum Associates Publishers.
Fernandez, C. B., & Hui, P. (2022). Life, the Metaverse and everything: An overview of privacy, ethics, and governance in Metaverse. arXiv preprint arXiv:2204.01480
First, M. B., Williams, J. B. W., Karg, R. S., & Spitzer, R. L. (2015). Structured clinical interview for DSM-5—research version (SCID-5 for DSM-5, Research Version; SCID-5-RV). VA, American Psychiatric Association: Arlington.
Foa, E., Hembree, E., & Rothbaum, B. O. (2007). Prolonged exposure therapy for PTSD: Emotional processing of traumatic experiences therapist guide. Oxford University Press.
Freeman, D., Reeve, S., Robinson, A., Ehlers, A., Clark, D., Spanlang, B., & Slater, M. (2017). Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychological Medicine, 47(14), 2393–2400. https://doi.org/10.1017/S003329171700040X
Golding, J. F. (1998). Motion sickness susceptibility questionnaire revised and its relationship to other forms of sickness. Brain Research Bulletin, 47(5), 507–516. https://doi.org/10.1016/S0361-9230(98)00091-4
Hofmann, S. G., & Otto, M. W. (2017). Cognitive behavioral therapy for social anxiety disorder: Evidence-based and disorder specific treatment techniques. Routledge.
Horigome, T., Kurokawa, S., Sawada, K., Kudo, S., Shiga, K., Mimura, M., & Kishimoto, T. (2020). Virtual reality exposure therapy for social anxiety disorder: A systematic review and meta-analysis. Psychological Medicine, 50, 2487–2497. https://doi.org/10.1017/S0033291720003785
Kenwright, B. (2018). Virtual reality: Ethical challenges and dangers [opinion]. IEEE Technology and Society Magazine, 37(4), 20–25. https://doi.org/10.1109/MTS.2018.2876104
Kim, S.-H., Hye, J. K., & Shin, G. (2021). Self-management mobile virtual reality program for women with gestational diabetes. International Journal of Environmental Research and Public Health, 18(1539), 1539. https://doi.org/10.3390/ijerph18041539
Kim, Y. R. & Kim, G. (Eds.). (2017). Presence and immersion of “easy” mobile VR with open flip-on lens. Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, ACIM Conferences. https://doi.org/10.1145/3139131.3139147. [Redacted for blind review].
Kulesza, M., Pedersen, E. R., Corrigan, P. W., & Marshall, G. N. (2015). Help-seeking stigma and mental health treatment seeking among young adult veterans. Military Behavioral Health, 3(4), 230–239.
Leon, A. C., Davis, L. L., & Kraemer, H. C. (2011). The role and interpretation of pilot studies in clinical research. Journal of Psychiatric Research, 45(5), 626–629. https://doi.org/10.1016/j.jpsychires.2010.10.008
Marissen, M. A., Franken, I. H., Blanken, P., Brink, W. V., & Hendriks, V. M. (2007). Cue exposure therapy for the treatment of opiate addiction: Results of a randomized controlled clinical trial. Psychotherapy and Psychosomatics, 76(2), 97–105. https://doi.org/10.1159/000097968
Metsis, V., Lawrence, G., Trahan, M., Smith, K. S., Tamir, D., & Selber, K. (2019). 360 Video: A prototyping process for developing virtual reality interventions. Journal of Technology in Human Services, 37(1), 32-50. https://doi.org/10.1080/15228835.2019.1604291
Morin, C. M., Belleville, G., Bélanger, L., & Ivers, H. (2011). The insomnia severity index: Psychometric indicators to detect insomnia cases and evaluate treatment response. Sleep, 34(5), 601–608.
O’Brien, H. L., Cairns, P., & Hall, M. (2018). A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form. International Journal of Human - Computer Studies, 112, 28–39. https://doi-org.libproxy.txstate.edu/10.1016/j.ijhcs.2018.01.004
Orsillo, S. M., Heimberg, R. G., Juster, H. R., & Garrett, J. (1996). Social phobia and PTSD in Vietnam veterans. Journal of Traumatic Stress, 9(2), 235–252. https://doi.org/10.1002/jts.2490090207
Posner, K., Brown, G. K., Stanley, B., Brent, D. A., Yershova, K. V., Oquendo, M. A., Currier, G. W., Melvin, G. A., Greenhill, L., Shen, S., & Mann, J. J. (2011). The Columbia-Suicide Severity Rating Scale: Initial validity and internal consistency findings from three multisite studies with adolescents and adults. The American Journal of Psychiatry, 168(12), 1266–1277. https://doi.org/10.1176/appi.ajp.2011.10111704
Pompeo-Fargnoli, A., Lapa, A., & Pellegrino, C. (2020). Telemental health and student veterans: A practice perspective through voices from the field. Journal of Technology in Human Services, 38(3), 271–287. https://doi-org.libproxy.txstate.edu/10.1080/15228835.2019.1674764
Roy, M. J., Costanzo, M. E., Blair, J. R., & Rizzo, A. A. (2014). Compelling evidence that exposure therapy for PTSD normalizes brain functioning. Annual Review of Cybertherapy and Telemedicine, 12, 61–65.
Sarkar, U., Lee, J. E., Nguyen, K. H., Lisker, S., & Lyles, C. R. (2021). Barriers and facilitators to the implementation of virtual reality as a pain management modality in academic, community, and safety-net settings: qualitative analysis. Journal of medical Internet research, 23(9), 1–9. https://doi.org/10.2196/26623
Smith, M. J., Graham, A. K., Sax, R., Spencer, E.-S., Razzano, L. A., Smith, J. D., & Jordan, N. (2019). Costs of preparing a virtual reality job interview training programme in a community mental health agency: A budget impact analysis. Journal of Evaluation in Clinical Practice, 26(4), 1188–1195. https://doi.org/10.1111/jep.13292
Tellegen, A., & Atkinson, G. (1974). Openness to absorbing and self-altering experiences (“absorption”), a trait related to hypnotic susceptibility. Journal of Abnormal Psychology, 83(3), 268–277. https://doi.org/10.1037/h0036681
United States. (1978). The Belmont report: Ethical principles and guidelines for the protection of human subjects of research. Bethesda, Md.: The Commission.
Watson, D., & Friend, R. (1969). Measurement of social-evaluative anxiety. Journal of Consulting and Clinical Psychology, 33, 448–457.
Witmer, B. G., & Singer, M. J. (1998). Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environments, 7(3), 225–240. https://doi.org/10.1162/105474698565686
The development of this article was supported by the Texas State University’s Multidisciplinary Internal Research Grant Program. The views, however, are those of the authors and do not reflect official positions of Texas State University.
Ethical of Approval
This study was performed in line with the principles of the Declaration of Helsinki. Approval was granted by the Internal Review Board of Texas State University.
The authors declare no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Nason, E.E., Trahan, M. & Cash, D. Evaluation of a Mobile Virtual Reality Intervention for Social Anxiety Disorder: Ethical and Methodological Lessons Learned. J. technol. behav. sci. 8, 79–86 (2023). https://doi.org/10.1007/s41347-022-00292-0
- Research ethics
- Virtual reality
- Research design
- Mental health treatment
- Anxiety disorders