Skip to main content

Evaluation of a Mobile Virtual Reality Intervention for Social Anxiety Disorder: Ethical and Methodological Lessons Learned

Journal of Technology in Behavioral Science volume 8, pages 79–86 (2023)Cite this article

Abstract

Technological advances, such as virtual reality (VR) platforms, have created new mechanisms that can be used to enhance exposure-based treatments targeting anxiety and posttraumatic stress disorders. In tandem with rapidly changing technologies, researchers and clinicians must consider the methodological strengths and limitations of VR platforms. Similarly, the application of novel technologies in clinical research requires a re-examination of the core principles of research ethics (i.e., respect for persons, beneficence, and justice). Despite the complex methodological and ethical considerations associated with VR technology, limited guidance is available. This paper uses a pilot study examining the development of a mobile VR intervention for social anxiety disorder among student veterans to examine methodological and ethical decision points for researchers and clinicians interested in using VR technologies to treat psychological disorders. Specifically, this paper highlights the decision-making process used by a multidisciplinary research team to maximize data usability related to treatment outcomes and minimize risks to the participant.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Data Availability

The data presented in this paper is limited in scope (e.g., related to reasons for participant attrition). Data is available through communication with the Principal Investigator of the project.

References

  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Publisher https://doi.org/10.1176/appi.books.9780890425596.744053

  • Amin, A.M., Tong, X., Gromala, D., & Shaw, C.D. (2017). Cardboard mobile virtual reality as an approach for pain distraction in clinical settings: Comparison, exploration and evaluation with Oculus Rift. Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, p. 2345–2351. https://doi.org/10.1145/3027063.3053234

  • Anderson, M., & Kumar, M. (2019, June 20). Digital divide persists even as Americans with lower incomes make gains in tech adoption. Pew Research Center. Retrieved at https://www.pewresearch.org/fact-tank/2021/06/22/digital-divide-persists-even-as-americans-with-lower-incomes-make-gains-in-tech-adoption/

  • Author. (2017). A new era of ethics: The use of virtual reality interventions in social work ethics. The International Journal of Continuing Social Work Education, 20(2), 5–24.

    Google Scholar 

  • Author. (2019). Virtual treatment for veteran social anxiety disorder: A comparison of 360° video and 3D virtual reality. Journal of Technology in Human Services. https://doi.org/10.1080/15228835.2019.1692760

    Article  Google Scholar 

  • Baer, R. A., Smith, G. T., Hopkins, J., Krietemeyer, J., & Toney, L. (2006). Using self-report assessment methods to explore facets of mindfulness. Assessment, 13, 27–45.

    Article  PubMed  Google Scholar 

  • Bibri, S. E., & Allam, Z. (2022). The Metaverse as a virtual form of data-driven smart cities: The ethics of the hyper-connectivity, datafication, algorithmization, and platformization of urban society. Computational Urban Science, 2(1), 1–22. https://doi.org/10.1007/s43762-022-00050-1

    Article  Google Scholar 

  • Blevins, C. A., Weathers, F. W., Davis, M. T., Witte, T. K., & Domino, J. L. (2015). The posttraumatic stress disorder checklist for DSM-5 (PCL-5): Development and initial psychometric evaluation. Journal of Traumatic Stress, 28(6), 489–498. https://doi.org/10.1002/jts.22059

    Article  PubMed  Google Scholar 

  • Bryan, C. J., Bryan, A. O., Hinkson, K., Jr., Bichrest, M., & Ahern, D. A. (2014). Depression, posttraumatic stress disorder, and grade point average among student service members and veterans. Journal of Rehabilitation Research and Development, 51, 1035–1046. https://doi.org/10.1682/JRRD.2014.01.0012

    Article  PubMed  Google Scholar 

  • Carl, E., Stein, A. T., Levihn-Coon, A., Pogue, J. R., Rothbaum, B., Emmelkamp, P., Asmundson, G. J. G., Carlbring, P., & Powers, M. B. (2019). Virtual reality exposure therapy for anxiety and related disorders: A meta-analysis of randomized controlled trials. Journal of Anxiety Disorders, 61, 27–36. https://doi.org/10.1016/j.janxdis.2018.08.003

    Article  PubMed  Google Scholar 

  • Campbell, R., & Riggs, S. A. (2015). The role of psychological symptomatology and social support in the academic adjustment of previously deployed student veterans. Journal of American College Health, 63, 473–481. https://doi.org/10.1080/07448481.2015.1040408

    Article  PubMed  Google Scholar 

  • Credé, M., & Niehorster, S. (2012). Adjustment to college as measured by the student adaptation to college questionnaire: A quantitative review of its structure and relationships with correlates and consequences. Educational Psychology Review, 24, 133–165. https://doi.org/10.1007/s10648-011-9184-5

    Article  Google Scholar 

  • Derogatis, L. R., & Savitz, K. L. (1999). The SCL-90-R, brief symptom inventory, and matching clinical rating scales. In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes assessment (pp. 679–724). Lawrence Erlbaum Associates Publishers.

    Google Scholar 

  • Fernandez, C. B., & Hui, P. (2022). Life, the Metaverse and everything: An overview of privacy, ethics, and governance in Metaverse. arXiv preprint arXiv:2204.01480

  • First, M. B., Williams, J. B. W., Karg, R. S., & Spitzer, R. L. (2015). Structured clinical interview for DSM-5—research version (SCID-5 for DSM-5, Research Version; SCID-5-RV). VA, American Psychiatric Association: Arlington.

    Google Scholar 

  • Foa, E., Hembree, E., & Rothbaum, B. O. (2007). Prolonged exposure therapy for PTSD: Emotional processing of traumatic experiences therapist guide. Oxford University Press.

  • Freeman, D., Reeve, S., Robinson, A., Ehlers, A., Clark, D., Spanlang, B., & Slater, M. (2017). Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychological Medicine, 47(14), 2393–2400. https://doi.org/10.1017/S003329171700040X

    Article  PubMed  PubMed Central  Google Scholar 

  • Golding, J. F. (1998). Motion sickness susceptibility questionnaire revised and its relationship to other forms of sickness. Brain Research Bulletin, 47(5), 507–516. https://doi.org/10.1016/S0361-9230(98)00091-4

  • Hofmann, S. G., & Otto, M. W. (2017). Cognitive behavioral therapy for social anxiety disorder: Evidence-based and disorder specific treatment techniques. Routledge.

  • Horigome, T., Kurokawa, S., Sawada, K., Kudo, S., Shiga, K., Mimura, M., & Kishimoto, T. (2020). Virtual reality exposure therapy for social anxiety disorder: A systematic review and meta-analysis. Psychological Medicine, 50, 2487–2497. https://doi.org/10.1017/S0033291720003785

    Article  PubMed  Google Scholar 

  • Kenwright, B. (2018). Virtual reality: Ethical challenges and dangers [opinion]. IEEE Technology and Society Magazine, 37(4), 20–25. https://doi.org/10.1109/MTS.2018.2876104

    Article  Google Scholar 

  • Kim, S.-H., Hye, J. K., & Shin, G. (2021). Self-management mobile virtual reality program for women with gestational diabetes. International Journal of Environmental Research and Public Health, 18(1539), 1539. https://doi.org/10.3390/ijerph18041539

    Article  PubMed  PubMed Central  Google Scholar 

  • Kim, Y. R. & Kim, G. (Eds.). (2017). Presence and immersion of “easy” mobile VR with open flip-on lens. Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, ACIM Conferences. https://doi.org/10.1145/3139131.3139147. [Redacted for blind review].

  • Kulesza, M., Pedersen, E. R., Corrigan, P. W., & Marshall, G. N. (2015). Help-seeking stigma and mental health treatment seeking among young adult veterans. Military Behavioral Health, 3(4), 230–239.

    Article  PubMed  PubMed Central  Google Scholar 

  • Leon, A. C., Davis, L. L., & Kraemer, H. C. (2011). The role and interpretation of pilot studies in clinical research. Journal of Psychiatric Research, 45(5), 626–629. https://doi.org/10.1016/j.jpsychires.2010.10.008

    Article  PubMed  Google Scholar 

  • Marissen, M. A., Franken, I. H., Blanken, P., Brink, W. V., & Hendriks, V. M. (2007). Cue exposure therapy for the treatment of opiate addiction: Results of a randomized controlled clinical trial. Psychotherapy and Psychosomatics, 76(2), 97–105. https://doi.org/10.1159/000097968

    Article  PubMed  Google Scholar 

  • Metsis, V., Lawrence, G., Trahan, M., Smith, K. S., Tamir, D., & Selber, K. (2019). 360 Video: A prototyping process for developing virtual reality interventions. Journal of Technology in Human Services, 37(1), 32-50. https://doi.org/10.1080/15228835.2019.1604291

  • Morin, C. M., Belleville, G., Bélanger, L., & Ivers, H. (2011). The insomnia severity index: Psychometric indicators to detect insomnia cases and evaluate treatment response. Sleep, 34(5), 601–608.

    Article  PubMed  PubMed Central  Google Scholar 

  • O’Brien, H. L., Cairns, P., & Hall, M. (2018). A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form. International Journal of Human - Computer Studies, 112, 28–39. https://doi-org.libproxy.txstate.edu/10.1016/j.ijhcs.2018.01.004

  • Orsillo, S. M., Heimberg, R. G., Juster, H. R., & Garrett, J. (1996). Social phobia and PTSD in Vietnam veterans. Journal of Traumatic Stress, 9(2), 235–252. https://doi.org/10.1002/jts.2490090207

    Article  PubMed  Google Scholar 

  • Posner, K., Brown, G. K., Stanley, B., Brent, D. A., Yershova, K. V., Oquendo, M. A., Currier, G. W., Melvin, G. A., Greenhill, L., Shen, S., & Mann, J. J. (2011). The Columbia-Suicide Severity Rating Scale: Initial validity and internal consistency findings from three multisite studies with adolescents and adults. The American Journal of Psychiatry, 168(12), 1266–1277. https://doi.org/10.1176/appi.ajp.2011.10111704

    Article  PubMed  PubMed Central  Google Scholar 

  • Pompeo-Fargnoli, A., Lapa, A., & Pellegrino, C. (2020). Telemental health and student veterans: A practice perspective through voices from the field. Journal of Technology in Human Services, 38(3), 271–287. https://doi-org.libproxy.txstate.edu/10.1080/15228835.2019.1674764

  • Roy, M. J., Costanzo, M. E., Blair, J. R., & Rizzo, A. A. (2014). Compelling evidence that exposure therapy for PTSD normalizes brain functioning. Annual Review of Cybertherapy and Telemedicine, 12, 61–65.

    Google Scholar 

  • Sarkar, U., Lee, J. E., Nguyen, K. H., Lisker, S., & Lyles, C. R. (2021). Barriers and facilitators to the implementation of virtual reality as a pain management modality in academic, community, and safety-net settings: qualitative analysis. Journal of medical Internet research, 23(9), 1–9. https://doi.org/10.2196/26623

  • Smith, M. J., Graham, A. K., Sax, R., Spencer, E.-S., Razzano, L. A., Smith, J. D., & Jordan, N. (2019). Costs of preparing a virtual reality job interview training programme in a community mental health agency: A budget impact analysis. Journal of Evaluation in Clinical Practice, 26(4), 1188–1195. https://doi.org/10.1111/jep.13292

    Article  PubMed  PubMed Central  Google Scholar 

  • Tellegen, A., & Atkinson, G. (1974). Openness to absorbing and self-altering experiences (“absorption”), a trait related to hypnotic susceptibility. Journal of Abnormal Psychology, 83(3), 268–277. https://doi.org/10.1037/h0036681

    Article  PubMed  Google Scholar 

  • United States. (1978). The Belmont report: Ethical principles and guidelines for the protection of human subjects of research. Bethesda, Md.: The Commission.

    Google Scholar 

  • Watson, D., & Friend, R. (1969). Measurement of social-evaluative anxiety. Journal of Consulting and Clinical Psychology, 33, 448–457.

    Article  PubMed  Google Scholar 

  • Witmer, B. G., & Singer, M. J. (1998). Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environments, 7(3), 225–240. https://doi.org/10.1162/105474698565686

    Article  Google Scholar 

Download references

Funding

The development of this article was supported by the Texas State University’s Multidisciplinary Internal Research Grant Program. The views, however, are those of the authors and do not reflect official positions of Texas State University.

Author information

Authors and Affiliations

  1. School of Social Work, Texas State University, 601 University Drive, San Marcos, TX, 78666, USA

    Erica E. Nason & Mark Trahan

  2. Department of Computer Science, Texas State University, San Marcos, TX, USA

    Dante Cash

Authors
  1. Erica E. Nason
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mark Trahan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dante Cash
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the study conception and design. Material preparation, data collection, and analysis were performed by Erica Nason, Mark Trahan, and Dante Cash. The first draft of the manuscript was written by Erica Nason and Mark Trahan, and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Erica E. Nason.

Ethics declarations

Ethical of Approval

This study was performed in line with the principles of the Declaration of Helsinki. Approval was granted by the Internal Review Board of Texas State University.

Competing Interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Nason, E.E., Trahan, M. & Cash, D. Evaluation of a Mobile Virtual Reality Intervention for Social Anxiety Disorder: Ethical and Methodological Lessons Learned. J. technol. behav. sci. 8, 79–86 (2023). https://doi.org/10.1007/s41347-022-00292-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41347-022-00292-0

Keywords

  • Research ethics
  • Virtual reality
  • Research design
  • Technology
  • Mental health treatment
  • Anxiety disorders