Virtual Patients for Clinical Therapist Skills Training

  • Patrick Kenny
  • Thomas D. Parsons
  • Jonathan Gratch
  • Anton Leuski
  • Albert A. Rizzo
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4722)


Virtual humans offer an exciting and powerful potential for rich interactive experiences. Fully embodied virtual humans are growing in capability, ease, and utility. As a result, they present an opportunity for expanding research into burgeoning virtual patient medical applications. In this paper we consider the ways in which one may go about building and applying virtual human technology to the virtual patient domain. Specifically we aim to show that virtual human technology may be used to help develop the interviewing and diagnostics skills of developing clinicians. Herein we proffer a description of our iterative design process and preliminary results to show that virtual patients may be a useful adjunct to psychotherapy education.


Virtual Humans Virtual Patients Psychopathology 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Andrew, R., Johnsen, K., Dickerson, R., Lok, B., Cohen, M., Stevens, A., Bernard, T., Oxendine, C., Wagner, P., Lind, S.: Comparing Interpersonal Interactions with a Virtual Human to those with a Real Human. IEEE Transactions on Visualization and Computer Graphics (2006)Google Scholar
  2. 2.
    Babu, S., Schmugge, S., Barnes, T., Hodges, L.: What Would You Like to Talk About? An Evaluation of Social Conversations with a Virtual Receptionist. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 169–180. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  3. 3.
    Beutler, L.E., Harwood, T.M.: Virtual reality in psychotherapy training. Journal of Clinical Psychology 60, 317–330 (2004)CrossRefGoogle Scholar
  4. 4.
    Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjálmsson, H., Yan, H.: An Architecture for Embodied Conversational Characters. In: Proceedings of the First Workshop on Embodied Conversational Characters, Tahoe City, California (October 12-15, 1998)Google Scholar
  5. 5.
    Diagnostic and Statistical Manual of Mental Disorders DSM-IV-TR 4th Ed, (Text Revision), American, Psychiatric Association (1994) Google Scholar
  6. 6.
    Dickerson, R., Johnsen, K., Raij, A., Lok, B., Hernandez, J., Stevens, A.: Evaluating a script-based approach for simulating patient-doctor interaction. In: Proceedings of the International Conference of Human-Computer Interface Advances for Modeling and Simulation (2005)Google Scholar
  7. 7.
    Evans, D., Hern, M., Uhlemann, M., Lvey, A.: Essential Interviewing: A Programmed Approach to Effective Communication, 3rd edn. Brooks/Cole Publishing Company (1989)Google Scholar
  8. 8.
    Frank, G., Guinn, C., Hubal, R., Pope, P., Stanford, M., Lamm-Weisel, D.: JUSTTALK: An application of responsive virtual human technology. In: Proceedings of the Interservice/Industry Training, Simulation and Education Conference, USA (2002)Google Scholar
  9. 9.
    Gratch, J., Rickel, J., André, E., Badler, N., Cassell, J., Petajan, E.: Creating Interactive Virtual Humans: Some Assembly Required. IEEE Intelligent Systems (July/August 2002)Google Scholar
  10. 10.
    Johnsen, K., Dickerson, R., Raij, A., Harrison, C., Lok, B., Stevens, A., et al.: Evolving an immersive medical communication skills trainer. Presence: Teleoperators and Virtual Environments 15(1), 33–46 (2006)CrossRefGoogle Scholar
  11. 11.
    Kiss, B., Szijarto, G., Benedek, B., Simon, L., Csukly, G., Takacs, B.: CyberTherapy: Applications of virtual reality and digital humans in clinical psychology. In: 2nd International Conference on Computer Animation Geometric Modeling, Hungary (2003)Google Scholar
  12. 12.
    Kopp, S., Krenn, B., Marsella, S., Marshall, A., Pelachaud, C., Pirker, H., Thorisson, K., Vilhjalmsson, H.: Towards a Common Framework for Multimodal Generation: The Behavior Markup Language. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 21–23. Springer, Heidelberg (2006)Google Scholar
  13. 13.
    Lee, J., Marsella, S.: Nonverbal Behavior Generator for Embodied Conversational Agents. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, Springer, Heidelberg (2006)Google Scholar
  14. 14.
    Leuski, A., Patel, R., Traum, D., Kennedy, B.: Building effective question answering characters. In: Proceedings of the 7th SIGdial Workshop on Discourse and Dialogue, Sydney, Australia (2006)Google Scholar
  15. 15.
    Leuski, A., Pair, J., Traum, D., McNerney, P.J., Georgiou, P., Patel, R.: How to talk to a hologram. In: Edmonds, E., Riecken, D., Paris, C.L., Sidner, C.L. (eds.) IUI 2006. Proceedings of the 11th international conference on Intelligent user interfaces, Sydney, Australia, pp. 360–362. ACM Press, New York (2006)CrossRefGoogle Scholar
  16. 16.
    McCauley, L., D’Mello, S.: MIKI: A Speech Enabled Intelligent Kiosk. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 132–144. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  17. 17.
    McGee, J.B., Neill, J., Goldman, L., Casey, E.: Using multimedia virtual patients to enhance the clinical curriculum for medical students. Medinfo 9(2), 732–735 (1998)Google Scholar
  18. 18.
    Parsons, T.D., Bowerly, T., Buckwalter, J.G., Rizzo, A.A.: A controlled clinical comparison of attention performance in children with ADHD in a virtual reality classroom compared to standard neuropsychological methods. Child Neuropsychology (2007)Google Scholar
  19. 19.
    Pellom, B.: Sonic: The University of Colorado continuous speech recognizer. Technical Report TR-CSLR-2001-01, University of Colorado, Boulder, CO (2001) Google Scholar
  20. 20.
    Prendinger, H., Ishizuka, M.: Life-Like Characters - Tools, Affective Functions, and Applications. Springer, Heidelberg (2004)Google Scholar
  21. 21.
    Rickel, J., Gratch, J., Hill, R., Marsella, S., Swartout, W.: Steve Goes to Bosnia: Towards a New Generation of Virtual Humans for Interactive Experiences. In: AAAI Spring Symposium on Artificial Intelligence and Interactive Entertainment, Stanford University, CA (2001)Google Scholar
  22. 22.
    Rizzo, A.A., Pair, J., Graap, K., Treskunov, A., Parsons, T.D.: User-Centered Design Driven Development of a VR Therapy Application for Iraq War Combat-Related Post Traumatic Stress Disorder. In: Proceedings of the 2006 International Conference on Disability, Virtual Reality and Associated Technology, pp. 113–122 (2006)Google Scholar
  23. 23.
    Rizzo, A., Bowerly, T., Buckwalter, J., Klimchuk, D., Mitura, R., Parsons, T.D.: A Virtual Reality Scenario for All Seasons: The Virtual Classroom. CNS Spectrums 11(1) (2006)Google Scholar
  24. 24.
    Patel, R., Leuski, A., Traum, D.: Dealing with out of domain questions in virtual characters. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, Springer, Heidelberg (2006)CrossRefGoogle Scholar
  25. 25.
    Sethy, A., Georgiou, P., Narayanan, S.: Building topic specific language models from webdata using competitive models. In: Proceedings of EUROSPEECH, Lisbon, Portugal (2005)Google Scholar
  26. 26.
    Stevens, A., Hernandex, J., Johnsen, K., et al.: The use of virtual patients to teach medical students communication skills. The Association for Surgical Education Annual Meeting, April 7-10, New York, NY (2005)Google Scholar
  27. 27.
    Swartout, W., Gratch, J., Hill, R., Hovy, E., Marsella, S., Rickel, J., Traum, D.: Toward Virtual Humans. AI Magazine 27(1) (2006)Google Scholar
  28. 28.
    Thiebaux, M., Marshall, A., Marsella, S., Fast, E., Hill, A., Kallmann, M., Kenny, P., Lee, J.: SmartBody: Behavior Realization for Embodied Conversational Agents. In: IVA 2007 (2007)Google Scholar
  29. 29.
    Triola, M., Feldman, H., Kalet, A.L., Zabar, S., Kachur, E.K., Gillespie, C., et al.: A randomized trial of teaching clinical skills using virtual and live standardized patients. Journal of General Internal Medicine 21(5), 424–429 (2006)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Patrick Kenny
    • 1
  • Thomas D. Parsons
    • 1
  • Jonathan Gratch
    • 1
  • Anton Leuski
    • 1
  • Albert A. Rizzo
    • 1
  1. 1.Institute for Creative Technologies, University of Southern California, 13274 Fiji Way Marina Del Rey, CA 90292USA

Personalised recommendations