Skip to main content

Virtual Human for Assisted Healthcare: Application and Technology

  • Living reference work entry
  • First Online:

Synonyms

Assisted healthcare; Realism; Virtual human character

Definition

Modern healthcare is constantly discovering and exploring the contributions that virtual reality can make to healthcare. The adoption of virtual human characters has had a success growth, in the past decades, in education, movies, games, and embodied conversational agents (ECAs). However, the growing interest of virtual reality in healthcare might stimulate a renewed interest in virtual human character. Therefore, this paper introduces the potential application areas of virtual human character (VHC) in healthcare from the point of view of realism and draws attention to the technology behind VHC as it pertains to realism.

Introduction

Modern healthcare is constantly discovering and exploring the contributions that virtual reality can make to healthcare. The usefulness of virtual reality in healthcare was discovered as far back as the 1990s during a surgery planning when a team of medical practitioners needed to...

This is a preview of subscription content, log in via an institution.

References

  • Ali, I.R., Kolivand, H., Alkawaz, M.H.: Lip syncing method for realistic expressive 3D face model. Multimed. Tools Appl. 77(5), 5323–5366 (2018)

    Article  Google Scholar 

  • Altobelli, D.E., Kikinis, R., Mulliken, J.B., Cline, H., Lorensen, W., Jolesz, F.: Computer-assisted three-dimensional planning in craniofacial surgery. Plast. Reconstr. Surg. 92(4), 576–585 (1993)

    Article  Google Scholar 

  • Arsov, I., Jovanova, B., Preda, M., Preteux, F.: On-line animation system for learning and practice cued speech. In: ICT Innovations, pp. 315–325, Springer (2010)

    Google Scholar 

  • Balci, K., Not, E., Zancanaro, M., Pianesi, F.: Xface open source project and SMIL-agent scripting language for creating and animating embodied conversational agents. In: Multimedia, pp. 1013–1016 (2007)

    Google Scholar 

  • Berger, M.A., Hofer, G., Shimodaira, H.: Carnival-combining speech technology and computer animation. Comput. Graph. Appl. IEEE. 31(5), 80–89 (2011)

    Article  Google Scholar 

  • Bertrand, J., Babu, S.V., Polgreen, P. and Segre, A.: Virtual agents-based simulation for training healthcare workers in hand hygiene procedures. In: International Conference on Intelligent Virtual Agents, pp. 125–131. Springer, Berlin/Heidelberg (2010)

    Chapter  Google Scholar 

  • Bevacqua Jr. John F.: System, method and financial product for providing retirement income protection, U.S. Patent 7,908,196, issued March 15 (2011)

    Google Scholar 

  • Brinkman, W.P., Van der Mast, C.A.P.G., de Vliegher, D.: Virtual Reality Exposure Therapy for Social Phobia: A Pilot Study in Evoking Fear in a Virtual World, vol. 1. Delft University of Technology, pp. 85–88 (2008)

    Google Scholar 

  • Čereković, A., Pandži, I.S.: Multimodal behaviour realization for embodied conversational agents. Multimed. Tools Appl. 54, 143–164 (2011)

    Article  Google Scholar 

  • Chinnock, C.: Virtual reality in surgery and medicine. Hosp. Technol. Ser. 13(18), 1–48 (1994)

    Google Scholar 

  • Deng, Z., Neumann, U.: Data-Driven 3D Facial Animation. Springer, London (2008)

    Google Scholar 

  • Didehbani, N., Allen, T., Kandalaft, M., Krawczyk, D., Chapman, S.: Virtual reality social cognition training for children with high functioning autism. Comput Hum Behav. 62, 703–711 (2016)

    Article  Google Scholar 

  • Grillon, H., Riquier, F., Herbelin, B., and Thalmann, D.: Use of virtual reality as therapeutic tool for behavioural exposure in the ambit of social anxiety disorder treatment. In: Proceedings of the 6th International Conference on Disability, Virtual Reality and Associated Technology, pp. 105–112. Esbjerg, 18–20 Sep, (2006)

    Google Scholar 

  • Gromala, D., Tong, X., Choo, A., Karamnejad, M. and Shaw, C.D.: The virtual meditative walk: virtual reality therapy for chronic pain management. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 521–524. ACM (2015)

    Google Scholar 

  • Hofer, G., Yamagishi, J., and Shimodaira, H.: Speech-driven lip motion generation with a trajectory HMM, Interspeech 2008, pp. 2314–2317, Brisbane (2008)

    Google Scholar 

  • Karaliotas, C.: When simulation in surgical training meets virtual reality. Hell. J. Surg. 83(6), 303–316 (2011)

    Article  Google Scholar 

  • Kessous, L., Castellano, G., Caridakis, G.: Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis. J. Multimodal User Interfaces. 3, 33–48 (2010)

    Article  Google Scholar 

  • Khor, W.S., Baker, B., Amin, K., Chan, A., Patel, K., Wong, J.: Augmented and virtual reality in surgery-the digital surgical environment: applications, limitations and legal pitfalls. Ann. Transl. Med. 4(23), 454 (2016)

    Article  Google Scholar 

  • Kokkinara, E., McDonnell, R.: Animation realism affects perceived character appeal of a self-virtual face. In: Proceedings of the 8th ACM SIGGRAPH Conference on Motion in Games, ACM, Paris, France, Nov 16–18, pp. 221–226 (2015)

    Google Scholar 

  • Kopp, S., Krenn, B., Marsella, S., Marshall, A.N., Pelachaud, C., Pirker, H.: Towards a Common Framework for Multimodal Generation: the Behaviour Markup Language. In: Intelligent Virtual Agents, pp. 205–217 (2006)

    Chapter  Google Scholar 

  • Kron, F.W., et al.: Medical student attitudes toward video games and related new media technologies in medical education. BMC Med. Educ. 10(1), 50 (2010)

    Article  Google Scholar 

  • Leigh, R., Zee, D.: The Neurology of Eye Movements: Book-and-DVD Package. Contemporary Neurology Series, vol. 70. Oxford University Press (2006)

    Google Scholar 

  • Magnenat-Thalmann, N., Thalmann, D.: Handbook of Virtual Humans. Wiley, Hoboken (2004)

    Book  Google Scholar 

  • Morten Havmøller Laursen.: Partially automated system for synthesizing human facial expressions in interactive media. Alborg University (2012)

    Google Scholar 

  • Pan, X., Gillies, M., Barker, C., Clark, D.M., Slater, M.: Socially anxious and confident men interact with a forward virtual woman: an experimental study. PLoS One. 7(4), e32931 (2012)

    Article  Google Scholar 

  • Parke, F.I., Waters, K.: Computer Facial Animation. AK Peters/CRC Press (2008)

    Google Scholar 

  • Patel, V., Aggarwal, R., Cohen, D., Taylor, D., Darzi, A.: Implementation of an interactive virtual-world simulation for structured surgeon assessment of clinical scenarios. J. Am. Coll. Surg. 217(2), 270–279 (2013)

    Article  Google Scholar 

  • Pasquariello, S., Pelachaud, C.: Greta: A Simple Facial Animation Engine. Soft Computing and Industry, 511–525. Springer London (2002)

    Google Scholar 

  • Platt, S.M., Badler, N.I.: Animating facial expressions. ACM SIGGRAPH Comp. Graph. 15(3), 245–252 (1981)

    Article  Google Scholar 

  • Queiroz, R.B., Cohen, M., Musse, S.R.: An extensible framework for interactive facial animation with facial expressions, lip synchronization and eye behaviour. Comput. Entertain. 7, 58 (2009)

    Article  Google Scholar 

  • Raibert, M., Playter, R., Krummel, T.M.: The use of a virtual reality haptic device in surgical training. Acad. Med. 73(5), 596–597 (1998)

    Article  Google Scholar 

  • Rosen, J.M., Lasko-Harvill, A., Satava, R.: Virtual reality and surgery. In: Taylor, R., Lavallee, S., Burdea, G., Moesges, R. (eds.) Computer-Integrated Surgery, pp. 231–244. MIT Press, Cambridge (1996)

    Google Scholar 

  • Satava, R.M.: Interactive technology and the new paradigm for healthcare, pp. 21–28. IOS Press, Washington, DC (1995)

    Google Scholar 

  • Seyema, J., Nagayama, R.: The uncanny valley: effect of realism on the impression of artificial human faces. Presence Teleop. Virt. Environ. 16(4), 337–351 (2007)

    Article  Google Scholar 

  • Shapiro, A.: Building a character animation system. In: Motion in games, pp. 98–109. Springer, Berlin (2011)

    Chapter  Google Scholar 

  • Sjolie, D.: Realistic and adaptive cognitive training using virtual characters. In: Proceedings of ICDVRAT, Sept 2014, pp. 385–388 (2014)

    Google Scholar 

  • Skantze, G., Al Moubayed, S.: IrisTK: a statechart-based toolkit for multi-party face-to-face interaction. In: Proceedings of the 14th ACM international conference on Multimodal interaction, pp. 69–76, ACM (2012)

    Google Scholar 

  • Smith, D.M., Aston, S.J., Oliker, A., Weinzweig, J.: Designing a virtual reality model for aesthetic surgery. Plast. Reconstr. Surg. 116(3), 893–897 (2005)

    Article  Google Scholar 

  • Thiebaux, M., Marsella, S., Marshall, A.N., Kallmann, M.: Smartbody: Behaviour Realization for Embodied Conversational Agents, Autonomous Agents and Multiagent Systems, vol. 1, pp. 151–158 (2008)

    Google Scholar 

  • Wang, L., Qian, X., Han, W., Soong, F.K: Synthesizing Photo-Real Talking Head Via Trajectory-Guided Sample Selection, INTERSPEECH, pp. 446–449 (2010)

    Google Scholar 

  • Zhang, L., Jiang, M., Farid, D., Hossain, M.: Intelligent facial emotion recognition and semantic-based topic detection for a humanoid robot. Expert Syst. Appl. 40, 5160–5168 (2013)

    Article  Google Scholar 

  • Zielke, M., LeFlore, J., Dufour, F., and Hardee, G.: Game-based virtual patients–educational opportunities and design challenges. In: Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC). Orlando, Florida (2010)

    Google Scholar 

  • Zoric, G., Forchheimer, R., Pandzic, I.S.: On creating multimodal virtual humans-real time speech driven facial gesturing. Multimed. Tools Appl. 54, 165–179 (2011)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Itimad Raheem Ali .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Ali, I.R., Ahmed, A.S., Tayyeh, H.K., Kolivand, H., Alkawaz, M.H. (2019). Virtual Human for Assisted Healthcare: Application and Technology. In: Lee, N. (eds) Encyclopedia of Computer Graphics and Games. Springer, Cham. https://doi.org/10.1007/978-3-319-08234-9_363-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-08234-9_363-1

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-08234-9

  • Online ISBN: 978-3-319-08234-9

  • eBook Packages: Springer Reference Computer SciencesReference Module Computer Science and Engineering

Publish with us

Policies and ethics