Skip to main content
SpringerLink
Log in

Remote 3D Medical Consultation

  • Chapter
  • First Online:
Virtual Realities

Abstract

Two-dimensional (2D) video-based telemedical consultation has been explored widely in the past 15–20 years. Two issues that seem to arise in most relevant case studies are the difficulty associated with obtaining the desired 2D camera views, and poor depth perception. To address these problems we are exploring the use of a small array of cameras to synthesize a spatially continuous range of dynamic three-dimensional (3D) views of a remote environment and events. The 3D views can be sent across wired or wireless networks to remote viewers with fixed displays or mobile devices such as a personal digital assistant (PDA). The viewpoints could be specified manually or automatically via user head or PDA tracking, giving the remote viewer virtual head- or hand-slaved (PDA-based) remote cameras for mono or stereo viewing. We call this idea remote 3D medical consultation (3DMC). In this article we motivate and explain the vision for 3D medical consultation; we describe the relevant computer vision/graphics, display, and networking research; we present a proof-of-concept prototype system; and we present some early experimental results supporting the general hypothesis that 3D remote medical consultation could offer benefits over conventional 2D televideo.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Autostereoscopic displays provide one more viewers with a fixed number of stereo views (for example eight) of a 3D scene, without the use of special user-worn glasses. See http://www.newsight.com.

References

  1. 3rdTech, Inc. (2005). http://www.3rdtech.com/

  2. ARToolkit (2005). http://www.hitl.washington.edu/artoolkit/

  3. Point Grey Research (2005). http://www.ptgrey.com/

  4. Virtual Reality Peripheral Network (2006). http://www.cs.unc.edu/Research/vrpn/

  5. Bandura, A.: Self-efficacy: the exercise of control. W.H. Freeman, New York (1997)

    Google Scholar 

  6. Chu, Y., Huang, X., Ganz, A.: Wista: A wireless transmission system for disaster patient care. In: Proceedings of BROADNETS: 2nd IEEE/CreateNet International Conference on Broadband Networks, pp. 118–122. Omnipress, Boston (2005)

    Google Scholar 

  7. Coates, T., Goode, A.: Towards improving prehospital trauma care. Lancet 357(9274), 2070 (2001)

    Google Scholar 

  8. David G. Ellis, M., James Mayrose, P., Dietrich V. Jehle, M., Ronald M. Moscati, M., Guillermo J. Pierluisi, M.: A telemedicine model for emergency care in a short-term correctional facility. Telemedicine Journal and e-Health 7(2), 87–92 (2001)

    Google Scholar 

  9. Dimmick, S.L., Mustaleski, C., Burgiss, S.G., Welsh, T.S.: A case study of benefits and potential savings in rural home telemedicine. Home Healthcare Nurse 18(2), 125–135 (2000)

    Article  Google Scholar 

  10. Doty, E., L. H. Zincone, J., Balch, D.C.: Medicine Meets Virtual Reality: Healthcare in the Information Age, chap. Telemedicine in the North Carolina Prison System, pp. 239–241. IOS Press, Eds. J. Weghorst, Hans B. Sieburg, and Karen S. Morgan (1996)

    Google Scholar 

  11. Downey, J.: Measuring general computer self-efficacy: The surprising comparison of three instruments in predicting performance, attitudes, and usage. Hawaii International Conference on System Sciences 8, 210a (2006). DOI doi. ieeecomputersociety.org/10.1109/HICSS.2006.268

  12. Fitzmaurice, G.W.: Situated information spaces ad spatially aware palmtop computers. Communications of the ACM 36(7) (1993)

    Google Scholar 

  13. Fitzmaurice, G.W., Buxton, W.: The chameleon: Spatially aware palmtop computers. In: ACM CHI94. Boston, MA USA (1994)

    Google Scholar 

  14. Fitzmaurice, G.W., Zhai, S., Chignell, M.H.: Virtual reality for palmtop computers. ACM Transactions on Information Systems 11, 197–218 (1993)

    Article  Google Scholar 

  15. Gotz, D., Mayer-Patel, K.: A general framework for multidimensional adaptation. In: MULTIMEDIA ’04: Proc. of the 12th annual ACM international conference on Multimedia, pp. 612–619. ACM, New York (2004). DOI doi.acm.org/10.1145/ 1027527.1027671

  16. Hendrix, C., Barfield, W.: Presence within virtual environments as a function of visual display parameters. Presence: Teloperators and virtual environments 5(3), 274–289 (1996)

    Google Scholar 

  17. Hinckley, K., Pausch, R., Goble, J.C., Kassell, N.F.: Passive real-world interface props for neurosurgical visualization. In: CHI ’94: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 452–458. ACM, New York (1994). DOI doi.acm.org/10.1145/191666.191821

  18. Hwang, J., Jung, J., Kim, G.J.: Hand-held virtual reality: A feasibility study. In: Proceedings of the ACM symposium on Virtual reality software and technology, pp. 356–363. ACM (2006)

    Google Scholar 

  19. Hwang, J., Jung, J., Yim, S., Cheon, J., Lee, S., Choi, S., Kim, G.J.: Requirements, implementation and applications of hand-held virtual reality. IJVR 5(2), 59–66 (2006)

    Google Scholar 

  20. Kaiser Permanente: Outcomes of the kaiser permanente tele-home health research project. Archives of Family Medicine 9 (2000)

    Google Scholar 

  21. Krishnan, S., Mayer-Patel, K.: A utility-driven framework for loss and encoding aware video adaptation. In: MULTIMEDIA ’07: Proceedings of the 15th international conference on Multimedia, pp. 1026–1035. ACM, New York, NY, USA (2007). DOI doi.acm.org/10.1145/1291233.1291459

  22. Meyer, A.: Death and disability from injury: A global challenge. J Trauma 44(1), 1–12 (1998)

    Article  Google Scholar 

  23. Michael G. Kienzle, M.: Rural-academic integration: Iowas national laboratory for the study of rural telemedicine. Tech. rep., National Laboratory for the Study of Rural Telemedicine (2000)

    Google Scholar 

  24. Mizell, D.W., Jones, S.P., Slater, M., Spanlang, B., Swapp, D.: Immersive virtual reality vs. “flat-screen” visualization: A measurable advantage. (Submitted for publication). (2003)

    Google Scholar 

  25. Mohring, M., Lessig, C., Bimber, O.: Video see-through AR on consumer cell-phones. In: Proc. of the Third IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’04), pp. 252–253. IEEE Computer Society, Washington, DC, USA (2004). DOI dx.doi.org/10.1109/ISMAR.2004.63

  26. Mun, S.K.: Project phoenix: Scrutinizing a telemedicine testbed. final project report, national library of medicine, contract #n01-lm-6-3544. Tech. rep., Georgetown University Medical Center (2000)

    Google Scholar 

  27. Office for the Advancement of Telehealth: Telemedicine report to congress. Tech. rep., U.S. Department of Health and Human Services, Health Resources and Services Administration (2001)

    Google Scholar 

  28. Pasman, W., van der Schaaf, A., Lagendijk R.L., Jansen F.W.: Accurate overlaying for mobile augmented reality. Computers and Graphics 23, 875–881 (1999)

    Article  Google Scholar 

  29. Pausch, R., Shackelford, M.A., Proffitt, D.: A user study comparing head-mounted and stationary displays. In: Proc. of IEEE Symposium on Research Frontiers in Virtual Reality, pp. 41–45. IEEE (1993)

    Google Scholar 

  30. Reitmayr, G., Drummond, T.W.: Going out: Robust modelbased tracking for outdoor augmented reality. In: Proceedings of 5th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR, pp. 109–118 (2006)

    Google Scholar 

  31. Schroeder, R., Steed, A., Axelsson, A.S., Heldal, I., Abelin, A., Wideström, J., Nilsson, A., Slater, M.: Collaborating in networked immersive spaces: As good as being there together? Computers & Graphics, Special Issue on Mixed Realities – Beyond Conventions 25(5), 781–788 (2001). http://www.elsevier.com/gej-ng/10/13/20/57/34/32/article.pdf

  32. Snow, M.P.: Charting presence in virtual environments and its effects on performance. Ph.D. thesis, Virginia Polytechnic Institute and State University (1996)

    Google Scholar 

  33. Söderholm, H.M., Sonnenwald, D.H.: Visioning future emergency healthcare collaboration: Perspectives from large and small medical centers. Journal of the American Society for Information Science and Technology 61(9), 1808–1823 (2010).

    Article  Google Scholar 

  34. Söderholm, H.M., Sonnenwald, D.H., Manning, J.E., Cairns, B., Welch, G., Fuchs, H.: Exploring the potential of video technologies for collaboration in emergency medical care. part ii: Task performance. Journal of the American Society for Information Science and Technology 59(14), 2335–2349 (2008). DOI 10.1002/asi.20939. http://www3.interscience.wiley.com/journal/121378034/abstract

  35. Sonnenwald, D.H., Söderholm, H.M., Manning, J.E., Cairns, B., Welch, G., Fuchs, H.: Exploring the potential of video technologies for collaboration in emergency medical care. part i: Information sharing. Journal of the American Society for Information Science and Technology 59(14), 2320–2334 (2008). DOI 10.1002/asi.20934. http://www3.interscience.wiley.com/journal/121378032/abstract?CRETRY=1&SRETRY=0

  36. Tachakra, S.: Depth perception in telemedical consultations. Telemed J E Health 7(2), 77–85. (2001)

    Article  Google Scholar 

  37. Telemedicine Directorate: Advanced concept technology demonstrations letter of finding. Tech. rep., Walter Reed Army Medical Center (2000). http://www.salud.gob.mx/unidades/sic/cits/doctosFuente/2001REPO.pdf

  38. Wagner, D., Schmalstieg, D.: First steps towards handheld augmented reality. In: ISWC ’03: Proceedings of the 7th IEEE International Symposium on Wearable Computers International Symposium on Wearable Computers. IEEE Computer Society, Washington, DC, USA (2003)

    Google Scholar 

  39. Wagner, D., Schmalstieg, D.: Handheld augmented reality displays. In: G. Welch (ed.) Proceedings of 2nd Emerging Display Technologies Workshop (EDT 2006), pp. 35–36 (2006)

    Google Scholar 

  40. Welch, G., Noland, M., Bishop, G.: Complementary tracking and two-handed interaction for remote 3d medical consultation with a pda. In: G. Zachmann (ed.) Proceedings of Trends and Issues in Tracking for Virtual Environments, Workshop at the IEEE Virtual Reality 2007 Conference. Shaker, Charlotte, NC USA (2007)

    Google Scholar 

  41. Yang, R.: View-dependent pixel coloring—a physically-based approach for 2d view synthesis. Ph.d. thesis, University of North Carolina at Chapel Hill (2003)

    Google Scholar 

  42. Yang, R., Pollefeys, M., Yang, H., Welch, G.: A unified approach to real-time, multi-resolution, multi-baseline 2d view synthesis and 3d depth estimation using commodity graphics hardware. International Journal of Image and Graphics (IJIG) 4(4), 1–25 (2004)

    Google Scholar 

  43. Zia Agha MD, M., Ralph M. Schapira, M., Azmaira H. Maker, P.: Cost effectiveness of telemedicine for the delivery of outpatient pulmonary care to a rural population. Telemedicine Journal and e-Health 8(3), 281–291 (2002)

    Google Scholar 

Download references

Acknowledgements

At UNC-Chapel Hill we thank Jim Mahaney and John Thomas for their technical support; and former Graduate Research Assistant Max Smolens for his early contributions to the effort. We thank the paramedics who participated in the evaluation. This effort is primarily supported by National Library of Medicine contract N01-LM-3-3514: “3D Telepresence for Medical Consultation: Extending Medical Expertise Throughout, Between and Beyond Hospitals,” and in part by NSF grant EIA-0303590: “Ubiquitous Pixels: Transforming Collaboration & Teaching with Pervasive Wall Displays.”

Author information

Authors and Affiliations

  1. The Department of Computer Science, The University of North Carolina at Chapel Hill, Campus Box 3175, Chapel Hill, North Carolina, 27599-3175, USA

    Greg Welch, Henry Fuchs, Ketan Mayer-Patel, Andrei State, Herman Towles, Adrian Ilie & Srinivas Krishnan

  2. School of Information and Library Studies, University College Dublin, Belfeild, Dublin 4, Ireland

    Diane H. Sonnenwald

  3. The Department of Surgery, The University of North Carolina at Chapel Hill, Campus Box 7228, Chapel Hill, North Carolina, 27599-7228, USA

    Bruce Cairns M.D.

  4. The Department of Computer Science, The University of Kentucky, 232 Hardymon Building, Lexington, Kentucky, 40506-0195, USA

    Ruigang Yang

  5. The Swedish School of Library and Information Science, Göteborg University and the University College of Borås, 50190, Borås, Sweden

    Hanna M. Söderholm

Authors
  1. Greg Welch
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Diane H. Sonnenwald
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Henry Fuchs
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bruce Cairns M.D.
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ketan Mayer-Patel
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ruigang Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Andrei State
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Herman Towles
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Adrian Ilie
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Srinivas Krishnan
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Hanna M. Söderholm
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Greg Welch .

Editor information

Editors and Affiliations

  1. Fak. Informatik, Professur für Graphische, TU Chemnitz, Straße der Nationen 62, Chemnitz, 09107, Germany

    Guido Brunnett

  2. ZIRST, INRIA Rhône-Alpes, avenue de l'Europe 655, St.Ismier, 38334, France

    Sabine Coquillart

  3. Dept. Computer Science, University of North Carolina, Sitterson Hall, Chapel Hill, 27599-3175, North Carolina, USA

    Greg Welch

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag/Wien

About this chapter

Cite this chapter

Welch, G. et al. (2011). Remote 3D Medical Consultation. In: Brunnett, G., Coquillart, S., Welch, G. (eds) Virtual Realities. Springer, Vienna. https://doi.org/10.1007/978-3-211-99178-7_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-211-99178-7_8

  • Published:

  • Publisher Name: Springer, Vienna

  • Print ISBN: 978-3-211-99177-0

  • Online ISBN: 978-3-211-99178-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation