Skip to main content
Log in

Controlling camera movement in VR colonography

Virtual Reality Aims and scope Submit manuscript

Abstract

Immersive colonography allows medical professionals to navigate inside the intricate tubular geometries of subject-specific 3D colon images using Virtual Reality displays. Typically, camera travel is performed via Fly-Through or Fly-Over techniques that enable semi-automatic traveling through a constrained, well-defined path at user-controlled speeds. However, Fly-Through is known to limit the visibility of lesions located behind or inside haustral folds. At the same time, Fly-Over requires splitting the entire colon visualization into two specific halves. In this paper, we study the effect of immersive Fly-Through and Fly-Over techniques on lesion detection and introduce a camera travel technique that maintains a fixed camera orientation throughout the entire medial axis path. While these techniques have been studied in non-VR desktop environments, their performance is not well understood in VR setups. We performed a comparative study to ascertain which camera travel technique is more appropriate for constrained path navigation in immersive colonography and validated our conclusions with two radiologists. To this end, we asked 18 participants to navigate inside a 3D colon to find specific marks. Our results suggest that the Fly-Over technique may lead to enhanced lesion detection at the cost of higher task completion times. Nevertheless, the Fly-Through method may offer a more balanced trade-off between speed and effectiveness, whereas the fixed camera orientation technique provided seemingly inferior performance results. Our study further provides design guidelines and informs future work.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Notes

  1. http://www.viatronix.com/ct-colonography.asp.

  2. Siemens Healthineers, 2017. syngo.CT Colonography.

References

  • Aguilar WG, Abad V, Ruiz H, Aguilar J, Aguilar-Castillo F (2017) Rrt-based path planning for virtual bronchoscopy simulator. In: International conference on augmented reality, virtual reality and computer graphics. Springer, pp 155–165

  • Bartz D (2005) Virtual endoscopy in research and clinical practice. Comput Graph Forum 24(1):111–126. https://doi.org/10.1111/j.1467-8659.2005.00831.x

    Article  Google Scholar 

  • Bowman DA, Koller D, Hodges LF (1997) Travel in immersive virtual environments: An evaluation of viewpoint motion control techniques. In: Proceedings of IEEE 1997 annual international symposium on virtual reality. IEEE, pp 45–52

  • Chaudhuri P, Khandekar R, Sethi D, Kalra P (2004) An efficient central path algorithm for virtual navigation. In: Proceedings computer graphics international, 2004. IEEE, pp 188–195

  • Cheng I, Shen R, Moreau R, Brizzi V, Rossol N, Basu A (2014) An augmented reality framework for optimization of computer assisted navigation in endovascular surgery. In: 2014 36th annual international conference of the IEEE engineering in medicine and biology society. IEEE, pp 5647–5650

  • Codd AM, Choudhury B (2011) Virtual reality anatomy: Is it comparable with traditional methods in the teaching of human forearm musculoskeletal anatomy? Anat Sci Edu 4(3):119–125

    Article  Google Scholar 

  • De Visser H, Watson MO, Salvado O, Passenger JD (2011) Progress in virtual reality simulators for surgical training and certification. Med J Aust 194:S38–S40

    Article  Google Scholar 

  • Elmqvist N, Tsigas P (2006) On navigation guidance for exploration of 3d environments. Göteborg, Sweden

    Google Scholar 

  • Elmqvist N, Tudoreanu ME, Tsigas P (2007) Tour generation for exploration of 3d virtual environments. In: Proceedings of the 2007 ACM symposium on virtual reality software and technology, VRST ’07. Association for Computing Machinery, New York, NY, USA, pp 207–210. https://doi.org/10.1145/1315184.1315224

  • Ferlay J, Soerjomataram I, Dikshit R, Eser S, Mathers C, Rebelo M, Parkin DM, Forman D, Bray F (2015) Cancer incidence and mortality worldwide: sources, methods and major patterns in GLOBOCAN 2012. Int J Cancer 136(5):E359–E386. https://doi.org/10.1002/ijc.29210

    Article  Google Scholar 

  • Haigron P, Bellemare ME, Acosta O, Goksu C, Kulik C, Rioual K, Lucas A (2004) Depth-map-based scene analysis for active navigation in virtual angioscopy. IEEE Trans Med Imaging 23(11):1380–1390

    Article  Google Scholar 

  • Haker S, Angenent SB, Tannenbaum AR, Kikinis R (2000) Nondistorting flattening maps and the 3-d visualization of colon ct images. IEEE Trans Med Imaging 19:665–670

    Article  Google Scholar 

  • Hassouna MS, Farag AA, Falk R (2006): Virtual fly-over: a new visualization technique for virtual colonoscopy. In: MICCAI 2006. Springer, Berlin, pp 381–388

  • He T, Hong L, Chen D, Liang Z (2001) Reliable path for virtual endoscopy: ensuring complete examination of human organs. IEEE Trans Vis Comput Graph 7(4):333–342. https://doi.org/10.1109/2945.965347

    Article  Google Scholar 

  • Hong L, Kaufman A, Wei YC, Viswambharan A, Wax M, Liang Z (1995) 3d virtual colonoscopy. In: Biomedical visualization, 1995. Proceedings. IEEE, pp 26–32

  • Huang A, Roy D, Franaszek M, Summers RM (2005) Teniae coli guided navigation and registration for virtual colonoscopy. In: IEEE conference on visualization, VIS 05. IEEE, pp 279–285. https://doi.org/10.1109/VISUAL.2005.1532806

  • Huang A, Summers RM, Roy D (2006) Synchronous navigation for ct colonography. In: Medical imaging 2006: physiology, function, and structure from medical images. International Society for Optics and Photonics, vol 6143, p 614315

  • King F, Jayender J, Bhagavatula SK, Shyn PB, Pieper S, Kapur T, Lasso A, Fichtinger G (2016) An immersive virtual reality environment for diagnostic imaging. J Med Robot Res 1(01):1640003. https://doi.org/10.1142/S2424905X16400031

    Article  Google Scholar 

  • LaViola JJ Jr (2000) A discussion of cybersickness in virtual environments. ACM SIGCHI Bull 32(1):47–56

    Article  Google Scholar 

  • Lopes DS, Medeiros D, Paulo SF, Borges PB, Nunes V, Mascarenhas V, Veiga M, Jorge JA (2018) Interaction techniques for immersive ct colonography: a professional assessment. In: MICCAI 2018. Springer, pp 629–637. https://doi.org/10.1007/978-3-030-00934-2_70

  • Medeiros D, Sousa M, Raposo A, Jorge J (2019) Magic carpet: interaction fidelity for flying in vr. IEEE Trans Vis Comput Graph 26(9):2793–2804

    Article  Google Scholar 

  • Mirhosseini S, Gutenko I, Ojal S, Marino J, Kaufman A (2019) Immersive virtual colonoscopy. IEEE Trans Vis Comput Graph 25(5):2011–2021

    Article  Google Scholar 

  • Mirhosseini K, Sun Q, Gurijala KC, Laha B, Kaufman AE (2014) Benefits of 3D immersion for virtual colonoscopy. In: 2014 IEEE VIS international workshop on 3DVis (3DVis), pp 75–79. https://doi.org/10.1109/3DVis.2014.7160105

  • Noser H, Stern C, Stucki P (2003) Automatic path searching for interactive navigation support within virtual medical 3d objects. In: International congress series. Elsevier, vol 1256, pp 29–34

  • Pareek TG, Mehta U, Gupta A et al (2018) A survey: virtual reality model for medical diagnosis. Biomed Pharmacol J 11(4):2091–2100

    Article  Google Scholar 

  • Randall D, Metherall P, Bardhan KD, Spencer P, Gillott R, de Noronha R, Fenner JW (2015) The oculus rift virtual colonoscopy: introducing a new technology and initial impressions. J Biomed Graph Comput. https://doi.org/10.5430/jbgc.v6n1p34

    Article  Google Scholar 

  • Ribeiro N, Fernandes P, Lopes D, Folgado J, Fernandes P (2009) 3-d solid and finite element modeling of biomechanical structures—a software pipeline. In: 7th EUROMECH solid mechanics conference

  • Robinett W, Holloway R (1992) Implementation of flying, scaling and grabbing in virtual worlds. In: Symposium on interactive 3d graphics. ACM Press, pp 189–192. https://doi.org/10.1145/147156.147201

  • Schuchardt P, Bowman DA (2007) The benefits of immersion for spatial understanding of complex underground cave systems. In: Proceedings of the 2007 ACM symposium on virtual reality software and technology, VRST ’07, pp 121–124. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/1315184.1315205

  • Shanmugan S, Leblanc F, Senagore AJ, Ellis CN, Stein SL, Khan S, Delaney CP, Champagne BJ (2014) Virtual reality simulator training for laparoscopic colectomy: What metrics have construct validity? Dis Colon Rectum 57(2):210–214

    Article  Google Scholar 

  • Smith K, Clark K, Bennett W, Nolan T, Kirby J, Wolfsberger M, Moulton J, Vendt B, Freymann J (2015) Data from CT_COLONOGRAPHY. http://doi.org/10.7937/K9/TCIA.2015.NWTESAY1. Accessed 23 April 2017

  • Sousa M, Mendes D, Paulo S, Matela N, Jorge J, Lopes DS (2017) VRRRRoom: virtual reality for radiologists in the reading room. In: Proceedings of the 2017 CHI conference on human factors in computing systems. ACM, pp 4057–4062. https://doi.org/10.1145/3025453.3025566

  • Tagliasacchi A, Alhashim I, Olson M, Zhang H (2012) Mean curvature skeletons. Comput Graph Forum 31(5):1735–1744. https://doi.org/10.1111/j.1467-8659.2012.03178.x

    Article  Google Scholar 

  • Venson JE, Berni J, Maia CS, da Silva AM, d’Ornelas M, Maciel A (2016) Medical imaging vr: Can immersive 3d aid in diagnosis? In: Proceedings of the 22nd ACM conference on virtual reality software and technology, pp 349–350

  • Vos FM, van Gelder RE, Serlie IW, Florie J, Nio CY, Glas AS, Post FH, Truyen R, Gerritsen FA, Stoker J (2003) Three-dimensional display modes for ct colonography: conventional 3d virtual colonoscopy versus unfolded cube projection. Radiology 228(3):878–885

    Article  Google Scholar 

  • Vosburgh KG, Golby A, Pieper SD (2013) Surgery, virtual reality, and the future. Stud Health Technol Inform 184:vii

    Google Scholar 

  • Wang H, Chen Y, Li L, Pan H, Gu X, Liang Z (2015) A novel colon wall flattening model for computed tomographic colonography: method and validation. Comput Methods Biomech Biomed Eng Imaging Vis 3(4):213–221

    Article  Google Scholar 

  • Wirth M, Gradl S, Sembdner J, Kuhrt S, Eskofier BM (2018) Evaluation of interaction techniques for a virtual reality reading room in diagnostic radiology. In: The 31st Annual ACM symposium on user interface software and technology. ACM, pp 867–876

  • Yao J, Chowdhury AS, Aman J, Summers RM (2010) Reversible projection technique for colon unfolding. IEEE Trans Biomed Eng 57(12):2861–2869

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by Fundação para a Ciência e a Tecnologia, Portugal, through Grant Numbers UIDB/50021/2020 and SFRH/BD/136212/2018, and by MBIE Grant ILF-VUW1901, New Zealand. We are grateful to Dr. Isabel Nobre and Dr. Sandra Sousa from the Imagiology Service of Hospital Lusíadas Lisboa for their professional assessment and comments. The authors would also like to thank Pedro Borges for his contributions during his MSc thesis work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Joaquim Jorge.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

1.1 Navigation experience questionnaire

figure a

1.2 User experience questionnaire

figure b

1.3 Simulator sickness questionnaire

figure c

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Paulo, S.F., Medeiros, D., Lopes, D. et al. Controlling camera movement in VR colonography. Virtual Reality 26, 1079–1088 (2022). https://doi.org/10.1007/s10055-021-00620-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-021-00620-4

Keywords

Navigation