Interaction Techniques for Immersive CT Colonography: A Professional Assessment

  • Daniel Simões LopesEmail author
  • Daniel Medeiros
  • Soraia Figueiredo Paulo
  • Pedro Brasil Borges
  • Vitor Nunes
  • Vasco Mascarenhas
  • Marcos Veiga
  • Joaquim Armando Jorge
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11071)


CT Colonography (CTC) is considered the leading imaging technique for colorectal cancer (CRC) screening. However, conventional CTC systems rely on clumsy 2D input devices and stationary flat displays that make it hard to perceive the colon structure in 3D. To visualize such anatomically complex data, the immersion and freedom of movement afforded by Virtual Reality (VR) systems bear the promise to assist clinicians to improve 3D reading, hence, enabling more expedite diagnoses. To this end, we propose iCOLONIC, a set of interaction techniques using VR to perform CTC reading. iCOLONIC combines immersive Fly-Through navigation with positional tracking, multi-scale representations and mini-maps to guide radiologists and surgeons while navigating throughout the colon. Contrary to stationary VR solutions, iCOLONIC allows users to freely walk within a work space to analyze both local and global 3D features. To assess whether our non-stationary VR approach can assist clinicians in improving 3D colon reading and 3D perception, we conducted a user study with three senior radiologists, three senior general surgeons and one neuroradiology intern. Results from formal evaluation sessions demonstrate iCOLONIC’s usability and feasibility as the proposed interaction techniques were seen to improve spatial awareness and promote a more fluent navigation. Moreover, participants remarked that our approach shows great potential to speed up the screening process.



Authors thank the financial support from the Portuguese Foundation for Science and Technology through grants UID/CEC/50021/2013, IT-MEDEX PTDC/EEI-SII/6038/2014, SFRH/BPD/97449/2013 and also the CAPES Foundation, Ministry of Education of Brazil, through grant 9040/13-7.


  1. 1.
    Ferlay, J., et al.: Cancer incidence and mortality worldwide: sources, methods and major patterns in GLOBOCAN 2012. Int. J. Cancer 136(5), E359–E386 (2015). Scholar
  2. 2.
    de Haan, M.C., van Gelder, R.E., Graser, A., Bipat, S., Stoker, J.: Diagnostic value of CT-colonography as compared to colonoscopy in an asymptomatic screening population: a meta-analysis. Eur. Radiol. 21(8), 1747–1763 (2011). Scholar
  3. 3.
    Hong, L., Kaufman, A., Wei, Y.C., Viswambharan, A., Wax, M., Liang, Z.: 3D virtual colonoscopy. In: Biomedical Visualization, Proceedings, pp. 26–32. IEEE (1995).
  4. 4.
    King, F., et al.: An immersive virtual reality environment for diagnostic imaging. J. Med. Rob. Res. 1(01), 1640003 (2016). Scholar
  5. 5.
    Kuhlen, T.W., Hentschel, B.: Quo vadis CAVE: does immersive visualization still matter? IEEE Comput. Graph. Appl. 34(5), 14–21 (2014). Scholar
  6. 6.
    Mirhosseini, K., Sun, Q., Gurijala, K.C., Laha, B., Kaufman, A.E.: Benefits of 3D immersion for virtual colonoscopy. In: 2014 IEEE VIS International Workshop on 3DVis (3DVis), pp. 75–79, November 2014.
  7. 7.
    Pickhardt, P.J., Hassan, C., Halligan, S., Marmo, R.: Colorectal Cancer: CT colonography and colonoscopy for detection—systematic review and meta-analysis. Radiology 259(2), 393–405 (2011). Scholar
  8. 8.
    Randall, D., et al.: The oculus rift virtual colonoscopy: introducing a new technology and initial impressions. J. Biomed. Graph. Comput. 6(1) (2015).
  9. 9.
    Ribeiro, N., Fernandes, P., Lopes, D., Folgado, J., Fernandes, P.: 3-D solid and finite element modeling of biomechanical structures-a software pipeline. In: 7th EUROMECH Solid Mechanics Conference, September 2009Google Scholar
  10. 10.
    Rumreich, L.L., Johnson, A.J.: From traditional reading rooms to a soft copy environment: radiologist satisfaction survey. J. Digit. Imaging 16(3), 262–269 (2003). Scholar
  11. 11.
    Smith, K., et al.: Data from CT\(\_\)COLONOGRAPHY (2015). Accessed 23 April 2017
  12. 12.
    Sousa, M., Mendes, D., Paulo, S., Matela, N., Jorge, J., Lopes, D.S.: VRRRRoom: virtual reality for radiologists in the reading room. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 4057–4062. ACM (2017).
  13. 13.
    Stoakley, R., Conway, M.J., Pausch, R.: Virtual reality on a WIM: interactive worlds in miniature. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 265–272. ACM Press/Addison-Wesley Publishing Co. (1995).
  14. 14.
    Tagliasacchi, A., Alhashim, I., Olson, M., Zhang, H.: Mean curvature skeletons. Comput. Graph. Forum 31, 1735–1744 (2012). Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Daniel Simões Lopes
    • 1
    • 2
    Email author
  • Daniel Medeiros
    • 1
    • 2
  • Soraia Figueiredo Paulo
    • 1
  • Pedro Brasil Borges
    • 2
  • Vitor Nunes
    • 3
  • Vasco Mascarenhas
    • 4
  • Marcos Veiga
    • 5
  • Joaquim Armando Jorge
    • 1
    • 2
  1. 1.INESC-ID LisboaLisboaPortugal
  2. 2.Instituto Superior TécnicoUniversidade de LisboaLisboaPortugal
  3. 3.Surgery DepartmentHospital Prof. Dr. Fernando Fonseca, E.P.E.AmadoraPortugal
  4. 4.Department of RadiologyHospital da LuzLisboaPortugal
  5. 5.Neuroradiology DepartmentCentro Hospitalar de Lisboa CentralLisboaPortugal

Personalised recommendations