Journal of Digital Imaging

, Volume 25, Issue 6, pp 792–801

Interactive Visualization and Analysis of Multimodal Datasets for Surgical Applications

  • Can Kirmizibayrak
  • Yeny Yim
  • Mike Wakid
  • James Hahn
Article

DOI: 10.1007/s10278-012-9461-y

Cite this article as:
Kirmizibayrak, C., Yim, Y., Wakid, M. et al. J Digit Imaging (2012) 25: 792. doi:10.1007/s10278-012-9461-y

Abstract

Surgeons use information from multiple sources when making surgical decisions. These include volumetric datasets (such as CT, PET, MRI, and their variants), 2D datasets (such as endoscopic videos), and vector-valued datasets (such as computer simulations). Presenting all the information to the user in an effective manner is a challenging problem. In this paper, we present a visualization approach that displays the information from various sources in a single coherent view. The system allows the user to explore and manipulate volumetric datasets, display analysis of dataset values in local regions, combine 2D and 3D imaging modalities and display results of vector-based computer simulations. Several interaction methods are discussed: in addition to traditional interfaces including mouse and trackers, gesture-based natural interaction methods are shown to control these visualizations with real-time performance. An example of a medical application (medialization laryngoplasty) is presented to demonstrate how the combination of different modalities can be used in a surgical setting with our approach.

Keywords

Volume visualizationHuman–computer interactionVolume renderingImage-guided surgery

Copyright information

© Society for Imaging Informatics in Medicine 2012

Authors and Affiliations

  • Can Kirmizibayrak
    • 1
    • 2
    • 3
  • Yeny Yim
    • 1
    • 2
  • Mike Wakid
    • 1
    • 2
  • James Hahn
    • 1
    • 2
  1. 1.Department of Computer ScienceThe George Washington UniversityWashingtonUSA
  2. 2.Institute for Biomedical EngineeringThe George Washington UniversityWashingtonUSA
  3. 3.Department of Radiation OncologyStanford School of MedicineStanfordUSA