Journal of Digital Imaging

, Volume 25, Issue 6, pp 792–801

Interactive Visualization and Analysis of Multimodal Datasets for Surgical Applications

Authors

    • Department of Computer ScienceThe George Washington University
    • Institute for Biomedical EngineeringThe George Washington University
    • Department of Radiation OncologyStanford School of Medicine
  • Yeny Yim
    • Department of Computer ScienceThe George Washington University
    • Institute for Biomedical EngineeringThe George Washington University
  • Mike Wakid
    • Department of Computer ScienceThe George Washington University
    • Institute for Biomedical EngineeringThe George Washington University
  • James Hahn
    • Department of Computer ScienceThe George Washington University
    • Institute for Biomedical EngineeringThe George Washington University
Article

DOI: 10.1007/s10278-012-9461-y

Cite this article as:
Kirmizibayrak, C., Yim, Y., Wakid, M. et al. J Digit Imaging (2012) 25: 792. doi:10.1007/s10278-012-9461-y

Abstract

Surgeons use information from multiple sources when making surgical decisions. These include volumetric datasets (such as CT, PET, MRI, and their variants), 2D datasets (such as endoscopic videos), and vector-valued datasets (such as computer simulations). Presenting all the information to the user in an effective manner is a challenging problem. In this paper, we present a visualization approach that displays the information from various sources in a single coherent view. The system allows the user to explore and manipulate volumetric datasets, display analysis of dataset values in local regions, combine 2D and 3D imaging modalities and display results of vector-based computer simulations. Several interaction methods are discussed: in addition to traditional interfaces including mouse and trackers, gesture-based natural interaction methods are shown to control these visualizations with real-time performance. An example of a medical application (medialization laryngoplasty) is presented to demonstrate how the combination of different modalities can be used in a surgical setting with our approach.

Keywords

Volume visualizationHuman–computer interactionVolume renderingImage-guided surgery

Copyright information

© Society for Imaging Informatics in Medicine 2012