TREK: an integrated system architecture for intraoperative cone-beam CT-guided surgery

International Journal of Computer Assisted Radiology and Surgery volume 7, pages159–173(2012)Cite this article

An Erratum to this article is available

Abstract

Purpose

A system architecture has been developed for integration of intraoperative 3D imaging [viz., mobile C-arm cone-beam CT (CBCT)] with surgical navigation (e.g., trackers, endoscopy, and preoperative image and planning data). The goal of this paper is to describe the architecture and its handling of a broad variety of data sources in modular tool development for streamlined use of CBCT guidance in application-specific surgical scenarios.

Methods

The architecture builds on two proven open-source software packages, namely the cisst package (Johns Hopkins University, Baltimore, MD) and 3D Slicer (Brigham and Women’s Hospital, Boston, MA), and combines data sources common to image-guided procedures with intraoperative 3D imaging. Integration at the software component level is achieved through language bindings to a scripting language (Python) and an object-oriented approach to abstract and simplify the use of devices with varying characteristics. The platform aims to minimize offline data processing and to expose quantitative tools that analyze and communicate factors of geometric precision online. Modular tools are defined to accomplish specific surgical tasks, demonstrated in three clinical scenarios (temporal bone, skull base, and spine surgery) that involve a progressively increased level of complexity in toolset requirements.

Results

The resulting architecture (referred to as “TREK”) hosts a collection of modules developed according to application-specific surgical tasks, emphasizing streamlined integration with intraoperative CBCT. These include multi-modality image display; 3D-3D rigid and deformable registration to bring preoperative image and planning data to the most up-to-date CBCT; 3D-2D registration of planning and image data to real-time fluoroscopy; infrared, electromagnetic, and video-based trackers used individually or in hybrid arrangements; augmented overlay of image and planning data in endoscopic or in-room video; and real-time “virtual fluoroscopy” computed from GPU-accelerated digitally reconstructed radiographs (DRRs). Application in three preclinical scenarios (temporal bone, skull base, and spine surgery) demonstrates the utility of the modular, task-specific approach in progressively complex tasks.

Conclusions

The design and development of a system architecture for image-guided surgery has been reported, demonstrating enhanced utilization of intraoperative CBCT in surgical applications with vastly different requirements. The system integrates C-arm CBCT with a broad variety of data sources in a modular fashion that streamlines the interface to application-specific tools, accommodates distinct workflow scenarios, and accelerates testing and translation of novel toolsets to clinical use. The modular architecture was shown to adapt to and satisfy the requirements of distinct surgical scenarios from a common code-base, leveraging software components arising from over a decade of effort within the imaging and computer-assisted interventions community.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

US$ 39.95

Tax calculation will be finalised during checkout.

References

  1. 1

    Siewerdsen JH, Moseley DJ, Burch S, Bisland SK, Bogaards A, Wilson BC, Jaffray DA (2005) Volume CT with a flat-panel detector on a mobile, isocentric C-arm: pre-clinical investigation in guidance of minimally invasive surgery. Med Phys 32(1): 241–254

    PubMed  Article  CAS  Google Scholar 

  2. 2

    Chan Y, Siewerdsen JH, Rafferty MA, Moseley DJ, Jaffray DA, Irish JC (2008) Cone-beam computed tomography on a mobile C-arm: novel intraoperative imaging technology for guidance of head and neck surgery. J Otolaryngol Head Neck Surg 37(1): 81–90

    PubMed  Google Scholar 

  3. 3

    Hamming NM, Daly MJ, Irish JC, Siewerdsen JH (2009) Automatic image-to-world registration based on X-ray projections in cone-beam CT-guided interventions. Med Phys 36(5): 1800–1812

    PubMed  Article  CAS  Google Scholar 

  4. 4

    Zhang J, Weir V, Fajardo L, Lin J, Hsiung H, Ritenour ER (2009) Dosimetric characterization of a cone-beam O-arm imaging system. J Xray Sci Technol 17(4): 305–317

    PubMed  Google Scholar 

  5. 5

    Lunsford LD, Parrish R, Albright L (1984) Intraoperative imaging with a therapeutic computed tomographic scanner. Neurosurgery 15(4): 559–561

    PubMed  Article  CAS  Google Scholar 

  6. 6

    Jolesz FA (1998) Interventional and intraoperative MRI: a general overview of the field. J Magn Reson Imaging 8(1): 3–7

    PubMed  Article  CAS  Google Scholar 

  7. 7

    Gary K, Ibanez L, Aylward S, Gobbi D, Blake MB, Cleary K (2006) IGSTK: an open source software toolkit for image-guided surgery. Computer 39(4): 46–53

    Article  Google Scholar 

  8. 8

    Deguet A, Kumar R, Taylor R, Kazanzides P (2008) The cisst libraries for computer assisted intervention systems. MIDAS J Syst Archit Comput Assist Interv

  9. 9

    Pieper S, Lorensen B, Schroeder W, Kikinis R (2006) The NA-MIC Kit: ITK, VTK, pipelines, grids and 3D slicer as an open platform for the medical image computing community. In: Proceedings of IEEE International Symposium Biomedical Imaging, 6–9 April 2006. pp 698–701

  10. 10

    Wolf I, Nolden M, Boettger T, Wegner I, Schoebinger M, Hastenteufel M, Heimann T, Meinzer H-P, Vetter M (2005) The MITK approach. Insight Journal—MICCAI Open-Source Workshop

  11. 11

    Rexilius J, Spindler W, Jomier J, Koenig M, Hahn H, Link F, Peitgen H-O (2005) A framework for algorithm evaluation and clinical application prototyping using ITK. Insight Journal—MICCAI Open-Source Workshop

  12. 12

    Schroeder W, Lorenson B (1996) Visualization toolkit: an object-oriented approach to 3-D graphics. Prentice Hall PTR, Englewood Cliffs

    Google Scholar 

  13. 13

    Ibanez L, Schroeder W, Ng L, Cates J (2005) The ITK software guide. MIDAS J Syst Archit Comput Assist Interv

  14. 14

    Tokuda J, Fischer GS, Papademetris X, Yaniv Z, Ibanez L, Cheng P, Liu H, Blevins J, Arata J, Golby AJ, Kapur T, Pieper S, Burdette EC, Fichtinger G, Tempany CM, Hata N (2009) OpenIGTLink: an open network protocol for image-guided therapy environment. Int J Med Robot 5(4): 423–434

    PubMed  Article  Google Scholar 

  15. 15

    Rafferty MA, Siewerdsen JH, Chan Y, Daly MJ, Moseley DJ, Jaffray DA, Irish JC (2006) Intraoperative cone-beam CT for guidance of temporal bone surgery. Otolaryngol Head Neck Surg 134(5): 801–808

    PubMed  Article  Google Scholar 

  16. 16

    Daly MJ, Siewerdsen JH, Moseley DJ, Jaffray DA, Irish JC (2006) Intraoperative cone-beam CT for guidance of head and neck surgery: assessment of dose and image quality using a C-arm prototype. Med Phys 33(10): 3767–3780

    PubMed  Article  CAS  Google Scholar 

  17. 17

    Schafer S, Nithananiathan S, Mirota DJ, Uneri A, Stayman JW, Zbijewski W, Schmidgunst C, Kleinszig G, Khanna AJ, Siewerdsen JH (2011) Mobile C-Arm cone-beam CT for guidance of spine surgery: image quality, radiation dose, and integration with interventional guidance. Med Phys (to appear)

  18. 18

    Ritter D, Orman J, Schmidgunst C, Graumann R (2007) 3D Soft tissue imaging with a mobile C-arm. Comput Med Imaging Graph 31(2): 91–102

    PubMed  Article  Google Scholar 

  19. 19

    Nithiananthan S, Brock KK, Daly MJ, Chan H, Irish JC, Siewerdsen JH (2009) Demons deformable registration for CBCT-guided procedures in the head and neck: convergence and accuracy. Med Phys 36(10): 4755–4764

    PubMed  Article  CAS  Google Scholar 

  20. 20

    Munbodh R, Jaffray DA, Moseley DJ, Chen Z, Knisely JPS, Cathier P, Duncan JS (2006) Automated 2D-3D registration of a radiograph and a cone beam CT using line-segment enhancement. Med Phys 33(5): 1398–1411

    PubMed  Article  Google Scholar 

  21. 21

    Yushkevich PA, Piven J, Hazlett HC, Smith RG, Ho S, Gee JC, Gerig G (2006) User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. NeuroImage 31(3): 1116–1128

    PubMed  Article  Google Scholar 

  22. 22

    Sherouse GW, Novins K, Chaney EL (1990) Computation of digitally reconstructed radiographs for use in radiotherapy treatment design. Int J Radiat Oncol Biol Phys 18(3): 651–658

    PubMed  Article  CAS  Google Scholar 

  23. 23

    Reaungamornrat S, Otake Y, Uneri A, Schafer S, Stayman JW, Zbijewski W, Mirota DJ, Yoo J, Nithiananthan S, Khanna AJ, Taylor RH, Siewerdsen JH (2011) Tracker-on-C: a novel tracker configuration for image-guided therapy using a mobile C-arm. In: Computer Assisted Radiology and Surgery, Berlin, Germany, 22–25 June 2011. CARS (to appear)

  24. 24

    Bradski G, Kaehler A (2008) Learning OpenCV: computer vision with the OpenCV library. O’Reilly Media, Sebastopol

    Google Scholar 

  25. 25

    Oguz I, Gerig G, Barre S, Styner M (2006) KWMeshVisu: a mesh visualization tool for shape analysis. Insight Journal—MICCAI Open-Source Workshop

  26. 26

    Beazley DM (2003) Automated scientific software scripting with SWIG. Futur Gener Comput Syst 19(5): 599–609

    Article  Google Scholar 

  27. 27

    Ousterhout JK (1998) Scripting: higher level programming for the 21st Century. Computer 31(3): 23–30

    Article  Google Scholar 

  28. 28

    Mirota DJ, Uneri A, Schafer S, Nithiananthan S, Reh DD, Gallia GL, Taylor RH, Hager GD, Siewerdsen JH (2011) High-accuracy 3D image-based registration of endoscopic video to C-arm cone-beam CT for image-guided skull base surgery. In: Wong KH, Holmes Iii DR (eds) SPIE medical imaging: visualization, image-guided procedures, and modeling. SPIE, Lake Buena Vista, pp 79640J–79610

  29. 29

    Horn BKP (1987) Closed-form solution of absolute orientation using unit quaternions. J Opt Soc Am A 4(4): 629–642

    Article  Google Scholar 

  30. 30

    Park FC, Martin BJ (1994) Robot sensor calibration: solving AX=XB on the Euclidean group. IEEE Trans Robot Autom 10(5): 717–721

    Article  Google Scholar 

  31. 31

    Daly MJ, Chan H, Prisman E, Vescan A, Nithiananthan S, Qiu J, Weersink R, Irish JC, Siewerdsen JH (2010) Fusion of intraoperative cone-beam CT and endoscopic video for image-guided procedures. In: Wong KH, Miga MI (eds) SPIE medical imaging: visualization, image-guided procedures, and modeling. SPIE, San Diego, pp 762503–762508

    Google Scholar 

  32. 32

    Mirota D, Wang H, Taylor R, Ishii M, Hager G (2009) Toward video-based navigation for endoscopic endonasal skull base surgery. In: Yang G-Z, Hawkes D, Rueckert D, Noble A, Taylor C (eds) Medical Image Computing and Computer Assisted Intervention Lecture notes in computer science, vol 5761. Springer, Berlin, Heidelberg, pp 91–99

    Google Scholar 

  33. 33

    Strobl KH, Hirzinger G (2006) Optimal hand-eye calibration. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 9–15 Oct. 2006, pp 4647–4653

  34. 34

    Siddon RL (1985) Fast calculation of the exact radiological path for a three-dimensional CT array. Med Phys 12(2): 252–255

    PubMed  Article  CAS  Google Scholar 

  35. 35

    Pluim J, Maintz J, Viergever M (2000) Image registration by maximization of combined mutual information and gradient information. In: Delp S, DiGoia A, Jaramaz B (eds) Medical Image Computing and Computer Assisted Intervention Lecture notes in computer science, vol 1935. Springer, Berlin, Heidelberg, pp 103–129

    Google Scholar 

  36. 36

    Hansen N (2006) The CMA evolution strategy: a comparing review. In: Lozano J, Larrañaga P, Inza I, Bengoetxea E (eds) Towards a new evolutionary computation, vol 192. Studies in fuzziness and soft computing. Springer, Berlin, Heidelberg, pp 75–102

    Google Scholar 

  37. 37

    Fitzpatrick JM, West JB, Maurer CR Jr (1998) Predicting error in rigid-body point-based registration. IEEE Trans Med Imaging 17(5): 694–702

    PubMed  Article  CAS  Google Scholar 

  38. 38

    Simpson AL, Ma B, Ellis RE, Stewart AJ, Miga MI (2011) Uncertainty propagation and analysis of image-guided surgery. In: Wong KH, Holmes Iii DR (eds) SPIE medical imaging: visualization, image-guided procedures, and modeling. SPIE, Lake Buena Vista, Florida, USA, pp 79640H–79647

    Google Scholar 

  39. 39

    Hamming NM, Daly MJ, Irish JC, Siewerdsen JH (2008) Effect of fiducial configuration on target registration error in intraoperative cone-beam CT guidance of head and neck surgery. In: Proceedings of the IEEE Engineering in Medicine and Biology Society, 20–25 Aug. 2008, pp 3643–3648

  40. 40

    Higgins WE, Helferty JP, Lu K, Merritt SA, Rai L, Yu K-C (2008) 3D CT-video fusion for image-guided bronchoscopy. Comput Med Imaging Graph 32(3): 159–173

    PubMed  Article  Google Scholar 

  41. 41

    DiGioia AM 3rd, Jaramaz B, Colgan BD (1998) Computer assisted orthopaedic surgery. Image guided and robotic assistive technologies. Clin Orthop Relat Res 354: 8–16

    PubMed  Article  Google Scholar 

Download references

Author information

Affiliations

  1. Department of Computer Science, Johns Hopkins University, Traylor Building, Room #726, 720 Rutland Avenue, Baltimore, MD, 21205-2109, USA

    A. Uneri

  2. Department of Biomedical Engineering, Johns Hopkins University, Traylor Building, Room #726, 720 Rutland Avenue, Baltimore, MD, 21205-2109, USA

    S. Schafer & S. Nithiananthan

  3. Department of Computer Science, Johns Hopkins University, 224 NEB, 3400 N. Charles Street, NE Baltimore, MD, 21218, USA

    D. J. Mirota

  4. Department of Computer Science, Johns Hopkins University, 128 Hackerman Hall, 3400 N. Charles Street, NE Baltimore, MD, 21218, USA

    Y. Otake

  5. Department of Computer Science, Johns Hopkins University, 127 Hackerman Hall, 3400 N. Charles Street, NE Baltimore, MD, 21218, USA

    R. H. Taylor

  6. Department of Computer Science, Johns Hopkins University, Baltimore, MD, USA

    J. H. Siewerdsen

  7. Department of Biomedical Engineering, Johns Hopkins University, Traylor Building, Room #718, 720 Rutland Avenue, Baltimore, MD, 21205-2109, USA

    J. H. Siewerdsen

Authors
  1. A. Uneri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. Schafer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. D. J. Mirota
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. S. Nithiananthan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Y. Otake
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. R. H. Taylor
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. J. H. Siewerdsen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to J. H. Siewerdsen.

Additional information

An erratum to this article can be found at http://dx.doi.org/10.1007/s11548-011-0647-4

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Uneri, A., Schafer, S., Mirota, D.J. et al. TREK: an integrated system architecture for intraoperative cone-beam CT-guided surgery. Int J CARS 7, 159–173 (2012). https://doi.org/10.1007/s11548-011-0636-7

Download citation

Keywords

  • Image-guided surgery
  • Cone-beam CT
  • Intraoperative imaging
  • Surgical navigation
  • System architecture
  • Open-source software