Intraoperative Fluorescence Imaging and Multimodal Surgical Navigation Using Goggle System

  • Christopher A. Mela
  • Francis A. Papay
  • Yang LiuEmail author
Part of the Methods in Molecular Biology book series (MIMB, volume 1444)


Intraoperative imaging is an invaluable tool in many surgical procedures. We have developed a wearable stereoscopic imaging and display system entitled Integrated Imaging Goggle, which can provide real-time multimodal image guidance. With the Integrated Imaging Goggle, wide field-of-view fluorescence imaging is tracked and registered with intraoperative ultrasound imaging and preoperative tomography-based surgical navigation, to provide integrated multimodal imaging capabilities in real-time. Herein we describe the system instrumentation and the methods of using the Integrated Imaging Goggle to guide surgeries.

Key words

Fluorescence imaging Stereoscopic imaging Multimodal imaging 3D imaging Image-guided surgery Surgical navigation 


  1. 1.
    Kelderhouse LE, Chelvam V, Wayua C, Mahalingam S, Poh S, Kularatne SA, Low PS (2013) Development of tumor-targeted near infrared probes for fluorescence guided surgery. Bioconjug Chem 24:1075–1080CrossRefPubMedGoogle Scholar
  2. 2.
    Liu Y, Zhao Y-M, Akers W, Tang Z-Y, Fan J, Sun H-C, Ye Q-H, Wang L, Achilefu S (2013) First in-human intraoperative imaging of HCC using the fluorescence goggle system and transarterial delivery of near-infrared fluorescence imaging agent: a pilot study. Transl Res 162:324–331CrossRefPubMedPubMedCentralGoogle Scholar
  3. 3.
    Wilke LG, Brown JQ, Bydlon TM, Kennedy SA, Richards LM, Junker MK, Gallagher J, Barry WT, Geradts J, Ramanujam N (2009) Rapid noninvasive optical imaging of tissue composition in breast tumor margins. Am J Surg 198:566–574CrossRefPubMedPubMedCentralGoogle Scholar
  4. 4.
    Keller MD, Majumder SK, Kelley MC, Meszoely IM, Boulos FI, Olivares GM, Mahadevan-Jansen A (2010) Autofluorescence and diffuse reflectance spectroscopy and spectral imaging for breast surgical margin analysis. Lasers Surg Med 42:15–23CrossRefPubMedGoogle Scholar
  5. 5.
    Sasaki K, Matsuda M, Ohkura Y, Kawamura Y, Hashimoto M, Ikeda K, Kumada H, Watanabe G (2013) Minimum resection margin should be based on tumor size in hepatectomy for hepatocellular carcinoma in hepatoviral infection patients. Hepatol Res 43:1295–1303CrossRefPubMedGoogle Scholar
  6. 6.
    Hughes OR, Stone N, Kraft M, Arens C, Birchall MA (2010) Optical and molecular techniques to identify tumor margins within the larynx. Head Neck 32:1544–1553CrossRefPubMedGoogle Scholar
  7. 7.
    Garcia-Allende PB, Glatz J, Koch M, Ntziachristos V (2013) Enriching the interventional vision of cancer with fluorescence and optoacoustic imaging. J Nucl Med 54:664–667CrossRefPubMedGoogle Scholar
  8. 8.
    Ashitate Y (2012) Real-time simultaneous near-infrared fluorescence imaging of bile duct and arterial anatomy. J Surg Res 176:7–13CrossRefPubMedGoogle Scholar
  9. 9.
    Matsui A, Tanaka E, Choi HS, Winer JH, Kianzad V, Gioux S, Laurence RG, Frangioni JV (2010) Real-time intra-operative near-infrared fluorescence identification of the extrahepatic bile ducts using clinically available contrast agents. Surgery 148:87–95CrossRefPubMedPubMedCentralGoogle Scholar
  10. 10.
    Jain V, Phillips BT, Conkling N, Pameijer C (2013) Sentinel lymph node detection using laser-assisted indocyanine green dye lymphangiography in patients with melanoma. Int J Surg Oncol. doi: 10.1155/2013/904214 PubMedPubMedCentralGoogle Scholar
  11. 11.
    Houssami N, Turner R, Morrow M (2013) Preoperative magnetic resonance imaging in breast cancer: meta-analysis of surgical outcomes. Ann Surg 257:249–255CrossRefPubMedGoogle Scholar
  12. 12.
    Aukema TS, Olmos RAV, Wouters MWJM, Klop WMC, Kroon BBR, Vogel WV, Nieweg OE (2010) Utility of preoperative 18F-FDG PET/CT and brain MRI in melanoma patients with palpable lymph node metastases. Ann Surg Oncol 17:2773–2778CrossRefPubMedGoogle Scholar
  13. 13.
    Hinz T, Voth H, Ahmadzadehfar H, Hoeller T, Wenzel J, Bieber T, Schmid-Wendtner M-H (2013) Role of high-resolution ultrasound and PET/CT imaging for preoperative characterization of sentinel lymph nodes in cutaneous melanoma. Ultrasound Med Biol 39:30–36CrossRefPubMedGoogle Scholar
  14. 14.
    Pallone MJ, Poplack SP, Avutu HBR, Paulsen KD, Barth RJ Jr (2014) Supine breast MRI and 3D optical scanning: A novel approach to improve tumor localization for breast conserving surgery. Ann Surg Oncol 21:2203–2208CrossRefPubMedGoogle Scholar
  15. 15.
    Lam DL, Mitsumori LM, Neligan PC, Warren BH, Shuman WP, Dubinsky TJ (2012) Pre-operative CT angiography and three-dimensional image post processing for deep inferior epigastric perforator flap breast reconstructive surgery. Br J Radiol 85:1293–1297CrossRefGoogle Scholar
  16. 16.
    Nam WH, Kang D-G, Lee D, Lee JY, Ra JB (2012) Automatic registration between 3D intra-operative ultrasound and pre-operative CT images of the liver based on robust edge matching. Phys Med Biol 57:69–91CrossRefPubMedGoogle Scholar
  17. 17.
    Kingham TP, Jayaraman S, Clements LW, Scherer MA, Stefansic JD, Jarnagin WR (2013) Evolution of image-guided liver surgery: transition from open to laparoscopic procedures. J Gastrointest Surg 17:1274–1282CrossRefPubMedPubMedCentralGoogle Scholar
  18. 18.
    van der Vorst JR, Schaafsma BE, Verbeek FPR, Keereweer S, Jansen JC, van der Velden L-A, Langeveld APM, Hutteman M, Löwik CWGM, van de Velde CJH, Frangioni JV, Vahrmeijer AL (2013) Near-infrared fluorescence sentinel lymph node mapping of the oral cavity in head and neck cancer patients. Oral Oncol 49:15–19CrossRefPubMedGoogle Scholar
  19. 19.
    Mela CA, Patterson CL, Liu Y (2015) A miniature wearable optical imaging system for guiding surgeries. Proc SPIE 93110Z. doi: 10.1117/12.2076226Google Scholar
  20. 20.
    Mela CA, Patterson C, Thompson WK, Papay F, Liu Y (2015) Stereoscopic Integrated imaging goggles for multimodal intraoperative image guidance. PLoS One. doi: 10.1371/journal.pone.0141956 Google Scholar
  21. 21.
    Liu Y, Njuguna R, Matthews T, Akers WJ, Sudlow GP, Mondal S, Tang R, Gruev V, Achilefu S (2013) Near-infrared fluorescence goggle system with complementary metal-oxide-semiconductor imaging sensor and see-through display. J Biomed Opt. doi: 10.1117/1.JBO.18.10.101303 Google Scholar
  22. 22.
    Liu Y, Bauer AQ, Akers WJ, Sudlow G, Liang K, Shen D, Berezin MY, Culver JP, Achilefu S (2011) Hands-free, wireless goggles for near-infrared fluorescence and real-time image-guided surgery. Surgery 149:689–698CrossRefPubMedPubMedCentralGoogle Scholar
  23. 23.
    Liu Y, Akers WJ, Bauer AQ, Mondal S, Gullicksrud K, Sudlow G, Culver JP, Achilefu S (2013) Intraoperative detection of liver tumors aided by fluorescence goggle system and multimodal imaging. Analyst 138:2254–2257CrossRefPubMedPubMedCentralGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  • Christopher A. Mela
    • 1
  • Francis A. Papay
    • 2
  • Yang Liu
    • 1
    Email author
  1. 1.Department of Biomedical EngineeringThe University of AkronAkronUSA
  2. 2.Department of Dermatology and Plastic Surgery InstituteCleveland ClinicClevelandUSA

Personalised recommendations