Advertisement

Registration of Untracked 2D Laparoscopic Ultrasound Liver Images to CT Using Content-Based Retrieval and Kinematic Priors

  • João RamalhinhoEmail author
  • Henry Tregidgo
  • Moustafa Allam
  • Nikolina Travlou
  • Kurinchi Gurusamy
  • Brian Davidson
  • David Hawkes
  • Dean Barratt
  • Matthew J. Clarkson
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11798)

Abstract

Laparoscopic Ultrasound (LUS) can enhance the safety of laparoscopic liver resection by providing information on the location of major blood vessels and tumours. Since many tumours are not visible in ultrasound, registration to a pre-operative CT has been proposed as a guidance method. In addition to being multi-modal, this registration problem is greatly affected by the differences in field of view between CT and LUS, and thus requires an accurate initialisation. We propose a novel method of registering smaller field of view slices to a larger volume globally using a Content-based retrieval framework. This problem is under-constrained for a single slice registration, resulting in non-unique solutions. Therefore, we introduce kinematic priors in a Bayesian framework in order to jointly register groups of ultrasound images. Our method then produces an estimate of the most likely sequence of CT images to represent the ultrasound acquisition and does not require tracking information nor an accurate initialisation. We demonstrate the feasibility of this approach in multiple LUS acquisitions taken from three sets of clinical data.

Keywords

Laparoscopic Ultrasound Multi-modal Registration Bayesian models 

Notes

Acknowledgements

JR was supported by the EPSRC CDT in Medical Imaging [EP/L016478/1] and EPSRC grant [EP/P034454/1]. MJC, DH and DB were supported by the Welcome/EPSRC [203145Z/16/Z]. BD was supported by the NIHR Biomedical Research Centre at University College London Hospitals NHS Foundations Trust and University College London. The imaging data used for this work was obtained with funding from the Health Innovation Challenge Fund (HICF-T4-317), a parallel funding partnership between the Wellcome Trust and the Department of Health. The views expressed in this publication are those of the author(s) and not necessarily those of the Wellcome Trust or the Department of Health.

Supplementary material

490678_1_En_2_MOESM1_ESM.avi (1.7 mb)
Supplementary material 1 (avi 1692 KB)

References

  1. 1.
    Wakabayashi, G., Cherqui, D., Geller, D.A., Buell, J.F., Kaneko, H., et al.: Recommendations for laparoscopic liver resection: a report from the second international consensus conference held in Morioka. Ann. Surg. 261(4), 619–629 (2015)Google Scholar
  2. 2.
    Wein, W., Brunke, S., Khamene, A., Callstrom, M.R., Navab, N.: Automatic CT-ultrasound registration for diagnostic imaging and image-guided intervention. Med. Image. Anal. 12(5), 577–585 (2008).  https://doi.org/10.1016/j.media.2008.06.006CrossRefGoogle Scholar
  3. 3.
    Penney, G.P., Blackall, J.M., Hamady, M.S., Sabharwal, T., Adam, A., Hawkes, D.J.: Registration of freehand 3D ultrasound and magnetic resonance liver images. Med. Image. Anal. 8(1), 81–91 (2004).  https://doi.org/10.1016/j.media.2003.07.003CrossRefGoogle Scholar
  4. 4.
    Song, Y., Totz, J., Thompson, S., Johnsen, S., Barratt, D., et al.: Locally rigid, vessel-based registration for laparoscopic liver surgery. IJCARS 10, 1–11 (2015).  https://doi.org/10.1007/s11548-015-1236-8CrossRefGoogle Scholar
  5. 5.
    Ramalhinho, J., Robu, M., Thompson, S., Edwards, P., Schneider, C., et al.: Breathing motion compensated registration of laparoscopic liver ultrasound to CT. In: Proceedings of SPIE Medical Imaging (2017).  https://doi.org/10.1117/12.2254488
  6. 6.
    Ramalhinho, J., Robu, M.R., Thompson, S., Gurusamy, K., Davidson, B., et al.: A pre-operative planning framework for global registration of laparoscopic ultrasound to CT images. IJCARS 13(8), 1177–1186 (2018).  https://doi.org/10.1007/s11548-018-1799-2CrossRefGoogle Scholar
  7. 7.
    Petrakis, E.G.M., Faloutsos, A.: Similarity searching in medical image databases. IEEE Trans. Knowl. Data Eng. 9(3), 435–447 (1997).  https://doi.org/10.1109/69.599932CrossRefGoogle Scholar
  8. 8.
    Cifor, A., Risser, L., Heinrich, M.P., Chung, D., Schnabel, J.A.: Rigid registration of untracked freehand 2D ultrasound sweeps to 3D CT of liver tumours. In: Yoshida, H., Warfield, S., Vannier, M.W. (eds.) ABD-MICCAI 2013. LNCS, vol. 8198, pp. 155–164. Springer, Heidelberg (2013).  https://doi.org/10.1007/978-3-642-41083-3_18CrossRefGoogle Scholar
  9. 9.
    Nir, G., Sahebjavaher, R.S., Kozlowski, P., Chang, S.D., Jones, E.C., et al.: Registration of whole-mount histology and volumetric imaging of the prostate using particle filtering. IEEE Trans. Med. Imaging 33(8), 1601–1613 (2014).  https://doi.org/10.1109/TMI.2014.2319231CrossRefGoogle Scholar
  10. 10.
    Smistad, E., Løvstakken, L.: Vessel detection in ultrasound images using deep convolutional neural networks. In: Carneiro, G., et al. (eds.) LABELS/DLMIA -2016. LNCS, vol. 10008, pp. 30–38. Springer, Cham (2016).  https://doi.org/10.1007/978-3-319-46976-8_4CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • João Ramalhinho
    • 1
    • 2
    Email author
  • Henry Tregidgo
    • 1
    • 2
  • Moustafa Allam
    • 3
  • Nikolina Travlou
    • 3
  • Kurinchi Gurusamy
    • 3
  • Brian Davidson
    • 3
  • David Hawkes
    • 1
    • 2
  • Dean Barratt
    • 1
    • 2
  • Matthew J. Clarkson
    • 1
    • 2
  1. 1.Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
  2. 2.Centre for Medical Image ComputingUniversity College LondonLondonUK
  3. 3.Division of Surgery and Interventional ScienceUniversity College LondonLondonUK

Personalised recommendations