Abstract
All current fully automated retinal layer segmentation methods fail in some subset of clinical 3D Optical Coherence Tomography (OCT) datasets, especially in the presence of appearance-modifying retinal diseases like Age-related Macular Degeneration (AMD), Diabetic Macular Edema (DME), and others. In the presence of local or regional failures, the only current remedy is to edit the obtained segmentation in a slice-by-slice manner. This is a very tedious and time-demanding process, which prevents the use of quantitative retinal image analysis in clinical setting. In turn, the non-existence of reliable retinal layer segmentation methods substantially limits the use of precision medicine concepts in retinal-disease applications of clinical ophthalmology. We report a new non-trivial extension of our previously-reported LOGISMOS-based simultaneous multi-layer 3D segmentation of retinal OCT images. In this new approach, automated segmentation of up to 9 retinal layers defined by 10 surfaces is followed by visual inspection of the segmentation results and by employment of minimally-interactive correction steps that invariably lead to successful segmentation thus yielding reliable quantification. The novel aspect of this “Just-Enough Interaction” (JEI) approach for retinal OCT relies on a 2-stage coarse-to-fine segmentation strategy during which the operator interacts with the LOGISMOS graph-based segmentation algorithm by suggesting desired but approximate locations of the layer surfaces in 3D rather than performing manual slice-by-slice corrections. As a result, the efficiency of the reliable analysis has been improved dramatically with more than 10-fold speedup compared to the traditional retracing approaches. In an initial testing set of 40 3D OCT datasets from glaucoma, AMD, DME, and normal subjects, clinically accurate segmentation was achieved in all analyzed cases after 5.3 ± 1.4 min/case devoted to JEI modifications. We estimate that reaching the same performance using slice-by-slice editing in the regions of local segmentation failures would require at least 60 min of expert-operator time for the 9 segmented retinal layers. Our JEI-LOGISMOS approach to segmentation of retinal 3D OCT images is now employed in a larger clinical-research study to determine its usability on a larger sample of OCT image data.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Garvin, M.K., Abràmoff, M.D., Kardon, R., Russell, S.R., Wu, X., Sonka, M.: Intraretinal layer segmentation of macular optical coherence tomography images using optimal 3-D graph search. IEEE Trans. Med. Imaging 27, 1495–1505 (2008)
Lee, K., Niemeijer, M., Garvin, M.K., Kwon, Y.H., Sonka, M., Abràmoff, M.D.: Segmentation of the optic disc in 3-D OCT scans of the optic nerve head. IEEE Trans. Med. Imaging 29, 159–168 (2010)
Quellec, G., Lee, K., Dolejsi, M., Garvin, M.K., Abràmoff, M.D., Sonka, M.: Three-dimensional analysis of retinal layer texture: identification of fluid-filled regions in SD-OCT of the macula. IEEE Trans. Med. Imaging 29, 1321–1330 (2010)
Garvin, M.K., Abràmoff, M.D., Wu, X., Russell, S.R., Burns, T.L., Sonka, M.: Automated 3-D intraretinal layer segmentation of macular spectral-domain optical coherence tomography images. IEEE Trans. Med. Imaging 28, 1436–1447 (2009)
Lee, K., Niemeijer, M., Garvin, M.K., Kwon, Y.H., Sonka, M., Abrmoff, M.D.: 3-D segmentation of the rim, cup in spectral-domain optical coherence tomography volumes of the optic nerve head. In: SPIE Medical Imaging, p. 72622D. International Society for Optics and Photonics (2009)
Bogunovic, H., Sonka, M., Kwon, Y.H., Kemp, P., Abramoff, M.D., Wu, X.: Multi-surface and multi-field co-segmentation of 3-D retinal optical coherence tomography. IEEE Trans. Med. Imaging 33(12), 2242–2253 (2014)
Li, K., Wu, X., Chen, D.Z., Sonka, M.: Optimal surface segmentation in volumetric images-a graph-theoretic approach. IEEE Trans. Pattern Anal. 28, 119–134 (2006)
Yin, Y., Zhang, X., Williams, R., Wu, X., Anderson, D.D., Sonka, M.: LOGISMOS – layered optimal graph image segmentation of multiple objects and surfaces: cartilage segmentation in the knee joint. IEEE Trans. Med. Imag. 29(12), 2023–2037 (2010)
Wu, X., Chen, D.Z.: Optimal net surface problem with applications. In: Proceedings of the 29th International Colloquium on Automata, Languages and Programming (ICALP), vol. 2380, pp. 1029–1042. Springer, Heidelberg (2002)
Li, K., Wu, X., Chen, D.Z., Sonka, M.: Optimal surface segmentation in volumetric images - a graph-theoretic approach. IEEE Trans. Pattern Anal. Mach. Intell. 28(1), 119–134 (2006)
Haeker, M., Wu, X., Abramoff, M., Kardon, R., Sonka, M.: Incorporation of regional information in optimal 3-D graph search with application for intraretinal layer segmentation of optical coherence tomography images. In: Information Processing in Medical Imaging, vol. 4584, pp. 607–618. Springer (2007)
Garvin, M.K., Abramoff, M.D., Wu, X., Russell, S.R., Burns, T.L., Sonka, M.: Automated 3-D intraretinal layer segmentation of macular spectral-domain optical coherence tomography images. IEEE Trans. Med. Imaging 28(9), 1436–1447 (2009)
Boykov, Y., Kolmogorov, V.: An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. Pattern Anal. Mach. Intell. 26, 1124–1137 (2004)
Kohli, P., Torr, P.H.: Dynamic graph cuts for efficient inference in markov random fields. IEEE Trans. Pattern Anal. 29(12), 2079–2088 (2007)
Acknowledgements
This work was partially supported by NIH grants R01 EY019112, R01 EY018853, and R01 EB004640.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Lee, K., Zhang, H., Wahle, A., Abràmoff, M.D., Sonka, M. (2018). Multi-layer 3D Simultaneous Retinal OCT Layer Segmentation: Just-Enough Interaction for Routine Clinical Use. In: Tavares, J., Natal Jorge, R. (eds) VipIMAGE 2017. ECCOMAS 2017. Lecture Notes in Computational Vision and Biomechanics, vol 27. Springer, Cham. https://doi.org/10.1007/978-3-319-68195-5_94
Download citation
DOI: https://doi.org/10.1007/978-3-319-68195-5_94
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-68194-8
Online ISBN: 978-3-319-68195-5
eBook Packages: EngineeringEngineering (R0)