Abstract
We propose a novel hands-free method to interactively segment 3D medical volumes. In our scenario, a human user progressively segments an organ by answering a series of questions of the form “Is this voxel inside the object to segment?”. At each iteration, the chosen question is defined as the one halving a set of candidate segmentations given the answered questions. For a quick and efficient exploration, these segmentations are sampled according to the Metropolis-Hastings algorithm. Our sampling technique relies on a combination of relaxed shape prior, learnt probability map and consistency with previous answers. We demonstrate the potential of our strategy on a prostate segmentation MRI dataset. Through the study of failure cases with synthetic examples, we demonstrate the adaptation potential of our method. We also show that our method outperforms two intuitive baselines: one based on random questions, the other one being the thresholded probability map.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Liu, Y., Bauer, A.Q., Akers, W.J., Sudlow, G., Liang, K., Shen, D., Berezin, M.Y., Culver, J.P., Achilefu, S.: Hands-free, wireless goggles for near-infrared fluorescence and real-time image-guided surgery. Surgery 149(5), 689–698 (2011)
Miller, E.C., Wang, C.N., Gunday, E.H., Juergens, A.M.: Stryker Corporation. Eyewear for hands-free communication. U.S. Patent 6,729,726 (2004)
Grady, L.: Random walks for image segmentation. TPAMI 28(11), 1768–1783 (2006)
Rother, C., Kolmogorov, V., Blake, A.: Grabcut: Interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. (TOG) 23(3), 309–314 (2004)
Sadeghi, M., Tien, G., Hamarneh, G., Atkins, M.S.: Hands-free interactive image segmentation using eyegaze. In: SPIE Medical Imaging, pp. 72601H–72601H. International Society for Optics and Photonics, February 2009
Gauriau, R., Lesage, D., Chiaradia, M., Morel, B., Bloch, I.: Interactive multi-organ segmentation based on multiple template deformation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 55–62. Springer, Heidelberg (2015). doi:10.1007/978-3-319-24574-4_7
Tu, Z., Zhu, S.C.: Image segmentation by data-driven Markov chain Monte Carlo. TPAMI 24(5), 657–673 (2002)
Rupprecht, C., Peter, L., Navab, N.: Image segmentation in twenty questions. In: CVPR, pp. 3314–3322 (2015)
Lê, M., Unkelbach, J., Ayache, N., Delingette, H.: GPSSI: gaussian process for sampling segmentations of images. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 38–46. Springer, Heidelberg (2015). doi:10.1007/978-3-319-24574-4_5
Freund, Y., Schapire, R., Abe, N.: A short introduction to boosting. J. Japan. Soc. Artif. Intell. 14, 771–780 (1999)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: CVPR, vol. 1, pp. 511–518 (2001)
Peter, L., Pauly, O., Chatelain, P., Mateus, D., Navab, N.: Scale-adaptive forest training via an efficient feature sampling scheme. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9349, pp. 637–644. Springer, Heidelberg (2015). doi:10.1007/978-3-319-24553-9_78
Niculescu-Mizil, A., Caruana, R.: Obtaining calibrated probabilities from boosting. In: UAI, p. 413, July 2005
Cremers, D., Schmidt, F.R., Barthel, F.: Shape priors in variational image segmentation: convexity, lipschitz continuity and globally optimal solutions. In: CVPR, pp. 1–6 (2008)
Zhao, P., Hoi, S.C., Wang, J., Li, B.: Online transfer learning. Artif. Intell. 216, 76–102 (2014)
Dowling, J., Fripp, J., Freer, P., Ourselin, S., Salvado, O.: Automatic atlas-based segmentation of the prostate: a MICCAI prostate segmentation challenge entry. In: MICCAI Worskshop (2009)
Sørensen, T.: A method of establishing groups of equal amplitude in plant sociology based on similarity of species and its application to analyses of the vegetation on Danish commons. Biol. Skr. 5, 1–34 (1948)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Dubost, F., Peter, L., Rupprecht, C., Becker, B.G., Navab, N. (2016). Hands-Free Segmentation of Medical Volumes via Binary Inputs. In: Carneiro, G., et al. Deep Learning and Data Labeling for Medical Applications. DLMIA LABELS 2016 2016. Lecture Notes in Computer Science(), vol 10008. Springer, Cham. https://doi.org/10.1007/978-3-319-46976-8_27
Download citation
DOI: https://doi.org/10.1007/978-3-319-46976-8_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-46975-1
Online ISBN: 978-3-319-46976-8
eBook Packages: Computer ScienceComputer Science (R0)