Abstract
Understanding neural connectivity and structures in the brain requires detailed three-dimensional (3D) anatomical models, and such an understanding is essential to the study of the nervous system. However, the reconstruction of 3D models from a large set of dense nanoscale microscopy images is very challenging, due to the imperfections in staining and noise in the imaging process. To overcome this challenge, we present a 3D segmentation approach that allows segmenting densely packed neuronal structures. The proposed algorithm consists of two main parts. First, different from other methods which derive the shape prior in an offline phase, the shape prior of the objects is estimated directly by extracting medial surfaces from the data set. Second, the 3D image segmentation problem is posed as Maximum A Posteriori (MAP) estimation of Markov Random Field (MRF). First, the MAP-MRF formulation minimizes the Gibbs energy function, and then we use graph cuts to obtain the optimal solution to the energy function. The energy function consists of the estimated shape prior, the flux of the image gradients, and the gray-scale intensity. Experiments were conducted on synthetic data and nanoscale image sequences from the Serial Block Face Scanning Electron Microscopy (SBFSEM). The results show that the proposed approach provides a promising solution to EM reconstruction. We expect the reconstructed geometries to help us better analyze and understand the structure of various kinds of neurons.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Helmstaedter, M., Briggman, K.L., Denk, W.: 3D structural imaging of the brain with photons and electrons. Current Opinion in Neurobiology 18, 633–641 (2008)
Briggman, K.L., Denk, W.: Towards neural circuit reconstruction with volume electron microscopy techniques. Current Opinion in Neurobiology 16, 562–570 (2006)
Denk, W., Horstmann, H.: Serial block-face scanning electron microscopy to reconstruct three-dimensional tissue nanostructure. PLoS Biology 2, e329 (2004)
Jain, V., Murray, J.F., Roth, F., Turaga, S., Zhigulin, V.P., Briggman, K.L., Helmstaedter, M., Denk, W., Seung, H.S.: Supervised learning of image restoration with convolutional networks. In: Proc. IEEE Int’l Conf. on Computer Vision, pp. 1–8 (2007)
Andres, B., Köthe, U., Helmstaedter, M., Denk, W., Hamprecht, F.A.: Segmentation of sbfsem volume data of neural tissue by hierarchical classification. In: Rigoll, G. (ed.) DAGM 2008. LNCS, vol. 5096, pp. 142–152. Springer, Heidelberg (2008)
Macke, J.H., Maack, N., Gupta, R., Denk, W., Schölkopf, B., Borst, A.: Contour-propagation algorithms for semi-automated reconstruction of neural processes. J. Neuroscience Methods 167, 349–357 (2008)
Jurrus, E., Hardy, M., Tasdizen, T., Fletcher, P., Koshevoy, P., Chien, C.B., Denk, W., Whitaker, R.: Axon tracking in serial block-face scanning electron microscopy. Medical Image Analysis 13, 180–188 (2009)
Li, S.Z.: Markov random field modeling in image analysis. Springer, New York (2001)
Hammersley, J.M., Clifford, P.: Markov field on finite graphs and lattices (1971)
Kolmogorov, V., Zabih, R.: What energy functions can be minimized via graph cuts? IEEE Trans. Pattern Anal. Mach. Intell. 26, 147–159 (2004)
Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23, 1222–1239 (2001)
Bouix, S., Siddiqi, K., Tannenbaum, A.: Flux driven automatic centerline extraction. Medical Image Analysis 9, 209–221 (2005)
Hassouna, M.S., Farag, A.A.: Variational curve skeletons using gradient vector flow. IEEE Trans. Pattern Anal. Mach. Intell. 31, 2257–2274 (2009)
Gorelick, L., Galun, M., Sharon, E., Basri, R., Brandt, A.: Shape representation and classification using the poisson equation. IEEE Trans. Pattern Anal. Mach. Intell. 28, 1991–2005 (2006)
Vasilevskiy, A., Siddiqi, K.: Flux maximizing geometric flows. IEEE Trans. Pattern Anal. Mach. Intell. 24, 1565–1578 (2002)
Kolmogorov, V., Boykov, Y.: What metrics can be approximated by geo-cuts, or global optimization of length/area and flux. In: Proc. IEEE Int’l Conf. Computer Vision, pp. 564–571 (2005)
Vu, N., Manjunath, B.S.: Graph cut segmentation of neuronal structures from transmission electron micrographs. In: Proc. Int’l Conf. Image Processing, pp. 725–728 (2008)
Boykov, Y., Funka-Lea, G.: Graph cuts and efficient N-D image segmentation. Int’l J. Computer Vision 70, 109–131 (2006)
Dice, L.R.: Measures of the amount of ecologic association between species. Ecology 26, 297–302 (1945)
Cardona, A., Saalfeld, S., Tomancak, P., Hartenstein, V.: TrakEM2: open source software for neuronal reconstruction from large serial section microscopy data. In: Proc. High Resolution Circuits Reconstruction, pp. 20–22 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yang, HF., Choe, Y. (2010). Electron Microscopy Image Segmentation with Graph Cuts Utilizing Estimated Symmetric Three-Dimensional Shape Prior. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2010. Lecture Notes in Computer Science, vol 6454. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17274-8_32
Download citation
DOI: https://doi.org/10.1007/978-3-642-17274-8_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17273-1
Online ISBN: 978-3-642-17274-8
eBook Packages: Computer ScienceComputer Science (R0)