Abstract
Two-photon Ca2+ imaging has become a popular approach for monitoring neuronal population activity with cellular or subcellular resolution in vivo. This approach allows for the recording of hundreds to thousands of neurons per animal and thus leads to a large amount of data to be processed. In particular, manually drawing regions of interest is the most time-consuming aspect of data analysis. However, the development of automated image analysis pipelines, which will be essential for dealing with the likely future deluge of imaging data, remains a major challenge. To address this issue, we developed NeuroSeg, an open-source MATLAB program that can facilitate the accurate and efficient segmentation of neurons in two-photon Ca2+ imaging data. We proposed an approach using a generalized Laplacian of Gaussian filter to detect cells and weighting-based segmentation to separate individual cells from the background. We tested this approach on an in vivo two-photon Ca2+ imaging dataset obtained from mouse cortical neurons with differently sized view fields. We show that this approach exhibits superior performance for cell detection and segmentation compared with the existing published tools. In addition, we integrated the previously reported, activity-based segmentation into our approach and found that this combined method was even more promising. The NeuroSeg software, including source code and graphical user interface, is freely available and will be a useful tool for in vivo brain activity mapping.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Al-Kofahi Y, Lassoued W, Lee W, Roysam B (2010) Improved automatic detection and segmentation of cell nuclei in histopathology images. IEEE Trans Biomed Eng 57(4):841–852. https://doi.org/10.1109/tbme.2009.2035102
Apthorpe N, Riordan A, Aguilar R, Homann J, Gu Y, Tank D, Seung HS (2016) Automatic neuron detection in calcium imaging data using convolutional networks. In: 2016 Advances in neural information processing systems, pp 3270–3278
Chang HH, Zhuang AH, Valentino DJ, Chu WC (2009) Performance measure characterization for evaluating neuroimage segmentation algorithms. Neuroimage 47(1):122–135. https://doi.org/10.1016/j.neuroimage.2009.03.068
Chen X, Leischner U, Rochefort NL, Nelken I, Konnerth A (2011) Functional mapping of single spines in cortical neurons in vivo. Nature 475(7357):501–505. https://doi.org/10.1038/nature10193
Chen TW, Wardill TJ, Sun Y, Pulver SR, Renninger SL, Baohan A, Schreiter ER, Kerr RA, Orger MB, Jayaraman V, Looger LL, Svoboda K, Kim DS (2013a) Ultrasensitive fluorescent proteins for imaging neuronal activity. Nature 499(7458):295–300. https://doi.org/10.1038/nature12354
Chen X, Rochefort NL, Sakmann B, Konnerth A (2013b) Reactivation of the same synapses during spontaneous up states and sensory stimuli. Cell Rep 4(1):31–39. https://doi.org/10.1016/j.celrep.2013.05.042
Cheng J, Rajapakse JC (2009) Segmentation of clustered nuclei with shape markers and marking function. IEEE Trans Biomed Eng 56(3):741–748. https://doi.org/10.1109/tbme.2008.2008635
Denk W, Delaney KR, Gelperin A, Kleinfeld D, Strowbridge BW, Tank DW, Yuste R (1994) Anatomical and functional imaging of neurons using 2-photon laser scanning microscopy. J Neurosci Methods 54(2):151–162
Diego F, Hamprecht FA (2013) Learning multi-level sparse representations. In: 2013 Advances in neural information processing systems, pp 818–826
Freeman J, Vladimirov N, Kawashima T, Mu Y, Sofroniew NJ, Bennett DV, Rosen J, Yang C-T, Looger LL, Ahrens MB (2014) Mapping brain activity at scale with cluster computing. Nat Methods 11(9):941–950. https://doi.org/10.1038/nmeth.3041
Guo ZV, Li N, Huber D, Ophir E, Gutnisky D, Ting Jonathan T, Feng G, Svoboda K (2014) Flow of cortical activity underlying a tactile decision in mice. Neuron 81(1):179–194. https://doi.org/10.1016/j.neuron.2013.10.020
Helmchen F, Denk W (2005) Deep tissue two-photon microscopy. Nat Methods 2(12):932–940. https://doi.org/10.1038/nmeth818
Huber D, Gutnisky DA, Peron S, O’Connor DH, Wiegert JS, Tian L, Oertner TG, Looger LL, Svoboda K (2012) Multiple dynamic representations in the motor cortex during sensorimotor learning. Nature 484(7395):473–478. https://doi.org/10.1038/nature11039
Jia H, Varga Z, Sakmann B, Konnerth A (2014) Linear integration of spine Ca2+ signals in layer 4 cortical neurons in vivo. Proc Natl Acad Sci USA 111(25):9277–9282. https://doi.org/10.1073/pnas.1408525111
Kaifosh P, Zaremba JD, Danielson NB, Losonczy A (2014) SIMA: python software for analysis of dynamic fluorescence imaging data. Front Neuroinform 8:80. https://doi.org/10.3389/fninf.2014.00080
Kong H, Akakin HC, Sarma SE (2013) A generalized Laplacian of Gaussian filter for blob detection and its applications. IEEE Trans Cybern 43(6):1719–1733. https://doi.org/10.1109/tsmcb.2012.2228639
Li C, Xu C, Gui C, Fox MD (2010) Distance regularized level set evolution and its application to image segmentation. IEEE Trans Image Process 19(12):3243–3254. https://doi.org/10.1109/tip.2010.2069690
Margolis DJ, Lütcke H, Schulz K, Haiss F, Weber B, Kügler S, Hasan MT, Helmchen F (2012) Reorganization of cortical population activity imaged throughout long-term sensory deprivation. Nat Neurosci 15(11):1539–1546. https://doi.org/10.1038/nn.3240
Maruyama R, Maeda K, Moroda H, Kato I, Inoue M, Miyakawa H, Aonishi T (2014) Detecting cells using non-negative matrix factorization on calcium imaging data. Neural Netw 55:11–19. https://doi.org/10.1016/j.neunet.2014.03.007
Meijering E (2012) Cell segmentation: 50 years down the road. IEEE Signal Process Mag 29(5):140–145
Muir DR, Kampa BM (2014) FocusStack and StimServer: a new open source MATLAB toolchain for visual stimulation and analysis of two-photon calcium neuronal imaging data. Front Neuroinform 8:85. https://doi.org/10.3389/fninf.2014.00085
Mukamel EA, Nimmerjahn A, Schnitzer MJ (2009) Automated analysis of cellular signals from large-scale calcium imaging data. Neuron 63(6):747–760. https://doi.org/10.1016/j.neuron.2009.08.009
Patel TP, Man K, Firestein BL, Meaney DF (2015) Automated quantification of neuronal networks and single-cell calcium dynamics using calcium imaging. J Neurosci Methods 243:26–38. https://doi.org/10.1016/j.jneumeth.2015.01.020
Peron S, Chen TW, Svoboda K (2015a) Comprehensive imaging of cortical networks. Curr Opin Neurobiol 32:115–123. https://doi.org/10.1016/j.conb.2015.03.016
Peron S, Freeman J, Iyer V, Guo C, Svoboda K (2015b) A cellular resolution map of barrel cortex activity during tactile behavior. Neuron 86(3):783–799. https://doi.org/10.1016/j.neuron.2015.03.027
Peters AJ, Chen SX, Komiyama T (2014) Emergence of reproducible spatiotemporal activity during motor learning. Nature 510(7504):263–267. https://doi.org/10.1038/nature13235
Pnevmatikakis EA, Soudry D, Gao Y, Machado TA, Merel J, Pfau D, Reardon T, Mu Y, Lacefield C, Yang W, Ahrens M, Bruno R, Jessell TM, Peterka DS, Yuste R, Paninski L (2016) Simultaneous denoising, deconvolution, and demixing of calcium imaging data. Neuron 89(2):285–299. https://doi.org/10.1016/j.neuron.2015.11.037
Romo R, de Lafuente V (2013) Conversion of sensory signals into perceptual decisions. Prog Neurobiol 103:41–75. https://doi.org/10.1016/j.pneurobio.2012.03.007
Sofroniew NJ, Flickinger D, King J, Svoboda K (2016) A large field of view two-photon mesoscope with subcellular resolution for in vivo imaging. Elife 5:e14472. https://doi.org/10.7554/eLife.14472
Stegmaier J, Otte JC, Kobitski A, Bartschat A, Garcia A, Nienhaus GU, Strahle U, Mikut R (2014) Fast segmentation of stained nuclei in terabyte-scale, time resolved 3D microscopy image stacks. PLoS One 9(2):e90036. https://doi.org/10.1371/journal.pone.0090036
Stosiek C, Garaschuk O, Holthoff K, Konnerth A (2003) In vivo two-photon calcium imaging of neuronal networks. Proc Natl Acad Sci USA 100(12):7319–7324. https://doi.org/10.1073/pnas.1232232100
Svoboda K, Yasuda R (2006) Principles of two-photon excitation microscopy and its applications to neuroscience. Neuron 50(6):823–839. https://doi.org/10.1016/j.neuron.2006.05.019
Tomek J, Novak O, Syka J (2013) Two-photon processor and SeNeCa: a freely available software package to process data from two-photon calcium imaging at speeds down to several milliseconds per frame. J Neurophysiol 110(1):243–256. https://doi.org/10.1152/jn.00087.2013
Valmianski I, Shih AY, Driscoll JD, Matthews DW, Freund Y, Kleinfeld D (2010) Automatic identification of fluorescently labeled brain cells for rapid functional imaging. J Neurophysiol 104(3):1803–1811. https://doi.org/10.1152/jn.00484.2010
Vedaldi A, Lenc K (2015) Matconvnet: convolutional neural networks for matlab. In: 2015 proceedings of the 23rd ACM international conference on multimedia, pp 689–692
Xing F, Xie Y, Yang L (2016) An automatic learning-based framework for robust nucleus segmentation. IEEE Trans Med Imaging 35(2):550–566. https://doi.org/10.1109/TMI.2015.2481436
Xu H, Lu C, Berendt R, Jha N, Mandal M (2016a) Automatic nuclei detection based on generalized Laplacian of Gaussian filters. IEEE J Biomed Health Inform 21(3):826–837. https://doi.org/10.1109/JBHI.2016.2544245
Xu K, Su H, Zhu J, Guan J-S, Zhang B (2016b) Neuron segmentation based on CNN with semi-supervised regularization. In: 2016 proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 20–28
Yang W, Miller J-eun K, Carrillo-Reid L, Pnevmatikakis E, Paninski L, Yuste R, Peterka Darcy S (2016) Simultaneous multi-plane imaging of neural circuits. Neuron 89(2):269–284. https://doi.org/10.1016/j.neuron.2015.12.012
Acknowledgements
This work was supported by Grants from the 1000 Talents Program for Young Scholars, the Natural Science Foundation of China (nos. 81671106, 31400933, 31572350), the National Basic Research Program of China (“973 Program”: 2015CB759500) and the China Postdoctoral Science Foundation (2015M572680). Xiaowei Chen is a junior fellow of the CAS Center for Excellence in Brain Science and Intelligence Technology.
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Conflict of interest
The authors declare that they have no conflicts of interest.
Rights and permissions
About this article
Cite this article
Guan, J., Li, J., Liang, S. et al. NeuroSeg: automated cell detection and segmentation for in vivo two-photon Ca2+ imaging data. Brain Struct Funct 223, 519–533 (2018). https://doi.org/10.1007/s00429-017-1545-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00429-017-1545-5