Accurate and Consistent Hippocampus Segmentation Through Convolutional LSTM and View Ensemble

  • Yani Chen
  • Bibo Shi
  • Zhewei Wang
  • Tao Sun
  • Charles D. Smith
  • Jundong LiuEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10541)


In this work, a novel deep neural network is developed to automatically segment human hippocampi from MR images. To take advantage of the efficiency of 2D convolutional operations, as well the inter-slice dependence within 3D volumes, our model stacks fully convolutional neural networks (CNN) through convolutional long short-term memory (CLSTM) to extract voxel labels. Enhanced slice-wise label consistency is ensured, leading to improved segmentation stability and accuracy. We apply our model on ADNI dataset, and demonstrate that our proposed model outperforms the state-of-the-art solutions.


Hippocampus segmentation Brain MRI CNN LSTM 


  1. 1.
    Branson, S., et al.: Bird species categorization using pose normalized deep convolutional nets. arXiv preprint arXiv:1406.2952 (2014)
  2. 2.
    Chen, J., et al.: Combining fully convolutional and recurrent neural networks for 3d biomedical image segmentation. In: NIPS 2016, pp. 3036–3044 (2016)Google Scholar
  3. 3.
    Chen, Y., et al.: Hippocampus segmentation through multi-view ensemble ConvNets. In: ISBI 2017, pp. 192–196 (2017)Google Scholar
  4. 4.
    Çiçek, Ö., Abdulkadir, A., Lienkamp, S.S., Brox, T., Ronneberger, O.: 3D U-Net: learning dense volumetric segmentation from sparse annotation. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 424–432. Springer, Cham (2016). doi: 10.1007/978-3-319-46723-8_49 CrossRefGoogle Scholar
  5. 5.
    Coupé, P., et al.: Patch-based segmentation using expert priors: application to hippocampus and ventricle segmentation. NeuroImage 54(2), 940–954 (2011)CrossRefGoogle Scholar
  6. 6.
    Hobbs, K.H., et al.: Quad-mesh based radial distance biomarkers for Alzheimer’s disease. In: ISBI 2016, pp. 19–23. IEEE (2016)Google Scholar
  7. 7.
    Long, J., et al.: Fully convolutional networks for semantic segmentation. In: CVPR 2015, pp. 3431–3440 (2015)Google Scholar
  8. 8.
    Morra, J.H., et al.: Comparison of AdaBoost and support vector machines for detecting Alzheimer’s disease through automated hippocampal segmentation. IEEE TMI 29(1), 30 (2010)Google Scholar
  9. 9.
    Poudel, R.P., et al.: Recurrent fully convolutional neural networks for multi-slice MRI cardiac segmentation. arXiv preprint arXiv:1608.03974 (2016)
  10. 10.
    Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). doi: 10.1007/978-3-319-24574-4_28 CrossRefGoogle Scholar
  11. 11.
    Song, Y., Wu, G., Sun, Q., Bahrami, K., Li, C., Shen, D.: Progressive label fusion framework for multi-atlas segmentation by dictionary evolution. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 190–197. Springer, Cham (2015). doi: 10.1007/978-3-319-24574-4_23 CrossRefGoogle Scholar
  12. 12.
    Stollenga, M.F., et al.: Parallel multi-dimensional LSTM, with application to fast biomedical volumetric image segmentation. In: NIPS 2015, pp. 2998–3006 (2015)Google Scholar
  13. 13.
    Tong, T., et al.: Segmentation of MR images via discriminative dictionary learning and sparse coding: application to hippocampus labeling. NeuroImage 76, 11–23 (2013)CrossRefGoogle Scholar
  14. 14.
    Wu, G., et al.: Hierarchical multi-atlas label fusion with multi-scale feature representation and label-specific patch partition. NeuroImage 106, 34–46 (2015)CrossRefGoogle Scholar
  15. 15.
    Xie, Y., Zhang, Z., Sapkota, M., Yang, L.: Spatial clockwork recurrent neural network for muscle perimysium segmentation. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 185–193. Springer, Cham (2016). doi: 10.1007/978-3-319-46723-8_22 CrossRefGoogle Scholar
  16. 16.
    Xingjian, S., et al.: Convolutional LSTM network: a machine learning approach for precipitation nowcasting. In: NIPS 2015, pp. 802–810 (2015)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Yani Chen
    • 1
  • Bibo Shi
    • 2
  • Zhewei Wang
    • 1
  • Tao Sun
    • 1
  • Charles D. Smith
    • 3
  • Jundong Liu
    • 1
    Email author
  1. 1.School of Electrical Engineering and Computer ScienceOhio UniversityAthensUSA
  2. 2.Department of RadiologyDuke UniversityDurhamUSA
  3. 3.Department of NeurologyUniversity of KentuckyLexingtonUSA

Personalised recommendations