Abstract
Multi-vertebrae segmentation plays an important role in spine diseases diagnosis and treatment planning. Global spatial dependencies between vertebrae are essential prior information for automatic multi-vertebrae segmentation. However, due to the lack of global information, previous methods have to localize specific vertebrae regions first, then segment and recognize the vertebrae in the region, resulting in a reduction in feature reuse and increase in computation. In this paper, we propose to leverage both global spatial and label information for multi-vertebrae segmentation from arbitrary MR images in one go. Specifically, a spatial graph convolutional network (GCN) is designed to first automatically learn an adjacency matrix and construct a graph on local feature maps, then adopt stacked GCN to capture the global spatial relationships between vertebrae. A label attention network is built to predict the appearance probabilities of all vertebrae using attention mechanism to reduce the ambiguity caused by variant FOV or similar appearances of adjacent vertebrae. The proposed method is trained in an end-to-end manner and evaluated on a challenging dataset of 292 MRI scans with various fields of view, image characteristics and vertebra deformations. The experimental results show that our method achieves high performance (\(89.28\pm 5.21\) of IDR and \(85.37\pm 4.09\%\) of mIoU) from arbitrary input images.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Cai, Y., Osman, S., Sharma, M., Landis, M., Li, S.: Multi-modality vertebra recognition in arbitrary views using 3D deformable hierarchical model. IEEE Trans. Med. Imaging 34(8), 1676–1693 (2015). https://doi.org/10.1109/TMI.2015.2392054
Han, Z., Wei, B., Leung, S., Nachum, I., Laidley, D., Li, S.: Automated pathogenesis-based diagnosis of lumbar neural foraminal stenosis via deep multiscale multitask learning. Neuroinformatics 16(3–4), 325–337 (2018)
Liao, H., Mesfin, A., Luo, J.: Joint vertebrae identification and localization in spinal CT images by combining short-and long-range contextual information. IEEE Trans. Med. Imaging 37(5), 1266–1275 (2018). https://doi.org/10.1109/TMI.2018.2798293
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440. IEEE Press, Boston (2015). https://doi.org/10.1109/CVPR.2015.7298965
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Sekuboyina, A., Valentinitsch, A., Kirschke, J.S., Menze, B.H.: A localisation-segmentation approach for multi-label annotation of lumbar vertebrae using deep nets. arXiv preprint arXiv:1703.04347 (2017)
Janssens, R., Zeng, G., Zheng, G.: Fully automatic segmentation of lumbar vertebrae from CT images using cascaded 3D fully convolutional networks. In: 15th IEEE International Symposium on Biomedical Imaging, pp. 893–897. IEEE Press, Washington (2018). https://doi.org/10.1109/ISBI.2018.8363715
Lessmann, N., van Ginneken, B., Isgum, I.: Iterative convolutional neural networks for automatic vertebra identification and segmentation in CT images. In: Medical Imaging 2018: Image Processing, vol. 10574, p. 1057408. International Society for Optics and Photonics, Huston (2018). https://doi.org/10.1117/12.2292731
Han, Z., Wei, B., Mercado, A., Leung, S., Li, S.: Spine-GAN: semantic segmentation of multiple spinal structures. Med. Image Anal. 50, 23–35 (2018)
Pang, S., Leung, S., Ben Nachum, I., Feng, Q., Li, S.: Direct automated quantitative measurement of spine via cascade amplifier regression network. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11071, pp. 940–948. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00934-2_104
He, X., Zhang, H., Landis, M., Sharma, M., Warrington, J., Li, S.: Unsupervised boundary delineation of spinal neural foramina using a multi-feature and adaptive spectral segmentation. Med. Image Anal. 36, 22–40 (2017)
Zhao, S., Wu, X., Chen, B., Li, S.: Automatic vertebrae recognition from arbitrary spine MRI images by a hierarchical self-calibration detection framework. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11767, pp. 316–325. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32251-9_35
Defferrard, M., Bresson, X., Vandergheynst, P.: Convolutional neural networks on graphs with fast localized spectral filtering. In: Advances in Neural Information Processing Systems, pp. 3844–3852. Curran Associates, Barcelona (2016)
Zhang, M., Cui, Z., Neumann, M., Chen, Y.: An end-to-end deep learning architecture for graph classification. In: 32th Thirty-Second AAAI Conference on Artificial Intelligence, pp. 4438–4445. AAAI Press, New Orleans (2018)
Kazi, A., et al.: Graph convolution based attention model for personalized disease prediction. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11767, pp. 122–130. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32251-9_14
Acknowledgement
This work was supported in part by the National Natural Science Fund of China under Grant 61806098 and 61976118, in part by the State’s Key Project of Research and Development Plan under Grant 2017YFA0104302, 2017YFC0109202 and 2017YFC0107900.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Chang, H., Zhao, S., Zheng, H., Chen, Y., Li, S. (2020). Multi-vertebrae Segmentation from Arbitrary Spine MR Images Under Global View. In: Martel, A.L., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2020. MICCAI 2020. Lecture Notes in Computer Science(), vol 12266. Springer, Cham. https://doi.org/10.1007/978-3-030-59725-2_68
Download citation
DOI: https://doi.org/10.1007/978-3-030-59725-2_68
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-59724-5
Online ISBN: 978-3-030-59725-2
eBook Packages: Computer ScienceComputer Science (R0)
