Abstract
A lightweight convolutional neural network model is presented for automatic brain tumor segmentation from multimodal MRI images. To explore 3D spatial contexts with computational efficiency, we introduce a Complementary Convolution Unit (CCU), which reduces memory overhead but not sacrifices accuracy by replacing 3D convolution with two complementary 2D convolutions. Specifically, 2D convolutions in different orientations are used to capture different in-slice features. Furthermore, we enhance the CCUs with dense connections to speed up network training and facilitate feature reuse. To mitigate interference between brain tissues, the task of multi-label brain tumor segmentation is decomposed into three binary segmentation subtasks. For each subtask, we fuse the segmentations on multi-axes to further improve the segmentation accuracy. Validations and comparisons with recent methods conducted on the BRATS17 validation dataset have demonstrated the effectiveness of proposed model. The experiment results showed that we achieved average Dice scores of 0.890, 0.808 and 0.753 for the whole tumor, tumor core and enhancing tumor core, respectively.
Similar content being viewed by others
References
Chen, X., Hao Liew, J., Xiong, W.: Focus, Segment and erase: an efficient network for multi-label brain tumor segmentation. In: Proceedings of the 15th European Conference on Computer Vision, pp. 654–669. Springer, Munich, Germany (2018)
Li, Y., Shen, L.: Deep learning based multimodal brain tumor diagnosis. In: 3th International MICCAI Brainlesion Workshop, pp. 149–158. Springer, Quebec, Canada (2017)
Wang, G., Li, W., Ourselin, S., et al.: Automatic brain tumor segmentation using cascaded anisotropic convolutional neural networks. In: 3th International MICCAI Brainlesion Workshop, pp. 178–190. Springer, Quebec, Canada (2017)
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the 28th IEEE conference on computer vision and pattern recognition, pp. 3431–3440. IEEE, Boston, Massachusetts (2015)
Chen, L., Bentley, P., Mori, K., et al.: DRINet for medical image segmentation. IEEE Trans. Med. Imag. 37(11), 2453–2462 (2018)
Havaei, M., Davy, A., Warde-Farley, D., et al.: Brain tumor segmentation with deep neural networks. Med. Image Anal. 35, 18–31 (2017)
Kamnitsas, K., Ledig, C., Newcombe, V.F., et al.: Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med. Image Anal. 36, 61–78 (2017)
Chen, F., Ding, Y., Wu, Z., et al.: An improved framework called Du++ applied to brain tumor segmentation. In: 15th International Computer Conference on Wavelet Active Media Technology and Information Processing, pp. 85–88. IEEE, Chengdu, China (2018)
Pereira, S., Alves, V., Silva, C.A.: Adaptive feature recombination and recalibration for semantic segmentation: application to brain tumor segmentation in MRI. In: 21th International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 706–714. Springer, Granada, Canada (2018)
Huang, G., Liu, Z., Weinberger, K.Q., et al.: Densely connected convolutional networks. In: Proceedings of the 30th IEEE conference on computer vision and pattern recognition, pp. 4700–4708. IEEE, Honolulu, Hawaii (2017)
Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedical image segmentation. In: 18th International Conference on Medical image computing and computer-assisted intervention, pp. 234–241. Springer, Munich, Germany (2015)
Litjens, G., Kooi, T., Bejnordi, B.E., et al.: A survey on deep learning in medical image analysis. Med. Image Anal. 42, 60–88 (2017)
Marcinkiewicz, M., Nalepa, J., Lorenzo, P.R., et al.: Segmenting brain tumors from MRI using cascaded multi-modal U-Nets. In: 4th International MICCAI Brainlesion Workshop, pp. 13–24. Springer, Granada, Canada (2018)
Meng, Z., Fan, Z., Zhao, Z., et al.: ENS-Unet: End-to-End noise suppression U-Net for brain tumor segmentation. In: 40th International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 5886–5889. IEEE, Honolulu, Hawaii (2018)
Zhao, X., Wu, Y., Song, G., et al.: A deep learning model integrating FCNNs and CRFs for brain tumor segmentation. Med. Image Anal. 43, 98–111 (2018)
Milletari, F., Navab, N., Ahmadi, S.A.: V-Net: Fully convolutional neural networks for volumetric medical image segmentation. In: 4th International Conference on 3D Vision, pp. 565–571. IEEE, Stanford, CA, (2016)
Isensee, F., Kickingereder, P., Wick, W., et al.: Brain tumor segmentation and radiomics survival prediction: contribution to the BRATS 2017 challenge. In: 4th International MICCAI Brainlesion Workshop, pp. 287–297. Springer, Granada, Canada (2018)
Casamitjana, A., Catà, M., Sánchez, I., et al.: Cascaded V-Net using ROI masks for brain tumor segmentation. In: 3th International MICCAI Brainlesion Workshop, pp. 381–391. Springer, Quebec, Canada (2017)
Zhou, C., Ding, C., Lu, Z., et al.: One-pass multi-task convolutional neural networks for efficient brain tumor segmentation. In: 21th International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 637–645. Springer, Granada, Spain (2018)
Chollet, F.: Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the 30th IEEE conference on computer vision and pattern recognition, pp. 1251–1258. IEEE, Honolulu, Hawaii (2017)
He, K., Zhang, X., Ren, S., et al.: Identity mappings in deep residual networks. In: Proceedings of the 14th European conference on computer vision, pp. 630–645. Springer, Amsterdam, Netherlands (2016)
He, K., Zhang, X., Ren, S., et al.: Delving deep into rectifiers: surpassing human-level performance on imagenet classification. In: Proceedings of the 15th IEEE international conference on computer vision, pp. 1026–1034. IEEE, Santiago, Chile (2015)
Menze, B.H., Jakab, A., Bauer, S., et al.: The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans. Med. Imag. 34(10), 1993–2024 (2015)
Bakas, S., Akbari, H., Sotiras, A., et al.: Advancing the cancer genome atlas glioma MRI collections with expert segmentation labels and radiomic features. Scientific Data. 4, 170117 (2017)
Abadi, M., Barham, p., Chen, J., et al.: TensorFlow: A system for large-scale machine learning. In: 12th Symposium on Operating Systems Design and Implementation, pp. 265–283. USENIS, Savannah, GA (2016)
Gibson, E., Li, W., Sudre, C., et al.: NiftyNet: a deep-learning platform for medical imaging. Computer Methods Programs Biomed. 158, 113–122 (2018)
Li, W., Wang, G., Fidon, L., et al.: On the compactness, efficiency, and representation of 3D convolutional networks: brain parcellation as a pretext task. In: 25th International Conference on Information Processing in Medical Imaging, pp. 348–360. Springer, Appalachian State University, North Carolina (2017)
Kingma, D. P., Ba, J.: Adam: A method for stochastic optimization. (2014)
Kamnitsas, K., Bai, W., Ferrante, E., et al.: Ensembles of multiple models and architectures for robust brain tumour segmentation. In: 21th International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 450–462. Springer, Granada, Spain (2018)
Islam, M., Ren, H.: Class balanced pixelnet for neurological image segmentation. In: Proceedings of the 6th International Conference on Bioinformatics and Computational Biology, pp. 83–87, ACM, Chengdu, China (2018)
Kim, G.: Brain tumor segmentation using deep fully convolutional neural networks. In: 3th International MICCAI Brainlesion Workshop, pp. 344–357. Springer, Quebec, Canada (2017)
Szegedy, C., Vanhoucke, V., Ioffe, S., et al.: Rethinking the inception architecture for computer vision. In: Proceedings of the 29th IEEE conference on computer vision and pattern recognition, pp. 2818–2826. IEEE, Las Vegas, Nevada (2016)
Grivalsky, S., Tamajka, M., Benesova, W.: Segmentation of gliomas in magnetic resonance images using recurrent neural networks. In: 42th International Conference on Telecommunications and Signal Processing, pp. 539–542. IEEE, Budapest, Hungary (2019)
Das, J., Patel, R., Pankajakshan, V.: Brain Tumor Segmentation Using Discriminator Loss. In: 25th National Conference on Communications, pp. 1–6. IEEE, Bangalore, Indian (2019)
Zhao, X., Wu, Y., Song, G., et al.: 3D Brain Tumor Segmentation Through Integrating Multiple 2D FCNNs. In: 3th International MICCAI Brainlesion Workshop, pp. 191–203. Springer, Quebec, Canada (2017)
Çiçek, Ö., Abdulkadir, A., Lienkamp, S.S., et al.: 3D U-Net: learning dense volumetric segmentation from sparse annotation. In: 19th International Conference on Medical image computing and computer-assisted intervention, pp. 424–432. Springer, Athens, Greece (2016)
Acknowledgements
This work was partially supported by NSFC (11771160) and STPF (2019H0016).
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Conflict of interest
There is not conflicts of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Wang, Y., Peng, J. & Jia, Z. Brain tumor segmentation via C-dense convolutional neural network. Prog Artif Intell 10, 147–156 (2021). https://doi.org/10.1007/s13748-021-00232-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13748-021-00232-8