Skip to main content
SpringerLink
Log in

Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks

  • Conference paper
  • First Online:
Medical Image Understanding and Analysis (MIUA 2017)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 723))

Included in the following conference series:

Abstract

A major challenge in brain tumor treatment planning and quantitative evaluation is determination of the tumor extent. The noninvasive magnetic resonance imaging (MRI) technique has emerged as a front-line diagnostic tool for brain tumors without ionizing radiation. Manual segmentation of brain tumor extent from 3D MRI volumes is a very time-consuming task and the performance is highly relied on operator’s experience. In this context, a reliable fully automatic segmentation method for the brain tumor segmentation is necessary for an efficient measurement of the tumor extent. In this study, we propose a fully automatic method for brain tumor segmentation, which is developed using U-Net based deep convolutional networks. Our method was evaluated on Multimodal Brain Tumor Image Segmentation (BRATS 2015) datasets, which contain 220 high-grade brain tumor and 54 low-grade tumor cases. Cross-validation has shown that our method can obtain promising segmentation efficiently.

H. Dong, G. Yang and F. Liu—contributed equally to this study.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Schwartzbaum, J.A., Fisher, J.L., Aldape, K.D., Wrensch, M.: Epidemiology and molecular pathology of glioma. Nat. Clin. Pract. Neurol. 2, 494–503 (2006)

    Article  Google Scholar 

  2. Smoll, N.R., Schaller, K., Gautschi, O.P.: Long-term survival of patients with glioblastoma multiforme (GBM). J. Clin. Neurosci. 20, 670–675 (2013)

    Article  Google Scholar 

  3. Ramakrishna, R., Hebb, A., Barber, J., Rostomily, R., Silbergeld, D.: Outcomes in reoperated low-grade gliomas. Neurosurgery 77, 175–184 (2015)

    Article  Google Scholar 

  4. Mazzara, G.P., Velthuizen, R.P., Pearlman, J.L., Greenberg, H.M., Wagner, H.: Brain tumor target volume determination for radiation treatment planning through automated MRI segmentation. Int. J. Radiat. Oncol. Biol. Phys. 59, 300–312 (2004)

    Article  Google Scholar 

  5. Yamahara, T., Numa, Y., Oishi, T., Kawaguchi, T., Seno, T., Asai, A., Kawamoto, K.: Morphological and flow cytometric analysis of cell infiltration in glioblastoma: a comparison of autopsy brain and neuroimaging. Brain Tumor Pathol. 27, 81–87 (2010)

    Article  Google Scholar 

  6. Bauer, S., Wiest, R., Nolte, L.-P., Reyes, M.: A survey of MRI-based medical image analysis for brain tumor studies. Phys. Med. Biol. 58, R97–R129 (2013)

    Article  Google Scholar 

  7. Jones, T.L., Byrnes, T.J., Yang, G., Howe, F.A., Bell, B.A., Barrick, T.R.: Brain tumor classification using the diffusion tensor image segmentation (D-SEG) technique. Neuro. Oncol. 17, 466–476 (2014)

    Google Scholar 

  8. Soltaninejad, M., Yang, G., Lambrou, T., Allinson, N., Jones, T.L., Barrick, T.R., Howe, F.A., Ye, X.: Automated brain tumour detection and segmentation using superpixel-based extremely randomized trees in FLAIR MRI. Int. J. Comput. Assist. Radiol. Surg. 12(2), 183–203 (2016)

    Article  Google Scholar 

  9. Szilágyi, L., Lefkovits, L., Benyó, B.: Automatic brain tumor segmentation in multispectral MRI volumes using a fuzzy c-means cascade algorithm. In: 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), pp. 285–291 (2015)

    Google Scholar 

  10. Mei, P.A., de Carvalho Carneiro, C., Fraser, S.J., Min, L.L., Reis, F.: Analysis of neoplastic lesions in magnetic resonance imaging using self-organizing maps. J. Neurol. Sci. 359, 78–83 (2015)

    Article  Google Scholar 

  11. Juan-Albarracín, J., Fuster-Garcia, E., Manjón, J.V., Robles, M., Aparici, F., Martí-Bonmatí, L., García-Gómez, J.M.: Automated glioblastoma segmentation based on a multiparametric structured unsupervised classification. PLoS ONE 10, e0125143 (2015)

    Article  Google Scholar 

  12. Dhanasekaran, R.: Fuzzy clustering and deformable model for tumor segmentation on MRI brain image: a combined approach. Procedia Eng. 30, 327–333 (2012)

    Article  Google Scholar 

  13. Wu, W., Chen, A.Y.C., Zhao, L., Corso, J.J.: Brain tumor detection and segmentation in a CRF (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features. Int. J. Comput. Assist. Radiol. Surg. 9(2), 241–253 (2013)

    Article  Google Scholar 

  14. Pinto, A., Pereira, S., Correia, H., Oliveira, J., Rasteiro, D.M.L.D., Silva, C.A.: Brain tumour segmentation based on extremely randomized forest with high-level features. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 3037–3040 (2015)

    Google Scholar 

  15. Gotz, M., Weber, C., Blocher, J., Stieltjes, B., Meinzer, H., Maier-Hein, K.: Extremely randomized trees based brain tumor segmentation. In: Proceeding of BRATS Challenge-MICCAI (2014)

    Google Scholar 

  16. Soltaninejad, M., Yang, G., Lambrou, T., Allinson, N., Jones, T.L., Barrick, T.R., Howe, F.A., Ye, X.: Automated brain tumour detection and segmentation using superpixel-based extremely randomized trees in FLAIR MRI. Int. J. Comput. Assist. Radiol. Surg. 12(2), 183–203 (2016)

    Article  Google Scholar 

  17. Jafari, M., Kasaei, S.: Automatic brain tissue detection in MRI images using seeded region growing segmentation and neural network classification. Aust. J. Basic Appl. Sci. 5, 1066–1079 (2011)

    Google Scholar 

  18. Subbanna, N., Precup, D., Arbel, T.: Iterative multilevel MRF leveraging context and voxel information for brain tumour segmentation in MRI. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 400–405 (2014)

    Google Scholar 

  19. Menze, B.H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., Lanczi, L., Gerstner, E., Weber, M.-A., Arbel, T., Avants, B.B., Ayache, N., Buendia, P., Collins, D.L., Cordier, N., Corso, J.J., Criminisi, A., Das, T., Delingette, H., Demiralp, Ç., Durst, C.R., Dojat, M., Doyle, S., Festa, J., Forbes, F., Geremia, E., Glocker, B., Golland, P., Guo, X., Hamamci, A., Iftekharuddin, K.M., Jena, R., John, N.M., Konukoglu, E., Lashkari, D., Mariz, J.A., Meier, R., Pereira, S., Precup, D., Price, S.J., Raviv, T.R., Reza, S.M.S., Ryan, M., Sarikaya, D., Schwartz, L., Shin, H.-C., Shotton, J., Silva, C.A., Sousa, N., Subbanna, N.K., Szekely, G., Taylor, T.J., Thomas, O.M., Tustison, N.J., Unal, G., Vasseur, F., Wintermark, M., Ye, D.H., Zhao, L., Zhao, B., Zikic, D., Prastawa, M., Reyes, M., Van Leemput, K.: The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans. Med. Imaging 34, 1993–2024 (2015)

    Article  Google Scholar 

  20. Hsieh, T.M., Liu, Y.-M., Liao, C.-C., Xiao, F., Chiang, I.-J., Wong, J.-M.: Automatic segmentation of meningioma from non-contrasted brain MRI integrating fuzzy clustering and region growing. BMC Med. Inform. Decis. Mak. 11, 54 (2011)

    Article  Google Scholar 

  21. Pereira, S., Pinto, A., Alves, V., Silva, C.A.: Brain tumor segmentation using convolutional neural networks in MRI images. IEEE Trans. Med. Imaging 35, 1240–1251 (2016)

    Article  Google Scholar 

  22. Havaei, M., Davy, A., Warde-Farley, D., Biard, A., Courville, A., Bengio, Y., Pal, C., Jodoin, P.-M., Larochelle, H.: Brain tumor segmentation with deep neural networks. Med. Image Anal. 35, 18–31 (2016)

    Article  Google Scholar 

  23. Kamnitsas, K., Ledig, C., Newcombe, V.F.J., Simpson, J.P., Kane, A.D., Menon, D.K., Rueckert, D., Glocker, B.: Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med. Image Anal. 36, 61–78 (2017)

    Article  Google Scholar 

  24. Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). doi:10.1007/978-3-319-24574-4_28

    Chapter  Google Scholar 

  25. Milletari, F., Navab, N., Ahmadi, S.-A.: V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation. arXiv, pp. 1–11 (2016)

    Google Scholar 

  26. Simard, P.Y., Steinkraus, D., Platt, J.C.: Best practices for convolutional neural networks applied to visual document analysis. In: Proceedings of Seventh International Conference on Document Analysis and Recognition, pp. 958–963. IEEE Computer Society (2003)

    Google Scholar 

  27. Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3431–3440. IEEE (2015)

    Google Scholar 

  28. Drozdzal, M., Vorontsov, E., Chartrand, G., Kadoury, S., Pal, C.: The importance of skip connections in biomedical image segmentation. In: Carneiro, G., et al. (eds.) LABELS/DLMIA -2016. LNCS, vol. 10008, pp. 179–187. Springer, Cham (2016). doi:10.1007/978-3-319-46976-8_19

    Chapter  Google Scholar 

  29. Kingma, D., Ba, J.: Adam: A Method for Stochastic Optimization (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Data Science Institute, Imperial College London, London, SW7 2AZ, UK

    Hao Dong, Fangde Liu, Yuanhan Mo & Yike Guo

  2. Neurosciences Research Centre, Molecular and Clinical Sciences Institute, St. George’s, University of London, London, SW17 0RE, UK

    Guang Yang

  3. National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, UK

    Guang Yang

Authors
  1. Hao Dong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guang Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fangde Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yuanhan Mo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yike Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yike Guo .

Editor information

Editors and Affiliations

  1. Department of Neuroimaging Sciences, University of Edinburgh, Edinburgh, United Kingdom

    María Valdés Hernández

  2. University of León, León, Spain

    Víctor González-Castro

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Dong, H., Yang, G., Liu, F., Mo, Y., Guo, Y. (2017). Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks. In: Valdés Hernández, M., González-Castro, V. (eds) Medical Image Understanding and Analysis. MIUA 2017. Communications in Computer and Information Science, vol 723. Springer, Cham. https://doi.org/10.1007/978-3-319-60964-5_44

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-60964-5_44

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-60963-8

  • Online ISBN: 978-3-319-60964-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation