Skip to main content

Context-Aware Refinement Network Incorporating Structural Connectivity Prior for Brain Midline Delineation

Part of the Lecture Notes in Computer Science book series (LNIP,volume 12267)

Abstract

Brain midline delineation can facilitate the clinical evaluation of brain midline shift, which plays an important role in the diagnosis and prognosis of various brain pathology. Nevertheless, there are still great challenges with brain midline delineation, such as the largely deformed midline caused by the mass effect and the possible morphological failure that the predicted midline is not a connected curve. To address these challenges, we propose a context-aware refinement network (CAR-Net) to refine and integrate the feature pyramid representation generated by the UNet. Consequently, the proposed CAR-Net explores more discriminative contextual features and larger receptive field, which is of great importance to predict largely deformed midline. For keeping the structural connectivity of the brain midline, we introduce a novel connectivity regular loss (CRL) to punish the disconnectivity between adjacent coordinates. Moreover, we address the ignored prerequisite of previous regression-based methods that the brain CT image must be in the standard pose. A simple pose rectification network is presented to align the source input image to the standard pose image. Extensive experimental results on the CQ dataset and one inhouse dataset show that the proposed method requires fewer parameters and outperforms three state-of-the-art methods in terms of four evaluation metrics. Code is available at https://github.com/ShawnBIT/Brain-Midline-Detection.

Keywords

  • Brain midline delineation
  • Computer aided diagnosis
  • Context-aware refinement network
  • Connectivity regular loss

This work was done when Shen Wang was an intern at Deepwise AI Lab.

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-59728-3_21
  • Chapter length: 10 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   119.00
Price excludes VAT (USA)
  • ISBN: 978-3-030-59728-3
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   159.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.

Notes

  1. 1.

    http://headctstudy.qure.ai/dataset.

References

  1. Chen, M., et al.: Automatic estimation of midline shift in patients with cerebral glioma based on enhanced voigt model and local symmetry. Australas. Phys. Eng. Sci. Med. 38(4), 627–641 (2015). https://doi.org/10.1007/s13246-015-0372-3

    CrossRef  Google Scholar 

  2. Chen, W., Najarian, K., Ward, K.: Actual midline estimation from brain CT scan using multiple regions shape matching. In: 2010 20th International Conference on Pattern Recognition, pp. 2552–2555. IEEE (2010)

    Google Scholar 

  3. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

    Google Scholar 

  4. Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)

    Google Scholar 

  5. Liao, C.C., Chen, Y.F., Xiao, F.: Brain midline shift measurement and itsautomation: a review of techniques and algorithms. Int. J. Biomed. Imaging 2018, 1–13 (2018)

    Google Scholar 

  6. Liao, C.C., Chiang, I.J., Xiao, F., Wong, J.M.: Tracing the deformed midline on brain CT. Biomed. Eng. Appl. Basis Commun. 18(06), 305–311 (2006)

    CrossRef  Google Scholar 

  7. Liu, R., et al.: Automatic detection and quantification of brain midline shift using anatomical marker model. Comput. Med. Imaging Graph. 38(1), 1–14 (2014)

    MathSciNet  CrossRef  Google Scholar 

  8. Pisov, M., et al.: Incorporating task-specific structural knowledge into cnns for brain midline shift detection. In: Suzuki, K., et al. (eds.) ML-CDS 2019, IMIMIC 2019. LNCS, vol. 11797, pp. 30–38. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-33850-3_4

    CrossRef  Google Scholar 

  9. Ronneberger, O., Fischer, P., Brox, T.: U-net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28

    CrossRef  Google Scholar 

  10. Wang, S., et al.: Segmentation-based method combined with dynamic programming for brain midline delineation. In: 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI), pp. 772–776. IEEE (2020)

    Google Scholar 

  11. Wei, H., et al.: Regression-based line detection network for delineation of largely deformed brain midline. In: Shen, D., et al. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 839–847. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-24574-4_28

    CrossRef  Google Scholar 

  12. Zhang, Z., Zhang, X., Peng, C., Xue, X., Sun, J.: Exfuse: enhancing feature fusion for semantic segmentation. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11214, pp. 273–288. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01249-6_17

    CrossRef  Google Scholar 

Download references

Acknowledgments

This work was supported in part by following grants, MOST-2018AAA0102004, NSFC-61625201, Key Program of Beijing Municipal Natural Science Foundation (7191003), and following institutes, Center on Frontiers of Computing Studies, Adv. Inst. of Info. Tech and Dept. of Computer Science, Peking University.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kongming Liang .

Editor information

Editors and Affiliations

1 Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (pdf 1044 KB)

Rights and permissions

Reprints and Permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Wang, S., Liang, K., Li, Y., Yu, Y., Wang, Y. (2020). Context-Aware Refinement Network Incorporating Structural Connectivity Prior for Brain Midline Delineation. In: , et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2020. MICCAI 2020. Lecture Notes in Computer Science(), vol 12267. Springer, Cham. https://doi.org/10.1007/978-3-030-59728-3_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-59728-3_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-59727-6

  • Online ISBN: 978-3-030-59728-3

  • eBook Packages: Computer ScienceComputer Science (R0)