Skip to main content
SpringerLink
Log in

Automatic bone segmentation in whole-body CT images

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Purpose

Many diagnostic or treatment planning applications critically depend on the successful localization of bony structures in CT images. Manual or semiautomatic bone segmentation is tedious, however, and often not practical in clinical routine. In this paper, we present a reliable and fully automatic bone segmentation in whole-body CT scans of patients suffering from multiple myeloma.

Methods

We address this problem by using convolutional neural networks with an architecture inspired by the U-Net [17]. In this publication, we compared three training procedures: (1) training from 2D axial slices, (2) a pseudo-3D approach including axial, sagittal and coronal slices and (3) an approach where the network is pre-trained in an unsupervised manner.

Results

We evaluated the method on an in-house dataset of 18 whole-body CT scans consisting of 6800 axial slices, achieving a dice score of 0.95 and an intersection over union (IOU) of 0.91. Furthermore, we evaluated our method on the dataset used by Peréz-Carrasco et al. (Comput Methods Progr Biomed 156:85–95, 2018). The data and the ground truth have been made publicly available. The proposed method outperformed the other methods, obtaining a dice score of 0.92 and an IOU of 0.85.

Conclusion

These promising results could facilitate the evaluation of bone density and the localization of focal lesions in the future, with a potential impact on both disease staging and treatment planning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. https://github.com/4Quant/Bone-Segmenter.

References

  1. Bae E, Yuan J, Tai XC (2011) Global minimization for continuous multiphase partitioning problems using a dual approach. Int J Comput Vis 92(1):112–129

    Article  Google Scholar 

  2. Buie HR, Campbell GM, Klinck RJ, MacNeil JA, Boyd SK (2007) Automatic segmentation of cortical and trabecular compartments based on a dual threshold technique for in vivo micro-ct bone analysis. Bone 41(4):505–515

    Article  PubMed  Google Scholar 

  3. Chang HH, Zhuang AH, Valentino DJ, Chu WC (2009) Performance measure characterization for evaluating neuroimage segmentation algorithms. Neuroimage 47(1):122–135

    Article  PubMed  Google Scholar 

  4. Clarke B (2008) Normal bone anatomy and physiology. Clin J Am Soc Nephrol 3(Supplement 3):S131–S139

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Erhan D, Bengio Y, Courville A, Manzagol PA, Vincent P, Bengio S (2010) Why does unsupervised pre-training help deep learning? J Mach Learn Res 11(Feb):625–660

    Google Scholar 

  6. Hillengass J, Delorme S (2012) Multiples Myelom: Aktuelle Empfehlungen für die Bildgebung. Der Radiologe 52(4):360–365. https://doi.org/10.1007/s00117-011-2257-0

    Article  CAS  PubMed  Google Scholar 

  7. Isensee F, Jaeger P, Full PM, Wolf I, Engelhardt S, Maier-Hein KH (2017) Automatic cardiac disease assessment on cine-mri via time-series segmentation and domain specific features. arXiv preprint arXiv:1707.00587

  8. Isensee F, Kickingereder P, Wick W, Bendszus M, Maier-Hein KH (2017) Brain tumor segmentation and radiomics survival prediction: contribution to the brats 2017 challenge. In: 2017 International MICCAI BraTS challenge

  9. Krčah M, Székely G, Blanc R (2011) Fully automatic and fast segmentation of the femur bone from 3d-ct images with no shape prior. In: 2011 IEEE international symposium on biomedical imaging: from nano to macro, pp 2087–2090

  10. Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, van der Laak JA, van Ginneken B, Sánchez CI (2017) A survey on deep learning in medical image analysis. arXiv preprint arXiv:1702.05747

  11. Maas AL, Hannun AY, Ng AY (2013) Rectifier nonlinearities improve neural network acoustic models. In: Proceedings of the ICML, vol 30, p 3

  12. Malladi R, Sethian JA, Vemuri BC (1995) Shape modeling with front propagation: a level set approach. IEEE Trans Pattern Anal Mach Intell 17(2):158–175

    Article  Google Scholar 

  13. Nolden M, Zelzer S, Seitel A, Wald D, Müller M, Franz AM, Maleike D, Fangerau M, Baumhauer M, Maier-Hein L, Maier-Hein KH, Meinzer HP, Wolf I (2013) The medical imaging interaction toolkit: challenges and advances. Int J Comput Assist Radiol Surg 8(4):607–620. https://doi.org/10.1007/s11548-013-0840-8

    Article  PubMed  Google Scholar 

  14. Pérez-Carrasco JA, Acha B, Suárez-Mejías C, López-Guerra JL, Serrano C (2018) Joint segmentation of bones and muscles using an intensity and histogram-based energy minimization approach. Comput Methods Progr Biomed 156:85–95

    Article  Google Scholar 

  15. Pérez-Carrasco JA, Acha-Piñero B, Serrano C (2015) Segmentation of bone structures in 3d ct images based on continuous max-flow optimization. Med Imaging Image Process. https://doi.org/10.1117/12.2082139

  16. Pinheiro M, Alves J (2015) A new level-set-based protocol for accurate bone segmentation from ct imaging. IEEE Access 3:1894–1906

    Article  Google Scholar 

  17. Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention (MICCAI), pp 234–241

  18. Wasserthal J, Neher PF, Maier-Hein KH (2018) Tractseg—fast and accurate white matter tract segmentation. arXiv preprint arXiv:1805.07103

  19. Wiehman S, Kroon S, De Villiers H (2016) Unsupervised pre-training for fully convolutional neural networks. In: Pattern Recognition Association of South Africa and robotics and mechatronics international conference (PRASA-RobMech). IEEE, pp 1–6

  20. Zhang Y, Matuszewski BJ, Shark LK, Moore CJ (2008) Medical image segmentation usingnew hybrid level-set method. In: Fifth international conference biomedical visualization: information visualization in medical and biomedical informatics. IEEE, pp 71–76

Download references

Acknowledgements

This research was supported by the International Myeloma Foundation.

Author information

Authors and Affiliations

  1. Division of Medical Image Computing, Deutsches Krebsforschungszentrum (DKFZ), Im Neuenheimer Feld 581, Heidelberg, Germany

    André Klein & Klaus H. Maier-Hein

  2. Medical Faculty, University of Heidelberg, Heidelberg, Germany

    André Klein & Jan Warszawski

  3. Department of Medicine, Roswell Park Comprehensive Cancer Center, Buffalo, NY, USA

    Jens Hillengaß

Authors
  1. André Klein
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jan Warszawski
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jens Hillengaß
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Klaus H. Maier-Hein
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to André Klein.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical standard

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Klein, A., Warszawski, J., Hillengaß, J. et al. Automatic bone segmentation in whole-body CT images. Int J CARS 14, 21–29 (2019). https://doi.org/10.1007/s11548-018-1883-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-018-1883-7

Keywords

Search

Navigation