Automated anatomical labeling of coronary arteries via bidirectional tree LSTMs

Abstract

Purpose

Automated anatomical labeling facilitates the diagnostic process for physicians and radiologists. One of the challenges in automated anatomical labeling problems is the robustness to handle the large individual variability inherited in human anatomy. A novel deep neural network framework, referred to Tree Labeling Network (TreeLab-Net), is proposed to resolve this problem in this work.

Methods

A multi-layer perceptron (MLP) encoder network and a bidirectional tree-structural long short-term memory (Bi-TreeLSTM) are combined to construct the TreeLab-Net. Vessel spatial locations and directions are selected as features, where a spherical coordinate transform is utilized to normalize vessel spatial variations. The dataset includes 436 coronary computed tomography angiography images. Tenfold cross-validation is performed for evaluation.

Results

The precision–recall curve of TreeLab-Net shows that the four main branch classes, LM, LAD, LCX and RCA, have the area under the curve (AUC) higher than 97%. Other major side branch classes, D, OM, and R-PLB, also have AUC higher than 90%. Comparing with four other methods (i.e., AdaBoost, MLP, Up-to-Down and Down-to-Up TreeLSTM), the TreeLab-Net achieves higher F1 scores with less topological errors.

Conclusion

The TreeLab-Net is able to capture the characteristics of tree structures by learning the spatial and topological dependencies of blood vessels effectively. The results demonstrate that TreeLab-Net is able to yield competitive performances on a large dataset with great variance among subjects.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Notes

  1. 1.

    Please note that some values are extracted from the figures or interpreted from the numbers reported in the paper for direct comparison.

  2. 2.

    TreeLab-Net is a general encoding–forecasting structure so that other deep neural networks can also be adopted as a building block for more complex structures; for example, CNN can be used as the encoder for more complex image input.

References

  1. 1.

    Akinyemi A, Murphy S, Poole I, Roberts C (2009) Automatic labelling of coronary arteries. In: 2009 17th European signal processing conference, pp 1562–1566

  2. 2.

    Cao Q, Broersen A, de Graaf MA, Kitslaar PH, Yang G, Scholte AJ, Lelieveldt B, Reiber J, Dijkstra J (2017) Automatic identification of coronary tree anatomy in coronary computed tomography angiography. Int J Cardiovasc Imaging 33:1809–1819. https://doi.org/10.1007/s10554-017-1169-0

    Article  PubMed  PubMed Central  Google Scholar 

  3. 3.

    Yang G, Broersen A, Petr R, Kitslaar PH, de Graaf MA, Bax JJ, Reiber J, Dijkstra J (2011) Automatic coronary artery tree labeling in coronary computed tomographic angiography datasets. In: 2011 Computing in cardiology, pp 109–112

  4. 4.

    Gülsün MA, Funka-Lea G, Zheng Y, Eckert M (2014) CTA coronary labeling through efficient geodesics between trees using anatomy priors. Med Image Comput Comput Assist Interv 17:521–528

    PubMed  Google Scholar 

  5. 5.

    Bilgel M, Roy S, Carass A, Nyquist PA, Prince JL (2013) Automated anatomical labeling of the cerebral arteries using belief propagation. Proc SPIE Int Soc Opt Eng. https://doi.org/10.1117/12.2006460

    Article  PubMed  PubMed Central  Google Scholar 

  6. 6.

    Bogunovic H, Pozo JM, Cárdenes R, San Román L, Frangi AF (2013) Anatomical labeling of the Circle of Willis using maximum a posteriori probability estimation. IEEE Trans Med Imaging 32:1587–1599. https://doi.org/10.1109/TMI.2013.2259595

    Article  PubMed  Google Scholar 

  7. 7.

    Robben D, Türetken E, Sunaert S, Thijs V, Wilms G, Fua G, Maes F, Suetens P (2016) Simultaneous segmentation and anatomical labeling of the cerebral vasculature. Med Image Anal 32:201–215. https://doi.org/10.1016/j.media.2016.03.006

    Article  PubMed  Google Scholar 

  8. 8.

    Hoang BH, Oda M, Jiang Z, Kitasaka T, Misawa K, Fujiwara M, Mori K (2011) A study on automated anatomical labeling to arteries concerning with colon from 3D abdominal CT images. In: Medical imaging 2011: image processing. International Society for Optics and Photonics, p 79623R

  9. 9.

    Kitasaka T, Kagajo M, Nimura Y, Hayashi Y, Oda M, Misawa K, Mori K (2017) Automatic anatomical labeling of arteries and veins using conditional random fields. Int J Comput Assist Radiol Surg 12:1041–1048. https://doi.org/10.1007/s11548-017-1549-x

    Article  PubMed  Google Scholar 

  10. 10.

    Matsuzaki T, Oda M, Kitasaka T, Hayashi Y, Misawa K, Mori K (2014) Automated anatomical labeling of abdominal arteries and hepatic portal system extracted from abdominal CT volumes. Med Image Anal. https://doi.org/10.1016/j.media.2014.11.002

    Article  PubMed  Google Scholar 

  11. 11.

    Zhang W, Liu J, Yao J, Summers RM (2013) Automatic anatomical labeling of abdominal arteries for small bowel evaluation on 3D CT scans. In: 2013 IEEE 10th international symposium on biomedical imaging, pp 210–213

  12. 12.

    Gu S, Wang Z, Siegfried JM, Wilson D, Bigbee WL, Pu J (2012) Automated lobe-based airway labeling. Int J Biomed Imaging. https://doi.org/10.1155/2012/382806

    Article  PubMed  PubMed Central  Google Scholar 

  13. 13.

    Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9:1735–1780

    CAS  Article  Google Scholar 

  14. 14.

    Tai KS, Socher R, Manning CD (2015) Improved semantic representations from tree-structured long short-term memory networks. arXiv:1503.00075 Cs

  15. 15.

    Graves A, Jaitly N, Mohamed A (2013) Hybrid speech recognition with Deep Bidirectional LSTM. In: 2013 IEEE workshop on automatic speech recognition and understanding, pp 273–278

  16. 16.

    Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Navab N, Hornegger J, Wells W, Frangi A (eds) Medical image computing and computer-assisted intervention (MICCAI 2015). Lecture notes in computer science, vol 9351. Springer, Cham, pp 234–241

    Google Scholar 

  17. 17.

    Raff GL, Abidov A, Achenbach S, Berman DS, Boxt LM, Budoff MJ, Cheng V, Defrance T, Hellinger JC, Karlsberg RP (2009) SCCT guidelines for the interpretation and reporting of coronary computed tomographic angiography. J Cardiovasc Comput Tomogr 3:122–136

    Article  Google Scholar 

Download references

Acknowledgements

The work received supports from Shenzhen Municipal Government under the Grant KQTD2016112809330877.

Author information

Affiliations

Authors

Corresponding authors

Correspondence to Kunlin Cao or Youbing Yin.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

All procedures performed in these studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards. For this type of study, formal consent is not required.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Wu, D., Wang, X., Bai, J. et al. Automated anatomical labeling of coronary arteries via bidirectional tree LSTMs. Int J CARS 14, 271–280 (2019). https://doi.org/10.1007/s11548-018-1884-6

Download citation

Keywords

  • Anatomical labeling
  • Coronary artery
  • Coronary computed tomography angiography
  • Spherical coordinate transform
  • Tree-structural long short-term memory
  • Deep learning