Advertisement

Automated anatomical labeling of coronary arteries via bidirectional tree LSTMs

  • Dan Wu
  • Xin Wang
  • Junjie Bai
  • Xiaoyang Xu
  • Bin Ouyang
  • Yuwei Li
  • Heye Zhang
  • Qi Song
  • Kunlin CaoEmail author
  • Youbing YinEmail author
Original Article

Abstract

Purpose

Automated anatomical labeling facilitates the diagnostic process for physicians and radiologists. One of the challenges in automated anatomical labeling problems is the robustness to handle the large individual variability inherited in human anatomy. A novel deep neural network framework, referred to Tree Labeling Network (TreeLab-Net), is proposed to resolve this problem in this work.

Methods

A multi-layer perceptron (MLP) encoder network and a bidirectional tree-structural long short-term memory (Bi-TreeLSTM) are combined to construct the TreeLab-Net. Vessel spatial locations and directions are selected as features, where a spherical coordinate transform is utilized to normalize vessel spatial variations. The dataset includes 436 coronary computed tomography angiography images. Tenfold cross-validation is performed for evaluation.

Results

The precision–recall curve of TreeLab-Net shows that the four main branch classes, LM, LAD, LCX and RCA, have the area under the curve (AUC) higher than 97%. Other major side branch classes, D, OM, and R-PLB, also have AUC higher than 90%. Comparing with four other methods (i.e., AdaBoost, MLP, Up-to-Down and Down-to-Up TreeLSTM), the TreeLab-Net achieves higher F1 scores with less topological errors.

Conclusion

The TreeLab-Net is able to capture the characteristics of tree structures by learning the spatial and topological dependencies of blood vessels effectively. The results demonstrate that TreeLab-Net is able to yield competitive performances on a large dataset with great variance among subjects.

Keywords

Anatomical labeling Coronary artery Coronary computed tomography angiography Spherical coordinate transform Tree-structural long short-term memory Deep learning 

Notes

Acknowledgements

The work received supports from Shenzhen Municipal Government under the Grant KQTD2016112809330877.

Compliance with ethical standards

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

All procedures performed in these studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards. For this type of study, formal consent is not required.

References

  1. 1.
    Akinyemi A, Murphy S, Poole I, Roberts C (2009) Automatic labelling of coronary arteries. In: 2009 17th European signal processing conference, pp 1562–1566Google Scholar
  2. 2.
    Cao Q, Broersen A, de Graaf MA, Kitslaar PH, Yang G, Scholte AJ, Lelieveldt B, Reiber J, Dijkstra J (2017) Automatic identification of coronary tree anatomy in coronary computed tomography angiography. Int J Cardiovasc Imaging 33:1809–1819.  https://doi.org/10.1007/s10554-017-1169-0 CrossRefGoogle Scholar
  3. 3.
    Yang G, Broersen A, Petr R, Kitslaar PH, de Graaf MA, Bax JJ, Reiber J, Dijkstra J (2011) Automatic coronary artery tree labeling in coronary computed tomographic angiography datasets. In: 2011 Computing in cardiology, pp 109–112Google Scholar
  4. 4.
    Gülsün MA, Funka-Lea G, Zheng Y, Eckert M (2014) CTA coronary labeling through efficient geodesics between trees using anatomy priors. Med Image Comput Comput Assist Interv 17:521–528Google Scholar
  5. 5.
    Bilgel M, Roy S, Carass A, Nyquist PA, Prince JL (2013) Automated anatomical labeling of the cerebral arteries using belief propagation. Proc SPIE Int Soc Opt Eng.  https://doi.org/10.1117/12.2006460 Google Scholar
  6. 6.
    Bogunovic H, Pozo JM, Cárdenes R, San Román L, Frangi AF (2013) Anatomical labeling of the Circle of Willis using maximum a posteriori probability estimation. IEEE Trans Med Imaging 32:1587–1599.  https://doi.org/10.1109/TMI.2013.2259595 CrossRefGoogle Scholar
  7. 7.
    Robben D, Türetken E, Sunaert S, Thijs V, Wilms G, Fua G, Maes F, Suetens P (2016) Simultaneous segmentation and anatomical labeling of the cerebral vasculature. Med Image Anal 32:201–215.  https://doi.org/10.1016/j.media.2016.03.006 CrossRefGoogle Scholar
  8. 8.
    Hoang BH, Oda M, Jiang Z, Kitasaka T, Misawa K, Fujiwara M, Mori K (2011) A study on automated anatomical labeling to arteries concerning with colon from 3D abdominal CT images. In: Medical imaging 2011: image processing. International Society for Optics and Photonics, p 79623RGoogle Scholar
  9. 9.
    Kitasaka T, Kagajo M, Nimura Y, Hayashi Y, Oda M, Misawa K, Mori K (2017) Automatic anatomical labeling of arteries and veins using conditional random fields. Int J Comput Assist Radiol Surg 12:1041–1048.  https://doi.org/10.1007/s11548-017-1549-x CrossRefGoogle Scholar
  10. 10.
    Matsuzaki T, Oda M, Kitasaka T, Hayashi Y, Misawa K, Mori K (2014) Automated anatomical labeling of abdominal arteries and hepatic portal system extracted from abdominal CT volumes. Med Image Anal.  https://doi.org/10.1016/j.media.2014.11.002 Google Scholar
  11. 11.
    Zhang W, Liu J, Yao J, Summers RM (2013) Automatic anatomical labeling of abdominal arteries for small bowel evaluation on 3D CT scans. In: 2013 IEEE 10th international symposium on biomedical imaging, pp 210–213Google Scholar
  12. 12.
    Gu S, Wang Z, Siegfried JM, Wilson D, Bigbee WL, Pu J (2012) Automated lobe-based airway labeling. Int J Biomed Imaging.  https://doi.org/10.1155/2012/382806 Google Scholar
  13. 13.
    Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9:1735–1780CrossRefGoogle Scholar
  14. 14.
    Tai KS, Socher R, Manning CD (2015) Improved semantic representations from tree-structured long short-term memory networks. arXiv:1503.00075 CsGoogle Scholar
  15. 15.
    Graves A, Jaitly N, Mohamed A (2013) Hybrid speech recognition with Deep Bidirectional LSTM. In: 2013 IEEE workshop on automatic speech recognition and understanding, pp 273–278Google Scholar
  16. 16.
    Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Navab N, Hornegger J, Wells W, Frangi A (eds) Medical image computing and computer-assisted intervention (MICCAI 2015). Lecture notes in computer science, vol 9351. Springer, Cham, pp 234–241Google Scholar
  17. 17.
    Raff GL, Abidov A, Achenbach S, Berman DS, Boxt LM, Budoff MJ, Cheng V, Defrance T, Hellinger JC, Karlsberg RP (2009) SCCT guidelines for the interpretation and reporting of coronary computed tomographic angiography. J Cardiovasc Comput Tomogr 3:122–136CrossRefGoogle Scholar

Copyright information

© CARS 2018

Authors and Affiliations

  • Dan Wu
    • 1
  • Xin Wang
    • 1
  • Junjie Bai
    • 1
  • Xiaoyang Xu
    • 1
  • Bin Ouyang
    • 1
  • Yuwei Li
    • 1
  • Heye Zhang
    • 2
  • Qi Song
    • 1
  • Kunlin Cao
    • 1
    Email author
  • Youbing Yin
    • 1
    Email author
  1. 1.CuraCloud CorporationSeattleUSA
  2. 2.School of Biomedical EngineeringSun Yat-Sen UniversityGuangzhouChina

Personalised recommendations