Textured Graph-Based Model of the Lungs: Application on Tuberculosis Type Classification and Multi-drug Resistance Detection

  • Yashin Dicente CidEmail author
  • Kayhan Batmanghelich
  • Henning Müller
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11018)


Tuberculosis (TB) remains a leading cause of death worldwide. Two main challenges when assessing computed tomography scans of TB patients are detecting multi-drug resistance and differentiating TB types. In this article we model the lungs as a graph entity where nodes represent anatomical lung regions and edges encode interactions between them. This graph is able to characterize the texture distribution along the lungs, making it suitable for describing patients with different TB types. In 2017, the ImageCLEF benchmark proposed a task based on computed tomography volumes of patients with TB. This task was divided into two subtasks: multi-drug resistance prediction, and TB type classification. The participation in this task showed the strength of our model, leading to best results in the competition for multi-drug resistance detection (AUC = 0.5825) and good results in the TB type classification (Cohen’s Kappa coefficient = 0.1623).


Lung graph model 3D texture analysis Tuberculosis 



This work was partly supported by the Swiss National Science Foundation in the project PH4D (320030–146804).


  1. 1.
    Bento, J., Silva, A.S., Rodrigues, F., Duarte, R.: Diagnostic tools in tuberculosis. Acta Med. Port. 24(1), 145–154 (2011)Google Scholar
  2. 2.
    Jeong, Y.J., Lee, K.S.: Pulmonary tuberculosis: up-to-date imaging and management. Am. J. Roentgenol. 191(3), 834–844 (2008)CrossRefGoogle Scholar
  3. 3.
    Richiardi, J., Achard, S., Bunke, H., Van De Ville, D.: Machine learning with brain graphs: predictive modeling approaches for functional imaging in systems neuroscience. IEEE Sig. Process. Mag. 30(3), 58–70 (2013)CrossRefGoogle Scholar
  4. 4.
    Richiardi, J., Eryilmaz, H., Schwartz, S., Vuilleumier, P., Van De Ville, D.: Decoding brain states from fMRI connectivity graphs. NeuroImage 56(2), 616–626 (2011)CrossRefGoogle Scholar
  5. 5.
    Dicente Cid, Y., et al.: A lung graph-model for pulmonary hypertension and pulmonary embolism detection on DECT images. In: Müller, H., et al. (eds.) MCV/BAMBI -2016. LNCS, vol. 10081, pp. 58–68. Springer, Cham (2017). Scholar
  6. 6.
    Dicente Cid, Y., Kalinovsky, A., Liauchuk, V., Kovalev, V., Müller, H.: Overview of ImageCLEFtuberculosis 2017 - predicting tuberculosis type and drug resistances. In: CLEF 2017 Labs Working Notes, CEUR Workshop Proceedings, Dublin, Ireland., 11–14 September 2017.
  7. 7.
    Müller, H., Clough, P., Deselaers, T., Caputo, B. (eds.): ImageCLEF - Experimental Evaluation in Visual Information Retrieval. The Springer International Series On Information Retrieval, vol. 32. Springer, Heidelberg (2010). Scholar
  8. 8.
    Kalpathy-Cramer, J., de Herrera, A.G.S., Demner-Fushman, D., Antani, S., Bedrick, S., Müller, H.: Evaluating performance of biomedical image retrieval systems: Overview of the medical image retrieval task at ImageCLEF 2004–2014. Comput. Med. Imaging Graph. 39, 55–61 (2015)CrossRefGoogle Scholar
  9. 9.
    Villegas, M., et al.: General overview of ImageCLEF at the CLEF 2015 labs. In: Mothe, J., et al. (eds.) CLEF 2015. LNCS, vol. 9283, pp. 444–461. Springer, Cham (2015)CrossRefGoogle Scholar
  10. 10.
    Ionescu, B., et al.: Overview of ImageCLEF 2017: information extraction from images. In: Jones, G.J.F., et al. (eds.) CLEF 2017. LNCS, vol. 10456, pp. 315–337. Springer, Cham (2017)CrossRefGoogle Scholar
  11. 11.
    Dicente Cid, Y., Jimenez-del-Toro, O., Depeursinge, A., Müller, H.: Efficient and fully automatic segmentation of the lungs in CT volumes. In: Goksel, O., Jimenez-del-Toro, O., Foncubierta-Rodriguez, A., Müller, H. (eds.) Proceedings of the VISCERAL Challenge at ISBI, CEUR Workshop Proceedings, vol. 1390, pp. 31–35, April 2015Google Scholar
  12. 12.
    Depeursinge, A., Zrimec, T., Busayarat, S., Müller, H.: 3D lung image retrieval using localized features. In: Medical Imaging 2011: Computer-Aided Diagnosis, vol. 7963, p. 79632E. SPIE (2011)Google Scholar
  13. 13.
    Zrimec, T., Busayarat, S., Wilson, P.: A 3D model of the human lung. In: Barillot, C., Haynor, D.R., Hellier, P. (eds.) MICCAI 2004. LNCS, vol. 3217, pp. 1074–1075. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  14. 14.
    Liu, K., et al.: Rotation-invariant hog descriptors using fourier analysis in polar and spherical coordinates. Int. J. Comput. Vis. 106(3), 342–364 (2014)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Dicente Cid, Y., Müller, H., Platon, A., Poletti, P.A., Depeursinge, A.: 3-D solid texture classification using locally-oriented wavelet transforms. IEEE Trans. Image Process. 26(4), 1899–1910 (2017)MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Yashin Dicente Cid
    • 1
    • 2
    Email author
  • Kayhan Batmanghelich
    • 3
  • Henning Müller
    • 1
    • 2
  1. 1.University of Applied Sciences Western Switzerland (HES-SO)SierreSwitzerland
  2. 2.University of GenevaGenevaSwitzerland
  3. 3.University of PittsburghPittsburghUSA

Personalised recommendations