Computer-aided diagnosis for World Health Organization-defined chest radiograph primary-endpoint pneumonia in children

Abstract

Background

The chest radiograph is the most common imaging modality to assess childhood pneumonia. It has been used in epidemiological and vaccine efficacy/effectiveness studies on childhood pneumonia.

Objective

To develop computer-aided diagnosis (CAD4Kids) for chest radiography in children and to evaluate its accuracy in identifying World Health Organization (WHO)-defined chest radiograph primary-endpoint pneumonia compared to a consensus interpretation.

Materials and methods

Chest radiographs were independently evaluated by three radiologists based on WHO criteria. Automatic lung field segmentation was followed by manual inspection and correction, training, feature extraction and classification. Radiographs were filtered with Gaussian derivatives on multiple scales, extracting texture features to classify each pixel in the lung region. To obtain an image score, the 95th percentile score of the pixels was used. Training and testing were done in 10-fold cross validation.

Results

The radiologist majority consensus reading of 858 interpretable chest radiographs included 333 (39%) categorised as primary-endpoint pneumonia, 208 (24%) as other infiltrate only and 317 (37%) as no primary-endpoint pneumonia or other infiltrate. Compared to the reference radiologist consensus reading, CAD4Kids had an area under the receiver operator characteristic (ROC) curve of 0.850 (95% confidence interval [CI] 0.823–0.876), with a sensitivity of 76% and specificity of 80% for identifying primary-endpoint pneumonia on chest radiograph. Furthermore, the ROC curve was 0.810 (95% CI 0.772–0.846) for CAD4Kids identifying primary-endpoint pneumonia compared to other infiltrate only.

Conclusion

Further development of the CAD4Kids software and validation in multicentre studies are important for future research on computer-aided diagnosis and artificial intelligence in paediatric radiology.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

References

  1. 1.

    Black RE, Cousens S, Johnson HL et al (2010) Global, regional, and national causes of child mortality in 2008: a systematic analysis. Lancet 375:1969–1987

    Article  Google Scholar 

  2. 2.

    O'Brien KL, Wolfson LJ, Watt JP et al (2009) Burden of disease caused by Streptococcus pneumoniae in children younger than 5 years: global estimates. Lancet 374:893–902

    Article  Google Scholar 

  3. 3.

    Watt JP, Wolfson LJ, O'Brien KL et al (2009) Burden of disease caused by Haemophilus influenzae type b in children younger than 5 years: global estimates. Lancet 374:903–911

    Article  Google Scholar 

  4. 4.

    Pitcher RD, Lombard C, Cotton MF et al (2014) Clinical and immunological correlates of chest X-ray abnormalities in HIV-infected South African children with limited access to anti-retroviral therapy. Pediatr Pulmonol 49:581–588

    Article  Google Scholar 

  5. 5.

    Qin C, Yao D, Shi Y, Song Z (2018) Computer-aided detection in chest radiography based on artificial intelligence: a survey. Biomed Eng Online 17:113

    Article  Google Scholar 

  6. 6.

    Cherian T, Mulholland EK, Carlin JB et al (2005) Standardized interpretation of paediatric chest radiographs for the diagnosis of pneumonia in epidemiological studies. Bull World Health Organ 83:353–359

    PubMed  PubMed Central  Google Scholar 

  7. 7.

    Mahomed N, Fancourt N, de Campo J et al (2017) Preliminary report from the World Health Organisation Chest Radiography in Epidemiological Studies project. Pediatr Radiol 47:1399–1404

    Article  Google Scholar 

  8. 8.

    Mouton A, Pitcher RD, Douglas TS (2010) Computer-aided detection of pulmonary pathology in pediatric chest radiographs. Med Image Comput Comput Assist Interv 13:619–625

    PubMed  Google Scholar 

  9. 9.

    Breuninger M, van Ginneken B, Philipsen RH et al (2014) Diagnostic accuracy of computer-aided detection of pulmonary tuberculosis in chest radiographs: a validation study from sub-Saharan Africa. PLoS One 9:e106381

    Article  Google Scholar 

  10. 10.

    Muyoyeta M, Maduskar P, Moyo M et al (2014) The sensitivity and specificity of using a computer aided diagnosis program for automatically scoring chest X-rays of presumptive TB patients compared with Xpert MTB/RIF in Lusaka Zambia. PLoS One 9:e93757

    Article  Google Scholar 

  11. 11.

    van Ginneken B, ter Haar Romeny BM, Viergever MA (2001) Computer-aided diagnosis in chest radiography: a survey. IEEE Trans Med Imaging 20:1228–1241

    Article  Google Scholar 

  12. 12.

    Oliveira LL, Silva SA, Ribeiro LH et al (2008) Computer-aided diagnosis in chest radiography for detection of childhood pneumonia. Int J Med Inform 77:555–564

    Article  Google Scholar 

  13. 13.

    Pneumonia Etiology Research for Child Health (PERCH) Study Group (2019) Causes of severe pneumonia requiring hospital admission in children without HIV infection from Africa and Asia: the PERCH multi-country case-control study. Lancet 394:757–779

    Article  Google Scholar 

  14. 14.

    Mahomed N, Sewchuran T, Moodley H, Madhi SA (2016) Chest x-ray findings in children hospitalized with WHO-defined severe, very severe pneumonia in a high HIV prevalence setting in the era of bacterial conjugate vaccines. Paper presented at the 7th International Pediatric Radiology (IPR) Conjoint Meeting & Exhibition, Chicago, Illinois, 15-20 May 2016

  15. 15.

    Scott JA, Wonodi C, Moisi JC et al (2012) The definition of pneumonia, the assessment of severity, and clinical standardization in the Pneumonia Etiology Research for Child Health study. Clin Infect Dis 54:S109–S116

    Article  Google Scholar 

  16. 16.

    van Ginneken B, Stegmann MB, Loog M (2006) Segmentation of anatomical structures in chest radiographs using supervised methods: a comparative study on a public database. Med Image Anal 10:19–40

    Article  Google Scholar 

  17. 17.

    Meyers A, Shah A, Cleveland RH et al (2001) Thymic size on chest radiograph and rapid disease progression in human immunodeficiency virus 1-infected children. Pediatr Infect Dis J 20:1112–1118

    CAS  Article  Google Scholar 

  18. 18.

    Mendelson DS (2001) Imaging of the thymus. Chest Surg Clin N Am 11:269–293

    CAS  PubMed  Google Scholar 

  19. 19.

    Menashe SJ, Iyer RS, Parisi MT et al (2016) Pediatric chest radiographs: common and less common errors. AJR Am J Roentgenol 207:1–9

    Article  Google Scholar 

  20. 20.

    Hogeweg L, Sanchez CI, Maduskar P et al (2015) Automatic detection of tuberculosis in chest radiographs using a combination of textural, focal, and shape abnormality analysis. IEEE Trans Med Imaging 34:2429–2442

    Article  Google Scholar 

  21. 21.

    Loog M, Van Ginneken B (2004) Static posterior probability fusion for signal detection: applications in the detection of interstitial diseases in chest radiographs. In: Proceedings of the 17th International Conference on Pattern Recognition, 26 August 2004, Cambridge, UK, pp 644-647

  22. 22.

    Elemraid MA, Muller M, Spencer DA et al (2014) Accuracy of the interpretation of chest radiographs for the diagnosis of paediatric pneumonia. PLoS One 9:e106051

    Article  Google Scholar 

  23. 23.

    Patel AB, Amin A, Sortey SZ et al (2007) Impact of training on observer variation in chest radiographs of children with severe pneumonia. Indian Pediatr 44:675–681

    PubMed  Google Scholar 

  24. 24.

    WHO HiB Initiative Radiology Workshop, Hanoi, Vietnam, 11-12 October 2011

  25. 25.

    Fancourt N, Deloria Knoll M, Baggett HC et al (2017) Chest radiograph findings in childhood pneumonia cases from the multisite PERCH study. Clin Infect Dis 64:S262–S270

    Article  Google Scholar 

  26. 26.

    Moore MM, Slonimsky E, Long AD et al (2019) Machine learning concepts, concerns and opportunities for a pediatric radiologist. Pediatr Radiol 49:509–516

    Article  Google Scholar 

  27. 27.

    Rajpurkar P, Irvin J, Zhu K et al (2018) CheXNet: radiologist-level pneumonia detection on chest X-rays with deep learning. https://arxiv.org/abs/1711.05225. Accessed 4 Jun 2019

  28. 28.

    You D, Hug L, Ejdemyr S et al (2015) Global, regional, and national levels and trends in under-5 mortality between 1990 and 2015, with scenario-based projections to 2030: a systematic analysis by the UN Inter-agency Group for Child Mortality Estimation. Lancet 386:2275–2286

    Article  Google Scholar 

  29. 29.

    Wang X, Peng Y, Lu L et al (2017) ChestX-ray8: hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. https://arxiv.org/abs/1705.02315. Accessed 4 Jun 2019

  30. 30.

    van Ginneken B, Katsuragawa S, ter Haar Romeny BM et al (2002) Automatic detection of abnormalities in chest radiographs using local texture analysis. IEEE Trans Med Imaging 21:139–149

    Article  Google Scholar 

  31. 31.

    Sousa RT, Marques O, Curado GTF et al (2014) Evaluation of classifiers to a childhood pneumonia computer-aided diagnosis system. Proceedings of the IEEE 27th International Symposium on Computer-Based Medical Systems, 477-478. https://doi.org/10.1109/CBMS.2014.98

Download references

Acknowledgements

The study received Carnegie PhD Fellowship funding and a South African Medical Research Council Self-Initiated Research Grant. We thank staff at the Respiratory and Meningeal Pathogens Research Unit involved in enrolling study patients: Azwifarwi Mudau, Debra Katisi, Audrey Kubheka, Magare Lelaka, Tsekabe Makgoba, Matshediso Moilwa, Malebo Motiane, Sibonsile Moya, Thondani Netshishivhe, Minah Nkuna, Mmabatho Selela, Ndulela Titi, Nonhlanhla Tsholetsane, Lerato Mapetla and Gudani Singo.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Nasreen Mahomed.

Ethics declarations

Conflicts of interest

None

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

ESM 1

(DOCX 19 kb)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Mahomed, N., van Ginneken, B., Philipsen, R.H.H.M. et al. Computer-aided diagnosis for World Health Organization-defined chest radiograph primary-endpoint pneumonia in children. Pediatr Radiol 50, 482–491 (2020). https://doi.org/10.1007/s00247-019-04593-0

Download citation

Keywords

  • Accuracy
  • Children
  • Computer-aided diagnosis
  • Pneumonia
  • Primary-endpoint
  • Radiography
  • World Health Organization