Abstract
Background
The chest radiograph is the most common imaging modality to assess childhood pneumonia. It has been used in epidemiological and vaccine efficacy/effectiveness studies on childhood pneumonia.
Objective
To develop computer-aided diagnosis (CAD4Kids) for chest radiography in children and to evaluate its accuracy in identifying World Health Organization (WHO)-defined chest radiograph primary-endpoint pneumonia compared to a consensus interpretation.
Materials and methods
Chest radiographs were independently evaluated by three radiologists based on WHO criteria. Automatic lung field segmentation was followed by manual inspection and correction, training, feature extraction and classification. Radiographs were filtered with Gaussian derivatives on multiple scales, extracting texture features to classify each pixel in the lung region. To obtain an image score, the 95th percentile score of the pixels was used. Training and testing were done in 10-fold cross validation.
Results
The radiologist majority consensus reading of 858 interpretable chest radiographs included 333 (39%) categorised as primary-endpoint pneumonia, 208 (24%) as other infiltrate only and 317 (37%) as no primary-endpoint pneumonia or other infiltrate. Compared to the reference radiologist consensus reading, CAD4Kids had an area under the receiver operator characteristic (ROC) curve of 0.850 (95% confidence interval [CI] 0.823–0.876), with a sensitivity of 76% and specificity of 80% for identifying primary-endpoint pneumonia on chest radiograph. Furthermore, the ROC curve was 0.810 (95% CI 0.772–0.846) for CAD4Kids identifying primary-endpoint pneumonia compared to other infiltrate only.
Conclusion
Further development of the CAD4Kids software and validation in multicentre studies are important for future research on computer-aided diagnosis and artificial intelligence in paediatric radiology.
Similar content being viewed by others
References
Black RE, Cousens S, Johnson HL et al (2010) Global, regional, and national causes of child mortality in 2008: a systematic analysis. Lancet 375:1969–1987
O'Brien KL, Wolfson LJ, Watt JP et al (2009) Burden of disease caused by Streptococcus pneumoniae in children younger than 5 years: global estimates. Lancet 374:893–902
Watt JP, Wolfson LJ, O'Brien KL et al (2009) Burden of disease caused by Haemophilus influenzae type b in children younger than 5 years: global estimates. Lancet 374:903–911
Pitcher RD, Lombard C, Cotton MF et al (2014) Clinical and immunological correlates of chest X-ray abnormalities in HIV-infected South African children with limited access to anti-retroviral therapy. Pediatr Pulmonol 49:581–588
Qin C, Yao D, Shi Y, Song Z (2018) Computer-aided detection in chest radiography based on artificial intelligence: a survey. Biomed Eng Online 17:113
Cherian T, Mulholland EK, Carlin JB et al (2005) Standardized interpretation of paediatric chest radiographs for the diagnosis of pneumonia in epidemiological studies. Bull World Health Organ 83:353–359
Mahomed N, Fancourt N, de Campo J et al (2017) Preliminary report from the World Health Organisation Chest Radiography in Epidemiological Studies project. Pediatr Radiol 47:1399–1404
Mouton A, Pitcher RD, Douglas TS (2010) Computer-aided detection of pulmonary pathology in pediatric chest radiographs. Med Image Comput Comput Assist Interv 13:619–625
Breuninger M, van Ginneken B, Philipsen RH et al (2014) Diagnostic accuracy of computer-aided detection of pulmonary tuberculosis in chest radiographs: a validation study from sub-Saharan Africa. PLoS One 9:e106381
Muyoyeta M, Maduskar P, Moyo M et al (2014) The sensitivity and specificity of using a computer aided diagnosis program for automatically scoring chest X-rays of presumptive TB patients compared with Xpert MTB/RIF in Lusaka Zambia. PLoS One 9:e93757
van Ginneken B, ter Haar Romeny BM, Viergever MA (2001) Computer-aided diagnosis in chest radiography: a survey. IEEE Trans Med Imaging 20:1228–1241
Oliveira LL, Silva SA, Ribeiro LH et al (2008) Computer-aided diagnosis in chest radiography for detection of childhood pneumonia. Int J Med Inform 77:555–564
Pneumonia Etiology Research for Child Health (PERCH) Study Group (2019) Causes of severe pneumonia requiring hospital admission in children without HIV infection from Africa and Asia: the PERCH multi-country case-control study. Lancet 394:757–779
Mahomed N, Sewchuran T, Moodley H, Madhi SA (2016) Chest x-ray findings in children hospitalized with WHO-defined severe, very severe pneumonia in a high HIV prevalence setting in the era of bacterial conjugate vaccines. Paper presented at the 7th International Pediatric Radiology (IPR) Conjoint Meeting & Exhibition, Chicago, Illinois, 15-20 May 2016
Scott JA, Wonodi C, Moisi JC et al (2012) The definition of pneumonia, the assessment of severity, and clinical standardization in the Pneumonia Etiology Research for Child Health study. Clin Infect Dis 54:S109–S116
van Ginneken B, Stegmann MB, Loog M (2006) Segmentation of anatomical structures in chest radiographs using supervised methods: a comparative study on a public database. Med Image Anal 10:19–40
Meyers A, Shah A, Cleveland RH et al (2001) Thymic size on chest radiograph and rapid disease progression in human immunodeficiency virus 1-infected children. Pediatr Infect Dis J 20:1112–1118
Mendelson DS (2001) Imaging of the thymus. Chest Surg Clin N Am 11:269–293
Menashe SJ, Iyer RS, Parisi MT et al (2016) Pediatric chest radiographs: common and less common errors. AJR Am J Roentgenol 207:1–9
Hogeweg L, Sanchez CI, Maduskar P et al (2015) Automatic detection of tuberculosis in chest radiographs using a combination of textural, focal, and shape abnormality analysis. IEEE Trans Med Imaging 34:2429–2442
Loog M, Van Ginneken B (2004) Static posterior probability fusion for signal detection: applications in the detection of interstitial diseases in chest radiographs. In: Proceedings of the 17th International Conference on Pattern Recognition, 26 August 2004, Cambridge, UK, pp 644-647
Elemraid MA, Muller M, Spencer DA et al (2014) Accuracy of the interpretation of chest radiographs for the diagnosis of paediatric pneumonia. PLoS One 9:e106051
Patel AB, Amin A, Sortey SZ et al (2007) Impact of training on observer variation in chest radiographs of children with severe pneumonia. Indian Pediatr 44:675–681
WHO HiB Initiative Radiology Workshop, Hanoi, Vietnam, 11-12 October 2011
Fancourt N, Deloria Knoll M, Baggett HC et al (2017) Chest radiograph findings in childhood pneumonia cases from the multisite PERCH study. Clin Infect Dis 64:S262–S270
Moore MM, Slonimsky E, Long AD et al (2019) Machine learning concepts, concerns and opportunities for a pediatric radiologist. Pediatr Radiol 49:509–516
Rajpurkar P, Irvin J, Zhu K et al (2018) CheXNet: radiologist-level pneumonia detection on chest X-rays with deep learning. https://arxiv.org/abs/1711.05225. Accessed 4 Jun 2019
You D, Hug L, Ejdemyr S et al (2015) Global, regional, and national levels and trends in under-5 mortality between 1990 and 2015, with scenario-based projections to 2030: a systematic analysis by the UN Inter-agency Group for Child Mortality Estimation. Lancet 386:2275–2286
Wang X, Peng Y, Lu L et al (2017) ChestX-ray8: hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. https://arxiv.org/abs/1705.02315. Accessed 4 Jun 2019
van Ginneken B, Katsuragawa S, ter Haar Romeny BM et al (2002) Automatic detection of abnormalities in chest radiographs using local texture analysis. IEEE Trans Med Imaging 21:139–149
Sousa RT, Marques O, Curado GTF et al (2014) Evaluation of classifiers to a childhood pneumonia computer-aided diagnosis system. Proceedings of the IEEE 27th International Symposium on Computer-Based Medical Systems, 477-478. https://doi.org/10.1109/CBMS.2014.98
Acknowledgements
The study received Carnegie PhD Fellowship funding and a South African Medical Research Council Self-Initiated Research Grant. We thank staff at the Respiratory and Meningeal Pathogens Research Unit involved in enrolling study patients: Azwifarwi Mudau, Debra Katisi, Audrey Kubheka, Magare Lelaka, Tsekabe Makgoba, Matshediso Moilwa, Malebo Motiane, Sibonsile Moya, Thondani Netshishivhe, Minah Nkuna, Mmabatho Selela, Ndulela Titi, Nonhlanhla Tsholetsane, Lerato Mapetla and Gudani Singo.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
None
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
ESM 1
(DOCX 19 kb)
Rights and permissions
About this article
Cite this article
Mahomed, N., van Ginneken, B., Philipsen, R.H.H.M. et al. Computer-aided diagnosis for World Health Organization-defined chest radiograph primary-endpoint pneumonia in children. Pediatr Radiol 50, 482–491 (2020). https://doi.org/10.1007/s00247-019-04593-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00247-019-04593-0