Abstract
Background
In low- and middle-income countries, chest radiographs are most frequently interpreted by non-radiologist clinicians.
Objective
We examined the reliability of chest radiograph interpretations performed by non-radiologist clinicians in Botswana and conducted an educational intervention aimed at improving chest radiograph interpretation accuracy among non-radiologist clinicians.
Materials and methods
We recruited non-radiologist clinicians at a referral hospital in Gaborone, Botswana, to interpret de-identified chest radiographs for children with clinical pneumonia. We compared their interpretations with those of two board-certified pediatric radiologists in the United States. We evaluated associations between level of medical training and the accuracy of chest radiograph findings between groups, using logistic regression and kappa statistics. We then developed an in-person training intervention led by a pediatric radiologist. We asked participants to interpret 20 radiographs before and immediately after the intervention, and we compared their responses to those of the facilitating radiologist. For both objectives, our primary outcome was the identification of primary endpoint pneumonia, defined by the World Health Organization as presence of endpoint consolidation or endpoint effusion.
Results
Twenty-two clinicians interpreted chest radiographs in the primary objective; there were no significant associations between level of training and correct identification of endpoint pneumonia; concordance between respondents and radiologists was moderate (κ=0.43). After the training intervention, participants improved agreement with the facilitating radiologist for endpoint pneumonia from fair to moderate (κ=0.34 to κ=0.49).
Conclusion
Non-radiologist clinicians in Botswana do not consistently identify key chest radiographic findings of pneumonia. A targeted training intervention might improve non-radiologist clinicians’ ability to interpret chest radiographs.
Similar content being viewed by others
References
Walker CLF, Rudan I, Liu L et al (2013) Global burden of childhood pneumonia and diarrhoea. Lancet 381:1405–1416
Chang AB, Ooi MH, Perera D, Grimwood K (2013) Improving the diagnosis, management, and outcomes of children with pneumonia: where are the gaps? Front Pediatr 1:29
Xavier-Souza G, Vilas-Boas AL, Fontoura M-SH et al (2013) The inter-observer variation of chest radiograph reading in acute lower respiratory tract infection among children. Pediatr Pulmonol 48:464–469
Kelly MS, Smieja M, Luinstra K et al (2015) Association of respiratory viruses with outcomes of severe childhood pneumonia in Botswana. PLoS One 10:e0126593
Scott JAG, Wonodi C, Moïsi JC et al (2012) The definition of pneumonia, the assessment of severity, and clinical standardization in the pneumonia etiology research for child health study. Clin Infect Dis 54:S109–S116
Zar HJ, Andronikou S, Nicol MP (2017) Advances in the diagnosis of pneumonia in children. BMJ 358:j2739
Lynch T, Bialy L, Kellner JD et al (2010) A systematic review on the diagnosis of pediatric bacterial pneumonia: when gold is bronze. PLoS One 5:e11989
Andronikou S, McHugh K, Abdurahman N et al (2011) Paediatric radiology seen from Africa. Part I: providing diagnostic imaging to a young population. Pediatr Radiol 41:811–825
Kelly MS, Crotty EJ, Rattan MS et al (2016) Chest radiographic findings and outcomes of pneumonia among children in Botswana. Pediatr Infect Dis J 35:257–262
Patel A, Mamtani M, Hibberd PL et al (2008) Value of chest radiography in predicting treatment response in children aged 3-59 months with severe pneumonia. Int J Tuberc Lung Dis 12:1320–1326
McClain L, Hall M, Shah SS et al (2014) Admission chest radiographs predict illness severity for children hospitalized with pneumonia. J Hosp Med 9:559–564
Cherian T, Mulholland EK, Carlin JB et al (2005) Standardized interpretation of paediatric chest radiographs for the diagnosis of pneumonia in epidemiological studies. Bull World Health Organ 83:353–359
Zar HJ, Andronikou S (2015) Chest X-rays for screening of paediatric PTB: child selection and standardised radiological criteria are key. Int J Tuberc Lung Dis 19:1411
Ben Shimol S, Dagan R, Givon-Lavi N et al (2012) Evaluation of the World Health Organization criteria for chest radiographs for pneumonia diagnosis in children. Eur J Pediatr 171:369–374
Levinsky Y, Mimouni FB, Fisher D, Ehrlichman M (2013) Chest radiography of acute paediatric lower respiratory infections: experience versus interobserver variation. Acta Paediatr 102:e310–e314
Bada C, Carreazo NY, Chalco JP, Huicho L (2007) Inter-observer agreement in interpreting chest X-rays on children with acute lower respiratory tract infections and concurrent wheezing. Sao Paulo Med J 125:150–154
Gatt ME, Spectre G, Paltiel O et al (2003) Chest radiographs in the emergency department: is the radiologist really necessary? Postgrad Med J 79:214–217
The Electives Network: Princess Marina Hospital (2019) https://www.electives.net/hospital/73/preview. Accessed 16 Apr 2018
World Health Organization (2001) Standardization of interpretation of chest radiographs for the diagnosis of pneumonia in children. WHO, Geneva
Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159
Harris PA, Taylor R, Thielke R et al (2009) Research electronic data capture (REDCap) — a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 42:377–381
Correia MA, Mello MJG, Petribu NC et al (2011) Agreement on radiological diagnosis of acute lower respiratory tract infection in children. J Trop Pediatr 57:204–207
Pauls S, Krüger S, Richter K et al (2007) Interobserver agreement in the assessment of pulmonary infiltrates on chest radiography in community-acquired pneumonia. Rofo 179:1152–1158
Elemraid MA, Muller M, Spencer DA et al (2014) Accuracy of the interpretation of chest radiographs for the diagnosis of paediatric pneumonia. PLoS One 9:e106051
Neuman MI, Lee EY, Bixby S et al (2012) Variability in the interpretation of chest radiographs for the diagnosis of pneumonia in children. J Hosp Med 7:294–298
Seddon JA, Padayachee T, Du Plessis A-M et al (2014) Teaching chest X-ray reading for child tuberculosis suspects. Int J Tuberc Lung Dis 18:763–769
Patel AB, Amin A, Sortey SZ et al (2007) Impact of training on observer variation in chest radiographs of children with severe pneumonia. Indian Pediatr 44:675–681
Semakula-Katende NS, Andronikou S, Lucas S (2016) Digital platform for improving non-radiologists’ and radiologists’ interpretation of chest radiographs for suspected tuberculosis — a method for supporting task-shifting in developing countries. Pediatr Radiol 46:1384–1391
Buijze GA, Guitton TG, van Dijk CN et al (2012) Training improves interobserver reliability for the diagnosis of scaphoid fracture displacement. Clin Orthop Relat Res 470:2029–2034
Shah VP, Tunik MG, Tsung JW (2013) Prospective evaluation of point-of-care ultrasonography for the diagnosis of pneumonia in children and young adults. JAMA Pediatr 167:119
Pereda MA, Chavez MA, Hooper-Miele CC et al (2015) Lung ultrasound for the diagnosis of pneumonia in children: a meta-analysis. Pediatrics 135:714–722
Custers EJFM (2010) Long-term retention of basic science knowledge: a review study. Adv Health Sci Educ 15:109–128
Acknowledgments
This work was supported by the Thrasher Research Fund, the Children’s Hospital of Philadelphia, the Pincus Family Foundation, and through core services from the Penn Center for Acquired Immunodeficiency Syndrome (AIDS) Research, a program funded by the National Institutes of Health. Funding for this project was also made possible in part by a Collaborative Initiative for Paediatric HIV Education and Research (CIPHER) grant (to M.S.K.) from the International AIDS Society, supported by ViiV Healthcare. The views expressed in this publication do not necessarily reflect the official policies of the International AIDS Society or ViiV Healthcare. M.S.K. received financial support from the National Institutes of Health through the Duke Center for AIDS Research and a Career Development Award. A.P.S. and T.A.M. received financial support from the National Institutes of Health through the Penn Center for AIDS Research.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
None
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Fawole, O.A., Kelly, M.S., Steenhoff, A.P. et al. Interpretation of pediatric chest radiographs by non-radiologist clinicians in Botswana using World Health Organization criteria for endpoint pneumonia. Pediatr Radiol 50, 913–922 (2020). https://doi.org/10.1007/s00247-020-04625-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00247-020-04625-0