Pediatric Radiology

, Volume 37, Issue 12, pp 1201–1208

Observer variability assessing US scans of the preterm brain: the ELGAN study

  • Karl Kuban
  • Ira Adler
  • Elizabeth N. Allred
  • Daniel Batton
  • Steven Bezinque
  • Bradford W. Betz
  • Ellen Cavenagh
  • Sara Durfee
  • Kirsten Ecklund
  • Kate Feinstein
  • Lynn Ansley Fordham
  • Frederick Hampf
  • Joseph Junewick
  • Robert Lorenzo
  • Roy McCauley
  • Cindy Miller
  • Joanna Seibert
  • Barbara Specter
  • Jacqueline Wellman
  • Sjirk Westra
  • Alan Leviton
Original Article

DOI: 10.1007/s00247-007-0605-z

Cite this article as:
Kuban, K., Adler, I., Allred, E.N. et al. Pediatr Radiol (2007) 37: 1201. doi:10.1007/s00247-007-0605-z

Abstract

Background

Neurosonography can assist clinicians and can provide researchers with documentation of brain lesions. Unfortunately, we know little about the reliability of sonographically derived diagnoses.

Objective

We sought to evaluate observer variability among experienced neurosonologists.

Materials and methods

We collected all protocol US scans of 1,450 infants born before the 28th postmenstrual week. Each set of scans was read by two independent sonologists for the presence of intraventricular hemorrhage (IVH) and moderate/severe ventriculomegaly, as well as hyperechoic and hypoechoic lesions in the cerebral white matter. Scans read discordantly for any of these four characteristics were sent to a tie-breaking third sonologist.

Results

Ventriculomegaly, hypoechoic lesions and IVH had similar rates of positive agreement (68–76%), negative agreement (92–97%), and kappa values (0.62 to 0.68). Hyperechoic lesions, however, had considerably lower values of positive agreement (48%), negative agreement (84%), and kappa (0.32). No sonologist identified all abnormalities more or less often than his/her peers. Approximately 40% of the time, the tie-breaking reader agreed with the reader who identified IVH, ventriculomegaly, or a hypoechoic lesion in the white matter. Only about 25% of the time did the third party agree with the reader who reported a white matter hyperechoic lesion.

Conclusion

Obtaining concordance seems to be an acceptable way to assure reasonably high-quality of images needed for clinical research.

Keywords

BrainNewbornPremature

Copyright information

© Springer-Verlag 2007

Authors and Affiliations

  • Karl Kuban
    • 1
  • Ira Adler
    • 2
  • Elizabeth N. Allred
    • 3
  • Daniel Batton
    • 4
  • Steven Bezinque
    • 5
  • Bradford W. Betz
    • 5
  • Ellen Cavenagh
    • 6
  • Sara Durfee
    • 7
  • Kirsten Ecklund
    • 8
  • Kate Feinstein
    • 9
  • Lynn Ansley Fordham
    • 10
  • Frederick Hampf
    • 11
  • Joseph Junewick
    • 5
  • Robert Lorenzo
    • 12
  • Roy McCauley
    • 13
  • Cindy Miller
    • 14
  • Joanna Seibert
    • 15
  • Barbara Specter
    • 16
  • Jacqueline Wellman
    • 17
  • Sjirk Westra
    • 18
  • Alan Leviton
    • 19
  1. 1.Division of Pediatric Neurology, Boston University Medical CenterBoston University School of MedicineBostonUSA
  2. 2.Eastern Radiologists, Inc.GrenvilleUSA
  3. 3.Neuroepidemiology Unit, Children’s Hospital BostonHarvard Medical School, Harvard School of Public HealthBostonUSA
  4. 4.Departments of Pediatrics and NeonatologyWilliam Beaumont HospitalRoyal OakUSA
  5. 5.Department of RadiologyDeVos Children’s HospitalGrand RapidsUSA
  6. 6.Department of RadiologySparrow HospitalLansingUSA
  7. 7.Department of Radiology, Brigham & Women’s HospitalHarvard Medical SchoolBostonUSA
  8. 8.Department of Radiology, Children’s Hospital BostonHarvard Medical SchoolBostonUSA
  9. 9.Department of Radiology, University of Chicago HospitalUniversity of ChicagoChicagoUSA
  10. 10.Department of RadiologyUniversity of North Carolina School of MedicineChapel HillUSA
  11. 11.Department of RadiologyBaystate Medical CenterSpringfieldUSA
  12. 12.Department of Radiology, Children’s Healthcare of AtlantaEmory University School of MedicineAtlantaUSA
  13. 13.Department of Radiology, Tufts-New England Medical CenterTufts University School of MedicineBostonUSA
  14. 14.Department of Radiology, Yale-New Haven HospitalYale University School of MedicineNew HavenUSA
  15. 15.Department of Radiology, Arkansas Children’s HospitalUniversity of Arkansas Medical SchoolLittle RockUSA
  16. 16.Department of Radiology, Forsyth Hospital, Baptist Medical CenterWake Forest University School of MedicineWinston-SalemUSA
  17. 17.Department of Radiology, Milford Regional Medical CenterMilfordUSA
  18. 18.Division of Pediatric Radiology, Massachusetts General HospitalHarvard Medical SchoolBostonUSA
  19. 19.Neuroepidemiology Unit, Children’s Hospital BostonHarvard Medical SchoolBostonUSA