Skip to main content
SpringerLink
Log in

Impact of Variability in Echocardiographic Interpretation on Assessment of Adequacy of Repair Following Congenital Heart Surgery: A Pilot Study

  • Original Article
  • Published:
Pediatric Cardiology Aims and scope Submit manuscript

Abstract

Technical Performance Score (TPS) is based largely on the presence and magnitude of residual lesions on postoperative echocardiograms; this score correlates with outcomes following repair of congenital heart defects. We evaluated reader variability for echocardiographic components of TPS for complete repair of tetralogy of Fallot (TOF) and arterial switch operation (ASO) in two centers and measured its effect on TPS. Postoperative echocardiograms were evaluated in 67 children (39 TOF and 28 ASO). Two readers (one per center) interpreted each echocardiogram. Reader variability in image quality assessments and measurements was compared using weighted kappa (κ), percent agreement, and intra-class correlation. TPS class (1 optimal-no residua, 2 adequate-minor residua, 3 inadequate-major residua) was assigned for each echocardiographic review by an independent investigator. The effect of reader interpretation variability on TPS classification was measured. There was strong agreement for TPS between the two readers (κ = 0.88). The readers were concordant for TPS classes for 57 children (85 %) and discordant for classes 2 (minor residua) versus 3 (major residua) in six (9 %). Coronary arteries and branch pulmonary arteries were frequently suboptimally visualized. Although inter-reader agreement for TPS was strong, inter-reader variation in echocardiographic interpretations had a small, but important effect on TPS for TOF and ASO, particularly for the distinction between minor and major residua. Further studies of generalizability and reproducibility of TPS and refinement of scoring modules may be needed before it can be used as a tool to assess pediatric cardiac surgical performance and outcomes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Bacha EA, Larrazabal LA, Pigula FA, Gauvreau K, Jenkins KJ, Colan SD et al (2008) Measurement of technical performance in surgery for congenital heart disease: the stage I Norwood procedure. J Thorac Cardiovasc Surg 136:993–997

    Article  PubMed  Google Scholar 

  2. Colan SD, Shirali G, Margossian R, Gallagher D, Altmann K, Canter C, for the Pediatric Heart Network Investigators et al (2012) The ventricular volume variability study of the Pediatric Heart Network: study design and impact of beat averaging and variable type on the reproducibility of echocardiographic measurements in children with chronic dilated cardiomyopathy. J Am Soc Echocardiogr 25(8):842–854

    Article  PubMed Central  PubMed  Google Scholar 

  3. Duke Clinical Research Institute—data analysis of Society of Thoracic Surgeons congenital heart surgery database (https://outcomes.dcri.duke.edu/registry). Downloaded on 28 Aug 2014

  4. Geelhoed JJM, Snijders SPE, Kleyburg-Linkers VE, Steegers EAP, Osch-Gevers L, Jaddoe VW (2009) Reliability of echocardiographic measurements of left cardiac structures in healthy children. Cardiol Young 19:494–500

    Article  PubMed  Google Scholar 

  5. Karamichalis MJ, Colan SD, Nathan M, Pigula FA, Baird C, Marx G et al (2012) Technical Performance Scores in congenital cardiac operations: a quality assessment initiative. Ann Thorac Surg 94:1317–1323

    Article  PubMed  Google Scholar 

  6. Larrazabal LA, del Nido PJ, Jenkins KJ, Gauvreau K, Lacro R, Colan SD et al (2007) Measurement of technical performance in congenital heart surgery: a pilot study. Ann Thorac Surg 83:179–184

    Article  PubMed  Google Scholar 

  7. Lee CK, Margossian R, Sleeper LA, Canter CE, Chen S, Tani LY, for the Pediatric Heart Network Investigators et al (2014) Variability of M-mode versus two-dimensional echocardiography measurements in children with dilated cardiomyopathy. Pediatr Cardiol 35:658–667

    Article  PubMed Central  PubMed  Google Scholar 

  8. Lipshultz SE, Easley KA, Orav EJ, Kaplan S, Bricker TJ, Moodie DJ et al (2001) Reliability of multicenter pediatric echocardiographic measurements of left ventricular structure and function. The prospective P2C2 HIV Study. Circulation 104:310–316

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  9. Margossian R, Schwartz ML, Prakash A, Wruck L, Colan SD, Atz AM, for the Pediatric Heart Network Investigators et al (2009) Comparison of echocardiographic and cardiac magnetic resonance imaging measurements of functional single ventricular volumes, mass, and ejection fraction (from the Pediatric Heart Network Fontan Cross-Sectional Study). Am J Cardiol 104(3):419–428

    Article  PubMed Central  PubMed  Google Scholar 

  10. Nathan M, Karamichalis JM, Liu H, del Nido P, Pigula F, Thiagarajan R et al (2011) Intraoperative adverse events can be compensated by technical performance in neonates and infants after cardiac surgery: a prospective study. J Thorac Cardiovasc Surg 142:1098–1107

    Article  PubMed  Google Scholar 

  11. Nathan M, Karamichalis JM, Liu H, Emani S, Baird C, Pigula FA et al (2012) Surgical Technical Performance Scores are predictors of late mortality and unplanned reinterventions in infants after cardiac surgery. J Thorac Cardiovasc Surg 144:1095–1101

    Article  PubMed  Google Scholar 

  12. Nathan M, Pigula FA, Colan S, Liu H, Mayer JE, Fynn-Thompson F et al (2013) Inadequate Technical Performance Scores are associated with late mortality and need for late re-intervention. Ann Thorac Surg 96:664–669

    Article  PubMed  Google Scholar 

  13. Nathan M, Sadhwani A, Gauvreau K, Ware J, Agus M, Newburger J et al (2014) Association between Technical Performance Scores and neurodevelopmental outcomes after congenital cardiac surgery. J Thorac Cardiovasc Surg 148:232–237

    Article  PubMed  Google Scholar 

  14. Nathan M, Karamichalis J, Liu H, Gauvreau K, Colan S, Pigula FA et al (2014) Technical Performance Scores are strongly associated with early mortality, postoperative adverse events and intensive care unit length of stay—analysis of consecutive discharges over 2 years. J Thorac Cardiovasc Surg 147:389–396

    Article  PubMed  Google Scholar 

  15. Nathan M, Sleeper LA, Ohye RG, Frommelt PC, Caldarone CA, Tweddell JS, for the Pediatric Heart Network Investigators et al (2014) Technical Performance Score is associated with outcomes after the Norwood procedure. J Thorac Cardiovasc Surg 148(5):2208–2214

    Article  PubMed Central  PubMed  Google Scholar 

  16. Saleeb SP, Margossian R, Spencer CT, Alexander ME, Smoot LB, Dorfman AL et al (2012) Reproducibility of echocardiographic diagnosis of left ventricular noncompaction. J Am Soc Echocardiogr 25(2):194–202

    Article  PubMed  Google Scholar 

  17. Selamet Tierney ES, Levine JC, Chen S, Bradley TJ, Pearson GD, Colan SD, for the Pediatric Heart Network Investigators et al (2013) Echocardiographic methods, quality review, and measurement accuracy in a randomized multicenter clinical trial of Marfan syndrome. J Am Soc Echocardiogr 26(6):657–666

    Article  PubMed Central  PubMed  Google Scholar 

  18. Shuhaiber J, Gauvreau K, Thiagarjan R, Bacha E, Mayer J, del Nido P et al (2012) Congenital heart surgeon’s technical proficiency affects neonatal hospital survival. J Thorac Cardiovasc Surg 144:1119–1124

    Article  PubMed  Google Scholar 

  19. Williams RV, Margossian R, Lu M, Atz A, Bradley T, Jay Campbell M, for the Pediatric Heart Network Investigators et al (2013) Factors impacting echocardiographic imaging after the Fontan procedure: a report from the Pediatric Heart Network Fontan Cross-Sectional Study. Echocardiography 30:1098–1106

Download references

Disclosure

Dr. Newburger provides consultation for Bristol Myer Squibb and Janssen Pharmaceuticals and has grant support from Bristol Myer Squibb. Dr. Levine’s spouse receives consultation fees from Audentis Therapeutics. Dr. Colan receives grant support from Myocardia. Dr. Shirali receives grant support from Edwards Lifesciences.

Author information

Authors and Affiliations

  1. Heart Center, Children’s Mercy Hospital, University of Missouri Kansas City School of Medicine, 2401 Gillham Road, Kansas City, MO, 64108, USA

    Anitha Parthiban, Jennifer A. Marshall, Girish S. Shirali & Geetha Raghuveer

  2. Department of Cardiology, Boston Children’s Hospital, 300 Longwood Ave, Boston, MA, 02115, USA

    Jami C. Levine, Steve D. Colan & Jane W. Newburger

  3. Harvard Medical School, 300 Longwood Ave, Boston, MA, 02115, USA

    Jami C. Levine, Meena Nathan, Steve D. Colan & Jane W. Newburger

  4. Department of Cardiac Surgery, Boston Children’s Hospital, Bader 665, 300 Longwood Ave, Boston, MA, 02115, USA

    Meena Nathan

  5. Department of Biostatistics, University of Missouri Kansas City School of Medicine, 2411 Holmes street, Kansas City, MO, 64108, USA

    Stephen D. Simon

Authors
  1. Anitha Parthiban
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jami C. Levine
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Meena Nathan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jennifer A. Marshall
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Girish S. Shirali
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Stephen D. Simon
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Steve D. Colan
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Jane W. Newburger
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Geetha Raghuveer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anitha Parthiban.

Ethics declarations

Conflicts of interest

The authors declare no relevant conflicts of interest.

Additional information

Anitha Parthiban and Jami C. Levine are the co-first author.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Parthiban, A., Levine, J.C., Nathan, M. et al. Impact of Variability in Echocardiographic Interpretation on Assessment of Adequacy of Repair Following Congenital Heart Surgery: A Pilot Study. Pediatr Cardiol 37, 144–150 (2016). https://doi.org/10.1007/s00246-015-1256-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00246-015-1256-8

Keywords

Search

Navigation