Abstract
Prenatal heart disease spans the spectrum of severity from very mild to severe life-threatening conditions. An accepted scale for grading fetal cardiovascular disease severity would aid in anomaly standardization, counseling, and future research. The Fetal Cardiovascular Disease Severity Scale with seven severity grades ranging from mild (grade 1) to severe (grade 7) disease was developed. Severity grade relates to the cardiovascular condition diagnosed by fetal echocardiography, with factors including postnatal intervention, number of interventions anticipated, likelihood of two-ventricle repair versus single-ventricle palliation, and overall prognosis. A survey describing 25 cardiac anomalies was offered to fetal cardiologists at six institutions for validation of scale reliability among practitioners. The study participants graded defects using this scale. A smaller group graded anomalies again more than 2 weeks after the initial survey. The intraclass correlation coefficient (ICC) was used to assess agreement of the respondents. The survey participants were 14 experienced fetal cardiologists: 9 from the Children’s Hospital of Philadelphia (CHOP) and 5 from five additional institutions in the United States. The initial survey ICC was high [0.93; 95 % confidence interval (CI) 0.88–0.96]. The subanalysis showed a higher ICC for the participants outside CHOP (0.95; 95 % CI 0.91–0.98 vs. 0.92; 95 % CI 0.86–0.96, respectively). The ICCs were high for all the fetal cardiologists participating in the repeat evaluation, ranging from 0.92 to 0.99 (95 % CI 0.65–1.00). The Fetal Cardiovascular Disease Severity Scale demonstrated good inter- and intrarater reliability among experienced fetal cardiologists and is a valid tool for standardization of prenatal cardiac diagnostic assessment across institutions. The scale has applications for parental counseling and research in fetal cardiovascular disease.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
Judgment of the severity of a particular form of congenital heart disease (CHD) comprises a multitude of factors including the anatomy and pathophysiology of the lesion as well as the number and type of interventions available to treat or palliate the condition. The outcomes and overall quality of life created through surgical and medical management, both short and long term, also are factors that enter into consideration of severity [1, 9, 10].
With the advent of fetal echocardiography, diagnosis of CHD before birth currently is well established [4, 5]. Early diagnosis enables a smooth transition from pre- to postnatal life and improves infant survival and morbidity [2, 7, 11]. The anatomy of the lesion, its implications for delivery, expected neonatal and life-long interventions, and overall prognosis all are discussed currently with families before the birth of a baby with CHD [8].
To provide accurate estimates of the clinical course of CHD based on fetal imaging alone, prenatal cardiac care providers, including pediatric cardiologists, maternal fetal medicine specialists, genetic counselors, and nurses, must convey an overall assessment of the lesion severity to families during counseling and to the medical team caring for the baby during delivery and after birth.
A comprehensive, standardized, and validated system to rate the severity of CHD in the fetus would be of great value to patients, their families, and the medical community caring for them. A uniform measure of disease severity could improve communication and conveyance of information at prenatal counseling. It also would aid in research studies assessing outcomes, particularly across institutions.
This study aimed to introduce such a tool, the Fetal Cardiovascular Disease Severity Scale, and to describe its validation across different centers.
Methods
Design of the Scale
Experts in the field of fetal and pediatric cardiology developed the Fetal Cardiovascular Disease Severity Scale to grade the severity of CHD (Table 1). In designing this scale, the experts carefully considered those elements that come into play in the attempt to describe the severity of a particular form of CHD at the time of fetal diagnosis and counseling.
To provide adequate gradation of each lesion with its own unique constellation of features, seven levels of severity were included in the scale. It then was sent for evaluation and review to the group of cardiologists, who further modified and revised it based on their feedback until a consensus was reached as to the content and design of the scale.
The degree of severity in the scale is determined by elements including the general category of anatomic complexity of heart disease (e.g., isolated valve pathology vs. isolated septal defect vs. complex outflow tract abnormality vs. ventricular hypoplasia), the need for postnatal intervention and its complexity, the number of lifelong interventions (catheter based or operative) anticipated, the likelihood that an intervention will lead to a two-ventricle repair versus single-ventricle palliation, and the overall prognosis with regard to quality and duration of life.
Table 1 describes the seven levels of severity ranging from level 1 (least severe) to level 7 (most severe). Each level is structured by a definition concerning anatomic categorization, the treatment anticipated, and the prognosis or anticipated outcome. A brief summary term describing each level is listed. Subjects with a possible two-ventricle management strategy can be graded at levels 1–7, whereas those with a single ventricle are graded only at levels 5–7.
Genetic/chromosomal abnormalities and extracardiac anomalies are not included in the scale because they may independently affect the prognosis irrespective of the cardiac condition. They are therefore considered additive to the cardiovascular severity. In addition, the Fetal Cardiovascular Disease Severity Scale is designed to grade the severity of structural CHD. Cardiomyopathies and arrhythmias are excluded because they have their own unique considerations and features that influence severity and because the aim was to create a more streamlined assessment tailored to the gradation of structural cardiac malformations.
Validation of the Scale
This assessment aimed to validate the Fetal Cardiovascular Disease Severity Scale and to determine its use among fetal cardiologists. Validity was determined by the degree of agreement among experienced fetal cardiologists in grading a sample of cases.
A survey was administered to fetal cardiologists within our institution, the Children’s Hospital of Philadelphia (CHOP), and to experienced fetal cardiologists at other institutions across the United States. Input provided by fetal cardiologists from multiple different centers introduced different institutional experiences, regional biases, and local outcomes to this analysis. The participating centers included the Children’s National Medical Center (MTD, Washington DC, USA), the University of California–San Francisco (AMG; San Francisco, CA, USA), the CS Mott Children’s Hospital at the University of Michigan (CGF; Ann Arbor, MI, USA); and the Advocate Children’s Hospital (BC; Oak Lawn, IL, USA). One of the fetal cardiologists at CHOP (C.B.F.), who had recently arrived from another institution [Texas Children’s Hospital (TCH)], was therefore considered to offer judgments that reflected her experiences in fetal cardiac care at TCH and not CHOP.
The survey assessment was sent via email to all the study participants. The survey consisted of 25 hypothetical case examples covering a wide spectrum of cardiovascular conditions diagnosed in fetal life by echocardiography (Table 2). The participants were asked to grade each of the lesions using the scale configured in Table 1. The responses then were emailed back to CHOP for compilation of data. The fetal cardiologists were blinded to the answers of the other participants.
Data Analysis
The intraclass correlation coefficient (ICC) was used to assess agreement between respondents to determine interrater reliability. The minimum, maximum, range, standard deviation, and interquartile ranges of the case severity grades from the respondents also were computed. Next, the 25 cases on the worksheet were shuffled to change their order and then sent to a smaller subgroup of the initial participants, including all nine CHOP fetal cardiologists and one outside fetal cardiologist. These participants, blinded to their previous answers, were again asked to grade the diagnoses using the severity scale. The ICC comparing the answers of the individual respondent with the same diagnosis at different points in time was used to assess for agreement and to determine the intrarater reliability of the scale.
Results
The participants in the survey evaluation were 14 physicians: 9 fetal cardiologists trained in fetal cardiology and/or practicing it at the Fetal Heart Program at CHOP and 5 fetal cardiologists trained in fetal cardiology and/or practicing it at other institutions. Of these 14 participants, 10 evaluated the severity of the same diagnoses on a shuffled worksheet, with a minimum of 2 weeks between the completion of the two surveys. The ICC of 0.93 [95 % confidence interval (CI) 0.88–0.96] among all the respondents demonstrated a high level of agreement between providers. The fetal cardiologists from outside institutions demonstrated an ICC of 0.95 (95 % CI 0.91–0.98), whereas the ICC for the participants at CHOP was 0.92 (95 % CI 0.86–0.96).
The range of severity grade responses by case is listed in Table 3. Overall, 60 % of the cases had respondents who offered a severity scale grade within one or two severity levels of each other, and 96 % of the cases had a severity scale grade within three levels of each other or less. In one case, the participants demonstrated a severity grade range of four levels (case 23: critical aortic valve stenosis, normal size, and functioning left ventricle).
All the cases had an interquartile range within one or two levels of severity, indicating that responses outside these levels were outliers (Fig. 1). The ICCs were high for all the fetal cardiologists participating in the repeat evaluation, ranging from 0.92 to 0.99 (95 % CI 0.65–1.00) (Table 4).
Discussion
Currently, the first point of entry into the realm of congenital heart care commonly occurs before birth with a prenatal diagnosis. Establishment of disease severity among the myriad of conditions that exist is an essential aspect of prenatal care for CHD. Disease severity influences decisions concerning continuation of the pregnancy, dictates management for the remainder of gestation, and affects planning for delivery and postnatal care. A commonly accepted grading system for fetal cardiovascular conditions among practitioners would be of great value in creating a common language, and importantly, could function as an instrument for investigational studies. A means of categorizing fetal cardiovascular disease severity, in essence the diagnosis of CHD at its earliest presentation, also could serve as a tool for gauging resource use and cost effectiveness. In this report, we describe the development of such a tool and its validation.
Methods for categorizing the clinical variability in congenital heart anomalies currently exist, but none are specifically designed for prenatal use. Task Force One of the 32nd Bethesda Conference of the American College of Cardiology uses elements of both anatomic diagnosis and surgical repair to divide adult patients with congenital heart defects into three groups of severity [12]: simple CHD, CHD of moderate severity, and CHD of great complexity, also described as simple, moderate, and severe CHD.
The Aristotle Score for Congenital Heart Surgery is designed to rate the complexity of surgical procedures used in palliating CHD based on morbidity, mortality, and anticipated level of surgical difficulty [6]. Patient characteristics also are taken into consideration with this system to provide a comprehensive score.
A consensus-based method of risk adjustment for in-hospital mortality after surgery to repair CHD is called the Risk Adjustment for Congenital Heart Surgery (RACHS-1) [3]. This system is designed to assess perioperative surgical mortality for children with CHD who are 18 years old or younger and allows for meaningful comparisons of surgical outcomes across institutions.
The aforementioned scoring systems do not provide a framework for a comprehensive assessment of CHD severity diagnosed in fetuses during the prenatal period, whereas the Fetal Cardiovascular Disease Severity Scale is uniquely designed for this patient population. In addition, these scoring systems take a more simplified approach to grading a group of extremely diverse cardiac lesions with unique features that affect risk and outcome. The 7-point system of the Fetal Cardiovascular Disease Severity Scale takes into account features beyond the anatomic complexity of the lesion, including need and number of interventions, two- versus single-ventricle palliation, and overall prognosis, making this scale a more comprehensive assessment of severity.
High ICCs comparing responses of fetal cardiologists with one another and with themselves indicate that the Fetal Cardiovascular Disease Severity Scale is a valid method for assessing structural CHD diagnosed in prenatal life. Agreement between the participants at CHOP (ICC 0.92) was slightly less than between those at the outside institutions (ICC 0.95). This may have been due to a higher number of CHOP participants from CHOP (9 participants) than from outside institutions (5 participants), leading to more opportunity for variability in response grades.
The ranges for the responses typically fell between one and two grades of severity, with some cases involving three grades, although the interquartile ranges all were within one or two levels. The sole case with a range of four severity grades had “critical aortic valve stenosis, normal size, and functioning left ventricle.” Of the 14 respondents, 12 identified this diagnosis as falling within severity grade level 4 or 5. One respondent graded the severity in this case as level 3, whereas one other respondent graded it as level 6. However, during the second evaluation to assess intrarater reliability, both respondents, blinded to their previous answers, independently graded the severity of the same diagnosis as level 4.
The description of critical aortic valve stenosis provided to the participants did not identify the gestational age of the fetus. This could have influenced the grade assignment because critical aortic stenosis with normal left ventricular function in a fetus at 20 weeks could potentially progress in utero, leading to a newborn with poor ventricular function or raising concern about the development of hypoplastic left heart syndrome. Such a diagnosis made at 36 weeks gestation would be less likely to create uncertainty about progression of the disease.
Certain conditions, such as the aforementioned case of critical aortic stenosis, can evolve anatomically during gestation. In other cases, the anatomy can lead to hemodynamic compromise, as in dysplastic tricuspid valve with tricuspid valve regurgitation, in which the degree of regurgitation worsens during gestation, causing hydrops and affecting prognosis.
The grading system used in the Fetal Cardiovascular Disease Severity Scale can be applied to each individual at multiple points in gestation as the fetal cardiovascular disease evolves. This can provide families with a more concrete parameter for understanding the implication of these changes during gestation. In addition, it can give fetal cardiologists a way to communicate the fetal cardiovascular disease course during gestation effectively to obstetricians and postnatal cardiologists.
In general, variability in responses across participants may be influenced by either institutional or personal experience with a specific individual defect. Furthermore, particular conditions in fetal life may be difficult to grade because they are plagued by uncertainty in outcomes based on a particular strategy, such as the notion that the outcome of a “good” single-ventricle strategy may be superior to that of a “poor” two-ventricle repair strategy. Nevertheless, our analysis showed that for a large heterogeneous group of 25 anomalies, the Fetal Cardiovascular Disease Severity Scale demonstrated excellent interclass correlation and hence can be used between practitioners and across institutions.
This assessment had several limitations. The survey was a subjective evaluation by a limited number of attending fetal cardiologists with variable years of practitioner training and experience. It did not include the gestational age of the fetuses, which could have influenced the grade assignment. Responses could have varied due to recall bias of the most recent or more memorable cases. The scale was assessed by fetal cardiologists and has not been validated among maternal-fetal medicine specialists or other practitioners who may care for patients with prenatal CHD. In addition, the scale did not take into account genetic information or the presence of other extracardiac anomalies that could independently affect long-term outcome and prognosis.
Finally, the scale was designed for a general global assessment of CHD severity. Therefore, factors that contribute to severity (e.g., the number of interventions anticipated and overall prognosis) are paired within the scale. It is possible that for some conditions, the number of interventions or the complexity of the intervention and prognosis may be disparate. Hence, a particular diagnosis may not fit precisely within one level, which may contribute to variability in grades.
The Fetal Cardiovascular Disease Severity Scale demonstrated good inter- and intrarater reliability among experienced fetal cardiologists. It therefore is a valid tool for standardization of prenatal prognostic assessment of CHD severity across institutions. It also can be used at different points in time throughout gestation as a marker of disease evolution. This scale can be used as a standard component of data collection for research and has applications for parental counseling and transition of care during delivery and after birth. Further evaluation of this scale may be applied prospectively to patients with CHD diagnoses made in fetal life and validated on the basis of actual outcomes, including number of interventions and quality-of-life measures.
References
Cohen M, Mansoor D, Langut H, Lorber A (2007) Quality of life, depressed mood, and self-esteem in adolescents with heart disease. Psychosom Med 69:313–318. doi:10.1097/PSY.0b013e318051542c
Franklin O, Burch M, Manning N, Sleeman K, Gould S, Archer N (2002) Prenatal diagnosis of coarctation of the aorta improves survival and reduces morbidity. Heart 87:67–69
Jenkins KJ, Gauvreau K, Newburger JW, Spray TL, Moller JH, Iezzoni LI et al (2002) Consensus-based method for risk adjustment for surgery for congenital heart disease. J Thorac Cardiovasc Surg 123(1):110–118
Jone P-N, Schowengerdt KO (2009) Prenatal diagnosis of congenital heart disease. Pediatr Clin North Am 56:709–715. doi:10.1016/j.pcl.2009.04.002 Table of Contents
Kovalchin JP, Silverman NH (2004) The impact of fetal echocardiography. Pediatr Cardiol 25:299–306. doi:10.1007/s00246-003-0593-1
Lacour-Gayet F, Clarke D, Jacobs J, Gaynor W, Hamilton L, Jacobs M et al (2004) The Aristotle score for congenital heart surgery. Semin Thorac Cardiovasc Surg Pediatr Card Surg Annu 7:185–191
Levey A, Glickstein JS, Kleinman CS, Levasseur SM, Chen J, Gersony WM et al (2010) The impact of prenatal diagnosis of complex congenital heart disease on neonatal outcomes. Pediatr Cardiol 31:587–597. doi:10.1007/s00246-010-9648-2
Mellander M (2005) Perinatal management, counseling and outcome of fetuses with congenital heart disease. Semin Fetal Neonatal Med 10:586–593. doi:10.1016/j.siny.2005.08.002
Moons P, Van Deyk K, De Geest S, Gewillig M, Budts W (2005) Is the severity of congenital heart disease associated with the quality of life and perceived health of adult patients? Heart 91:1193–1198. doi:10.1136/hrt.2004.042234
Tahirović E, Begić H, Nurkić M, Tahirović H, Varni JW (2010) Does the severity of congenital heart defects affect disease-specific health-related quality of life in children in Bosnia and Herzegovina? Eur J Pediatr 169:349–353. doi:10.1007/s00431-009-1060-7
Tworetzky W, McElhinney DB, Reddy VM, Brook MM, Hanley FL, Silverman NH (2001) Improved surgical outcome after fetal diagnosis of hypoplastic left heart syndrome. Circulation 103:1269–1273
Warnes CA, Liberthson R, Danielson GK, Dore A, Harris L, Hoffman JI et al (2001) Task force 1: the changing profile of congenital heart disease in adult life. J Am Coll Cardiol 37:1170–1175
Conflict of Interest
The authors declare that they have no conflict of interest.
Funding
Dr. Rychik is supported by the Robert and Dolores Harrington Endowed Chair in Pediatric Cardiology at The Children’s Hospital of Philadelphia.
Ethical Standards
This study protocol was evaluated by the Internal Review Board at Children’s Hospital of Philadelphia and received an exemption, as it does not meet the definition of “human subject” research. It has therefore been performed in accordance with the ethical standards laid down in the 1964 Declaration of Helsinki and its later amendments.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.
About this article
Cite this article
Davey, B.T., Donofrio, M.T., Moon-Grady, A.J. et al. Development and Validation of a Fetal Cardiovascular Disease Severity Scale. Pediatr Cardiol 35, 1174–1180 (2014). https://doi.org/10.1007/s00246-014-0911-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00246-014-0911-9