Effect of reader experience on variability, evaluation time and accuracy of coronary plaque detection with computed tomography coronary angiography
To assess the effect of reader experience on variability, evaluation time and accuracy in the detection of coronary artery plaques with computed tomography coronary angiography (CTCA).
Three independent, blinded readers with three different experience levels twice labelled 50 retrospectively electrocardiography (ECG)-gated contrast-enhanced dual-source CTCA data sets (15 female, age 67.3 ± 10.4 years, range 46–86 years) indicating the presence or absence of coronary plaques. The evaluation times for the readings were recorded. Intra- and interobserver variability expressed as κ statistics and sensitivity, specificity, and negative and positive predictive values were calculated for plaque detection, with a consensus reading of the three readers taken as the standard of reference. A bootstrap method was applied in the statistical analysis to account for clustering.
Significant correlations were found between reader experience and, respectively, evaluation times (r = −0.59, p < 0.05) and intraobserver variability (r = 0.73, p < 0.05). The evaluation time significantly differed among the readers (p < 0.05). The observer variability for plaque detection, compared with the consensus, varied between κ = 0.582 and κ = 0.802. Variability of plaque detection was significantly smaller (p < 0.05) and more accurate (p < 0.05) for the most experienced reader.
Reader experience significantly correlated with observer variability, evaluation time and accuracy of coronary plaque detection at CTCA.
KeywordsCoronary plaque Observer variability Evaluation time Reader experience Computed tomography coronary angiography
This research has been supported by the National Center of Competence in Research, Computer Aided and Image Guided Medical Interventions of the Swiss National Science Foundation (http://co-me.ch).
- 10.Shimada Y, Courtney BK, Nakamura M et al (2006) Intravascular ultrasonic analysis of atherosclerotic vessel remodeling and plaque distribution of stenotic left anterior descending coronary arterial bifurcation lesions upstream and downstream of the side branch. Am J Cardiol 98:193–196CrossRefPubMedGoogle Scholar
- 12.Hendel RC, Patel MR, Kramer CM et al (2006) ACCF/ACR/SCCT/SCMR/ASNC/NASCI/SCAI/SIR 2006 appropriateness criteria for cardiac computed tomography and cardiac magnetic resonance imaging: a report of the American College of Cardiology Foundation Quality Strategic Directions Committee Appropriateness Criteria Working Group, American College of Radiology, Society of Cardiovascular Computed Tomography, Society for Cardiovascular Magnetic Resonance, American Society of Nuclear Cardiology, North American Society for Cardiac Imaging, Society for Cardiovascular Angiography and Interventions, and Society of Interventional Radiology. J Am Coll Cardiol 48:1475–1497CrossRefPubMedGoogle Scholar
- 14.Achenbach S, Moselewski F, Ropers D et al (2004) Detection of calcified and noncalcified coronary atherosclerotic plaque by contrast-enhanced, submillimeter multidetector spiral computed tomography: a segment-based comparison with intravascular ultrasound. Circulation 109:14–17CrossRefPubMedGoogle Scholar
- 31.Budoff MJ, Achenbach S, Berman DS et al (2008) Task force 13: training in advanced cardiovascular imaging (computed tomography): endorsed by the American Society of Nuclear Cardiology, Society of Atherosclerosis Imaging and Prevention, Society for Cardiovascular Angiography and Interventions, and Society of Cardiovascular Computed Tomography. J Am Coll Cardiol 51:409CrossRefPubMedGoogle Scholar
- 32.Austen WG, Edwards JE, Frye RL (1975) A reporting system on patients evaluated for coronary artery disease. Report of the Ad Hoc Committee for Grading of Coronary Artery Disease, Council on Cardiovascular Surgery, American Heart Association. Circulation 5–40Google Scholar
- 33.Efron B, Tibshirani RJ (1993) An introduction to the bootstrap. Chapman & Hall, New YorkGoogle Scholar
- 36.Tessmann M, Vega-Higuera F, Fritz D et al (2009) Multi-scale feature extraction for learning-based classification of coronary artery stenosis. In: Nico K, Maryellen LG (eds) SPIE 726002Google Scholar
- 37.Renard F, Yongyi Y (2008) Image analysis for detection of coronary artery soft plaques in MDCT images. In: Proceedings of the 5th IEEE international symposium on biomedical imaging: from nano to macro, ISBI, Paris, France, 14–17 May 2008, pp 25–28Google Scholar
- 40.Saur S, Cattin P, Desbiolles L et al (2009) Prediction rules for the detection of coronary artery plaques: evidence from cardiac CT. Invest Radiol 44:483–490Google Scholar