Abstract
Objectives
To determine whether (1) computer-based self-training for CT colonography (CTC) improves interpretation performance of novice readers; (2) computer-aided detection (CAD) use during training affects learning.
Methods
Institutional review board approval and patients’ informed consent were obtained for all cases included in this study. Twenty readers (17 radiology residents, 3 radiologists) with no experience in CTC interpretation were recruited in three centres. After an introductory course, readers performed a baseline assessment test (37 cases) using CAD as second reader. Then they were randomized (1:1) to perform either a computer-based self-training (150 cases verified at colonoscopy) with CAD as second reader or the same training without CAD. The same assessment test was repeated after completion of the training programs. Main outcome was per lesion sensitivity (≥ 6 mm). A generalized estimating equation model was applied to evaluate readers’ performance and the impact of CAD use during training.
Results
After training, there was a significant improvement in average per lesion sensitivity in the unassisted phase, from 74% (356/480) to 83% (396/480) (p < 0.001), and in the CAD-assisted phase, from 83% (399/480) to 87% (417/480) (p = 0.021), but not in average per patient sensitivity, from 93% (390/420) to 94% (395/420) (p = 0.41), and specificity, from 81% (260/320) to 86% (276/320) (p = 0.15). No significant effect of CAD use during training was observed on per patient sensitivity and specificity, nor on per lesion sensitivity.
Conclusions
A computer-based self-training program for CTC improves readers’ per lesion sensitivity. CAD as second reader does not have a significant impact on learning if used during training.
Key Points
• Computer-based self-training for CT colonography improves per lesion sensitivity of novice readers.
• Self-training program does not increase per patient specificity of novice readers.
• CAD used during training does not have significant impact on learning.
Similar content being viewed by others
Abbreviations
- 2D:
-
Two-dimensional
- 3D:
-
Three-dimensional
- CAD:
-
Computer-aided detection
- CI :
-
Confidence interval
- CTC:
-
CT colonography
- ESGAR:
-
European Society of Gastrointestinal and Abdominal Radiology
- GEE:
-
Generalized estimating equation
- OR:
-
Odds ratio
References
Fletcher JG, Chen M-H, Herman BA et al (2010) Can radiologist training and testing ensure high performance in CT colonography? Lessons from the National CT Colonography Trial. AJR Am J Roentgenol 195:117–125
Taylor SA, Halligan S, Burling D et al (2004) CT colonography: effect of experience and training on reader performance. Eur Radiol 14:1025–1033
European Society of Gastrointestinal and Abdominal Radiology CT Colonography Group Investigators (2007) Effect of directed training on reader performance for CT colonography: multicenter study. Radiology 242:152–161
Taylor PM (2007) A review of research into the development of radiologic expertise: implications for computer-based training. Acad Radiol 14:1252–1263
Dachman AH, Kelly KB, Zintsmaster MP et al (2008) Formative evaluation of standardized training for CT colonographic image interpretation by novice readers. Radiology 249:167–177
Liedenbaum MH, Bipat S, Bossuyt PMM et al (2011) Evaluation of a standardized CT colonography training program for novice readers. Radiology 258:477–487
Regge D, Della Monica P, Galatola G et al (2013) Efficacy of computer-aided detection as a second reader for 6–9-mm lesions at CT colonography: multicenter prospective trial. Radiology 266:168–176
Mang T, Bogoni L, Anand VX et al (2014) CT colonography: effect of computer-aided detection of colonic polyps as a second and concurrent reader for general radiologists with moderate experience in CT colonography. Eur Radiol 24:1466–1476
Neri E, Halligan S, Hellström M et al (2013) The second ESGAR consensus statement on CT colonography. Eur Radiol 23:720–729
Neri E, Faggioni L, Regge D et al (2011) CT colonography: role of a second reader CAD paradigm in the initial training of radiologists. Eur J Radiol 80:303–809
Boone D, Mallett S, McQuillan J et al (2015) Assessment of the incremental benefit of computer-aided detection (CAD) for interpretation of CT colonography by experienced and inexperienced readers. PLoS One 10:e0136624
Fisichella VA, Jäderling F, Horvath S et al (2009) Computer-aided detection (CAD) as a second reader using perspective filet view at CT colonography: effect on performance of inexperienced readers. Clin Radiol 64:972–982
Baker ME, Bogoni L, Obuchowski NA et al (2007) Computer-aided detection of colorectal polyps: can it improve sensitivity of less-experienced readers? Preliminary findings. Radiology 245:140–149
Pickhardt PJ (2004) Differential diagnosis of polypoid lesions \n at CT colonography (virtual colonoscopy). Radiographics 24:1535–1556
Mang T, Maier A, Plank C et al (2007) Pitfalls in multi-detector row CT colonography: a systematic approach. Radiographics 27:431–454
Delsanto, S, Morra, L, Campanella et al (2008) Computer aided detection of polyps in virtual colonoscopy with sameday fecal tagging. Medical Imaging, San Diego, California, 16–21 Feb 2008
Iussich G, Correale L, Senore C et al (2013) CT colonography: preliminary assessment of a double-read paradigm that uses computer-aided detection as the first reader. Radiology 268:743–751
Yan J (2002) geepack: yet another package for generalized estimating equations. R-News 2:12–14
Yan J, Fine J (2004) Estimating equations for association structures. Stat Med 23:859–874
Gallas BD, Bandos A, Samuelson FW, Wagner RF (2009) A framework for random-effects ROC analysis: biases with the bootstrap and other variance estimators. Commun Stat - Theory Methods 38:2586–2603
Obuchowski NA, Gallas BD, Hillis SL (2012) Multi-reader ROC studies with split-plot designs. Acad Radiol 19:1508–1517
Tonidandel S, Overall JE, Smith F (2004) Use of resampling to select among alternative error structure specifications for GLMM analyses of repeated measurements. Int J Methods Psychiatr Res 13:24–33
Obuchowski NA, Hillis SL (2011) Sample size tables for computer-aided detection studies. AJR Am J Roentgenol 197:W821–W828
Auffermann WF, Henry TS, Little BP, Tigges S, Tridandapani S (2015) Simulation for teaching and assessment of nodule perception on chest radiography in nonradiology health care trainees. J Am Coll Radiol 12:1215–1222
Zafar S, Safdar S, Zafar AN (2014) Evaluation of use of e-Learning in undergraduate radiology education: a review. Eur J Radiol 83:2277–2287
ACR (2014) ACR practice guideline for the performance of computed tomography (CT) colonography in adults. American College of Radiology. https://www.acr.org/~/media/ACR/Documents/PGTS/guidelines/CT_Colonography.pdf. Accessed 13 Nov 2017
Acknowledgements
im3D (Turin, Italy) provided the CTC training software, six workstations with CAD and technical support for the study.
We acknowledge the CTC readers of the study who are radiologists and radiology residents from Radiology Units of Florence, Rome and Turin: Lina Bartolini, Rosanna Candreva, Federica Ciolina, Giacomo Gabbani, Marco Gatti, Angela Grasso, Maria Luisa Grognardi, Nicholas Landini, Simone Liberali, Viorica Maldur, Simona Martinello, Antonella Masserelli, Maria Antonietta Napoli, Vincenzo Noce, Giulia Scarpini, Giulia Schivazappa, Gian Giacomo Taliani, Virginia Vegni, Andrea Wlderk, Stefania Zuccherelli.
Funding
The authors state that this work has not received any funding.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Guarantor
The scientific guarantor of this publication is Professor Daniele Regge.
Conflict of interest
Four authors of this manuscript (Loredanda Correale, Silvia Delsanto, Lia Morra, Daniela Sacchetto) declare relationships with the following company: im3D, Turin, Italy.
All other authors of this manuscript declare no relationships with any companies whose products or services may be related to the subject matter of the article.
Statistics and biometry
One of the authors has significant statistical expertise.
Informed consent
Written informed consent was obtained from all subjects in this study.
Ethical approval
Institutional review board approval was obtained.
Study subjects or cohorts overlap
CTC cases for the assessment tests in this study were extracted from a previously published study (Iussich G, et al. Computer-aided detection for computed tomographic colonography screening: a prospective comparison of a double-reading paradigm with first-reader computer-aided detection against second-reader computer-aided detection. Invest Radiol. 2014;49:173–182).
Methodology
• prospective
• pmulticentre study
Electronic supplementary material
Rights and permissions
About this article
Cite this article
Sali, L., Delsanto, S., Sacchetto, D. et al. Computer-based self-training for CT colonography with and without CAD. Eur Radiol 28, 4783–4791 (2018). https://doi.org/10.1007/s00330-018-5480-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00330-018-5480-5