Fully automated detection of retinal disorders by image-based deep learning
With the aging population and the global diabetes epidemic, the prevalence of age-related macular degeneration (AMD) and diabetic macular edema (DME) diseases which are the leading causes of blindness is further increasing. Intravitreal injections with anti-vascular endothelial growth factor (anti-VEGF) medications are the standard of care for their indications. Optical coherence tomography (OCT), as a noninvasive imaging modality, plays a major part in guiding the administration of anti-VEGF therapy by providing detailed cross-sectional scans of the retina pathology. Fully automating OCT image detection can significantly decrease the tedious clinician labor and obtain a faithful pre-diagnosis from the analysis of the structural elements of the retina. Thereby, we explore the use of deep transfer learning method based on the visual geometry group 16 (VGG-16) network for classifying AMD and DME in OCT images accurately and automatically.
A total of 207,130 retinal OCT images between 2013 and 2017 were selected from retrospective cohorts of 5319 adult patients from the Shiley Eye Institute of the University of California San Diego, the California Retinal Research Foundation, Medical Center Ophthalmology Associates, the Shanghai First People’s Hospital, and the Beijing Tongren Eye Center, with 109,312 images (37,456 with choroidal neovascularization, 11,599 with diabetic macular edema, 8867 with drusen, and 51,390 normal) for the experiment. After images preprocessing, 1000 images (250 images from each category) from 633 patients were selected as validation dataset while the rest images from another 4686 patients were used as training dataset. We used deep transfer learning method to fine-tune the VGG-16 network pre-trained on the ImageNet dataset, and evaluated its performance on the validation dataset. Then, prediction accuracy, sensitivity, specificity, and receiver-operating characteristic (ROC) were calculated.
Experimental results proved that the proposed approach had manifested superior performance in retinal OCT images detection, which achieved a prediction accuracy of 98.6%, with a sensitivity of 97.8%, a specificity of 99.4%, and introduced an area under the ROC curve of 100%.
Deep transfer learning method based on the VGG-16 network shows significant effectiveness on classification of retinal OCT images with a relatively small dataset, which can provide assistant support for medical decision-making. Moreover, the performance of the proposed approach is comparable to that of human experts with significant clinical experience. Thereby, it will find promising applications in an automatic diagnosis and classification of common retinal diseases.
KeywordsAge-related macular degeneration Diabetic macular edema Optical coherence tomography Deep transfer learning Visual geometry group 16 network
This work was supported by the National Key Research and Development Program of China (2016YFF0101400) and the National Natural Science Foundation of China (51675321).
Compliance with ethical standards
Conflict of interest
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
All procedures performed in this study were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki Declaration and its later amendments. For this type of study, formal consent is not required.
- 1.Mariotti SP (2012) Global data on visual impairments 2010. http://www.who.int/blindness/GLOBALDATAFINALforweb.pdf . Accessed 6 Jun 2018
- 2.Bourne RRA, Flaxman SR, Braithwaite T et al (2017) Magnitude, temporal trends, and projections of the global prevalence of blindness and distance and near vision impairment: a systematic review and meta-analysis. Lancet Glob Health 5:e888–e897. https://doi.org/10.1016/S2214-109X(17)30293-0 Accessed 6 Jun 2018CrossRefGoogle Scholar
- 3.Bourne RRA, Jonas JB, Flaxman SR et al (2014) Vision loss expert Group of the Global Burden of Disease Study, prevalence and causes of vision loss in high-income countries and in Eastern and Central Europe: 1990–2010. Br J Ophthalmol 98:629–638. https://doi.org/10.1136/bjophthalmol-2013-304033 CrossRefGoogle Scholar
- 12.Bressler NM (2002) Early detection and treatment of neovascular age-related macular degeneration. http://www.jabfm.org/content/15/2/142.full.pdf . Accessed 6 Jun 2018
- 13.Ciulla TA, Amador AG, Zinman B (2003) Diabetic retinopathy and diabetic macular edema: pathophysiology, screening, and novel therapies. http://care.diabetesjournals.org/content/diacare/26/9/2653.full.pdf . Accessed 6 Jun 2018
- 16.Alsaih K, Lemaître G, Vall JM et al (2016) Classification of sd-oct volumes with multi pyramids, lbp and hog descriptors: application to dme detections. https://doi.org/10.1109/EMBC.2016.7590956 . Accessed 6 Jun 2018
- 19.Burlina P, Freund DE, Joshi N et al (2016) Detection of age-related macular degeneration via deep learning. https://doi.org/10.1109/ISBI.2016.7493240 . Accessed 6 Jun 2018