Abstract
Diabetic retinopathy (DR) is the major cause of visual impairment among diabetic patients. Significant works have been done to hybrid a modified CNN architecture such as AlexNet with some of classifiers such as support vector machines (SVMs) or fuzzy C-Means (FCM) to improve the DR screening. This new hybrid innovative structure uses more efficient extracting features of a retinal images in both spatial and spectral domains. In spite the advantages of this innovative architecture, the different kernel functions affect the performance of the proposed algorithm. Using the appropriate transformed data into two- or three-dimensional feature maps and using an improved support vector domain description (ISVDD) can obtain more flexible and more accurate image description. To this end, the optimal degree values of different kernel functions can be extracted by using a particle swarm optimization (PSO) algorithm. Also, we compared the performance of our approach (modified-AlexNet-ISVDD) with the results obtained by hybrid modified AlexNet and some of classifiers such as K-Nearest Neighbors (KNN) and FCM clustering. We achieve the proposed CNN architecture using ISVDD on the DIARETDB1 and MESSIDOR datasets, with more than 99% sensitivity.
Similar content being viewed by others
Data availability
Enquiries about data availability should be directed to the authors.
References
Abbas Q et al (2017) Automatic recognition of severity level for diagnosis of diabetic retinopathy using deep visual features. Biol Eng Comput 55(11):1959–1974
Anbeek P, Vincken KL, Bochove GS, Osch MJ, Grond J (2005) Probabilistic segmentation of brain tissue in MR imaging. Neuroimage 27(4):795–804
Andonová M, et al (2017) Diabetic retinopathy screening based on CNN. In: Proceedings of IEEE international symposium ELMAR, pp 51–54
Antal B, Hajdu A (2012) An ensemble-based system for microaneurysm detection and diabetic retinopathy grading. IEEE Trans Biomed Eng 59(6):1720–1726
Bar Y, Diamant I, Wolf L, Greenspan H (2015) Deep learning with non-medical training used for chest pathology identification. In: Proceedings SPIE medical imaging, p 94140V
Bezdek JC, Ehrlich R, Full W (1984) FCM: the fuzzy C-Means clustering algorithm. Comput Geosci 10(2–3):191–203
Bhatkar AP, Kharat GU (2015) Detection of diabetic retinopathy in retinal images using MLP classifier. In: Proceedings of the international symposium on nanoelectronic and information systems
Chiu S (1994) Fuzzy model identification based on cluster estimation. J Intell Fuzzy Syst 2(3):267–278
Ciresan DC, Giusti A, Gambardella LM, Schmidhuber J (2012) Deep neural networks segment neuronal membranes in electron microscopy images. In: Pereira F, Burges C, Bottou L, Weinberger K (eds), Advances in neural inf. process. syst., Red Hook, NY: Curran, 25, pp. 2843–2851.
Cireşan DC, Giusti A, Gambardella LM, Schmidhuber J (2013) Mitosis detection in breast cancer histology images with deep neural networks. In: Proceedings of the MICCAI, pp 411–418
Cocosco CA, Zijdenbos AP, Evans AC (2003) A fully automatic and robust brain MRI tissue classification method. Med Image Anal 7(4):513–527
Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Meas 20(1):37–46
Congdon N, Zheng Y, He M (2012) The worldwide epidemic of diabetic retinopathy. Indian J Ophthalmol 60(5):428
Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297
Doshi D, Shenoy A, Sidhpura D, Gharpure P (2016) Diabetic retinopathy detection using deep convolutional neural networks. In: Proceedings of the international conference on computer analysis security Trends (CAST), pp 261–266
Dunn JC (1973) A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters. J Cybern 3(3):32–57
Edwards DC, Kupinski MA, Metz CE, Nishikawa RM (2002) Maximum likelihood fitting of FROC curves under an initial-detection- and-candidate-analysis model. Med Phys 29(12):2861–2870
Erhan, D., Manzagol, P. A., Bengio, Y., Bengio, S., Vincent, P., 2009. The difficulty of training deep architectures and the effect of unsupervised pre-training. In: Proceedings of the international conference on artificial intelligence and statistics, pp 153–160
Fan RE, Chen PH, Lin CJ (2005) Working Set Selection Using Second Order Information for Training SVM. J Mach Learn Res 6:1889–1918
Franklin S, Rajan S (2014) Diagnosis of diabetic retinopathy by employing image processing technique to detect exudates in retinal images. IET Image Process 8(10):601–609
Ghosh R, Ghosh K, Maitra S (2017) Automatic detection and classification of diabetic retinopathy stages using CNN. In: IEEE international conference on Signal Processing and Integrated Networks (SPIN), pp 550–554
Gong M, Liang Y, Shi J, Ma W, Ma J (2013) Fuzzy C-Means clustering with local information and kernel metric for image segmentation. IEEE Trans Image Process 22(2):573–584
Hani AFM, Nugroho HA (2010) Gaussian bayes classifier for medical diagnosis and grading: application to diabetic retinopathy. In: Proceedings of conference on biomedical engineering science (EMBS)
Hussain S, Anwar S, Majid M (2018) Segmentation of glioma tumors in brain using deep convolutional neural network. Neurocomputing 282:248–261
Kamadi V et al (2016) A computational intelligence technique for the effective diagnosis of diabetic patients using principal component analysis (PCA) and modified fuzzy SLIQ decision tree approach. Appl Soft Comput 49:137–145
Kauppi T, et al (2007) The DIARETDB1 diabetic retinopathy database and evaluation protocol. In: Proceedings of the british conference on machine vision, pp 252–261
Khalid M, Pal N, Arora K (2014) Clustering of image data using K-means and fuzzy K-means. Int J Adv Comput Sci Appl 5(7):160–163
Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Proceedings of the conference on neural information processing systems (NIPS)
Kuncheva LI (2011) A bound on Kappa-error diagrams for analysis of classifier ensembles. IEEE Trans Knowl Data Eng 25(3):494–501
Kwasigroch A, Jarzembinski B, Grochowski M (2018) Deep CNN based decision support system for detection and assessing the stage of diabetic retinopathy. In: Proceedings of the IEEE international interdisciplinary PhD workshop (IIPhDW), pp 111–116
Lalaoui L, Mohamadi T, Djaalab A, Abdelghani H (2015) A modified expectation of maximization method and its application to image segmentation. Current Med Image Rev 11(2):132–137
Li W, Du Q, Zhang F, Hu W (2015) Collaborative-representation-based nearest neighbor Classifier for Hyperspectral imagery. IEEE Geosci Remote Sens Lett 12(2):389–393
Liu X, Tang J (2014) Mass classification in mammograms using selected geometry and texture features, and a new SVM-based feature selection method. IEEE Syst J 8(3):910–920
Margeta J, Criminisi A, Lozoya RC, Lee DC, Ayache N (2015) Fine-tuned convolutional neural nets for cardiac MRI acquisition plane recognition. Comput Methods Biomechan Biomed Eng Image vis 5(5):1–11
Menze B, Reyes M, Leemput KV (2015) The multimodal brain tumor image segmentation benchmark (brats). IEEE Trans Med Imag 34(10):1993–2024
Mohammadian S, Karsaz A, Roshan YM (2017a) A comparative analysis of classification algorithms in diabetic retinopathy. In: Proceedings of the international conference on software engineering and knowledge engineering
Mohammadian S, Karsaz A, Roshan YM (2017b) Comparative study of fine-tuning of pre-trained convolutional neural networks for diabetic retinopathy screening. Presentedat the 2nd international conference on biomedical engineering, Iran, to be published
Motamedi M, Gysel P, Akella V, Ghiasi S (2016) Design space exploration of FPGA-based deep convolutional neural network. In: Proceedings of the IEEE conference on design automation
Niazmardi S, Homayouni S, Safari A (2013) An improved FCM algorithm based on the SVDD for unsupervised hyperspectral data classification. IEEE J Sel Top Appl Earth Observ Remote Sens 6(2):831–839
Nie, D., Wang, L., Adeli, E., Lao, C., Lin, W., Shen, D., 2018. 3-D fully convolutional networks for multimodal isointense infant brain image segmentation. IEEE Trans. Cybern. PP (99), pp. 1–14.
Niemeijer M et al (2010) Retinopathy online challenge: Automatic detection of microaneurysms in digital color fundus photographs. IEEE Trans Med Imag 29(1):185–195
Olson DL, Delen D (2008) Advanced data mining techniques. Choice Rev 45(12):45–6838
Osareh A, Shadgar B, Markham R (2009) A computational-intelligence-based approach for detection of exudates in diabetic retinopathy images. IEEE Trans Inf Technol Biomed 13(4):535–545
Pan Y et al (2015) Brain tumor grading based on neural networks and convolutional neural networks. In: Proceedings of the conference on engineering in medicine and biology Society (EMBS)
Pasolli E, Melgani F, Tuia D, Pacifici F, Emery W (2014) SVM active learning approach for image classification using spatial information. IEEE Trans Geosci Remote Sens 52(4):2217–2233
Patry G, Gauthier G, Lay B, Roger J, Elie D (2016) ADCIS download third party: Messidor database. ADCIS S.A., 2016. [Online]. Available: http://messidor.crihan.fr. Accessed: Nov. 16, 2016
Prasoon A, Petersen K, Igel C, Lauze F, Dam E, Nielsen M (2013) Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network. In: Proceedings of the MICCAI, pp 246–253
Pratt H, et al (2016) Convolutional neural networks for diabetic retinopathy. In: Proceedings of the conference on medical imaging understanding and anal
Priya R, Aruna P (2013) Diagnosis of diabetic retinopathy using machine learning techniques. ICTACT J Soft Comput 03(4):563–575
Qureshi I, Ma J, Abbas Q (2021) Diabetic retinopathy detection and stage classification in eye fundus images using active deep learning. Multimedia Tools Appl 80(8):11691–11721
Razavian AS, Azizpour H, Sullivan J, Carlsson S (2014) CNN features off-the-shelf: an astounding baseline for recognition. In: proceedings of the IEEE conference on computer vision and pattern recognition Workshops, pp 512–519
Reddy YMS, Ravindran RE, Kishore KH (2017) Diabetic retinopathy through retinal image analysis: A review. Int J Eng Technol 7(1–5):19
Roth H, et al (2014) A new 2.5D representation for lymph node detection using random sets of deep convolutional neural network observations. In: Goll P, Hata N, Barillot C, Hornegger J, Howe R, (eds), Proceedings of the MICCAI, 8673, LNCS, pp 520–527
Roth H, Lu L, Lay N, Harrison A, Farag A, Sohn A, Summers R (2018) Spatial aggregation of holistically-nested convolutional neural networks for automated pancreas localization and segmentation. Med Image Anal 45:94–107
Saranya K, Ramasubramanian B, Kaja S, Mohideen G (2012) A novel approach for the detection of new vessels in the retinal images for screening diabetic retinopathy. In: Proceedings of the international conference on communication and signal processing
Selvaraj H, Selvi ST, Selvathi D, Gewali L (2007) Brain MRI slices classification using least squares support vector machine. Int J Intell Comput Med Sci Image Process 1(1):21–33
Shin H, Roth H, Gao M, Lu L, Xu Z, Nogues I, Yao J, Mollura D, Summers R (2016a) Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imag 35(5):1285–1298
Shin JY, Tajbakhsh N, Hurst JY, Kendall CB, Liang J (2016b) Automating carotid intima-media thickness video interpretation with convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV.
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. http://arxiv.org/abs/1409.1556
Singh C, Ranade SK, Singh K (2016) Invariant moments and transform-based unbiased nonlocal means for denoising of MR images. Biomed Signal Process Control 30:13–24
Tajbakhsh N et al (2016) Convolutional neural networks for medical image analysis: fine tuning or full training? IEEE Trans Med Imag 35(5):1299–1312
Tajbakhsh N, Gurudu SR, Liang J (2015a) A comprehensive computer-aided polyp detection system for colonoscopy videos. In: Information processing in medical imaging, pp 327–338
Tajbakhsh N, Liang J (2015b) Computer-aided pulmonary embolism detection using a novel vessel-aligned multi-planar image representation and convolutional neural networks. In: Proceedings of the MICCAI
Tax DMJ, Duin RPW (1999) Support vector domain description”. Pattern Recognit Lett 20(11–13):1191–1199
Vapnik VN (1995) The nature of statistical learning theory. Springer, NewYork
Vo D, Lee S (2018) Semantic image segmentation using fully convolutional neural networks with multi-scale images and multi-scale dilated convolutions. Multimedia Tools Appl 77:1–19
Vo HH, Verma A (2016) New deep neural nets for fine-grained diabetic retinopathy recognition on hybrid color space. In: Proceedings of the IEEE international symposium on multimedia
Wang C, Zhang X, Yang H, Bu J (2012) A pixel-based color image segmentation using support vector machine and fuzzy C–means. Neural Netw 33:148–159
Wang J, Kong J, Lu Y, Qi M, Zhang B (2008) A modified FCM algorithm for MRI brain image segmentation using both local and non-local spatial constraints. Comput Med Imag Graph 32(8):685–698
Wang S et al (2015) Hierarchical retinal blood vessel segmentation based on feature and ensemble learning. Neurocomputing 149:708–717
Wen X, Zhang H, Jiang Z (2008) Multiscale unsupervised segmentation of SAR imagery using the genetic algorithm. Sensors 8(3):1704–1711
Zhang R, Zheng Y, Mak T, Yu R, Wong S, Lau, j., Poon, C. (2017) Automatic detection and classification of colorectal polyps by transferring low-level CNN features from nonmedical domain. IEEE J Biomed Health Inform 21(1):41–47
Zhang W et al (2015) Deep convolutional neural networks for multi-modality isointense infant brain image segmentation. Neuroimage 108:214–224
Zheng Y, Liu D, Georgescu B, Nguyen H, Comaniciu D (2015) 3d deep learning for efficient and robust landmark detection in volumetric data. In: Proceedings of the MICCAI, pp 565–572
Zhoul W, Wu C, Chen D, Wang Z, Yi Y, Du W (2017) Automatic microaneurysm detection of diabetic retinopathy in fundus images. In: Proceedings of the IEEE conference on control and decision (CCDC)
Acknowledgements
The author would like to thank Dr. M. Ansari and Khatam-al-Anbia eye hospital employees for making available the data sets used in this paper. The author would also like to thank Dr. Hamid Khakshur and Navid-Didegan Clinic employees for their participation in preparing and labeling the retinal images to use in this study. This work was supported by [Iranian Society of Ophthalmology] (Grant number [ISO-G341397101]) and by [Khorasan Institute of Higher Education] (Grant number [KIHE-13971230]).
Funding
None
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The author has no relevant financial or non-financial interests to disclose.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Karsaz, A. Diabetic retinopathy screening using improved support vector domain description: a clinical study. Soft Comput 26, 10085–10101 (2022). https://doi.org/10.1007/s00500-022-07387-z
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-022-07387-z