Abstract
Deep learning (DL) technology has been the best way to execute class over the most recent couple of years. These techniques were extended more specifically to retinal blood vessel segmentation, classifications, and predictions. One of the most significant technologies has been a deep learning technique, U-Net. During this research, we suggested improving the segmentation of retinal images in U-Net, bi-directional ConvLSTM U-Net (BiDCU-Net) with fully connected convolutional layers, like absolute U-Net, bi-directionally Convolutional LSTM (BiConvLSTM) preferences as well as the fully connected layers method. Rather than a basic link in the skip connection of U-Net, we utilize BiConvLSTM to join the feature maps extricated from the comparing encoding way and the past decoding up-convolutional layer in a straightforward manner. For enhancing the distribution and empowerment of highlighting, we use fully connected convolutional layers during the last encoding layer. Consequently, by using batch normalization (BN), we can speed up the configuration of this proposed network. Three recognized datasets were evaluated on the proposed technique: DRIVE, STARE and CHASED DB1 data sets. The visual as well as the quantitative findings show the strength of the approach suggested. This proposed methodology was carried out with the appropriate detailed measurements, accuracy, F1 score, sensitivity, and specificity in DRIVE, 0.9732, 0.8385, 0.8256, and 0.9868 in CHASE, 0.9744, 0.8194, 0.8392 and 0.9845 in STARE, 0.9733, 0.823, 0.8212 and 0.9857, respectively. Furthermore, we state that the approach is better than three similar techniques.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ahlawat S, Choudhary A, Nayyar A, Singh S, Yoon B (2020) Improved handwritten digit recognition using convolutional neural networks (CNN). Sensors 20(12):3344
Alom MZ, Hasan M, Yakopcic C, Taha TM, Asari VK (2018) Recurrent residual convolutional neural network based on u-net (r2u-net) for medical image segmentation. arXiv preprint arXiv:1802.06955
Alom MZ, Taha TM, Yakopcic C, Westberg S, Sidike P, Nasrin MS, Asari VK (2019a) A state-of-the-art survey on deep learning theory and architectures. Electronics 8(3):292
Alom MZ, Yakopcic C, Hasan M, Taha TM, Asari VK (2019b) Recurrent residual U-Net for medical image segmentation. J Med Imaging 6(1):014006
Asadi-Aghbolaghi M, Azad R, Fathy M, Escalera S (2020) Multi-level context gating of embedded collective knowledge for medical image segmentation. arXiv preprint arXiv:2003.05056
Cai J, Lu L, Xie Y, Xing F, Yang L (2017) Improving deep pancreas segmentation in CT and MRI images via recurrent neural contextual learning and direct loss function. arXiv preprint arXiv:1707.04912
Chen LC, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848
Cui C, Fearn T (2018) Modern practical convolutional neural networks for multivariate regression: applications to NIR calibration. Chemom Intell Lab Syst 182:9–20
Cui Z, Ke R, Pu Z, Wang Y (2018) Deep bidirectional and unidirectional LSTM recurrent neural network for network-wide traffic speed prediction. arXiv preprint arXiv:1801.02143
di Ruffano L, Takwoingi Y, Dinnes J, Chuchu N, Bayliss SE, Davenport C, Matin RN, Godfrey K, O'Sullivan C, Gulati A, Chan SA, Durack A, O'Connell S, Gardiner MD, Bamber J, Deeks JJ, Williams HC, Cochrane Skin Cancer Diagnostic Test Accuracy Group (2018) Computer-assisted diagnosis techniques (dermoscopy and spectroscopy-based) for diagnosing skin cancer in adults. Cochrane Database Syst Rev 12(12):CD013186. https://doi.org/10.1002/14651858.CD013186
Dick AD, Tundia N, Sorg R, Zhao C, Chao J, Joshi A, Skup M (2016) Risk of ocular complications in patients with noninfectious intermediate uveitis, posterior uveitis, or panuveitis. Ophthalmology 123(3):655–662
Dolz J, Gopinath K, Yuan J, Lombaert H, Desrosiers C, Ayed IB (2018) HyperDense-Net: a hyper-densely connected CNN for multi-modal image segmentation. IEEE Trans Med Imaging 38(5):1116–1126
Dong H, Yang G, Liu F, Mo Y, Guo Y (2017) Automatic brain tumor detection and segmentation using U-Net based fully convolutional networks. In: Annual conference on medical image understanding and analysis. Springer, Cham, pp 506–517
Drozdzal M, Vorontsov E, Chartrand G, Kadoury S, Pal C (2016) The importance of skip connections in biomedical image segmentation. In: Deep learning and data labeling for medical applications. Springer, Cham, pp 179–187
Gitman I, Ginsburg B (2017) Comparison of batch normalization and weight normalization algorithms for the large-scale image classification. arXiv preprint arXiv:1709.08145
Guo Y, Peng Y (2020) BSCN: bidirectional symmetric cascade network for retinal vessel segmentation. BMC Med Imaging 20(1):1–22
Ibtehaz N, Rahman MS (2020) MultiResUNet: rethinking the U-Net architecture for multimodal biomedical image segmentation. Neural Netw 121:74–87
Jiang Y, Zhang H, Tan N, Chen L (2019) Automatic retinal blood vessel segmentation based on fully convolutional neural networks. Symmetry 11(9):1112
Jin Q, Meng Z, Pham TD, Chen Q, Wei L, Su R (2019) DUNet: a deformable network for retinal vessel segmentation. Knowl Based Syst 178:149–162
Khan A, Sohail A, Zahoora U, Qureshi AS (2020) A survey of the recent architectures of deep convolutional neural networks. Artif Intell Rev. https://doi.org/10.1007/s10462-020-09825-6
Leclerc S, Smistad E, Pedrosa J, Østvik A, Cervenansky F, Espinosa F et al (2019) Deep learning for segmentation using an open large-scale dataset in 2D echocardiography. IEEE Trans Med Imaging 38(9):2198–2210
Li Z, Gavrilyuk K, Gavves E, Jain M, Snoek CG (2018) Videolstm convolves, attends and flows for action recognition. Comput Vis Image Underst 166:41–50
Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M et al (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88
Lu C, Wang Z, Zhou B (2017) Intelligent fault diagnosis of rolling bearing using hierarchical convolutional network based health state classification. Adv Eng Inform 32:139–151
Lundervold AS, Lundervold A (2019) An overview of deep learning in medical imaging focusing on MRI. Z Med Phys 29(2):102–127
Müller D, Netzelmann U, Valeske B (2020) Defect shape detection and defect reconstruction in active thermography by means of two-dimensional convolutional neural network as well as spatiotemporal convolutional LSTM network. Quant InfraRed Thermogr J. https://doi.org/10.1080/17686733.2020.1810883
Panboonyuen T, Jitkajornwanich K, Lawawirojwong S, Srestasathiern P, Vateekul P (2017) Road segmentation of remotely-sensed images using deep convolutional neural networks with landscape metrics and conditional random fields. Remote Sens 9(7):680
Parameswari, C., Siva Ranjani, S (2020) Prediction of atherosclerosis pathology in retinal fundal images with machine learning approaches. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-020-02294-3
Poudel P, Illanes A, Sheet D, Friebe M (2018) Evaluation of commonly used algorithms for thyroid ultrasound images segmentation and improvement using machine learning approaches. J Healthc Eng. https://doi.org/10.1155/2018/8087624
Rajagopalan N, Narasimhan V, Vinjimoor SK, Aiyer J (2020) Deep CNN framework for retinal disease diagnosis using optical coherence tomography images. J Ambient Intell Humaniz Comput. https://doi.org/10.1007/s12652-020-02460-7
Sahiner B, Pezeshk A, Hadjiiski LM, Wang X, Drukker K, Cha KH et al (2019) Deep learning in medical imaging and radiation therapy. Med Phys 46(1):e1–e36
Saranya P, Prabakaran S (2020) Automatic detection of non-proliferative diabetic retinopathy in retinal fundus images using convolution neural network. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-020-02518-6
Schlemper J, Oktay O, Schaap M, Heinrich M, Kainz B, Glocker B, Rueckert D (2019) Attention gated networks: learning to leverage salient regions in medical images. Med Image Anal 53:197–207
Shang R, He J, Wang J, Xu K, Jiao L, Stolkin R (2020) Dense connection and depthwise separable convolution based CNN for polarimetric SAR image classification. Knowl-Based Syst. 194:105542. https://doi.org/10.1016/j.knosys.2020.105542
Shin HC, Roth HR, Gao M, Lu L, Xu Z, Nogues I et al (2016) Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging 35(5):1285–1298
Shrestha S, Vanneschi L (2018) Improved fully convolutional network with conditional random fields for building extraction. Remote Sens 10(7):1135
Stolte S, Fang R (2020) A survey on medical image analysis in diabetic retinopathy. Med Image Anal. https://doi.org/10.1016/j.media.2020.101742
Tai Y, Yang J, Liu X, Xu C (2017) Memnet: a persistent memory network for image restoration. In: Proceedings of the IEEE international conference on computer vision, pp 4539–4547
Tamim N, Elshrkawey M, Abdel Azim G, Nassar H (2020) Retinal blood vessel segmentation using hybrid features and multi-layer perceptron neural networks. Symmetry 12(6):894
Ünver HM, Ayan E (2019) Skin lesion segmentation in dermoscopic images with combination of YOLO and grabcut algorithm. Diagnostics 9(3):72
Wang C, Zhao Z, Ren Q, Xu Y, Yu Y (2019) Dense u-net based on patch-based learning for retinal vessel segmentation. Entropy 21(2):168
Wu Y, Lin Y, Zhou Z, Bolton DC, Liu J, Johnson P (2018) DeepDetect: a cascaded region-based densely connected network for seismic event detection. IEEE Trans Geosci Remote Sens 57(1):62–75
Yap MH, Pons G, Martí J, Ganau S, Sentís M, Zwiggelaar R et al (2017) Automated breast ultrasound lesions detection using convolutional neural networks. IEEE J Biomed Health Inform 22(4):1218–1226
Zhao B, Feng J, Wu X, Yan S (2017) A survey on deep learning-based fine-grained object classification and semantic segmentation. Int J Autom Comput 14(2):119–135
Zhu Y, Zabaras N (2018) Bayesian deep convolutional encoder–decoder networks for surrogate modeling and uncertainty quantification. J Comput Phys 366:415–447
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Rani, B.M.S., Ratna, V.R., Srinivasan, V.P. et al. Disease prediction based retinal segmentation using bi-directional ConvLSTMU-Net. J Ambient Intell Human Comput (2021). https://doi.org/10.1007/s12652-021-03017-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s12652-021-03017-y