Skip to main content

Optic Disc and Cup Image Segmentation Utilizing Contour-Based Transformation and Sequence Labeling Networks

Journal of Medical Systems volume 44, Article number: 96 (2020) Cite this article

Abstract

Optic disc (OD) and optic cup (OC) segmentation are important steps for automatic screening and diagnosing of optic nerve head abnormalities such as glaucoma. Many recent works formulated the OD and OC segmentation as a pixel classification task. However, it is hard for these methods to explicitly model the spatial relations between the labels in the output mask. Furthermore, the proportion of the background, OD and OC are unbalanced which also may result in a biased model as well as introduce more noise. To address these problems, we developed an approach that follows a coarse-to-fine segmentation process. We start with a U-Net to obtain a rough segmenting boundary and then crop the area around the boundary to form a boundary contour centered image. Second, inspired by sequence labeling tasks in natural language processing, we regard the OD and OC segmentation as a sequence labeling task and propose a novel fully convolutional network called SU-Net and combine it with the Viterbi algorithm to jointly decode the segmentation boundary. We also introduced a geometric parameter-based data augmentation method to generate more training samples in order to minimize the differences between training and test sets and reduce overfitting. Experimental results show that our method achieved state-of-the-art results on 2 datasets for both OD and OC segmentation and our method outperforms most of the ophthalmologists in terms of achieving agreement out of 6 ophthalmologists on the MESSIDOR dataset for both OD and OC segmentation. In terms of glaucoma screening, we achieved the best cup-to-disc ratio (CDR) error and area under the ROC curve (AUC) for glaucoma classification on the Drishti-GS dataset.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

43,34 €

Price includes VAT (Finland)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Notes

  1. https://github.com/HzFu/MNet_DeepCDR

  2. https://github.com/Tramac/awesome-semantic-segmentation-pytorch

References

  1. Sadun A. A, Wang M. Y (2011) Abnormalities of the optic disc

  2. Gagnon L, Lalonde M, Beaulieu M, Boucher M. C (2001) Procedure to detect anatomical structures in optical fundus images. In: Medical imaging 2001: Image processing. Pp 1218–1225

  3. Sevastopolsky, A., Optic disc and cup segmentation methods for glaucoma detection with modification of U-net convolutional neural network. Pattern Recognit Image Anal. 27(3):618–624, 2017. https://doi.org/10.1134/S1054661817030269.

    Article  Google Scholar 

  4. Murthy V, Shankar M, Lin J, Lieu S, Patel M, Post H, Murthy H, Liu BJ (2019) Fundus Analysis Software Tool (FAST): development of software integrating CAD with the EHR for the longitudinal study of fundus images. In: Proc. SPIE 10954, Medical Imaging 2019: Imaging informatics for healthcare, Research, and Applications

  5. Fu, H., Cheng, J., Xu, Y., Wong, D. W. K., Liu, J., and Cao, X., Joint optic disc and cup segmentation based on multi-label deep network and polar transformation. IEEE Trans Med Imaging., 2018. https://doi.org/10.1109/TMI.2018.2791488.

  6. Chakravarty, A., and Sivaswamy, J., Joint optic disc and cup boundary extraction from monocular fundus images. Computer Methods and Programs in Biomedicine, 2017. https://doi.org/10.1016/j.cmpb.2017.06.004.

  7. Liu, Q., Hong, X., Li, S., Chen, Z., Zhao, G., and Zou, B., A spatial-aware joint optic disc and cup segmentation method. Neurocomputing, 2019. https://doi.org/10.1016/j.neucom.2019.05.039.

  8. Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)

  9. Dauphin Y. N, Fan A, Auli M, Grangier D (2017) Language modeling with gated convolutional networks. In: 34th international conference on machine learning, ICML 2017

  10. Yu F, Koltun V (2016) Multi-scale context aggregation by dilated convolutions. In: 4th international conference on learning representations, ICLR 2016 - conference track proceedings

  11. Aquino, A., Gegúndez-Arias, M. E., and Marín, D., Detecting the optic disc boundary in digital fundus images using morphological, edge detection, and feature extraction techniques. IEEE Trans Med Imaging., 2010. https://doi.org/10.1109/TMI.2010.2053042.

  12. Giachetti A, Ballerini L, Trucco E (2014) Accurate and reliable segmentation of the optic disc in digital fundus images. J Med Imaging. https://doi.org/10.1117/1.jmi.1.2.024001

  13. Pallawala P. M. D. S, Hsu W, Lee M. L, Eong K. G. A (2004) Automated optic disc localization and contour detection using ellipse fitting and wavelet transform. Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics). https://doi.org/10.1007/978-3-540-24671-8_11

  14. Zhu X, Rangayyan R. M (2008) Detection of the optic disc in images of the retina using the Hough transform. In: Proceedings of the 30th annual international conference of the IEEE engineering in medicine and biology society, EMBS’08 - “personalized healthcare through technology”

  15. Almazroa A, Alodhayb S, Raahemifar K, Lakshminarayanan V (2017) Optic cup segmentation: Type-II fuzzy thresholding approach and blood vessel extraction. Clin Ophthalmol. https://doi.org/10.2147/OPTH.S117157

  16. Lalonde M, Beaulieu M, Gagnon L (2001) Fast and robust optic disc detection using pyramidal decomposition and hausdorff-based template matching. IEEE Trans Med Imaging. https://doi.org/10.1109/42.963823

  17. Dashtbozorg, B., Mendonça, A. M., and Campilho, A., Optic disc segmentation using the sliding band filter. Comput Biol Med., 2015. https://doi.org/10.1016/j.compbiomed.2014.10.009.

  18. Osareh A (2004) Automated identification of diabetic retinal exudates and the optic disc

  19. Dehghani, A., Moghaddam, H. A., and Moin, M. S., Optic disc localization in retinal images using histogram matching. Eurasip J Image Video Process. 2012(1):1–11, 2012. https://doi.org/10.1186/1687-5281-2012-19.

    Article  Google Scholar 

  20. Barrett S. F, Naess E, Molvik T (2001) Employing the hough transform to locate the optic disk. In: Biomedical Sciences Instrumentation

  21. Chrástek R, Wolf M, Donath K, Niemann H, Paulus D, Hothorn T, Lausen B, Lämmer R, Mardin C. Y, Michelson G (2005) Automated segmentation of the optic nerve head for diagnosis of glaucoma. Med Image Anal. https://doi.org/10.1016/j.media.2004.12.004

  22. Mendels F, Heneghan C, Thiran J. P (1999) Identification of the optic disk boundary in retinal images using active contours. Proc Irish Mach Vis Image Process Conf

  23. Sedai S, Roy P. K, Mahapatra D, Garnavi R (2016) Segmentation of optic disc and optic cup in retinal fundus images using shape regression. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS

  24. Hatanaka Y, Nagahata Y, Muramatsu C, Okumura S, Ogohara K, Sawada A, Ishida K, Yamamoto T, Fujita H (2014) Improved automated optic cup segmentation based on detection of blood vessel bends in retinal fundus images. In: 2014 36th annual international conference of the IEEE engineering in medicine and biology society, EMBC 2014

  25. Haleem M. S, Han L, van Hemert J, Li B, Fleming A, Pasquale L. R, Song B. J (2018) A novel adaptive deformable model for automated optic disc and cup segmentation to aid Glaucoma diagnosis. Journal of Medical Systems https://doi.org/10.1007/s10916-017-0859-4, 42, 1, 1, 18

  26. Joshi, G. D., Sivaswamy, J., and Krishnadas, S. R., Optic disk and cup segmentation from monocular color retinal images for glaucoma assessment. IEEE Trans Med Imaging., 2011. https://doi.org/10.1109/TMI.2011.2106509.

  27. Cootes T. F, Taylor C. J, Cooper DH, Graham J (1995) Active shape models - their training and application. Comput Vis Image Underst. https://doi.org/10.1006/cviu.1995.1004

  28. Li H, Chutatape O (2003) Boundary detection of optic disk by a modified ASM method. Pattern Recognit. https://doi.org/10.1016/S0031-3203(03)00052-9

  29. Yin F, Liu J, Ong S. H, Sun Y, Wong D. W. K, Tan N. M, Cheung C, Baskaran M, Aung T, Wong T. Y (2011) Model-based optic nerve head segmentation on retinal fundus images. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS

  30. Hamednejad G, Pourghassem H (2017) Retinal optic disk segmentation and analysis in fundus images using DBSCAN clustering algorithm. In: 2016 23rd Iranian conference on biomedical engineering and 2016 1st international Iranian conference on biomedical engineering, ICBME 2016

  31. Khalid N. E. A, Noor N. M, Ariff N. M (2014) Fuzzy c-means (FCM) for optic cup and disc segmentation with morphological operation. In: Procedia Computer Science

  32. Thakur, N., and Juneja, M., Optic disc and optic cup segmentation from retinal images using hybrid approach. Expert Systems with Applications 127:308–322, 2019.

    Article  Google Scholar 

  33. Joshi G. D, Sivaswamy J, Krishnadas S. R (2012) Depth discontinuity-based cup segmentation from multiview color retinal images. IEEE Trans Biomed Eng. https://doi.org/10.1109/TBME.2012.2187293

  34. Cheng J, Liu J, Xu Y, Yin F, Wong D. W. K, Tan N. M, Tao D, Cheng C. Y, Aung T, Wong T. Y (2013) Superpixel classification based optic disc and optic cup segmentation for glaucoma screening. IEEE Trans Med Imaging. https://doi.org/10.1109/TMI.2013.2247770

  35. Xu Y, Duan L, Lin S, Chen X, Wong D. W. K, Wong T. Y, Liu J (2014) Optic cup segmentation for glaucoma detection using low-rank superpixel representation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)

  36. Tan N. M, Xu Y, Goh W. B, Liu J (2015) Robust multi-scale superpixel classification for optic cup localization. Comput Med Imaging Graph. https://doi.org/10.1016/j.compmedimag.2014.10.002

  37. Krizhevsky A, Sutskever I, Hinton G. E (2017) ImageNet classification with deep convolutional neural networks. Commun ACM. https://doi.org/10.1145/3065386

  38. Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd international conference on learning representations, ICLR 2015 - conference track proceedings

  39. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

  40. Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

  41. Chen L. C, Papandreou G, Kokkinos I, Murphy K, Yuille A. L (2018) DeepLab: Semantic image segmentation with deep convolutional nets, Atrous convolution, and fully connected CRFs. IEEE Trans Pattern Anal Mach Intell. https://doi.org/10.1109/TPAMI.2017.2699184

  42. Chen L. C, Zhu Y, Papandreou G, Schroff F, Adam H (2018) Rethinking Atrous convolution for semantic image segmentation. arXiv.org. https://doi.org/10.1159/000018039

  43. Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: Proceedings - 30th IEEE conference on computer vision and pattern recognition, CVPR 2017

  44. Muramatsu C, Nakagawa T, Sawada A, Hatanaka Y, Hara T, Yamamoto T, Fujita H (2009) Determination of cup-to-disc ratio of optical nerve head for diagnosis of glaucoma on stereo retinal fundus image pairs. In: Medical imaging 2009: Computer-aided diagnosis

  45. Zahoor M. N, Fraz M. M (2017) Fast optic disc segmentation in retina using polar transform. IEEE Access. https://doi.org/10.1109/ACCESS.2017.2723320

  46. Zuiderveld K (1994) Contrast limited adaptive histogram equalization. In: Graphics Gems

  47. Shankaranarayana S. M, Ram K, Mitra K, Sivaprakasam M (2017) Joint optic disc and cup segmentation using fully convolutional and adversarial networks. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)

  48. Singh V. K, Rashwan H. A, Akram F, Pandey N, Sarker M. M. K, Saleh A, Abdulwahab S, Maaroof N, Barrena J. T, Romani S, Puig D (2018) Retinal optic disc segmentation using conditional generative adversarial network. In: Frontiers in Artificial Intelligence and Applications

  49. Jiang Y, Tan N, Peng T (2019) Optic disc and cup segmentation based on deep convolutional generative adversarial networks. IEEE Access. https://doi.org/10.1109/ACCESS.2019.2917508

  50. Wang S, Yu L, Yang X, Fu C. W, Heng P. A (2019) Patch-based output space adversarial learning for joint optic disc and cup segmentation. IEEE Trans Med Imaging. https://doi.org/10.1109/TMI.2019.2899910

  51. Gehring J, Auli M, Grangier D, Yarats D, Dauphin Y. N (2017) Convolutional sequence to sequence learning. In: 34th international conference on machine learning, ICML 2017

  52. Decencière E, Zhang X, Cazuguel G, Laÿ B, Cochener B, Trone C, Gain P, Ordóñez-Varela J. R, Massin P, Erginay A, Charton B, Klein JC (2014) Feedback on a publicly distributed image database: The Messidor database. Image Anal Stereol. https://doi.org/10.5566/ias.1155

  53. Sivaswamy J, Krishnadas S. R, Joshi G. D, Ujjwal M. J, Tabish S (2014) Drishti-GS: Retinal image dataset for optic nerve head (ONH) segmentation. In: 2014 IEEE 11th international symposium on biomedical imaging, ISBI 2014

  54. Almazroa A. A, Alodhayb S, Osman E, Ramadan E, Hummadi M, Dlaim M, Alkatee M, Raahemifar K, Lakshminarayanan V (2018) Retinal fundus images for glaucoma analysis: The RIGA dataset

  55. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Download references

Acknowledgements

Thanks to the University of Chinese Academy of Sciences, UCAS Joint PhD Training Program. This work was supported in part by the Ministry of Science and Technology of China under project 2017YFC0112902.

Author information

Affiliations

  1. Laboratory for Medical Imaging Informatics, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai, 200083, China

    Zhe Xie, Tonghui Ling, Yuanyuan Yang & Rong Shu

  2. Laboratory for Medical Imaging Informatics, University of Chinese Academy of Sciences, Beijing, 100049, China

    Zhe Xie

  3. Department of Biomedical Engineering, Image Processing and Informatics Laboratory, University of Southern California, Los Angeles, CA, 90089, USA

    Brent J. Liu

Authors
  1. Zhe Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tonghui Ling
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuanyuan Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Rong Shu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Brent J. Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Brent J. Liu.

Ethics declarations

The authors declare that they have no conflict of interest. This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This article is part of the Topical Collection on Image & Signal Processing

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Xie, Z., Ling, T., Yang, Y. et al. Optic Disc and Cup Image Segmentation Utilizing Contour-Based Transformation and Sequence Labeling Networks. J Med Syst 44, 96 (2020). https://doi.org/10.1007/s10916-020-01561-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10916-020-01561-2

Keywords

  • Fundus image
  • Optic disc segmentation
  • Convolutional neural networks
  • Sequence labeling
  • Viterbi decoding
  • Glaucoma screening