Skip to main content
Log in

A generalized multi-scale line-detection method to boost retinal vessel segmentation sensitivity

  • Theoretical Advances
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

Many chronic eye diseases can be conveniently investigated by observing structural changes in retinal blood vessel diameters. However, detecting changes in an accurate manner in face of interfering pathologies is a challenging task. The task is generally performed through an automatic computerized process. The literature shows that powerful methods have already been proposed to identify vessels in retinal images. Though a significant progress has been achieved toward methods to separate blood vessels from the uneven background, the methods still lack the necessary sensitivity to segment fine vessels. Recently, a multi-scale line-detector method proved its worth in segmenting thin vessels. This paper presents modifications to boost the sensitivity of this multi-scale line detector. First, a varying window size with line-detector mask is suggested to detect small vessels. Second, external orientations are fed to steer the multi-scale line detectors into alignment with flow directions. Third, optimal weights are suggested for weighted linear combinations of individual line-detector responses. Fourth, instead of using one global threshold, a hysteresis threshold is proposed to find a connected vessel tree. The overall impact of these modifications is a large improvement in noise removal capability of the conventional multi-scale line-detector method while finding more of the thin vessels. The contrast-sensitive steps are validated using a publicly available database and show considerable promise for the suggested strategy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21

Similar content being viewed by others

References

  1. Hardarson S, Stefansson E (2010) Oxygen saturation in central retinal vein occlusion. Am J Ophthalmol 150:871–875

    Article  Google Scholar 

  2. Hardarson S, Stefansson E (2012) Retinal oxygen saturation is altered in diabetic retinopathy. Br J Ophthalmol 96:560–563

    Article  Google Scholar 

  3. Olafsdottir O, Hardarson S, Gottfredsdottir M, Harris A, Stefnsson E (2011) Retinal oximetry in primary open-angle glaucoma. Investig Ophthalmol Vis Sci 52:6409–6413

    Article  Google Scholar 

  4. Traustason S, Jensen A, Arvidsson H, Munch I, Sndergaard L, Larsen M (2011) Retinal oxygen saturation in patients with systemic hypoxemia. Investig Ophthalmol Vis Sci 52:5064–5067

    Article  Google Scholar 

  5. Diabetic retinopathy detection. https://www.kaggle.com/c/diabetic-retinopathy-detection (Feb 2015)

  6. Patton N, Aslam T, Macgillivray T, Pattie A, Deary IJ (2005) Retinal vascular image analysis as a potential screening tool for cerebrovascular disease: a rationale based on homology between cerebral and retinal microvasculatures. J Anat 206:319–348

    Article  Google Scholar 

  7. Wang JJ, Liew G, Klein R, Rochtchina E, Knudtson MD (2007) Retinal vessel diameter and cardiovascular mortality: pooled data analysis from two older populations. Eur Heart J 28:1984–1992

    Article  Google Scholar 

  8. Hubbard LD, Brothers RJ, King WN, Clegg LX, Klein R (1999) Methods for evaluation of retinal microvascular abnormalities associated with hypertension/sclerosis in the atherosclerosis risk in communities study. Ophthalmology 106:2269–2280

    Article  Google Scholar 

  9. Soomro TA, Gao J, Khan TM, Hani AFM, Khan MAU, Paul M (2017) Computerised approaches for the detection of diabetic retinopathy using retinal fundus images: a survey. Pattern Anal Appl 20(4):927–961

    Article  MathSciNet  Google Scholar 

  10. Soomro TA, Khan MAU, Gao J, Khan TM, Paul M (2017) Contrast normalization steps for increased sensitivity of a retinal image segmentation method. SIViP 11(8):1509–1517

    Article  Google Scholar 

  11. Soomro TA, Khan TM, Khan MAU, Gao J, Paul M, Zheng L (2018) Impact of ICA-based image enhancement technique on retinal blood vessels segmentation. IEEE Access. https://doi.org/10.1109/ACCESS.2018.2794463

    Article  Google Scholar 

  12. Khan MAU, Khan TM, Soomro TA, Mir N, Gao J (2017) Boosting sensitivity of a retinal vessel segmentation algorithm. Pattern Anal Appl. https://doi.org/10.1007/s10044-017-0661-4

  13. Saine PJ, Tyler ME (2002) Ophthalmic photography: retinal photography, angiography, and electronic imaging, 2nd edn. Butterworth-Heinemann, Boston

    Google Scholar 

  14. Cassin B, Solomon SAB (1996) Dictionary of eye terminology, 2nd edn, Triad Pub Co

  15. Pakter HM, Ferlin E, Fuchs SC, Maestri MK, Moraes RS (2005) Measuring arteriolar-to-venous ratio in retinal photography of patients with hypertension: development and application of a new semi-automated method. Am J Hypertens 18:417–421

    Article  Google Scholar 

  16. Wong TY, Knudtson MD, Klein R, Klein BEK, Meuer SM (2004) Computer-assisted measurement of retinal vessel diameters in the beaver dam eye study: methodology, correlation between eyes, and effect of refractive errors. Ophthalmology 111:1183–1190

    Article  Google Scholar 

  17. Soares JVB, Leandro JJG, Cesar RM, Jelinek HF, Cree MJ (2006) Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification. IEEE Trans Med Imaging 25(9):1214–1222

    Article  Google Scholar 

  18. Lindberg T (1990) Scale-space for discrete signals. IEEE Trans Pattern Anal Mach Intell 12:234–254

    Article  Google Scholar 

  19. Maji D, Santara A, Mitra P, Sheet D (2016) Ensemble of deep convolutional neural networks for learning to detect retinal vessels in fundus images. In: EMBC 2016—engineering in medicine and biology society computing research repository (CoRR)

  20. Staal J, Abramoff MD, Niemeijer M, Viergever MA, van Ginneken B (2004) Ridge-based vessel segmentation in color images of the retina. IEEE Trans Med Imaging 23(4):501–509

    Article  Google Scholar 

  21. Zana F, Klein J (2001) Segmentation of vessel-like patterns using mathematical morphology and curvature evaluation. IEEE Trans Image Process 10(7):1010–1019

    Article  MATH  Google Scholar 

  22. Azzopardia G, Strisciuglio N, Vento M, Petkov N (2015) Trainable COSFIRE filters for vessel delineation with application to retinal images. Med Image Anal 19(1):46–57

    Article  Google Scholar 

  23. Nguyen UTV, Bhuiyan A, Park LAF, Ramamohanarao K (2013) An effective retinal blood vessel segmentation method using multi-scale line detection. Pattern Recognit 46:703–715

    Article  Google Scholar 

  24. Fraz MM, Remagnin P, Hoppe A, Uyyanonvara B, Rudnicka AR, Owen CG, Barman SA (2012) Blood vessel segmentation methodologies in retinal images—a survey. Comput Methods Programs Biomed 108:407–433

    Article  Google Scholar 

  25. Chaudhuri S, Chatterjee S, Katz N, Nelson M, Goldbaumi M (1989) Detection of blood vessels in retinal images using two-dimensional matched filters. IEEE Trans Med Imaging 8(3):263–269

    Article  Google Scholar 

  26. Heneghan C, Flynn J, O’Keefe M, Cahill M (2002) Characterization of changes in blood vessel width and tortuosity in retinopathy of prematurity using image analysis. Med Image Anal 6(4):409–429

    Article  Google Scholar 

  27. Zhang B, Zhang L, Zhang L (2011) Retinal vessel extraction by matched filtering with first order Gaussian derivative. Comput Biol Med 40(4):438–445

    Article  Google Scholar 

  28. Frangi AF, Niessen WJ, Vincken KL, Viergever MA (1998) Multiscale vessel enhancement filtering. In: Wells WM, Colchester A, Delp S (eds) Medical image computing and computer-assisted intervention-MICCAI’98. MICCAI 1998, Lecture notes in computer science, vol 1496, Springer, Berlin, pp 130–137

  29. Leontidis G (2014) Retinal vessel segmentation using two-dimensional second-order Gaussian filter and clustering algorithm. Afr Dev Resour Res Inst (ADRRI) J 6(6):14

    Google Scholar 

  30. Ricci E, Perfetti R (2007) Retinal blood vessel segmentation using line operators and support vector classification. IEEE Trans Image Process 26(10):1357–1365

    Article  Google Scholar 

  31. Hou Y (2014) Automatic segmentation of retinal blood vessels based on improved multiscale line detection. J Comput Sci Eng 8(2):119–128

    Article  Google Scholar 

  32. Sigursson EM, Valero S, Benediktsson JA, Chanussot J, Talbot H, Stefnsson E (2014) Automatic retinal vessel extraction based on directional mathematical morphology and fuzzy classification. Pattern Recognit Lett 47:164–171

    Article  Google Scholar 

  33. Talbot H, Appleton B (2007) Efficient complete and incomplete path openings and closings. Image Vis Comput 25:416–425

    Article  Google Scholar 

  34. Valero S, Chanussot J, Benediktsson J, Talbot H, Waske B (2010) Advanced directional mathematical morphology for the detection of the road network in very high resolution remote sensing images. Pattern Recognit 31:1120–1127

    Article  Google Scholar 

  35. Valero S, Chanussot J, Benediktsson JA, Talbot H (2009) D’etection automatique du r’eseau vasculaire r’etinien bas’ee sur la morphologie directionnelle et la fusion de d’ecision. XIIe Colloque GRETSI

  36. Dragut L, Eisank C, Strasser T (2011) Local variance for multi-scale analysis in geomorphometry. Geomorphology 130:162–172

    Article  Google Scholar 

  37. Gottschlich C, Schonlieb C-B (2012) Oriented diffusion filtering for enhancing low-quality fingerprint images. IET Biom 1(2):105–113

    Article  Google Scholar 

  38. Feng X (2003) Analysis and approaches to image local orientation estimations. M.S. thesis, University of California Santa Cruz

  39. Canny JA (1986) Computational approach to edge detection. IEEE Trans Pattern Anal Mach Intell 8(6):679–698

    Article  Google Scholar 

  40. Kanan C, Cottrell GW (2012) Color-to-grayscale: does the method matter in image recognition? PLOS One 7:1–7

    Article  Google Scholar 

  41. Niemeijer M, Staal J, van Ginneken B, Loog M, Abramoff MD (2004) Comparative study on retinal vessel segmentation methods on a new publicly available database. In: Medical imaging, vol 5370. SPIE , pp 608–656

  42. Mendonca AM, Campilho A (2006) Segmentation of retinal blood vessels by combining the detection of centerlines and morphological reconstruction. IEEE Trans Med Imaging 25:1200–1213

    Article  Google Scholar 

  43. Jiang X, Mojon D (2003) Adaptive local thresholding by verificationbased multithreshold probing with application to vessel detection in retinal images. IEEE Trans Pattern Anal Mach Intell 254(1):131–137

    Article  Google Scholar 

  44. Reyes-Aldasoro CC (2009) Retrospective shading correction algorithm based on signal envelope estimation. Electron Lett 45(9):454–456

    Article  Google Scholar 

  45. Sinthanayothin C, Boyce JF, Cook HL, Williamson TH (1999) Automated localisation of the optic disc, fovea and retinal blood vessels from digital colour fundus images. Br J Ophthalmol 83:902–910

    Article  Google Scholar 

  46. Pratt WK (2001) Digital image processing. Wiley, New York

    Book  MATH  Google Scholar 

  47. Kass M, Witkin A (1987) Analyzing oriented patterns. Comput Vis Graph Image Process 37(3):362–385

    Article  Google Scholar 

  48. Khan MAU, Khan MK, Khan MA, Rehman T (2004) A decimation free directional filter bank for medical image enhancement. Inf Technol J 3(2):146–149

    Article  Google Scholar 

  49. Khan MAU, Khan MK, Khan MA (2005) Comparative analysis of decimation-free directional filter bank with directional filter bank: in context of image enhancement. In: Proceedings of the 9th international multitopic conference, IEEE INMIC. Karachi, pp 1–8

  50. Truc PTH, Khan MAU, Lee YK, Kim TS (2009) Vessel enhancement filter using directional filter bank. Comput Vis Image Underst 113:101–112

    Article  Google Scholar 

  51. Khan TM, Khan MAU, Kong Y (2014) Fingerprint image enhancement using multi-scale DDFB based diffusion filters and modified Hong filters. Opt Int J Light Electron Opt 25:4206–4214

    Article  Google Scholar 

  52. Bamberger RH (1992) The directional filter bank: a multirate filter bank for the directional decomposition of images. Ph.D. thesis, Georgia Institute of Technology, Atlanta, Georgia

  53. Khan MAU, Alhalabi W (2013) Robust multi-scale orientation estimation: spatial domain vs Fourier domain. In: International conference on communications, signal processing, and their applications

  54. Khan MAU, Ullah K, Khan A, Islam IU (2014) Robust multi-scale orientation estimation: directional filter bank based approach. Elsevier J Appl Math Comput 242:814–824

    Article  MATH  Google Scholar 

  55. Granlund GH (1978) In search of a general picture processing operator. Comput Graph Image Process 8:155–173

    Article  Google Scholar 

  56. Kirk K, Andersen HJ (2006) Noise characterization of weighting schemes for combination of multiple exposures. In: British machine vision conference, 2006, pp 1129–1136

  57. Hartung J, Knapp G, Sinha BK (2008) Statistical meta-analysis with applications. Wiley, New York

    Book  MATH  Google Scholar 

  58. Wang Y, Fang B, Pi J, Wu L, Wang P, Wang H (2013) Automatic multi-scale segmentation of intrahepatic vessel in CT images for liver surgery planning. Int J Pattern Recognit Artif Intell 27(1):1357001

    Article  MathSciNet  Google Scholar 

  59. Soler L, Delingette H, Malandain G, Montagnat J, Ayache N, Koehl C, Dourthe O, Malassagne B, Smith M, Mutter D, Marescaux J (2001) Fully automatic anatomical, pathological, and functional segmentation from CT scans for hepatic surgery. Comput Aided Surg 6(3):131–142

    Article  Google Scholar 

  60. Dunn ME, Joseph SH (1988) Processing poor quality line drawings by local estimation of noise. In: 4th international conference on pattern recognition, pp 153–162

  61. Pridmore TP (2002) Thresholding images of line drawings with hysteresis. In: Fourth international workshop on graphics recognition algorithms and applications, pp 310–319

  62. Luu HM, Klink C, Moelker A, Niessen W, van Walsum T (2015) Quantitative evaluation of noise reduction and vesselness filters for liver vessel segmentation on abdominal CTA images. Phys Med Biol 60(10):3905–3926

    Article  Google Scholar 

  63. Digital retinal image for vessel extraction (DRIVE) database. http://www.isi.uu.nl/Research/Databases/DRIVE

  64. Structured analysis of the retina (STARE) database. http://cecas.clemson.edu/~ahoover/stare/

  65. Martinez-Perez ME, Hughes AD, Thom SA (2007) Segmentation of blood vessels from red-free and fluorescein retinal images. Med Image Anal 11(1):47–61

    Article  Google Scholar 

  66. Vlachos M, Dermatas E (2009) Multi-scale retinal vessel segmentation using line tracking. Comput Med Imaging Graph 34(3):213–227

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tariq M. Khan.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Khan, M.A.U., Khan, T.M., Bailey, D.G. et al. A generalized multi-scale line-detection method to boost retinal vessel segmentation sensitivity. Pattern Anal Applic 22, 1177–1196 (2019). https://doi.org/10.1007/s10044-018-0696-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10044-018-0696-1

Keywords

Navigation