Abstract
This paper proposes a novel Adaptive Region-based Edge Smoothing Model (ARESM) for automatic boundary detection of optic disc and cup to aid automatic glaucoma diagnosis. The novelty of our approach consists of two aspects: 1) automatic detection of initial optimum object boundary based on a Region Classification Model (RCM) in a pixel-level multidimensional feature space; 2) an Adaptive Edge Smoothing Update model (AESU) of contour points (e.g. misclassified or irregular points) based on iterative force field calculations with contours obtained from the RCM by minimising energy function (an approach that does not require predefined geometric templates to guide auto-segmentation). Such an approach provides robustness in capturing a range of variations and shapes. We have conducted a comprehensive comparison between our approach and the state-of-the-art existing deformable models and validated it with publicly available datasets. The experimental evaluation shows that the proposed approach significantly outperforms existing methods. The generality of the proposed approach will enable segmentation and detection of other object boundaries and provide added value in the field of medical image processing and analysis.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Avoid common mistakes on your manuscript.
Introduction and background
Automated boundary detection of optic disc and cup plays an important role for the computer-aided diagnosis of retinal diseases from ophthalmic images. In a typical 2-Dimensional (2D) retinal image, the optic disc is a bright elliptical structure with a cup and surrounding rim tissue. Changes in the shape and depth of the cup or colour of the rim tissue represent signs of optic neuropathology such as glaucoma, which is a leading cause of irreversible blindness. In the case of glaucoma, nerve fibre atrophy is accompanied by erosion of rim tissue, which manifests as cup enlargement. The degree of cupping is quantified clinically as the horizontal, vertical and area Cup-to-Disc Ratio (CDR) (Figs. 1 and 2) [1, 2]. In current clinical practise, the size of the cup relative to the disc is estimated subjectively which is both time-consuming and prone to inter-observer variability [3]. Therefore, accurate automatic boundary detection of optic disc and cup is critical for the diagnosis of glaucoma.
Some research efforts have been made on automatic segmentation of the optic disc or optic cup [4,5,6,7,8,9,10,11]. These efforts can be broadly divided into two categories: non-model-based and model-based approaches. In the non-model-based approaches [12,13,14,15] the boundary detection mainly uses some algorithms such as thresholding, morphological operations, pixel clustering etc. However, the identification process of the optic disc boundary had some problems due to obscuration by bridging retinal vessels. The model-based approaches can be classified into shape-based template matching and deformable modelling approaches. The template matching focuses on incorporating the shape of the object and its grey-level appearance in an image by matching optic disc edge with a circular [16, 17] or elliptical shape [18]. But these methods suffer from inaccuracy since they often fails to detect shape irregularity due to the shape variation of an object. The deformable modelling can be further classified into either free-form or parametric deformable models. The free-form deformable models have no global structure of the template, which can freely deform the shape of an object. Typical examples of free-form deformable models include the active contour or ‘snakes’ model (ACM), level-set model [19,20,21] and Chan-Vese (C-V) level set model [22] (a type of ACM model without edge) and their variations [23,24,25,26,27,28]. The parametric deformable models involve an offline training process to determine a shape model parameterising diverse shape characteristics, such as Active Shape Model (ASM) [29,30,31]. The ASM-based approach refers to shape approximation of an object using statistical approaches to learn the boundary shape of the optic disc from a training set [32,33,34].
The aforementioned deformable models have shown promise for segmentation of the optic disc or cup. However, there are still challenges related to achieving high accuracy in optic disc and cup segmentation. For instance, in some cases, the optic disc might not have a distinct edge due to disc tilting or peripapillary atrophy (PPA) and disc vessels could misguide the segmentation. The ASM does not adequately segment optic discs with PPA [34]. Additionally, since pathological changes may arbitrarily deform the shape of the optic disc and also distort the course of blood vessels, the existing ASM-based approaches fail to accurately extract the object boundary with variation and irregularity and are influenced by blood vessel obscuration. The modified ACM approach as proposed by Xu and colleagues [35] have addressed optic disc segmentation problems due to vasculature occlusion and PPA by adjusting the uncertain cluster points of the contour. Nevertheless, they have also observed optic disc segmentation failures due to retinal atrophy or bright retinal lesions. Furthermore, the method is dependent on initialisation parameters as it relies on local gradient information only. The accuracy of the Chan-Vese (C-V) level set model is dependent on the initialisation parameters as well. Despite the application of gabor filters at different frequencies used after vasculature removal to reduce the PPA occlusion [23], the filtering parameters may need to be modified manually for better accuracy. Vasculature removal with morphological filtering can also diminish the optic disc edges which can affect the segmentation accuracy.
To address the limitations above, this research has proposed a novel adaptive deformable model for automatic segmentation of the optic disc and cup capable of capturing shape variation and irregularity. Our approach doesn’t need to fit a predefined template or shape constraints. The major contributions include:
-
1.
A new Region Classification Model (RCM) which identifies the initial optimum contour approximation representing optic disc or cup boundary between inside and outside a Region of Interest (ROI) based on pixel-wise classification in a multidimensional feature space (with features extracted on the pixel level). The multidimensional feature space represents the local textural, gradient and frequency based information which is used as input for training a backpropagation Neural Networks classification model of an optimum contour approximation.
-
2.
A new Adaptive Edge Smoothing Update model (AESU) for contour regularisation and smoothing update based on iterative force field calculations with any contour obtained from the RCM.
The rest of this paper is organised as follows: “The proposed adaptive region-based edge smoothing deformable model” details the proposed model; “Experimental evaluation” describes datasets used, evaluation metrics and experimental results; “Conclusion” concludes the work and highlights future work.
The proposed adaptive region-based edge smoothing deformable model
The rationale
The proposed adaptive region-based edge smoothing model (ARESM) aims to accurately detect the boundary of an object and search optimum contour points in an iterative way. As shown in Fig. 3, the principles of the proposed method mainly include: 1) The Region Classification model (RCM) that generates the initial optimum contour; 2) the Adaptive Edge Smoothing Update (AESU) model that dynamically updates the initial optimum contour obtained from the RCM for accurate detection of the boundary. The segmentation focuses on the pixel-based image representation in a multidimensional feature space by applying Gaussian [36], Dyadic gaussian [37] and Gabor filters [38] at different scales on both the red and green image channels to make use of local information and provide power in capturing shape variation and irregularity.
Different from the existing approaches, the proposed method extracts the feature information at the pixel-level, identifies the initial optimum contour based on regional classification, and dynamically updates the contour without requiring a predefined template such as a circular or elliptical shape. The model uses only once the mean of shapes in the training set as an initial parameter. The model will then search the optimum contour points based on the RCM classification, which is not necessarily identical with the landmarks of the mean shape and may dynamically change during the search. The shape irregularities and misclassified contour points are then dynamically updated and smoothed by the AESU model through the minimisation of energy function based on the force field direction. The proposed approach can capture shape variations and irregularity very well, for example, in the presence of PPA or vasculature occlusion.
Pixel-based image representation in multidimensional feature space
To provide robustness against variations found in and around the Region of Interest (ROI), we consider features on the pixel-level to fully take advantage of local image information. Each pixel of an image belongs to a homogenous region corresponding to an object or part of an object. We have generated a multidimensional feature map by applying the Gaussian, Dyadic Gaussian and Gabor filters at different scales on both the red and green channel of an image. These features represent the gradient, texture and the frequency based information. The details of these features have been based on our previous work [40] and are summarised in Table 1. This is in contrast to the previous pixel-based approaches which focus on either the red channel or its gradient. The advantage is to extract the representative pixel-level features of an image and accurately classify between the region inside and outside the boundary of an object (e.g. optic disc or cup). For the boundary of the optic disc, its region outside includes the retinal area and the PPA and the region inside includes Optic Nerve Head (ONH) rim and optic cup. For the boundary of the optic cup, we extract features and classify between the region inside of the optic cup and the ONH rim. The retinal vasculature area is also converged inside the ONH area and obscures both the optic disc and the optic cup margin. To investigate the influence of vasculature, we have calculated the feature map under two situations: a) with vasculature removal and b) without vasculature removal. The comparison of the classification power of the features with and without vasculature removal has been described in the experimental section.
Contour profile sampling steps to determine the disc boundary in this challenging optic nerve photo due to extensive PPA with a Mean shape initialisation, b Sampling the search line (red) normal to the contour point. Each sample on the search line has its subline samples. c Determination of optimal sample on the search line
Feature extraction and selection
The feature space after applying the different filters above on the pixel-level is of high dimensionality. To obtain the most relevant features for the respective classification, we have adopted iterative sequential maximisation of task performance (also called the ‘wrapper feature selection’ [41]) in which initially the data is divided into k folds (in our case k = 5). Then the first feature is selected which has maximum mean classification performance across the folds. During subsequent iterations, the features together with previously selected features resulting in the highest mean classification performance are selected. This process continues until there is little or no maximisation (less than 0.01) towards classification performance. For the quantification of classification performance, we have certain performance measures such as Area Under the Curve (AUC), Linear Discriminant Analysis (LDA) accuracy and Quadratic Discriminant Analysis (QDA) accuracy [42].
Region classification model for initial optimum contour approximation
The RCM consists of two main steps: 1) Initialisation of shape or contour profile; 2) Contour profile optimisation.
Initialisation of shape or contour profile
The RCM requires an initial shape profile which is then dynamically updated. In our approach, we use the mean of the shape from the training set as an initial input. It is worth noting that the initial optimum contour profile is not necessarily identical with the mean shape and can dynamically change during the search. To obtain the initial shape (the mean of the shapes), we have used Procrustes alignment [43]. The shape alignment aims to transform all training set shapes into a common coordinate frame. Given an object shape, described by n points, referred to as landmark points which can be obtained from the training sample images manually annotated by clinicians. Each shape can be described as a vector of n coordinate pairs having 2n elements as mentioned below:
The shape alignment can be achieved by translating the shapes to the origin. Initially, the centroid of each shape is calculated as the average position of all its landmarks, then the shapes are translated to its local origin by subtracting its centroid. The centroid of the shape can be represented as:
and the shapes are translated to the origin as:
where, \(\textbf {v}_{trans}=\textbf {v}-(\frac {1}{n}{\sum }_{j = 1}^{n} x_{j},\frac {1}{n}{\sum }_{j = 1}^{n} y_{j})\) is the shape translated to local origin after subtracting its centroid. We obtain the mean of N aligned shapes present in the training set as:
Contour profile optimisation
After obtaining the mean shape from the training set (Fig. 4a), we determine a preliminary optimum contour around this initial region. The essence is to find the best contour points around the initial region (the mean shape). We have developed a classification model based on a backpropagation artificial neural network (ANN) [42] that creates a classification of pixels as likely belonging to the optic disc or to background. We have performed a search to find an initial outline of the optic disc. A search is made along the n p samples of each radial line extending from the centre to the edge of the image, as shown in Fig. 4b. A sliding window of length 2m+ 1, where m= 7 was defined empirically, traversed the radial line (Algorithm 1), to find the optimum transition from pixels which were highly likely to be optic disc to pixels highly likely to be background, as determined by the ANN (Fig. 4c). The optimum transition is where Eq. 5 is minimised. Considering that whilst training the classification model (i.e. backpropagation ANN classification model in our case), the samples outside the optic disc are labelled as 0 and samples inside the optic disc region are labelled as 1, we have the equation to determine optimum position of the contour point:
where g is the subline of 2m + 1 subsamples and g k is the subsample of the subline g. The value of j corresponds to the sample at the search line. The factor \(\frac {{\sum }_{k = 1}^{m}net_{j}(g_{k})}{m}\) is supposed to be a group of subsamples from outside of the optic disc and expected to have logistic output near to 0 whereas the factor \(\frac {{\sum }_{k=m + 2}^{2m + 1}net_{j}(g_{k})}{m}\) is expected vice versa. n e t j (g) is the neural weight of the respective profile at sample j of the search line which is obtained based on ANN with the backpropagation algorithm. The ANN is composed of an input layer, a hidden layer and an output layer. The number of units in the input layer are equal to the number of selected features. The hidden layer is the weighted combination of units of the input layer. In the backpropagation algorithm, the weights of the hidden and the output layer are adjusted according to the error between the expected output and the actual output. The logistic output of the ANN is given with the following sigmoid function as:
The variables w i and w h represent the weights to the input of output layer and hidden layer respectively, w o is the bias input value, whereas x i are samples from the selected feature maps. The optimisation algorithm is shown in Algorithm 1.
![figure a](http://media.springernature.com/lw685/springer-static/image/art%3A10.1007%2Fs10916-017-0859-4/MediaObjects/10916_2017_859_Figa_HTML.gif)
The RCM proves to be accurate and shows most of the contour points have been classified correctly as the optic disc boundary (Fig. 5a). However, some of the contour points can be misclassified on disc with extensive cupping and PPA as shown in Fig. 5b, c. Therefore, in order to overcome the classification error, we have developed an adaptive edge smoothing scheme to perform the contour update as explained in subsequent sections.
Adaptive edge smoothing update
After the determination of tentative optimum contour Y from the RCM above, the shape can still be irregular due to misclassification as shown in Fig. 5b. There have been several techniques such as least square regression or circular or ellipse fitting to approximate the shape of the contour [16,17,18]. However, these methods have limited capability in detecting shape irregularity. The ASM shape approximation approach tends to keep the shape consistent with the mean shape of the training set (the shape parameter is static) and can not dynamically adapt to the actual boundary of the object (as each object has its variability). Different from existing methods, we propose an adaptive edge smoothing update (AESU) model to dynamically update the contour profile generated from the RCM. The AESU is an iterative model which is updated according to the force field direction in every step by a minimising energy function of grey-level image I as \(\epsilon = \int \int ({u_{x}^{2}}+{u_{y}^{2}}+{v_{x}^{2}}+{v_{y}^{2}})+||\nabla I||^{2}||\textbf {F}-\nabla I||^{2}dxdy\) computed from Gradient Vector Flow (GVF) [44]. For minimisation of energy function, we need to determine force field F(x,y) = [u(x,y),v(x,y)] at pixel (x,y). The u x , u y , v x and v y are force field derivatives along the x and y direction. In contrast to existing approaches such as the Hough transform, we need not assume that the optic disc is either circular or elliptical in shape. The optimum contour Y obtained from the RCM can be redefined as:
where x c and y c are the centre of the contour Y. In the first step of the iteration, they can be taken from mean of Y from the RCM in both x and y directions respectively. D i and 𝜃 i are distances from the mean and angle from the x-axis, respectively. We have n coordinate pairs and for each case, 𝜃 i can be given as:
In the first iteration, we can calculate the force at the contour point defined as follows:
where \(N_{D_{i}}\) is the number of neighbourhood points lying between the range [\(\theta _{i}-\frac {2\pi }{N_{D_{i}}}\) \(\theta _{i}+\frac {2\pi }{N_{D_{i}}}\)]. The idea is to determine the force field including the contour point and its neighbour so as to avoid false edges due to occlusion. After determining the force field, the distances of the contour from the centre can be updated as:
where t D is the threshold which can be determined empirically based on the average force field of each contour point in the training set. Like the distance, the centre of the contour will also be updated. This can be achieved by defining the contour force in horizontal (F c h ) and vertical (F c v ) directions. We can define these forces as:
The contour centre can be updated as:
where t c is the threshold which can be determined empirically based on minimum centre force field in the training set. The contour is updated as:
This iterative process continues until convergence, i.e. F(Y x n e w ,Y y n e w ) −∇I ≈ 0. The update process is illustrated in Fig. 6.
ARESM application to segmentation of optic disc and cup
Optic disc segmentation
Due to differences between the optic disc and optic cup, we have applied our proposed approach with a certain customisation for segmentation of the optic disc and cup, respectively. Optic disc localisation is the first step towards accurate segmentation of optic disc and cup. We have described our optic disc localisation method in [40]. It is based on enhancing both the optic disc and retinal vasculature convergence point whilst avoiding bright lesions and instrument reflections. The method is capable of locating the point somewhere within the optic disc boundary. However, the region initialisation can be more accurate if it is located closer to the optic disc centre. The optic disc centre can be readjusted to the centroid of the overlap area of the vasculature structure and the optic disc segmented within the area twice the size of optic disc. The vasculature can be segmented as mentioned in [45] whereas the optic disc can be segmented by binary classification from the RCM. The overview of optic disc segmentation is shown in Fig. 7. Furthermore, the optimum contour obtained from the RCM needs to be updated according to the AESU model which updates the contour according to the force field direction in every step by minimising energy function. To reduce undesirable influence of vasculature obscuration or PPA, and enhance the region of interest, we calculate the external energy of the image as the convolution between the image and the DoG filter which is the difference between two Gaussian filters defined at different scales, i.e. \(-{\Gamma }_{\sigma _{1},\sigma _{2}}(x,y)*I(x,y)\), where \({\Gamma }_{\sigma _{1},\sigma _{2}}(x,y)\) as defined in Table 1.
Optic cup segmentation
Compared to the optic disc segmentation, the optic cup segmentation is a more challenging task for two reasons: a) there is no clear or distinct boundary between optic cup and rim of optic disc and b) vasculature occlusion. We have adapted our proposed approach to optic cup segmentation in two ways: a) the use of the prior knowledge in the RCM for accurate detection of optic cup by adding an additional feature, namely distance maps; b) adaptive smoothing update using the weighted features to make the optic cup force field more influential and enhance the region of interest (ROI) by performing multiplication between the external energy function and the weighted features from the RCM.
Normally, the optic cup has higher vasculature occlusion since the vascular tree converges towards the centre of the optic cup. This occlusion can affect the brighter portion of optic cup, which can distinguish between optic disc rim and optic cup, especially in case of normal images. Therefore we have introduced the Distance Map as an additional feature (the prior knowledge) to the classification model (RCM) between the optic disc rim and the optic cup. The distance map can be determined by the Eq. 14:
where Y x i n e w , Y y i n e w are updated contour points by AESU from Eq. 13 and x c n e w , y c n e w are the updated centre. The concept behind adding the distance map is based on the fact that there is a higher probability of optic cup if the pixel lies near the centre of the optic disc. Therefore, the prior values for the pixel near the optic disc centre would be higher than the those away from the centre. Optic cup segmentation is performed after optic disc segmentation. Therefore the feature training will be performed between the optic disc rim and the optic cup. As an example, the distance map for the optic cup is shown in Fig. 8.
Since the gradient is a very poor approximation of the boundary between the rim and the cup, we have redefined the external energy function by multiplying the weighted features obtained from the RCM. The purpose of performing the multiplication is to enhance the gradient for determining optic cup boundary. The modified external energy function for the optic cup is \(-{\Gamma }_{\sigma _{1},\sigma _{2}}(x,y)*I(x,y).*net_{c}\), where . ∗ is dot multiplication, I(x,y) is the feature map best suited for optic cup segmentation and n e t c is weighted features based on logistic output of the ANN. The workflow of the optic cup segmentation is shown in Fig. 9.
Experimental evaluation
Evaluation metrics
The optic disc and cup segmentation results have been compared with the masks obtained from the clinical annotations. The Dice Coefficient is used to determine the degree of overlap of the mask from clinical annotation and segmentation results and for determining the extent to which the segmented objects match [32, 46], defined as follows:
where A and B are the segmented regions surrounded by model boundary and annotations from the ophthalmologists respectively, ∩ represents intersection. Its value varies between 0 and 1. A higher value means an increased degree of overlap. For optic cup segmentation accuracy, it is dependent on accurate optic disc segmentation as defined as follows:
where R i m 1 and R i m 2 are the rim pixels and O C 1 and O C 2 are the optic cup pixels obtained from the benchmark and the automatic segmentation respectively, N t o t = R i m 1 + R i m 2 + O C 1 + O C 2.
The performance of our approach has also been evaluated by determining mean absolute difference between a clinical CDR and a CDR from the automatic segmentation results. The absolute difference can be given as:
where C D R c is CDR from clinical annotations and C D R s is the CDR from segmentation results. The CDR values have been evaluated in vertical, horizontal meridian as well as ratio of area covered by optic cup to the area covered by optic disc.
Datasets
To validate the proposed approach, we have used two publicly available datasets: RIM-ONE [47] and Drishti-GS datasets [48]. The datasets used in the experiments include retinal images consisting of normal, glaucoma and glaucoma suspect images. The number of images in total is 209.
RIM-ONE (An Open Retinal Image Database for Optic Nerve Evaluation) [47] is a fundus image dataset. The latest release is composed of 85 normal, 39 glaucoma and 35 glaucoma suspect images; 159 in total with dimensions of 1072 × 1424 pixels. All the images have been annotated by two experts with boundaries of optic disc and optic cup. The interobserver variability of the RIM-ONE dataset has been calculated by the Dice Coefficients (“Evaluation metrics”) as shown in Table 2. There is 5% difference for optic disc and 7% difference for optic cup with 2% standard deviation on average amongst different annotations from the experts. Therefore, we evaluated the mean of annotations of both experts for each optic disc and cup in each image. An averaged outline of the annotations of all experts was obtained by taking, at each angle, the mean distance to the annotations from the mean centroid. The retinal images were obtained from three different hospitals across different regions of Spain to ensure a collection of representative and heterogeneous dataset. All images are non-mydriatic retinal photographs, which were collected with specific flash intensities to avoid saturation. This dataset has been used for the training and testing.
Drishti-GS dataset contains 50 images [48] in total. All images were captured at Aravind Eye Hospital, India. The patients were selected based on the age (ranging from 40 to 80 years old) and the gender (roughly equal number of males and females). The images taken were centred around optic disc with a field-of-view(FOV) of 30-degrees and of dimensions 2896 × 1944 pixels and PNG uncompressed image format. Four experts with various clinical experiences of 3, 5, 9 and 20 years annotated optic disc and optic cup of the images (Table 2). Drishti dataset does not specify if the image is glaucomatous or not. However, its average CDR values are comparatively higher than those in RIM-ONE (Table 3). This dataset has been used for the testing purpose only.
Model parameterisation
The ARESM requires parameterisation for accurate boundary detection and segmentation, which are related to several factors: 1) whether vasculature removal is required before feature selection; 2) feature selection; 3) training protocol and 4) classifier and contour profile optimisation parameters. The following sections details the approach of model parameterisation.
Determination on whether vasculature removal is required
For the determination of feature sets for the RCMs of the optic disc and optic cup, we have the features determined with and without vasculature removal. The results of the features with highest Individual Classification Performance (ICP) (which is the measure of individual performance of each feature in terms of classification power) for both cases with and without vasculature removal is shown in Fig. 10.
The ICPs have been measured in terms of AUC value for individual features. The results show that for both optic disc and optic cup, the features calculated with vasculature removal have higher ICPs compared to those calculated with and without vasculature removal. Therefore we have determined the feature set on those after vasculature removal.
Feature selection
The results of the feature selection procedure with different performance measures (as discussed in “Feature extraction and selection”) are shown in Fig. 11. The results show that if the features are selected by AUC as performance measure of sequential maximisation, we can achieve significantly higher classification accuracy compared to other performance measures. The list of selected features in Table 4 (also represent x-axis of Fig. 11 for features selected by AUC sequential maximisation) show that the Gaussian derived features dominate the feature set for the optic disc extraction since they have strong edge information at different scales. The feature sets selected for optic cup extraction are mostly dominated by Gaussian features and Dyadic Gaussian Features.
Training protocol
The training was performed on the RIMONE dataset with 2-fold cross validation i.e. training one part whilst testing the other. The Drishti dataset has been tested on the model built upon the RIMONE dataset.
As far as the training is concerned, we have a binary classification problem for generating RCMs for both optic disc and optic cup. The pixel-wise training can make the training set very large which can slow down the training process. Also for the optic disc, we need to train the features which are part of the atrophy region as well as the retinal area. Therefore, we have divided optic disc into 3 zones in which zone-1 and zone-2 belong to class-0 (outside optic disc) and zone-3 belong to class-1 (inside optic disc) (Fig. 12). Zone-1 belongs to retinal area whereas zone-2 belongs to the atrophy region. We have randomly selected 2000 samples from zone-3 and 1000 samples from each zone-1 and zone-2 of each optic disc cropped image in the training set. For optic cup, the procedure is the same except that we have removed vasculature area after segmenting out and morphological closing [45] as well as the training has been performed between the optic cup and the rim inside optic disc.
As far as training parameters are concerned in “Contour profile optimisation”, we have trained a single layer backpropagation neural networks with the number of input and hidden neurons equal to the number of selected features (20 for optic disc and 25 for optic cup). However, the hidden neurons vary from 15 to 30 which will give a similar result. Other parameters include n p = 25 − 35, m = 7 − 10, n = 200 (optic disc), 100 (optic cup).
Accuracy comparison with state-of-the-art approaches
The optic disc and cup segmentation accuracy were determined on the basis of the following aspects:
-
Accuracy performance comparison with the previous approaches.
-
Accuracy performance comparison based on CDR values (Cup-Disc-Ratio).
Optic Disc Segmentation Accuracy Comparison
We applied our approach to the datasets above and compared it with existing approaches including ASM [29,30,31], ACM [19, 49] and Chan-Vese (C-V) [22, 50] models. We used the mean Dice Coefficient D to measure the accuracy of the optic disc segmentation across different datasets and methods as shown in Table 5. Some examples of optic disc segmentation results based on different methods are shown in Fig. 13. The second and third rows in Fig. 13 present the optic disc boundary segmentation by the different methods in the presence of PPA.
Based on the results, our proposed approach yield the highest Dice Coefficients in comparison with the existing models. Figure 13c shows the examples of visual results. The ASM model-based segmentation is misguided as the mean of the shape in the training set keeps constant (once it is trained). Figure 13d shows the examples of visual results. The ACM and C-V model-based segmentations are comparable to our approach on these images. Nevertheless their performance is uncertain as presented in other examples. The ACM is dependent on the strong edges of the optic disc which might not be the case in every example. The examples of visual results are shown in Fig. 13e. Optic disc margin segmentation errors can occur using the Chan Vese model when PPA is present (Fig. 13f). For RIM-One dataset, the average accuracy of optic disc segmentation is 91%. The accuracy of Drishti-GS is 95%.
Optic cup segmentation accuracy comparison
Compared to optic disc segmentation, optic cup segmentation is more challenging as there is no clear or distinct boundary of the optic cup. The cup has a volume and the image is really a 2d presentation of a 3D structure. Moreover, in the normal optic nerve the cup is typically smaller and it’s margins are often obscured by retinal vessels. Previous methods such as the Fuzzy C-means (FCM) clustering [51] and thresholding [52] often fail to correctly outline the optic cup boundary. Since the proposed approach is based on the deformable model approach, we have compared our method with existing deformable approaches (ASM, ACM, C-V). The performance of our proposed approach produces the highest Dice Coefficients compared to these approaches in both large and small size optic cups as shown in Table 6. Some examples of optic cup segmentation results are shown in Fig. 14.
The results suggest that the proposed method has achieved high accuracy, in comparing with the existing approaches. The reason is that optic cup segmentation has been highly dependent on the accurate optic disc segmentation. Moreover, the algorithms like ACM and C-V are not converged in the case of cup segmentation. The ASM produces annotation failures due to vasculature occlusion which is not the case in the ARESM. The ARESM method does fail in some of the normal images due to their very small size of optic cup. Nevertheless, the cup segmentation has an average accuracy of 89% for RIM-ONE and 81% for Drishti-GS database images.
Accuracy Comparison based on CDR
CDR is an important indicators related to glaucoma diagnosis. Accurate automated CDR assessment requires precise assessment of the cup and disc margins compared to an acceptable reference standard.
In order to compare the clinical manual CDR and automatically determined CDR, we have used the RIM-ONE dataset in which both the optic disc and optic cup have been manually annotated by clinicians. Hence the manual CDR values can be calculated from these two datasets in the a) vertical meridian, b) horizontal meridian; and c) area. However, CDR in the vertical meridian is used most commonly by clinicians in optic nerve evaluation for glaucoma [1].
Both datasets contain three types of images: normal, glaucoma and glaucoma suspect images. Therefore, we have evaluated the CDRs (i.e. vertical CDR, horizontal CDR and area CDR) in two sets 1) normal (N) vs glaucoma (G) and 2) normal (N) vs glaucoma and suspects (G + S). The RIM-ONE dataset has 85 normal (N), 39 glaucoma (G) and 35 glaucoma suspect (S) images.
Receiver Operating Characteristic (ROC) curves have been generated to illustrate the classification performance between the manual CDRs based on clinical and automated classifications as shown in Fig. 15. The paired t-test has been used to compare the ROC curves generated by the manual CDRs with those obtained from automatic CDRs. The difference between the ROC curves were declared to be significant if the p-value is less than 0.05 [53]. This determines confidence level of using the automatic CDRs clinically. The first row in Fig. 15 shows ROC curves about classification performance between the manual and automatic CDRs on the first set (normal (N) and glaucoma (G)). The second row shows the ROC curves about classification between the manual and the automatic CDRs on normal and glaucoma plus glaucoma suspect (G+S) images. Table 7 shows the p-values calculated by the paired t-test between ROC curves generated by the automatic CDRs and the manual CDRs. The results show that there is no significant difference between the ROC curves generated by the manual CDRs and the ROC curves generated by ARESM CDRs as far as classification between Normal and Glaucoma is concerned. This demonstrates that if the CDR is considered as one of the clinical measurement for glaucoma classification, the CDRs generated by the ARESM can be used to faciltate automatic classification between normal and glaucoma. However, it needs to be tested on the large set of images as there are other clinical factors which need to be considered.
Comparison of classification performance between the clinical manual CDR and the automatic CDRs with the first row a, b and c represents the results on set 1 (N vs G) and second row represents the results on set 2 (N vs (G + S)). The first column ((a) and (d)) represent the results calculated on vertical CDR whereas the second and third column represent the results on horizontal CDR and the area CDR respectively
Conclusion
In this work, we have presented a novel solution to accurately segment the optic disc and optic cup. In contrast to the existing approaches, the novelty of the proposed approach lies in two aspects:
-
We have developed the Region Classification Model (RCM) which identifies the initial optimum contour approximation representing optic disc or cup boundary between inside and outside region of interest based on pixel-wise classification in a multidimensional feature space, and performs region search for optimum contour profile. This is different from the existing models such as the conventional ASM model where the contour is static once it has been trained from the training set. Our model can dynamically search the region and obtain the most optimum contour.
-
To overcome misclassification and irregularity of contour points, we have proposed the Adaptive Edge Smoothing Update model (AESU) which can dynamically smooth and update the irregularities and misclassified points by minimising the energy function according to the force field direction in an iterative manner. Our model does not require a predefined template such as a circle or an ellipse. It could be any contour generated from the RCM model. This is different from the existing approaches which used a circular or ellipse fitting for smoothing update.
We have applied our approach to both optic disc and optic cup segmentations. We have conducted a comprehensive comparison with the existing approaches such as ASM, ACM, and Chan-Vese (C-V) models. The approaches were validated with two publicly available data sets: RIM-ONE and Drishti-GS.
For optic disc segmentation of RIM-One dataset, the average accuracy of optic disc segmentation is 91%. The accuracy of Drishti-GS is 95%. It should be noted that the proposed approach works well on high resolution images of RIM-ONE since the low resolution images have blurred vasculature and optic disc edges. For optic cup segmentation, the average accuracy of optic cup segmentation is 89% for RIM-ONE and 81% for Drishti-GS databases. The optic cup segmentation results are highly dependent on the accurate segmentation of the optic disc segmentation. Moreover, failed cases of optic cup segmentation include the normal images which have very small cup size. Future work will focus on more accurate segmentation of the small cup.
Based on the rationale outlined here, our proposed approach can also be applied to boundary detection of other objects. Future work is needed to apply this algorithm to other object boundary detections and also improve accuracy of the ARESM model.
References
Jonas J., Budde W., Jonas S.: Ophthalmoscopic evaluation of optic nerve head. Surv. Ophthalmol. 43: 293–320, 1999
Tangelder G., Reus N., Lemij H.: Estimating the clinical usefulness of optic disc biometry for detecting glaucomatous change over time. Eye 20: 755–763, 2006
Liu J., Lim J. H., Wong W. K., Li H., Wong T.Y. (2011) Automatic cup to disc ratio measurement system. http://www.faqs.org/patents/app/20110091083
Haleem M. S., Han L., van Hemert J., Li B.: Automatic extraction of retinal features from colour retinal images for glaucoma diagnosis: a review. Comput. Med. Imaging Graph. 37: 581–596, 2013
Mahapatra D.: Combining multiple expert annotations using semi-supervised learning and graph cuts for medical image segmentation. Comput. Vis. Image Underst. 151: 114–123, 2016. Probabilistic Models for Biomedical Image Analysis
Qureshi R. J., Kovacs L., Harangi B., Nagy B., Peto T., Hajdu A.: Combining algorithms for automatic detection of optic disc and macula in fundus images. Comput. Vis. Image Underst. 116(1): 138–145, 2012
Salazar-Gonzalez A., Kaba D., Li Y., Liu X.: Segmentation of the blood vessels and optic disk in retinal images. IEEE Journal of Biomedical and Health Informatics 18(6): 1874–1886, 2014
Zhang D., Zhao Y.: Novel accurate and fast optic disc detection in retinal images with vessel distribution and directional characteristics. IEEE Journal of Biomedical and Health Informatics 20(1): 333–342, 2016
Roychowdhury S., Koozekanani D. D., Kuchinka S. N., Parhi K. K.: Optic disc boundary and vessel origin segmentation of fundus images. IEEE Journal of Biomedical and Health Informatics 20(6): 1562–1574, 2016
Zhao Y., Zheng Y., Liu Y., Yang J., Zhao Y., Chen D., Wang Y.: Intensity and compactness enabled saliency estimation for leakage detection in diabetic and malarial retinopathy. IEEE Trans. Med. Imaging 36(1): 51–63, 2017
Zhao Y., Liu Y., Wu X., Harding S. P., Zheng Y.: Retinal vessel segmentation: an efficient graph cut approach with retinex and local phase. PloS one 10(4): e0122332, 2015
Nayak J., Acharya R., Bhat P., Shetty N., Lim T. -C.: Automated diagnosis of glaucoma using digital fundus images. J. Med. Syst. 33: 337–346, 2009
Walter T., Klein J. -C.: Segmentation of color fundus images of the human retina: detection of the optic disc and the vascular tree using morphological techniques.. In: Proceedings of the Second International Symposium on Medical Data Analysis, 2001, pp 282–287
Vishnuvarthanan A., Rajasekaran M. P., Govindaraj V., Zhang Y., Thiyagarajan A.: An automated hybrid approach using clustering and nature inspired optimization technique for improved tumor and tissue segmentation in magnetic resonance brain images. Appl. Soft Comput. 57: 399–426, 2017
Wang S., Li Y., Shao Y., Cattani C., Zhang Y., Du S.: Detection of dendritic spines using wavelet packet entropy and fuzzy support vector machine. CNS Neurol. Disord. Drug Targets (Formerly Curr. Drug Targets CNS Neurol. Disord.) 16(2): 116–121, 2017
Abdel-Ghafar R., Morris T.: Progress towards automated detection and characterization of the optic disc in glaucoma and diabetic retinopathy. Inform. Health Soc. Care 32(1): 19–25, 2007
Lalonde M., Beaulieu M., Gagnon L.: Fast and robust optic disc detection using pyramidal decomposition and hausdorff-based template matching. IEEE Trans. Med. Imaging 20: 1193–1200, 2001
Pallawala P., Hsu W., Lee M., Eong K.: Automatic localization and contour detection of optic disc.. In: ECCV, 2004, pp 139–151
Kass M., Witkin A., Terzopoulous D.: Snakes: active contour models. Int. J. Comput. Vis. 1(4): 321–331, 1987
Zhao Y., Zhao J., Yang J., Liu Y., Zhao Y., Zheng Y., Xia L., Wang Y.: Saliency driven vasculature segmentation with infinite perimeter active contour model. Neurocomputing 259: 201–209, 2017
Sethian J.: Level set methods and fast marching methods Cambridge: Cambridge University Press, 1999
Chan T., Vese L.: An active contour model without edges. IEEE Trans. Image Process. 10(2): 266–277, 2002
Joshi G., Sivaswamy J., Krishnadas S.: Optic disk and cup segmentation from monocular color retinal images for glaucoma assessment. IEEE Trans. Med. Imaging 30: 1192–1205, 2011
Lowell J., Hunter A., Steel D., Basu A., Ryder R., Fletcher E., Kennedy L.: Optic nerve head segmentation. IEEE Trans. Biomed. Eng. 23: 256–264, 2004
Xu J., Chutatape O., Sung E., Zheng C., Kuan P. C. T.: Optic disk feature extraction via modified deformable model technique for glaucoma analysis. Pattern Recogn. 40: 2063–2076, 2007
Wong D., Liu J., Lim J., Jia X., Yin F., Li H., Wong T.: Level-set based automatic cup-to-disc ratio determination using retinal fundus images in argali.. In: 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2008, pp 2266–2269
Osareh A., Mirmehdi M., Thomas B., Markham R.: Comparison of colour spaces for optic disc localisation in retinal images.. In: Proceedings of the 16th International Conference on Pattern Recognition, 2002, pp 743–746
Tang Y., Li X., von Freyberg A., Goch G.: Automatic segmentation of the papilla in a fundus image based on the c-v model and a shape restraint.. In: Proceedings of 18th International Conference on Pattern Recognition (ICPR’06), vol 1, 2006, pp 183–186
Cootes T., Taylor C. (2004) Statistical models of appearance for computer vision. Tech. Rep., University of Manchester
Cheng J., Liu J., Yin F., Lee B. -H., Wong D. W. K., Aung T., Cheng C. -Y., Wong T. Y.: Self-assessment for optic disc segmentation.. In: Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE. IEEE, 2013, pp 5861–5864
Yin F., Liu J., Ong S. H., Sun Y., Wong D. W., Tan N. M., Cheung C., Baskaran M., Aung T., Wong T. Y.: Model-based optic nerve head segmentation on retinal fundus images.. In: Engineering in Medicine and Biology Society, EMBC, 2011 Annual International Conference of the IEEE. IEEE, 2011, pp 2626–2629
Fengshou Y. (2011) Extraction of features from fundus images for glaucoma assessment. Master’s Thesis, National University of Singapore
Haleem M. S., Han L., Li B., Nisbet A., van Hemert J., Verhoek M.: Automatic extraction of optic disc boundary for detecting retinal diseases.. In: 14th IASTED International Conference on Computer Graphics and Imaging (CGIM), 2013, pp 40–47
Li H., Chutatape O.: Boundary detection of optic disk by a modified asm method. Pattern Recogn. 36: 2093–2104, 2003
Xu J., Chutatape O., Chew P.: Automated optic disk boundary detection by modified active contour model. IEEE Trans. Biomed. Eng. 54: 473–482, 2007
Abràmoff M., Alward W., Greenlee E., Shuba L., Kim C., Fingert J., Kwon Y.: Automated segmentation of the optic disc from stereo color photographs using physiologically plausible features. Investig. Ophthalmol. Vis. Sci. 48: 1665–1673 , 2007
Anderson C. H., Bergen J. R., Burt P. J., Ogden J. M.: Pyramid methods in image processing. RCA Engineer 29: 33–41, 1984
Daugman J.: Complete discrete 2-d gabor transforms by neural networks for image analysis and compression. IEEE Trans. Acoust. Speech Signal Process. 36(7): 1169–1179, 1988
Lindeberg T.: Edge detection and ridge detection with automatic scale selection. Int. J. Comput. Vis. 30(2): 117–154, 1998
Haleem M. S., Han L., van Hemert J., Fleming A., Pasquale L. R., Silva P. S., Song B. J., Aiello L. P.: Regional image features model for automatic classification between normal and glaucoma in fundus and scanning laser ophthalmoscopy (slo) images. J. Med. Syst. 40(6): 132, 2016
Serrano A. J., Soria E., Martin J. D., Magdalena R., Gomez J.: Feature selection using roc curves on classification problems.. In: The International Joint Conference on Neural Networks (IJCNN), 2010, pp 1–6
Smola A., Vishwanathan S.: Introduction to machine learning Cambridge: Cambridge University Press, 2008
Stegmann M., Gomez D. (2002) A brief introduction to statistical shape analysis. Tech. rep
Yuan X., Giritharan B., Oh J.: Gradient vector flow driven active shape for image segmentation.. In: IEEE International Conference on Multimedia and Expo, 2007, pp 2058–2061
Lupascu C. A., Tegolo D., Trucco E.: Fabc: retinal vessel segmentation using adaboost. IEEE Trans. Inf. Technol. Biomed. 14(5): 1267–1274, 2010
Sun J., Luan F., Wu H. (2015) Optic disc segmentation by balloon snake with texture from color fundus image. J. Biomed. Imaging 4
Fumero F., Sigut J., Alayón S., González-Hernández M., González M.: Interactive tool and database for optic disc and cup segmentation of stereo and monocular retinal fundus images.. In: Short Papers Proceedings–WSCG, 2015, pp 91–97
Sivaswamy J., Krishnadas S. R., Joshi G.D., Jain M., Tabish A.U.S.: Drishti-gs: Retinal image dataset for optic nerve head (ONH) segmentation.. In: IEEE 11th International Symposium on Biomedical Imaging (ISBI). IEEE, 2014, pp 53–56
Mary M. C. V. S., Rajsingh E. B., Jacob J. K. K., Anandhi D., Amato U., Selvan S. E.: An empirical study on optic disc segmentation using an active contour model. Biomed. Signal Process. Control 18: 19–29, 2015
Joshi G. D., Sivaswamy J., Krishnadas S.: Optic disk and cup segmentation from monocular color retinal images for glaucoma assessment. IEEE Trans. Med. Imaging 30(6): 1192–1205, 2011
Babu T. R. G., Shenbagadevi S.: Automatic detection of glaucoma using fundus image. Eur. J. Sci. Res. 59: 22–32, 2011
Kose C., Ikibas C.: Statistical techniques for detection of optic disc and macula and parameters measurement in retinal fundus images. Journal of Medical and Biological Engineering 31: 395–404, 2010
DeLong E., DeLong D. M., Clarke-Pearson D. L.: Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44(3): 837–845, 1988
Acknowledgments
This project is fully sponsored by EPSRC-DHPA and Optos plc., entitled “Automatic Detection of Features in Retinal Imaging to Improve Diagnosis of Eye Diseases” (Grant Ref: EP/J50063X/1). Dr. Pasquale is supported by the Harvard Glaucoma Center of Excellence. Brian J. Song has been supported by the Harvard Vision Clinical Scientist Development Program 2K12 EY016335-11.
Author information
Authors and Affiliations
Corresponding author
Additional information
This article is part of the Topical Collection on Image & Signal Processing
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Haleem, M.S., Han, L., Hemert, J.v. et al. A Novel Adaptive Deformable Model for Automated Optic Disc and Cup Segmentation to Aid Glaucoma Diagnosis. J Med Syst 42, 20 (2018). https://doi.org/10.1007/s10916-017-0859-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10916-017-0859-4