Abstract
In this study, fuzzy regression (FR) models with fuzzy inputs and outputs are discussed. Some of the FR methods based on linear programming and fuzzy least squares in the literature are explained. Within this study, we propose a Fuzzy Radial Basis Function (FRBF) Network to obtain the estimations for FR model in the case that inputs and outputs are symmetric/nonsymmetric triangular fuzzy numbers. Proposed FRBF Network approach is a fuzzification of the inputs, outputs and weights of traditional RBF Network and it can be used as an alternative to FR methods. The FRBF Network approach is constructed on the basis of minimizing the square of the total difference between observed and estimated outputs. A simple training algorithm from the cost function of the FRBF Network through Backpropagation algorithm is developed in this study. The advantage of our proposed approach is its simplicity and easy computation as well as its performance. To compare the performance of the proposed method with those given in the literature, three numerical examples are presented.
Similar content being viewed by others
Introduction
Regression analysis is one of the most widely used methods of estimation and it is applied to determine the functional relationship between independent and dependent variables. Fuzzy regression (FR) is a fuzzy type of classical regression in which some elements of the model are represented by any type of fuzzy numbers [35].
Fuzzy linear regression (FLR) first proposed by Tanaka et al. [46] is used to minimize the total spread of the fuzzy parameters subject to the support of the estimated values cover the support of the observed values for a certain \(\alpha \)-level. In the light of Tanaka et al.’s [46] study, several methods have been developed for FR models. Another approach to FLR method is proposed by Diamond [16] to determine the fuzzy parameters in analog to conventional normal equations derived with a suitable metric. In general, there are two main approaches in FR analysis: linear programming-based methods and FLS-based methods. The first one is based on minimizing fuzziness as an optimal criterion [4–6, 8, 20, 33, 36–38, 40–42, 45, 47], whereas the second one is based on least squares (LS) of errors as a fitting criterion [3, 9, 15, 16, 25–27, 31, 48].
There are many studies in the literature related to FR since then proposed by Tanaka et al. [46]. Bardossy [5] developed a general form of regression equations for the fuzzy numbers and formulated the FR problem as a mathematical programming. Bardossy et al. [6] introduced a general methodology for FR and applied to an actual hydrological case study including the imprecise relationship between soil electrical resistivity and hydraulic permeability. Sakawa and Yano [40] developed LP-based methods for solving formulated three types of problems for obtaining the FLR models, where both input and output data are fuzzy numbers. Sakawa and Yano [41] introduced three types of multiobjective programming (MOP) problems for obtaining FLR models with fuzzy input and fuzzy output data. They developed an LP-based interactive decision making method to derive the satisfying solution of the decision maker for the MOP problems. Ming et al. [31] described a model for LS fitting of fuzzy input and fuzzy output data. Kao and Chyu [26] introduced the method of LS under fuzzy environment to handle fuzzy observations in regression analysis for three cases: crisp input-fuzzy output, fuzzy input-fuzzy output, and non-triangular fuzzy observations. Yang and Lin [48] proposed two estimation methods along with an FLS approach for considered FLR models with fuzzy inputs, fuzzy outputs and fuzzy parameters. Hojati et al. [20] proposed a simple goal programming-like approach for computation of FR for two cases: crisp inputs-fuzzy outputs and fuzzy inputs-fuzzy outputs. Chen and Dang [10] proposed a three-phase method to construct the FR model with variable spreads to resolve the problem of increasing spreads. Lu and Wang [30] proposed an enhanced fuzzy linear regression model (FLR\(_{\textit{FS}})\). Shakouri and Nadimi [43] introduced an approach to find the parameters of an FLR with crisp inputs and fuzzy outputs. Khan and Valeo [27] introduced a method, which is an extension of the Diamond’s [16] FLS method, for FLR with fuzzy regressors, regressand and coefficients.
Many Neural Networks (NN) models are similar or identical to well-known statistical techniques such as linear regression, polynomial regression, nonparametric regression, discriminant analysis, principal components analysis and cluster analysis. Radial Basis Function Network (RBFN) is a special kind of NNs that consists of input layers, only one hidden layer and output layers. It has radial basis functions in hidden units and linear functions in output units, with adjustable weights. In recent years, various fuzzified versions of the NNs and the RBF Network have been developed for linear, nonlinear and nonparametric regression models.
NNs models have been applied in the FR analysis by various researchers. For example, Ishibuchi and Tanaka [23] introduced simple and powerful methods for FR analysis using NNs. Ishibuchi et al. [24] proposed an architecture of Fuzzy Neural Networks (FNN) that have crisp inputs, interval weights and interval outputs for FR analysis. Ishibuchi et al. [21] introduced an architecture of FNN with triangular fuzzy weights. Ishibuchi and Nii [22] proposed nonlinear fuzzy regression methods based on FNN with asymmetric fuzzy weights. Cheng and Lee [11] proposed FRBF Network that weights between input-hidden units and outputs considered as fuzzy numbers, but inputs and weights between hidden-output units considered as crisp numbers for FR analysis. Dunyak and Wunsch [17] described a method for nonlinear FR using NN models. Khashei et al. [28] proposed a hybrid method that yields more accurate results with incomplete data sets based on the basic concepts of NN and FR models to overcome the limitations in both methods. Mosleh et al. [35] presented a novel hybrid method based on FNN for approximate fuzzy parameters of fuzzy linear and nonlinear regression models with crisp inputs and fuzzy output. Cobaner et al. [14] proposed an adaptive neuro-fuzzy approach to estimate suspended sediment concentration on rivers. The potential of neuro-fuzzy technique is compared with Generalized Regression Neural Networks (GRNN), Radial Basis Function Neural Networks (RBFNN) and Multi-layer Perceptron (MLP) and also two different sediment rating curves (SRC). Haddadnia et al. [18] presented a fuzzy hybrid learning algorithm for the RBFNN. Roh et al. [39] presented a Fuzzy RBFNN based on the concept of information ambiguity. Hathaway et al. [19] presented a model that integrates three data types of numbers, intervals and linguistic assessment. Staiano et al. [44] described a novel approach to fuzzy clustering as a summation of a number of linear local regression models. Their approach is more effective in the training of RBFNN leading to improved performance with respect to other clustering algorithms. Alvisi and Franchini [2] proposed an approach under uncertainty using NN for water level (or discharge) forecasting. The parameters of the NN, i.e., the weights and biases, are represented by fuzzy numbers. Mitra and Basak [32] proposed a fuzzy version of the RBF Network.
To the best knowledge of the authors, there is no study on FRBF Network dealing with fuzzy regression with fuzzy input and fuzzy output. Therefore, we propose FRBF Network with fuzzy input, fuzzy output and also fuzzy weights, as an alternative to the existing FR methods in the literature. To show its appropriateness and effectiveness, our proposed method is applied to the three numerical examples and its performance is compared with existing FR methods. The results indicate that our proposed method is an effective method to estimate the output under fuzzy environment.
The remainder of the paper is organized as follows: in Sect. 2, fuzzy regression methods in the literature are reviewed. Our proposed Fuzzy Radial Basis Function Network approach is presented in Sect. 3. Three numerical examples are illustrated to compare the proposed approach with other FR methods given in Sect. 4. Finally, conclusions are drawn in Sect. 5.
Fuzzy regression methods
Fuzzy linear regression was first introduced by Tanaka et al. [46] and since then several different methods have been proposed for FR by various researchers. In general, fuzzy regression methods are divided into two categories: the first one is based on linear programming (LP) approach and the second one is based on the fuzzy least squares (FLS) approach. The first class which minimizes the total vagueness of the estimated values for the output includes Tanaka et al.’s [46] method and its extensions [20, 33, 40, 45, 46]. The second class includes FLS methods to minimize the total square of errors in the estimated values [15, 16, 31, 48].
In this section, we investigate widely used fuzzy regression methods of Fuzzy Least Squares (FLS), General Fuzzy Least Squares (GFLS), Sakawa–Yano (SY), Hojati–Bector–Smimou (HBS), Approximate-Distance Fuzzy Least Squares (ADFLS) and Interval-Distance Fuzzy Least Squares (IDFLS).
To determine the parameters of FR by minimizing the total square of errors in the estimated values, FLS and GFLS methods were proposed by Diamond [16] and Ming et al. [31], respectively. Fuzzy regression model for the methods of FLS and GFLS as considered as follows:
where \(a_0 ,a_1 \in \mathfrak {R}\) are nonfuzzy parameters, \(X_i ,Y_i \in E^1\) are fuzzy numbers and \(E^1\) is fuzzy number space. \(X_i =(x_i ,\underline{f}_i ,\overline{f} _i )_T \) are fuzzy inputs and \(Y_i =(y_i ,\underline{e}_i ,\overline{e} _i )_T \) are fuzzy outputs considered as triangular fuzzy numbers (TFNs). In fuzzy inputs, \(x_i \) is the center, \(\underline{f}_i \) and \(\overline{f} _i \) are the left and right spread of \(X_i \), respectively. It is assumed that, \(x_i -\underline{f}_i \ge 0\).
The objective of the FLS and GFLS methods is defined as follows:
In Eq. (2), two cases arise according to \(a_1 \ge 0\) or \(a_1 <0\). In case of \(a_1 \ge 0\), \(d(a_0 +a_1 X_i ,Y_i )^2\) is given by;
for FLS and GFLS, respectively. In Eqs. (3) and (4), the parameters \(a_0 \) and \(a_1 \) parameters are derived via \(\frac{\partial r}{\partial a_0 }=0\) and \(\frac{\partial r}{\partial a_1 }=0\) (for \(a_1 <0\); see [16, 31]).
Sakawa and Yano [40], and Hojati et al. [20] considered the following fuzzy regression model:
where \(X_i =(x_i ,f_i )_T \), \(Y_i =(y_i ,e_i )_T \) and parameters \(A_j =(a_j ,c_j )\) are considered as symmetric TFNs.
Sakawa and Yano [40] formulated three types of problems for obtaining the FLR models with fuzzy input and fuzzy output using the three indices for equality between two fuzzy numbers as follows:
Hojati et al. [20] proposed a goal programming-like approach which minimizes the total deviations of upper and lower points of \(\alpha \)-certain predicted and associated observed intervals, for FLR model with fuzzy input and fuzzy output as follows:
where \(d_{ilU}^+ ,\quad d_{ilU}^- ,\quad d_{ilL}^+ ,\quad d_{ilL}^- ,\quad d_{irU}^+ ,\quad d_{irU}^- ,\quad d_{irL}^+ \) and \(d_{irL}^- \) are deviation variables, “l” and “r” refer to the left (lower) and right (upper) points of the input intervals, “U” and “L” refer to the upper and lower points of the observed and predicted intervals, respectively (for details, see [20, 40]).
Yang and Lin [48] proposed alternative FLS methods called as Approximate-distance fuzzy least squares (ADFLS) and Interval-distance fuzzy least squares (IDFLS), for FLR model with fuzzy input and fuzzy output as follows:
where \(X_{ij} =(x_{ij} ,\,\bar{f}_{ij} ,\underline{f}_{ij} )\), \(Y_i =(y_i ,\,\bar{e}_i ,\underline{e}_i )\) and parameters \(A_j =(a_j ,\,\bar{c}_j ,\underline{c}_j )\) are considered as LR fuzzy numbers.
In the ADFLS method, the objective function is defined as follows:
The objective function \(J(A_0 ,A_1 ,\ldots ,A_k )\) is minimized over \(A_j \) subject to \(\bar{c}_j \ge 0\) and \(\underline{c}_j \ge 0\) for ADFLS method. In Eq. (9), \(\tilde{m}_i \), \(\tilde{l}_i \), \(\tilde{r}_i \), \(H_{1}\) and \(H_{2}\) are defined as follows:
and
In the IDFLS method, the objective function is defined as follows:
The objective function \(\rho (A_0 ,A_1 ,\ldots ,A_k )\) is minimized over \(A_j \) for IDFLS method (for details of ADFLS and IDFLS, see [48]).
Proposed approach
Radial Basis Function (RBF) Network is a special kind of NN which has input layers, a single hidden layer and output layers. The hidden layer contains hidden units, also called as radial basis function units, which have two parameters that describe the location of the function’s center and its deviation (or width). Hidden units measure the distance between an input data and the functions’s center. There are two sets of weights, one connecting the input layer to the hidden layer and the other connecting the hidden layer to the output layer. The weights between input and hidden layer which are also called as centers are determined by any clustering method, such as Fuzzy c-Means Clustering (FCM). The weights connecting the hidden layer to the output layer are used to form linear combinations of the hidden units for generating outputs of the RBF Network. RBF Network is trained by unsupervised learning or combining the supervised and unsupervised learning [12, 13, 50].
In this section, we propose a FRBF Network approach for FR model with fuzzy input and fuzzy output which are symmetric or nonsymmetric TFNs. Our proposed FRBF Network includes fuzzy input (\(X_p )\), fuzzy output (\(Y_p )\), fuzzy weights between input and hidden unit (\(W_{ij} )\) and also fuzzy weights between hidden and output unit (\(V_j )\). In this approach, the weights \(W_{ij} \) and normalization factor \(\sigma _j^2 \) are determined by unsupervised learning. \(W_{ij} \) s are initialized by modified FCM algorithm given in Sect. 3.2 and \(V_j \) s are randomly selected as TFNs. Then, \(W_{ij} \), \(V_j \) and \(\sigma _j^2 \) s are updated by BackPropagation (BP) algorithm which is supervised learning.
\(\alpha \)-level sets of the fuzzy input \(X_{pi} \) and the fuzzy output \(Y_p \) are expressed as \([X_{pi} ]_\alpha =[X_{pi}^L ,X_{pi}^U ]\) and \([Y_p ]_\alpha =[Y_p^L ,Y_p^U ]\), respectively. The weights between input and hidden units are symmetrical TFNs and denoted as \(W_{ij} =(w_{ij}^L ,w_{ij}^C ,w_{ij}^U )\), where \(w_{ij}^L \) is the lower limit, \(w_{ij}^C\) is the center and \(w_{ij}^U \) is the upper limit of \(W_{ij} . \quad \alpha \)-level sets of \(W_{ij} \) are written as follows:
The weights between hidden unit and output unit are TFNs and denoted as \(V_j =(v_j^L ,v_j^C ,v_j^U )\). \(\alpha \)-level sets of \(V_j\) can be written as same manner in \(W_{ij}\). Arithmetic operations on fuzzy numbers and intervals can be found in Alefeld and Mayer [1], Klir and Yuan [29] and Moore [34].
The hidden unit j is calculated as follows:
Normalization factor of hidden unit j is determined as follows:
Fuzzy estimated output for observation p of FRBF Network is calculated by;
Let \(Y_p \) be the fuzzy output corresponding to the fuzzy input \(X_p \). The cost function for the \(\alpha \)-level sets of the fuzzy estimated output \(\hat{Y}_p \) and the corresponding fuzzy output \(Y_p \) is introduced in Ishibuchi et al. [24] as follows:
where, \(E_{p,\alpha }^L \) and \(E_{p,\alpha }^U \) indicate the squared errors for the lower limit and the upper limit of the \(\alpha \)-level sets of \(E_p\), respectively. The total cost function E for the input–output pair (\(X_p \),\(Y_p )\) is computed as follows:
Training algorithm of our proposed Fuzzy Radial Basis Function Network
Training algorithm of our proposed FRBF Network is constituted by Yapıcı Pehlivan [49]. In the algorithm, Choi et al.’s [13] BP algorithm for RBF Network is fuzzified and it is integrated with Ishibuchi et al.’s [21] Back-Propagation (BP) algorithm for FNN. Framework of the training algorithm for the proposed FRBF Network is demonstrated in Fig. 1.
The purpose of the proposed FRBF Network is to minimize total errors in estimations through the training algorithm. Let \(\eta \) be a learning constant, \(\lambda \) be a momentum constant and t indicates the number of iterations. The weights \(V_j\), \(W_{ij}\) and normalization factor \(\sigma _j^2\) are updated by the training algorithm as follows:
The fuzzy weights \(V_j\) are updated by;
If \(v_j^L >v_j^U \) then,
In Eqs. (17) and (18), \(\Delta v_j^L (t)\) and \(\Delta v_j^U (t)\) can be calculated using the cost function \(E_{p,\alpha } \) as follows:
The derivatives \(\frac{\partial \,E_{p,\alpha } }{\partial \,v_{jk}^L }\) and \(\frac{\partial \,E_{p,\alpha } }{\partial \,v_{jk}^U }\) in Eqs. (19) and (20) can be written as follows:
The fuzzy weights \(W_{ij} \) are updated by;
If \(w_{ij}^L >w_{ij}^U \) then,
In Eqs. (21) and (22), \(\Delta w_{ij}^L (t)\) and \(\Delta w_{ij}^U (t)\) can be computed using the cost function \(E_{p,\alpha } \) as follows:
The derivatives \(\frac{\partial \,E_{p,\alpha } }{\partial \,w_{ij}^L }\) and \(\frac{\partial \,E_{p,\alpha } }{\partial \,w_{ij}^U }\) in Eqs. (23) and (24) can be written as follows:
where \(\frac{\partial \,E_{p,\alpha } }{\partial \,[W_{ij}]_{\alpha } ^L }\) and \(\frac{\partial \,E_{p,\alpha } }{\partial \,[W_{ij}]_{\alpha } ^U }\) can be computed in two ways as follows:
-
(i) If \(\max \left\{ {\,\left| {\,[X_{pi} ]_{_\alpha }^L -[W_{ij} ]_{_\alpha }^L } \right| \,,\,\left| {\,[X_{pi} ]_{_\alpha }^U -[W_{ij} ]_{_\alpha }^U } \right| \,} \right\} =\left| {\,[X_{pi} ]_{_\alpha }^L -[W_{ij} ]_{_\alpha }^L } \right| \), then
$$\begin{aligned} \frac{\partial E_{p,\alpha } }{\partial [W_{ij}]_{\alpha } ^L }&=-\alpha (\left| {\,[Y_p ]_{\alpha } ^L -[\hat{Y}_p ]_{_\alpha }^L } \right| )h_{pj} (\sigma _{pj} )^{-2}\nonumber \\&\quad \times \left| {\,[X_{pi} ]_{\alpha }^L -[W_{ij} ]_{\alpha }^L } \right| v_j^L \\&\quad -\alpha (\left| {\,[Y_p ]_{\alpha }^U -[\hat{Y}_p ]_{\alpha }^U } \right| )h_{pj} (\sigma _{pj} )^{-2}\,\nonumber \\&\quad \times \left| {\,[X_{pi} ]_{\alpha }^L -[W_{ij} ]_{\alpha }^L } \right| v_j^U\\ \frac{\partial E_{p,\alpha } }{\partial [W_{ij}]_{\alpha } ^U }&=0 \end{aligned}$$ -
(ii) If \(\max \left\{ {\,\left| {\,[X_{pi} ]_{_\alpha }^L -[W_{ij} ]_{_\alpha }^L } \right| \,,\,\left| {\,[X_{pi} ]_{_\alpha }^U -[W_{ij} ]_{_\alpha }^U } \right| \,} \right\} =\left| {\,[X_{pi} ]_{_\alpha }^U -[W_{ij} ]_{_\alpha }^U } \right| \), then
$$\begin{aligned} \frac{\partial E_{p,\alpha } }{\partial [W_{ij}]_{_\alpha } ^L }&=0\\ \frac{\partial E_{p,\alpha } }{\partial [W_{ij}]_{_\alpha } ^U }&=-\alpha \left( \left| {\,[Y_p ]_\alpha ^L -[\hat{Y}_p ]_{_\alpha }^L } \right| \right) h_{pj} (\sigma _{pj} )^{-2}\,\nonumber \\&\quad \times \left| {\,[X_{pi} ]_{_\alpha }^U -[W_{ij} ]_{_\alpha }^U } \right| v_j^L \\&\quad -\alpha \left( \left| {\,[Y_p ]_{_\alpha }^U -[\hat{Y}_p ]_{_\alpha }^U } \right| \right) h_{pj} (\sigma _{pj} )^{-2}\,\nonumber \\&\quad \times \left| {\,[X_{pi} ]_{_\alpha }^U -[W_{ij} ]_{_\alpha }^U } \right| v_j^U \end{aligned}$$The normalization factors \(\sigma _{pj}^2 \) are updated by;
$$\begin{aligned} \sigma _{pj} (t+1)=\sigma _{pj} (t)+\Delta \sigma _{pj} (t) \end{aligned}$$(25)where \(\Delta \sigma _{pj}^{(t)}\) can be calculated using the cost function \(E_{p,\alpha } \) as follows:
$$\begin{aligned} \Delta \sigma _{pj} (t)=-\eta \frac{\partial \,E_{p,\alpha } }{\partial \,\sigma _{pj} }+\lambda .\Delta \sigma _{pj} (t-1) \end{aligned}$$(26)The derivative \(\frac{\partial \,E_{p,\alpha } }{\partial \,\sigma _{pj} }\) in Eq. (26) can be written as;
$$\begin{aligned} \frac{\partial \,E_{p,\alpha } }{\partial \,\sigma _{pj} }=\zeta ^L+\zeta ^U \end{aligned}$$
where \(\zeta ^\mathrm{L}\) and \(\zeta ^\mathrm{U}\) can be computed in two ways as follows:
-
(i) If \(\max \left\{ {\,\left| {\,[X_{pi} ]_{_\alpha }^L -[W_{ij} ]_{_\alpha }^L } \right| ,\quad \left| {\,[X_{pi} ]_{_\alpha }^U -[W_{ij} ]_{_\alpha }^U } \right| \,} \right\} =\left| {\,[X_{pi} ]_{_\alpha }^L -[W_{ij} ]_{_\alpha }^L } \right| \), then
$$\begin{aligned} \zeta ^L&=-\alpha \left( [Y_{pk} ]_\alpha ^L -[\hat{Y}_{pk} ]_\alpha ^L \right) h_{pj} (\sigma _{pj} )^{-3}\\&\quad \times \left| {[X_{pi} ]_\alpha ^L -[W_{ij} ]_\alpha ^L } \right| ^2v_j^L\\ \zeta ^U&=-\alpha \left( [Y_{pk} ]_\alpha ^U -[\hat{Y}_{pk} ]_\alpha ^U \right) h_{pj} (\sigma _{pj} )^{-3}\\&\quad \times \left| {[X_{pi} ]_\alpha ^L -[W_{ij} ]_\alpha ^L } \right| ^2v_j^U \end{aligned}$$ -
(ii) If \(\max \left\{ {\,\left| {\,[X_{pi} ]_{_\alpha }^L -[W_{ij} ]_{_\alpha }^L } \right| ,\quad \left| {\,[X_{pi} ]_{_\alpha }^U -[W_{ij} ]_{_\alpha }^U } \right| \,} \right\} =\left| {\,[X_{pi} ]_{_\alpha }^U -[W_{ij} ]_{_\alpha }^U } \right| \), then
$$\begin{aligned} \zeta ^L&=-\alpha \left( [Y_{pk} ]_\alpha ^L -[\hat{Y}_{pk} ]_\alpha ^L \right) h_{pj} (\sigma _{pj} )^{-3}\\&\quad \times \left| {[X_{pi} ]_\alpha ^U -[W_{ij} ]_\alpha ^U } \right| ^2v_j^L\\ \zeta ^U&=-\alpha \left( [Y_{pk} ]_\alpha ^U -[\hat{Y}_{pk} ]_\alpha ^U \right) h_{pj} (\sigma _{pj} )^{-3}\\&\quad \times \left| {[X_{pi} ]_\alpha ^U -[W_{ij} ]_\alpha ^U } \right| ^2v_j^U \end{aligned}$$
From the above expressions, the training algorithm of the proposed FRBF Network can be summarized as follows:
-
Step 1 Determine the fuzzy weights \(W_{ij} \) using modified FCM algorithm given in Eqs. (27)–(29) Initialize the fuzzy weights \(V_j \) as fuzzy numbers randomly Calculate the initial values of normalization factor by Eq. (13)
-
Step 2 Repeat Step 3 for \(\alpha _1 ,\alpha _2 ,\ldots ,\alpha _s \)
-
Step 3 Repeat the following procedures for \(p=1,2,\ldots ,n\)
-
Step 4 If the total number of iterations is satisfied, stop. Otherwise, go to Step 2.
Modified Fuzzy c-Means Clustering algorithm
The Fuzzy c-Means Clustering (FCM) algorithm is the most common cluster algorithm for RBF Network. It divides n data sets into c-fuzzy groups and estimates the cluster centers of each group [7, 12].
In this study, we modified the FCM algorithm because of \(X_i \) and \(W_{ij} \) are fuzzy numbers. Modified FCM algorithm for our proposed FRBF Network is given as follows:
-
Step 1 Set the number of clusters m and parameter b. Initialize cluster centers \(W_{ij} \) and inputs \(X_i \) for \(\alpha =0\).
-
Step 2 Determine the membership values using \(W_{ij} \) in two ways as;
-
(i) If \(\left\| {\left[ {[X_i ]_\alpha ^L ,[X_i ]_\alpha ^U } \right] -\left[ {[W_{ij} ]_\alpha ^L ,[W_{ij} ]_\alpha ^U } \right] } \right\| ^2\ne 0\), then
$$\begin{aligned}&\mu _j ([X_i ]_\alpha )\nonumber \\&=\left[ {\sum \limits _{k=1}^m {\left( {\frac{\left( {\max \left\{ {\,\left| {x_i ^L-w_{ij} ^L} \right| \,,\,\left| {x_i ^U-w_{ij} ^U} \right| \,} \right\} \,}\right) ^2}{\left( {\,\max \left\{ {\,\left| {x_i ^L-w_{ik} ^L} \right| \,,\,\left| {x_i ^U-w_{ik} ^U} \right| \,} \right\} \,}\right) ^2}}\right) ^{1/(b-1)}} } \right] ^{-1} \end{aligned}$$(27) -
(ii) If \(\left\| {\left[ {[X_i ]_\alpha ^L ,[X_i ]_\alpha ^U } \right] -\left[ {[W_{ij} ]_\alpha ^L ,[W_{ij} ]_\alpha ^U } \right] } \right\| ^2=0\), then
$$\begin{aligned}&\mu _j ([X_i ]_\alpha )\nonumber \\&\quad =\left\{ {\begin{array}{l} 1,\quad if\quad \left[ {[X_i ]_{\alpha }^L ,[X_i]_{\alpha }^U } \right] =\left[ {[W_{ij} ]_{\alpha }^L ,[W_{ij} ]_{\alpha }^U } \right] \\ 0,\quad if\quad \left[ {[X_i ]_{\alpha }^L ,[X_i ]_{\alpha }^U } \right] \ne \left[ {[W_{ij} ]_{\alpha }^L ,[W_{ij} ]_{\alpha }^U } \right] \\ \end{array}} \right. \nonumber \\ \end{aligned}$$(28)
-
Step 3 Update the cluster centers \(W_{ij} \) until the membership values are stabilized by;
$$\begin{aligned}&\left[ {[W_{ij} ]_\alpha ^L ,[W_{ij} ]_\alpha ^U } \right] \nonumber \\&\quad =\left[ {\frac{\sum \nolimits _{i=1}^n {[\mu _j ([X_i ]_\alpha )]^b[X_i ]_\alpha ^L } }{\sum \nolimits _{i=1}^n {[\mu _j ([X_i ]_\alpha )]^b} }},\right. \left. {\frac{\sum \nolimits _{i=1}^n {[\mu _j ([X_i ]_\alpha )]^b[X_i ]_\alpha ^U } }{\sum \nolimits _{i=1}^n {[\mu _j ([X_i ]_\alpha )]^b} }} \right] \nonumber \\ \end{aligned}$$(29)
Numerical examples
In this section, we considered three numerical examples to demonstrate the proposed FRBF Network approach that performs well while handling with FR model when input and outputs are triangular fuzzy numbers. Using these fuzzy data, we obtain an estimated fuzzy regression equation \(\hat{Y}=A_0 +A_1 \hat{X}\) with fuzzy parameters \(A_0 =(a_0 ,\underline{c}_0 ,\bar{c}_0 )\) and \(A_1 =(a_1 ,\underline{c}_1 ,\bar{c}_1 )\). The proposed FRBF Network approach is applied to the examples and compared with FLS, GFLS, SY, HBS, ADFLS and IDFLS methods. LINGO and MATLAB Softwares are used for computations of FR methods and MATLAB Software is applied for generating the proposed FRBF Network on a Notebook (Intel Core 2 Duo) with CPU time of 2.0 GHz.
In all computations of the examples, we use learning constant(\(\eta \)) as 0.01, momentum constant(\(\lambda \)) as 0.1 and values of \(\alpha \)-cut as \(\alpha =0,\,0.2,\,0.4,\,0.6,\,0.8\) and 1.0 for traininig algorithm of the proposed FRBF Network. The initial values of the \(W_{ij} \) s for \(\alpha =0\) are computed using modified FCM algorithm via Eqs. (27)–(29). The initial values of the \(\sigma _{pj}^2 \)s are determined using the initial values of \(W_{ij} \)s. The initial values of the \(V_j \)s are randomly determined as fuzzy numbers. We calculate the cost function of each fuzzy output by Eq. (15) and total cost function by Eq. (16) according to the values of \(\alpha =0,\,0.2,\,0.4,\,0.6,\,0.8\) and 1.0.
To compare the performance of the methods, we calculate the total errors in estimation using Eq. (2) for FLS and GFLS, Eq. (6) for SY, Eq. (7) for HBS, Eq. (9) for ADFLS and Eq. (10) for IDFLS methods.
Example 1
Sakawa and Yano [40] used an example to illustrate the regression model, in which input and outputs are symmetrical TFNs. The example has eight sets of the fuzzy observations \((X_i ,Y_i )\) as shown in Table 1.
In the computations of the Example 1, we consider following specifications of our proposed FRBF Network approach for the training algorithm:
-
(1)
Number of input units: \(n_{I }= 1\) unit
-
(2)
Number of hidden units: \(n_{O }= 3\) units
-
(3)
Number of output units: \(n_{O }= 1\) unit
-
(4)
Stopping condition: \(t= 20,000\) iterations of the training algorithm
To compare the performance of the seven FR methods in estimation given in Sect. 2, we applied to calculate the errors in estimating the observed outputs. Table 2 shows parameter estimations, predicted intervals of fuzzy outputs and sum of squares errors (SSE) in estimating the eight observations for these considered methods. In the methods of FLS, GFLS, SY, HBS, ADFLS, IDFLS and proposed FRBF Network approach, the results for \(\alpha =0\) are used for comparison. In Table 2, SSE value of the FRBF Network approach is 9.9680, which is obviously better than FLS, GFLS, SY, HBS, ADFLS and IDFLS methods with 17.008, 22.162, 17.3682, 15.1991, 15.4723 and 10.3435 SSE values, respectively. Figure 2 illustrates the errors in estimations of FR methods and proposed FRBF Network approach.
Example 2
Diamond [16] used an example to illustrate the regression model, in which inputs and outputs are nonsymmetrical TFNs. The example has eight sets of the fuzzy observations \((X_i ,Y_i )\), see Table 3.
In the computations of the Example 2, we consider following specifications of our proposed FRBF Network approach for the training algorithm:
-
(1)
Number of input units: \(n_{I }= 1\) unit
-
(2)
Number of hidden units: \(n_{O }= 3\) units
-
(3)
Number of output units: \(n_{O }= 1\) unit
-
(4)
Stopping condition: \(t= 20,000\) iterations of the training algorithm
The methods of SY and HBS could not be applied on Example 2, because data include nonsymmetrical TFNs. To compare the performance of the five FR methods in estimation given in Sect. 2, we applied to calculate the errors in estimating the observed outputs. Table 4 shows parameter estimations, predicted intervals of fuzzy outputs and SSE values in estimating the eight observation for these considered methods. In the methods of FLS, GFLS, ADFLS, IDFLS and proposed FRBF Network approach, the results for \(\alpha =0\) is used for comparison. In Table 4, SSE values of the IDFLS method is 1.4477 and FRBF Network approach is 1.5517, which are obviously better than FLS, GFLS and ADFLS methods with 2.4055, 3.0867 and 2.0843 SSE values, respectively. Figure 3 depicts the errors in estimations of FR methods and proposed FRBF Network approach.
Computational experience
The superiority of the proposed FRBF Network approach can be also observed through a test example from Diamond [16] and Ming et al. [31], in which inputs and outputs are symmetrical TFNs. This example has three sets of the fuzzy observations \((X_i ,Y_i )\) as given in Table 5.
In the computations of the Example 3, we consider following specifications of our proposed FRBF Network approach for the training algorithm:
-
(1)
Number of input units: \(n_{I }= 1\) unit
-
(2)
Number of hidden units: \(n_{O }= 2\) units
-
(3)
Number of output units: \(n_{O }= 1\) unit
-
(4)
Stopping condition: \(t= 10,000\) iterations of the training algorithm
The training algorithm of the proposed FRBFN is started with fuzzy weights between input and hidden unit as \(W_{11} =\left[ {0.2793,1.7982} \right] ,\quad W_{12} =\left[ {1.5904,3.5904} \right] \) which is calculated by the FCM method, and normalization factor as \(\sigma _1^2 =1.614,\quad \sigma _2^2 =1.182\) and fuzzy weights between hidden unit and output unit as \(V_1 =\left[ {1,2} \right] ,\quad V_2 =\left[ {2,3} \right] \).
To compare the performance of the seven FR methods in the estimation given in Sect. 2, we applied to calculate the errors in estimating the observed outputs. Table 6 shows parameter estimations, predicted intervals of fuzzy outputs and SSE values in estimating the eight observation for these considered methods. In the methods of FLS, GFLS, SY, HBS, ADFLS, IDFLS and proposed FRBF Network approach, the results for \(\alpha =0\) are used for comparison. In Table 6, SSE value of the FRBF Network approach is 0.0770, which is obviously better than FLS, GFLS, SY, HBS, ADFLS and IDFLS methods with 0.5390, 0.6060, 3.0152, 16.3878, 0.1566 and 0.1161 SSE values, respectively. Figure 4 shows the errors in estimations of FR methods and proposed FRBF Network approach.
LINGO Software is used for solving the fuzzy regression methods. The training algorithm for the proposed FRBFN is coded in MATLAB Software and implemented on a Notebook (Intel Core 2 Duo) with CPU time of 2.0 GHz. The average relative performance of the proposed FRBF Network approach and other FR methods, measured by SSE values and CPU time, is shown in Table 7.
Table 7 shows relative performance of the existing Fuzzy Regression methods and Fuzzy Radial Basis Function Network approach for Test Example from Diamond [16] and Ming et al. [31]. We compared the performance of considered methods with respect to the SSE values and CPU time. The SSE value of the proposed FRBF Network approach is 0.0770, whereas its CPU time is 233.626 s. As can be seen from Table 7, compared with FLS, GFLS, SY, HBS, ADFLS and IDFLS, the performance of FRBF Network approach improves substantially when the CPU time is increased. Although the CPU time of our proposed approach is more than the compared FR methods, SSE value of the estimations is obtained minimum than those. Because, it is expected to obtain the estimations with minimum SSE. It can be seen that our proposed approach gives better results than existing methods for FR models with fuzzy input and fuzzy output.
Conclusion
In this study, we have reviewed the relevant articles on Fuzzy Regression and provided an easily computation approach to estimate FR models with fuzzy input and fuzzy output. We presented a new estimation approach, Fuzzy Radial Basis Function Network, for Fuzzy Regression in the case that inputs and outputs are symmetric or nonsymmetric triangular fuzzy numbers. We derived a training algorithm of three-layer FRBF Network consisting of input, hidden and output layers. In the training algorithm, inputs, outputs and weights were defined by triangular fuzzy numbers. The construction of the algorithm is quite simple and the parameters of the FRBF Network, i.e., fuzzy weights and normalization factors, are systematically updated using this training algorithm given in Sect. 3.1.
The effectiveness of the derived training algorithm is demonstrated by computation of three numerical examples performed for proposed FRBF Network approach using the Backpropagation algorithm. The examples show that our proposed approach performs better than the existing fuzzy regression methods based on Linear Programming and Fuzzy Least Squares.
This study is one of the approaches to derive training algorithm of FRBF Network approach which has fuzzy input, fuzzy output and fuzzy weights, as an alternative to FR methods in the literature. The advantage of this approach is its simplicity and easy computation as well as its performance, while its disadvantage is spending more time than the other FR methods. The proposed approach is more suitable than the existing FR methods: firstly, the proposed method is able to handle symmetric and nonsymmetric triangular fuzzy inputs and outputs. Secondly, Example 1 and Example 3 show that the FRBF Network approach is better than of the existing FR methods, in terms of the SSE values and predicted intervals in estimation.
As a conclusion, our proposed approach suggests an efficient alternative procedure to estimate predicted intervals for FR model with fuzzy input and output. As a limitation of our study, we only focused on fuzzy regression model in the case that input and output are assumed to be symmetric or nonsymmetric triangular fuzzy numbers. Therefore, we only considered FRBF Network when input, output and weights are triangular fuzzy numbers and we did not consider another types of fuzzy numbers in this study. Although the discussion of this study is confined to simple regression with one input and one output, it can be generalized to cope with cases of multiple inputs and outputs. For future studies, more general fuzzy inputs, outputs and weights such as trapezoidal fuzzy numbers could be handled with our FRBF Network approach and it could be applied to different FR models.
References
Alefeld G, Mayer G (2000) Interval analysis: theory and applications. J Comput Appl Math 121:421–464. doi:10.1016/S0377-0427(00)00342-3
Alvisi S, Franchini M (2011) Fuzzy neural networks for water level and discharge forecasting with uncertainty. Environ Model Softw 26:523–537. doi:10.1016/j.envsoft.2010.10.016
Apaydin A, Baser F (2010) Hybrid fuzzy least-squares regression analysis in claims reserving with geometric separation method. Insur Math Econ 47:113–122. doi:10.1016/j.insmatheco.2010.07.001
Azadeh A, Khakestani M, Saberi M (2009) A flexible fuzzy regression algorithm for forecasting oil consumption estimation. Energy Policy 37:5567–5579. doi:10.1016/j.enpol.2009.08.017
Bárdossy A (1990) Note on fuzzy regression. Fuzzy Sets Syst 37:65–75. doi:10.1016/0165-0114(90)90064-D
Bárdossy A, Bogárdi I, Duckstein L (1993) Fuzzy nonlinear regression analysis of dose-response relationships. Eur J Oper Res 66:36–51. doi:10.1016/0377-2217(93)90204-Z
Bezdek JC, Ehrlich R, Full W (1984) FCM: the fuzzy c-means clustering algorithm. Comput Geosci 10:191–203. doi:10.1016/0098-3004(84)90020-7
Chang PT, Lee ES (1994) Fuzzy linear regression with spreads unrestricted in sign. Comput Math Appl 28:61–70. doi:10.1016/0898-1221(94)00127-8
Chang Y-HO (2001) Hybrid fuzzy least-squares regression analysis and its reliability measures. Fuzzy Sets Syst 119:225–246. doi:10.1016/S0165-0114(99)00092-5
Chen S-P, Dang J-F (2008) A variable spread fuzzy linear regression model with higher explanatory power and forecasting accuracy. Inf Sci 178:3973–3988. doi:10.1016/j.ins.2008.06.005
Cheng C-B, Stanley Lee E (2001) Fuzzy regression with radial basis function network. Fuzzy Sets Syst 119:291–301. doi:10.1016/S0165-0114(99)00098-6
Cherkassky V, Mulier F (1998) Learn from data: concepts. Theory and methods. Wiley, New York
Choi SW, Lee D, Park JH, Lee I-B (2003) Nonlinear regression using RBFN with linear submodels. Chemometr Intell Lab Syst 65:191–208. doi:10.1016/S0169-7439(02)00109-0
Cobaner M, Unal B, Kisi O (2009) Suspended sediment concentration estimation by an adaptive neuro-fuzzy and neural network approaches using hydro-meteorological data. J Hydrol 367:52–61. doi:10.1016/j.jhydrol.2008.12.024
D’Urso P (2003) Linear regression analysis for fuzzy/crisp input and fuzzy/crisp output data. Comput Stat Data Anal 42:47–72. doi:10.1016/S0167-9473(02)00117-2
Diamond P (1988) Fuzzy least squares. Inf Sci 46:141–157. doi:10.1016/0020-0255(88)90047-3
Dunyak JP, Wunsch D (2000) Fuzzy regression by fuzzy number neural networks. Fuzzy Sets Syst 112:371–380. doi:10.1016/S0165-0114(97)00393-X
Haddadnia J, Faez K, Ahmadi M (2003) A fuzzy hybrid learning algorithm for radial basis function neural network with application in human face recognition. Pattern Recognit 36:1187–1202. doi:10.1016/S0031-3203(02)00231-5
Hathaway R, Bezdek JC, Pedrycz W (1996) A parametric model for fusing heterogeneous data. IEEE Trans Fuzzy Syst 4:270–281
Hojati M, Bector CR, Smimou K (2005) A simple method for computation of fuzzy linear regression. Eur J Oper Res 166:172–184. doi:10.1016/j.ejor.2004.01.039
Ishibuchi H, Kwon K, Tanaka H (1995) A learning algorithm of fuzzy neural networks with triangular fuzzy weights. Fuzzy Sets Syst 71:277–293. doi:10.1016/0165-0114(94)00281-B
Ishibuchi H, Nii M (2001) Fuzzy regression using asymmetric fuzzy coefficients and fuzzified neural networks. Fuzzy Sets Syst 119:273–290. doi:10.1016/S0165-0114(98)00370-4
Ishibuchi H, Tanaka H (1992) Fuzzy regression analysis using neural networks. Fuzzy Sets Syst 50:257–265. doi:10.1016/0165-0114(92)90224-R
Ishibuchi H, Tanaka H, Okada H (1993) An architecture of neural networks with interval weights and its application to fuzzy regression analysis. Fuzzy Sets Syst 57:27–39. doi:10.1016/0165-0114(93)90118-2
Kao C, Chyu C-L (2002) A fuzzy linear regression model with better explanatory power. Fuzzy Sets Syst 126:401–409. doi:10.1016/S0165-0114(01)00069-0
Kao C, Chyu C-L (2003) Least-squares estimates in fuzzy regression analysis. Eur J Oper Res 148:426–435. doi:10.1016/S0377-2217(02)00423-X
Khan UT, Valeo C (2015) A new fuzzy linear regression approach for dissolved oxygen prediction. Hydrol Sci J 60:1096–1119. doi:10.1080/02626667.2014.900558
Khashei M, Reza Hejazi S, Bijari M (2008) A new hybrid artificial neural networks and fuzzy regression model for time series forecasting. Fuzzy Sets Syst 159:769–786. doi:10.1016/j.fss.2007.10.011
Klir GJ, Yuan B (1995) Fuzzy sets fuzzy logic: theory and application. Prentice Hall International Inc., New Jersey
Lu J, Wang R (2009) An enhanced fuzzy linear regression model with more flexible spreads. Fuzzy Sets Syst 160:2505–2523. doi:10.1016/j.fss.2009.02.023
Ming M, Friedman M, Kandel A (1997) General fuzzy least squares. Fuzzy Sets Syst 88:107–118. doi:10.1016/S0165-0114(96)00051-6
Mitra S, Basak J (2001) FRBF: a fuzzy radial basis function network. Neural Comput Appl 10:244–252. doi:10.1007/s521-001-8052-9
Modarres M, Nasrabadi E, Nasrabadi MM (2005) Fuzzy linear regression models with least square errors. Appl Math Comput 163:977–989. doi:10.1016/j.amc.2004.05.004
Moore RE (1979) Methods and application of interval analysis. SIAM, Philadelphia
Mosleh M, Otadi M, Abbasbandy S (2010) Evaluation of fuzzy regression models by fuzzy neural network. J Comput Appl Math 234:825–834. doi:10.1016/j.cam.2010.01.046
Nasrabadi MM, Nasrabadi E, Nasrabady AR (2005) Fuzzy linear regression analysis: a multi-objective programming approach. Appl Math Comput 163:245–251. doi:10.1016/j.amc.2004.02.008
Özelkan EC, Duckstein L (2000) Multi-objective fuzzy regression: a general framework. Comput Oper Res 27:635–652. doi:10.1016/S0305-0548(99)00110-0
Peters G (1994) Fuzzy linear regression with fuzzy intervals. Fuzzy Sets Syst 63:45–55. doi:10.1016/0165-0114(94)90144-9
Roh S-B, Joo S-C, Pedrycz W, Oh S-K (2010) The development of fuzzy radial basis function neural networks based on the concept of information ambiguity. Neurocomputing 73:2464–2477. doi:10.1016/j.neucom.2010.05.006
Sakawa M, Yano H (1992a) Fuzzy linear regression analysis for fuzzy input-output data. Inf Sci 63:191–206. doi:10.1016/0020-0255(92)90069-K
Sakawa M, Yano H (1992b) Multiobjective fuzzy linear regression analysis for fuzzy input-output data. Fuzzy Sets Syst 47:173–181. doi:10.1016/0165-0114(92)90175-4
Sánchez JdA (2006) Calculating insurance claim reserves with fuzzy regression. Fuzzy Sets Syst 157:3091–3108. doi:10.1016/j.fss.2006.07.003
Shakouri GH, Nadimi R (2009) A novel fuzzy linear regression model based on a non-equality possibility index and optimum uncertainty. Appl Soft Comput 9:590–598. doi:10.1016/j.asoc.2008.08.005
Staiano A, Tagliaferri R, Pedrycz W (2006) Improving RBF networks performance in regression tasks by means of a supervised fuzzy clustering. Neurocomputing 69:1570–1581. doi:10.1016/j.neucom.2005.06.014
Tanaka H (1987) Fuzzy data analysis by possibilistic linear models. Fuzzy Sets Syst 24:363–375. doi:10.1016/0165-0114(87)90033-9
Tanaka H, Uejima S, Asai K (1982) Linear regression analysis with fuzzy model. IEEE Trans Syst Man Cybernet 12:903–907. doi:10.1109/TSMC.1982.4308925
Tanaka H, Watada J (1988) Possibilistic linear systems and their application to the linear regression model. Fuzzy Sets Syst 27:275–289. doi:10.1016/0165-0114(88)90054-1
Yang M-S, Lin T-S (2002) Fuzzy least-squares linear regression analysis for fuzzy input-output data. Fuzzy Sets Syst 126:389–399. doi:10.1016/S0165-0114(01)00066-5
Yapıcı Pehlivan N (2005) Fuzzy estimators in nonparametric regression. PhD Thesis, Selçuk University, Konya
Yilmaz I, Kaynar O (2011) Multiple regression, ANN (RBF, MLP) and ANFIS models for prediction of swell potential of clayey soils. Exp Syst Appl 38:5958–5966. doi:10.1016/j.eswa.2010.11.027
Acknowledgments
The authors are grateful for the valuable comments and suggestions from the respected reviewers. Their valuable comments and suggestions have improved the quality of the our study.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Pehlivan, N.Y., Apaydın, A. Fuzzy radial basis function network for fuzzy regression with fuzzy input and fuzzy output. Complex Intell. Syst. 2, 61–73 (2016). https://doi.org/10.1007/s40747-016-0013-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40747-016-0013-9