Simultaneous robust estimation of multi-response surfaces in the presence of outliers

Abstract

A robust approach should be considered when estimating regression coefficients in multi-response problems. Many models are derived from the least squares method. Because the presence of outlier data is unavoidable in most real cases and because the least squares method is sensitive to these types of points, robust regression approaches appear to be a more reliable and suitable method for addressing this problem. Additionally, in many problems, more than one response must be analyzed; thus, multi-response problems have more applications. The robust regression approach used in this paper is based on M-estimator methods. One of the most widely used weighting functions used in regression estimation is Huber’s function. In multi-response surfaces, an individual estimation of each response can cause a problem in future deductions because of separate outlier detection schemes. To address this obstacle, a simultaneous independent multi-response iterative reweighting (SIMIR) approach is suggested. By presenting a coincident outlier index (COI) criterion while considering a realistic number of outliers in a multi-response problem, the performance of the proposed method is illustrated. Two well-known cases are presented as numerical examples from the literature. The results show that the proposed approach performs better than the classic estimation, and the proposed index shows efficiency of the proposed approach.

Introduction

A common method of explaining and analyzing the results of experiments is response surface modeling. This term is used for a regression equation that shows the whole behavior of the control variables, the nuisance factors, and the response or responses. We can use the estimated function to predict the response in each value of specific controllable factors. After gathering experimental data, a relationship between the factors (input data) and the response or responses (output results) should be defined to complete the analysis procedure. If we cannot construct a suitable model to define the precise relation between the input variables and the response or the responses' consequents, then the interpretations will not be reliable. After determining an experimental design and performing experiments, the next steps include the statistical analysis and the selection of the optimal input variables.

One of the most common approaches of regression coefficient estimation is the Least Squares (LS) method. A solution given by LS determines the coefficient values that minimize the sum of the squares of the residuals, in other words, the sum of the square differences between the experimental response values and those calculated by the fitted equation.

The quality of a manufactured product is often evaluated by several performance measures, which are called quality characteristics, each of which is described by a response variable. The values of these response variables are affected by one or more process parameters, which are the input variables. Often, processes with two or more response variables operate in a conflicting way. A group of responses often characterizes the performance of a manufactured product. These responses are usually correlated and measured by different measurement scales. Therefore, a decision-maker must resolve the parameter selection problem to optimize each response. This problem is considered to be a multi-response optimization problem, which is subject to different response requirements.

It is usually difficult to realize an optimal level of the input variables that can result in values close to the ideal or target values for all of the response variables. The main goal of multi-response optimization is, therefore, to find the settings of the input variables that achieve an optimal compromise in the response variables.

In many cases, especially in experimental results, some of the data should be treated outliers. These points, which may occur because of operator reading faults or other similar factors, may have a confusing effect on the total interpretation of the results. These points are called outliers. A data observation or a group of data points that are well separated from the majority of the whole pattern of observation, in other words, data that deviate from the general pattern, are called outliers. However, they are avoidable during the processing to some extent. The main concept in robustness is the presence of outliers and, more precisely, the changes in the distribution of the data. A common way to address outliers and to find them when using LS is to identify the bad observations. To detect the outliers, some graphical procedures such as normal probability plots and numerical regression diagnostics have been proposed. These procedures are defined in Weisberg (1985). Wisnowskia et al. (2001) studied the analysis of multiple outlier detection procedures for a linear regression model. Monte Carlo simulation is used to compare different approaches, and the performances and limitations of each method are discussed. Outlier detection in multivariate problems is not simple to understand; to describe this problem, simple visual methods can be applied. Fernandez Pierna et al. (2002) compared this type of method, called the convex hull method, with classical techniques and robust methods.

The concept of outlier data is qualitative in the sense that it is not the same as incorrect data but rather refers to data that are different from the majority. Often, the presence of outlier data illustrates the existence of an unexpected phenomenon at the start of experimentation but that can be explained, possibly from experimental causes. A problem that we often encountered in the application of regression is the presence of an outlier or outliers in the data. Outliers can be generated by a simple operational mistake, a small sample size, or other factors. Even one outlying observation can destroy an LS estimation, resulting in parameter estimates that do not provide useful information for the majority of the data. Robust regression analysis was developed to improve LS estimation in the presence of outliers and to provide additional information about valid observations. The primary purpose of robust regression analysis is to fit a model that represents the information that is in the majority of the data.

To address this obstacle, some robust approaches were proposed by different authors. Robust regression methods were introduced to address the above-mentioned problems. Ample (Fernandez Pierna et al. 2002) introduced robustness and computational approaches that include Huber (1981) robust statistics and different estimation algorithms. One common robust estimation approach is the M-estimator, which is based on a maximum likelihood estimation (MLE). LS was derived by this type of estimation and considers a special residuals function. The main idea of M-estimators is to replace the squared residuals by another function. The M-estimator works by an iterative procedure. As a consequence, several authors (e.g., Cummins and Andrews 1995) have called this estimator iteratively reweighted least squares, or the IRLS method. Additionally in our case, to estimate the regression coefficients, the iterative weighting method can be applied to estimate robust coefficients. One M-estimator function is from Huber (1981), which has become increasingly popular. Since then, more robust approaches have been discussed by investigators. However since M-estimators are simple to understand and considering that recent methods are sometimes so sensitive that they wrongly identify good points as outliers (Hund et al. 2002), we chose to use these type of estimators. Maronna et al. (2006) explained the most recent robust regression algorithms.

Morgenthaler and Schumacher (1999) discussed robust response surfaces in chemistry based on the design of experiments. Hund et al. (2002) presented various methods of outlier detection and evaluated robustness tests with different experimental designs. Robust regression methods and reconstruction experimental design methods have been compared. Wiens and Wu (2010) proposed a comparative study of M-estimators and presented a design that is more optimal compared with possible regression models.

In multi-response problems, the first step is the accurate determination of the regression coefficient because contamination and outlier data can have a negative effect on the models. The robustness concept in multi-responses has been presented by different authors; however, robust design was developed by Taguchi (1986, 1987). This approach is often used in process improvement project, to redesign processes for the purpose of increasing customer satisfaction by improving operational performances. Usually, the model parameters are estimated by LS in robust design. This methodology specifically utilizes both experimentation and optimization methods to determine the system's optimum operating conditions. Koksoy (2008, 2006) presented MSE as a robust design criterion in multi-response problems. Additionally, genetic algorithms and generalized reduced gradients method were used in their solution stage. In the mentioned studies, the general framework for multivariate problems in which data are collected from a combined array has been presented. For example, Quesada and Del Castillo (2004) proposed a dual response approach to multivariate robust parameter designs.

There are also several papers that consider correlations between responses, allowing the variance-covariance structure of the multiple responses to be accounted for. In this case, some multivariate techniques can be applied to these problems. Daszykowski et al. (2007) reviewed robust models and both univariate and multivariate outliers, and the effects of data analysis have been studied. One of the most efficient and useful robust multivariate regressions is the minimum covariance determinant, which was proposed by Rousseeuw et al. (2004).

In multi-response problems, robust regression approaches can be used to decrease the effects of contaminations and to focus outliers. In this paper, it is assumed that there is no correlation between responses; a similar assumption is made in other studies, such as Koksoy (2008). However, by considering each response and using univariate M-estimators to estimate the coefficients, a problem could occur, and outlier detection is required to consider all of the responses simultaneously. An outlier appearance in only one response cannot be considered a wrong observation while the other responses are considered to contain normal behavior. If we consider the responses individually, an experiment could treat an observation as outlier data, while in an iterative procedure, that point would be down-weighted more than it is appropriate. Considering all of the responses simultaneously leads to calculating the real number of outliers in a multi-response problem. In this paper, we suppose that the outlier data will occur because of a mistake in the experimentation, but not in the recording of the data. Hence considering one response as an outlier while considering others not to be contaminated is not rational. A brief review on the literature is given in Table 1, as follows:

Table 1 A brief review of single and multi-response robust regression in the literature

To the best of our knowledge, there are a few studies on multi-response robust regression, and this paper focuses on the multi-response robust regression that considers the response residuals simultaneously. To estimate the regression coefficients in the multi-response problem, we propose a procedure in which we apply a simultaneous independent multi-response iterative reweighting procedure and change the M-estimator weighting function; a more precise estimation of each response can be obtained. By considering this procedure, a new criterion is proposed named the coincident outlier index (COI), and the performance of this procedure is analyzed.

This paper is organized as follows. ‘Using M-estimators for robust estimation of regression coefficients’ section presents the robust M-estimator procedure and the modification of the response surface by an iterative weighting procedure. The proposed method for the multi-response problem is defined in ‘Robust simultaneous estimation of multi-response problem’ section. To illustrate the proposed method, a numerical example is presented before the ‘Conclusions’ section. Finally, the last section provides the conclusions of this paper.

Using M-estimators for robust estimation of regression coefficients

The M-estimator proposed by Huber (1981) is the generalized form of the (MLEs). This part is extracted from Maronna et al. (2006). The M-estimator is the solution of Equation (1), as follows:

$$\stackrel{⌢}{\theta }=arg\underset{\theta }{\text{min}}{\displaystyle \sum _{i=1}^n\rho \left(x_i,\theta \right)}$$

(1)

where ρ is a function with specific properties. Supposed that f is a density function and ρ = -log f, where f is a density function, then $\stackrel{⌢}{\mathrm{\theta }}$ will be introduced as the MLE of the parameter. There are several ρ functions. One common ρ function is Huber (1981). This function is well-defined in Equation (2):

$${\mathit{\rho }}_k\left(x\right)=\left\{\begin{array}{ll}{\mathit{x}}^2& \mathit{if}\left|x\right|\le k\\ \mathit{2}\mathit{k}\left|x\right|-{\mathit{k}}^{\mathit{2}}& \mathit{if}\left|\mathit{x}\right|>\mathit{k}\end{array}\right.$$

(2)

By considering this function and by defining ψ = ρ′ and a weighting function by Equation (3), the iterative algorithm to estimate the unknown parameter can be defined.

$$W\left(x\right)=\left\{\begin{array}{l}\psi \left(x\right)/x\mathit{if}x\ne 0\\ {\psi }^{\prime }\left(x\right)\mathit{if}x=0\end{array}\right.$$

(3)

M-estimates for estimating regression coefficients are developed in the same way as defined in previous part. Equation (4) should be considered, and the coefficients can be obtained by solving following equation:

$${\displaystyle \sum _{i=1}^n\psi \left(\frac{r_i\left(\widehat{\beta }\right)}{\widehat{\sigma }}\right)}{\mathrm{x}}_{\mathrm{i}}=0$$

(4)

The $\stackrel{⌢}{\mathrm{\sigma }}$ in Equation (4) can also be estimated individually by Equation (5), as follows, or can be solved simultaneously in Equation (4). r _i is a residual of the response.

$$\stackrel{⌢}{\sigma }=\frac{1}{0.675}{{\displaystyle \mathit{Med}}}_i\left(\left|{{\displaystyle \mathit{r}}}_i\right|{{\displaystyle \mathit{r}}}_i\ne 0\right)$$

(5)

To make the estimation procedure invariant with respect to the scale of the residuals, the r _i s are divided by ‘s’. The value of ‘s’ is often taken to be equal to 1.4826 MAD, where MAD is the median of the absolute deviations of the residuals from their median, and 1.4826 is a bias adjustment for the standard deviation under the normal distribution.

An iterative reweighting method can be defined as follows: First, compute an initial estimate β₀ and compute $\stackrel{⌢}{\sigma }$ from Equation (5). After that, for k = 0, 1, 2, … :

First, Compute an initial estimate β₀ and compute $\stackrel{⌢}{\sigma }$ from Equation (5). After that, For k = 0, 1, 2, … :

• (a) Given ${{\displaystyle \stackrel{⌢}{\beta }}}_k$ , for i = 1, . . . , n, compute ${{\displaystyle r}}_{i,k}={{\displaystyle y}}_i-{{\displaystyle X}}_i^{\text{'}}{{\displaystyle \stackrel{⌢}{\beta }}}_k$ and ${{\displaystyle w}}_{i,k}=W\left({{\displaystyle r}}_{i,k}/\stackrel{⌢}{\sigma }\right)$.

• (b) Compute ${{\displaystyle \stackrel{⌢}{\beta }}}_{k+1}$ by solving the following:

  $${\displaystyle \sum _{i=1}^n{{\displaystyle w}}_{i,k}{{\displaystyle X}}_i}\left({{\displaystyle y}}_i-{{\displaystyle X}}_i^{\text{'}}{{\displaystyle \stackrel{⌢}{\beta }}}_k\right)=0$$

  (6)

Finally, the algorithm s tops when max $\left(\left|{{\displaystyle r}}_{i,k}-{{\displaystyle r}}_{i,k+1}\right|\right)/\stackrel{⌢}{\sigma }<ϵ$This algorithm converges if W(x) is non-increasing for x > 0 (Maronna et al. 2006). If ψ is monotone, because the solution is essentially unique, the choice of the starting point influences the number of iterations but not the final result. This procedure is called (IRWLS).

The procedure is as follows: compute the first coefficients of the regression model, then compute the residuals and weights, and finally compute the new coefficients using Equation (6). This procedure can be repeated because the values of the coefficients and the values of the residuals and weights are different; as a result, this procedure can be repeated until a good solution is obtained. The procedure terminates when the change in the estimation from one iteration to the next is sufficiently small. The estimators of coefficients based on the LS method are basically unbiased; the robust estimators like LS methods are basically unbiased too.

Robust simultaneous estimation of multi-response problem

In a multi-response problem, similar to a single response problem, robust estimation of the regression model is an important issue. A simple approach to estimating the regression models in multi-response problems is to consider the responses individually and to estimate the solution to each problem by the robust M-estimator approach. However, this approach could cause some problems. Assume in one experiment that a specific response residual appears to be an outlier. However, other responses do not show any signs of being unacceptable data for that specific experiment. The outlier data could occur because of a fault in the experimentation. It is not rational to say, then, whether one experiment's result is an outlier for one response because it may not be unacceptable data for the other responses. From this type of deduction, a large amount of the experiment's results could become outliers, and for each response, some points will be assumed to be outliers by mistake. Thus, assuming independence between responses, a simultaneous independent multi-response iterative reweighting (SIMIR) approach is proposed to solve this problem. In this approach, based on M-estimators, some changes are applied in the procedure of weighting functions to estimate the coefficients of the model. The weighting function proposed in this method, down-weights the residuals by considering each response of the multi-response problem in each iteration, simultaneously. We have j responses in this problem and i experiments. The variable r(i) _j defines the residual for the i th replicate of the j th response. The proposed weighting function is given in Equation (7):

$$\left\{\begin{array}{c}\hfill {{\displaystyle w}}_i=1\hfill \\ \hfill {{\displaystyle w}}_i=\frac{c}{\left|{\displaystyle \sum _{j=1}^l{{\displaystyle \mathit{r}\left(\mathit{i}\right)}}_{\mathit{j}}}\right|}\hfill \end{array}\right.\begin{array}{c}\hfill \begin{array}{c}\hfill \mathit{if}\begin{array}{}\end{array}\forall \begin{array}{}\end{array}\left|{{\displaystyle \mathit{r}\left(\mathit{i}\right)}}_{\mathit{j}}\right|<c\hfill \end{array}\hfill \\ \hfill \mathit{if}\begin{array}{}\end{array}\exists \begin{array}{c}\hfill \left|{{\displaystyle \mathit{r}\left(\mathit{i}\right)}}_{\mathit{j}}\right|>c\hfill \end{array}\hfill \end{array},$$

(7)

The proposed pseudo code is as follows:

• 1. Compute the actual values of the responses in each experiment by performing all of the experiments

• 2. Estimate the regression coefficients of the initial regression model by applying the proper method.

While $\left(\left|{{\displaystyle \mathit{r}}}_{i,k}-{{\displaystyle \mathit{r}}}_{i,k+1}\right|\right)/\stackrel{⌢}{\sigma }<ϵ$ Do (ϵ is determined by the analyzer).

• 3. Calculate the residuals of each response in all of the experiments

• 4. Compute the $\stackrel{⌢}{\sigma }$ by Equation ( 5).

• 5. If all r(i) _j are smaller than the threshold determined in the Huber M-estimator method, then dedicate the weight to be equal to 1 for the residuals in this iteration and go to step (7); else, go to step (6).

• 6. Down weight the residuals by considering the values of the residuals in all of the responses by a function in Equation ( 7 ).

• 7. Estimate the regression coefficients by solving Equation ( 6 ).

The performance of the proposed method is presented by a numerical example in the next section. By applying the SIMIR procedure, the squared errors (SE) of the estimated parameters, which are regression coefficients, are reduced compared to those of the least squares estimation of each response; however, to some extent, this strategy is not as precise as the robust individual estimation. One important problem in multi-response problems is the number of real outliers.

The SE criterion is computed in Equation (8):

$$\mathit{SE}={\left(\theta -\widehat{\theta }\right)}^2$$

(8)

Individually, residuals computed for one response could not be outliers in the whole multi-response problem. To detect the outliers in a multi-response problem, it is not correct to mention the outliers in each individual response. We present the COI to detect the real number of outliers in a robust estimation of the regression coefficients in a multi-response problem. This index can be computed by this procedure, for which we define the threshold by considering the suggested C (defined in Equation (7)) in the Huber procedure and by considering scaled residuals. If we consider the number of responses as n, then the proposed threshold is defined as $T=\left(\left[\frac{n}{2}\right]+1\right)\times C$. If the sum of the residuals is greater than this threshold, then that experiment is treated as an outlier. Thus, the COI is equal to the number of points that are greater than T. Equation (9) defines the proposed COI, as follows:

$$\mathrm{COI}={\displaystyle \sum _{i=1}^N{{\displaystyle z}}_{\mathit{ij}}}\begin{array}{c}\hfill \mathit{for}\begin{array}{cc}\hfill \begin{array}{c}\hfill \mathit{each}\hfill \end{array}\hfill & \hfill \begin{array}{c}\hfill j=1,\dots ,l\hfill \end{array}\hfill \end{array}\hfill \end{array}$$

$${{\displaystyle z}}_{\mathit{ij}}=\left\{\begin{array}{c}\hfill 1\hfill \\ \hfill 0\hfill \end{array}\right.\begin{array}{c}\hfill \mathit{if}\begin{array}{c}\hfill {\displaystyle \sum _{j=1}^4{{\displaystyle r}}_{\mathit{ij}}>T\begin{array}{c}\hfill \mathit{for}\begin{array}{}\end{array}\mathit{each}\begin{array}{c}\hfill i\hfill \end{array}\hfill \end{array}}\hfill \end{array}\hfill \\ \hfill \mathit{if}\begin{array}{c}\hfill {\displaystyle \sum _{j=1}^4{{\displaystyle r}}_{\mathit{ij}}<T\begin{array}{c}\hfill \mathit{for}\begin{array}{}\end{array}\mathit{each}\begin{array}{c}\hfill i\hfill \end{array}\hfill \end{array}}\hfill \end{array}\hfill \end{array}$$

(9)

where N is the number of experiments.

Numerical example

In this section, the efficiency of our proposed approach compared with existing approaches is illustrated for two cases. In case one, the number of coinciding outliers differs from the number of outliers that were detected by an individual procedure. In the second case, the previous experiments contain most of the outliers because of a true fault by the experimenter. The number of coinciding outliers and the outliers that are detected individually does not differ significantly in this case.

Case 1. tire tread compound problem

In this section, we illustrate the proposed method using the well-known problem ‘tire tread compound problem’, which was originally presented by Derringer and Suich (1980). In this model, three main chemical materials, such as silica (x₁), silane (x₂), and sulfur (x₃), and four responses are assumed. The experimental data results are given in Table 2.

Table 2 Experimental data of the tire tread compound problem

As a first step, we attempt to find a primary regression model with four responses. A central composite design (CCD) with six center points is applied to describe the model. All of the controllable variables are - 1.63 ≤ x _i  ≤ 1.63, i = 1, 2, 3. The regression coefficients that are obtained by the least squares estimation method and according to the CCD are given in Table 3, as follows:

Table 3 Summary of the least squares regression coefficients for each response in the first example

The scaled residuals of this multi-response problem are reported in Table 4, as follows:

Table 4 Scaled residuals of responses in the first iteration for the tire tread compound problem

For the first response, the residuals obtained by the experiments numbered 2, 7, 15, 16, and 19 appear to be outliers, and for the second response residuals, those numbered 5, 8, and 13 appear to be outliers. For the third response residuals, those numbered 11, 17, and 18 appear to be outliers. The fourth model does not contain a residual that implies an outlier. By omitting the values of the implied outliers, actual regression models can be obtained by a least squares method because least square is the most efficient method in the absence of outlier data. This method is considered to be the actual result in Table 5. In addition, to obtain the robust regression models by two different approaches, the robust individual regression approach and the SIMIR approach are applied and can be compared by considering the SE criteria.

Table 5 Actual, individual robust, and SIMIR regression coefficient estimations for the tire tread compound problem

First, we consider each response individually and apply the M-estimator procedure to each response. The constant C in this example is assumed to be 1.37. Finally, the SIMIR procedure is applied to the data. Coefficients obtained by actual, robust individual and SIMIR procedures are given in Table 5.

Then, to evaluate the procedures mentioned (actual, individual robust, and SIMIR approaches), the SE of these estimated parameters are computed using Equation (8), and the results are reported in Table 6. In Equation (8), it is assumed that the value of θ is the regression coefficient in the actual method, and $\widehat{\theta }$ is the regression coefficient in the considered method (actual, individual robust, and SIMIR approaches).

Table 6 SE of the estimation of each regression coefficient in the least squares, individual robust and SIMIR approaches

Additionally, the evaluation is given in Figure 1, as follows:

Figure 1

Evaluation of the sum of squared errors of proposed approach and classical approaches for the first example.

A comparison among the three approaches by considering the sum of squared errors (SSE) is computed in Table 6 and illustrated in Figure 1. In this figure, for the first three responses, the scaled values of the SSE are given.

The results show that the robust individual regression estimation is more precise than that of the least squares estimation or the proposed SIMIR approach, but the coincident outlier index that was presented in the previous section is more reliable and realistic. Moreover, the results state that in the case with an absence of outliers, LS performs better than both the robust individual and the SIMIR procedures. In this example, if we want to count the outliers as a multi-response problem individually, the results would be 11 experiments. However, by the proposed COI index, the real number of the multi-response problem outliers is 2, and it would be more rational that in 20 experiments, almost 10% of the experiments result in outliers.

Case 2. elastic element of a force transducer problem

We provide another example to illustrate the efficiency of the proposed method. The following example was presented as a case study in Romano et al. (2004), in which the problem was about the elastic element of a force transducer. This example involves a combined array design with three control (x) and two noise (z) variables. The control factors are the three parameters that describe the element configuration, namely the lozenge angle (x1), the bore diameter (x2), and the half-length of the vertical segment (x3). Noise factors are the deviation of the lozenge angle from its nominal value (z1) and the deviation of the bore diameter from its nominal value (z2). These internal noise factors are undeniably independent. The two indicators, namely the non-linearity (y1) and the hysteresis (y2), define the responses. Table 7 displays the data from this experiment.

Table 7 Experimental data of the elastic element of the force transducer problem

First, we need to find a primary regression model for the two responses. All of the controllable variables are - 1 ≤ x _i  ≤ 1, i = 1, 2. The regression coefficients that were obtained by the least squares estimation method are given in Table 8, as follows:

Table 8 Summary of the least squares regression coefficient for each response in the second example

The scaled residuals of this multi-response problem are reported in Table 9, as follows:

Table 9 Scaled residuals of two responses in the first iteration for proposed example

Consequently, for the first response, outliers appear with the residuals obtained by the experiments, numbered 17, 18, 21, 22, 23 and 25; for second response residuals, they are numbered 19, 20, 21 and 22. By omitting these values, the actual regression models can be obtained. To obtain the robust regression models, two different approaches are applied, and these two approaches are compared by considering the SE criteria.

First, we consider each response individually and apply the M-estimator procedure to each response. The constant C in this example is assumed to be 1.37. Thus, three groups of coefficients are reported in Table 10.

Table 10 Actual, individual robust, and SIMIR approach for regression coefficient estimation for the proposed problem

To evaluate the three procedures, the proposed SE criterion are calculated, and the results are given in Table 11 as follows:

Table 11 SE of the estimation of regression coefficients in LS, robust individual, and SIMIR methods

In addition, to provide more illustration, Figure 2 is given as follows:

Figure 2

Evaluation of the sum of squared errors of proposed and classical approaches for the second example.

Similar to the previous example, our results showed that the robust individual regression estimation performs better, but not significantly better than the least squares method; the SIMIR approach was also considered, but the COI is more realistic and accurate. In this example, if we want to count the outliers in a multi-response problem individually, the results would consist of eight experiments. However, by the proposed COI index, the real number of outliers in the multi-response problem is six.

Therefore, by considering these two examples, the number of detected outliers calculated by both the classical method and the SIMIR proposed approach is shown in Figure 3, as follows:

Figure 3

Evaluating the performance of the proposed method and the existing method for both cases, by considering the COI index.

Conclusions

As mentioned in the previous sections, a robust simultaneous estimation of regression coefficients in the multi-response problem in the case in which contaminated data exists was presented in this paper. In addition, the results showed that the proposed approach would consider a number of points to be real outliers in the multi-response problem, although individual robust regression shows some other points as outliers. Thus, an aggregative approach in the weighting function was proposed, in which all of the responses were surveyed. The SIMIR approach performed better than the classic method for detecting outliers and estimating regression coefficients. Additionally, our results show that the proposed approach would provide a better COI index than the classical approach for outlier detection. For future research, other robust regression approaches can be studied. In addition, considering a problem with correlated responses can be another aspect of related future research.

Authors' information

MB is an associate professor of the Department of Industrial Engineering, Shahed University, and his research interests are Multiple Response Optimization and Facilities Location Problem. AM is a Ph.D. student of the Department of Industrial Engineering at Amirkabir University of Technology (Tehran Polytechnic).