Phase II monitoring of multivariate simple linear profiles with estimated parameters

In some applications of statistical process monitoring, a quality characteristic can be characterized by linear regression relationships between several response variables and one explanatory variable, which is referred to as a “multivariate simple linear profile.” It is usually assumed that the process parameters are known in Phase II. However, in most applications, this assumption is violated; the parameters are unknown and should be estimated based on historical data sets in Phase I. This study aims to compare the effect of parameter estimation on the performance of three Phase II approaches for monitoring multivariate simple linear profiles, designated as MEWMA, MEWMA_3 and MEWMA∕ 2 . Three metrics are used to accomplish this objective: AARL, SDARL and CVARL. The superior method may be different in terms of the AARL and SDARL metrics. Using the CVARL metric helps practitioners make reliable decisions. The comparisons are carried out under both in-control and out-of-control conditions for all competing approaches. The corrected limits are also obtained by a Monte Carlo simulation in order to decrease the required number of Phase I samples for parameter estimation. The results reveal that parameter estimation strongly affects the in-control and out-of-control performance of monitoring approaches, and a large number of Phase I samples are needed to achieve a parameter estimation that is close to the known parameters. The simulation results show that the MEWMA and MEWMA∕ 2 methods perform better than the MEWMA_3 method in terms of the CVARL metric. However, the superior approach is different in terms of AARL and SDARL.


Introduction
In most statistical process monitoring (SPM) applications, it is assumed that the quality of a process or product is characterized by the statistical distribution of a single quality characteristic or a vector of several quality characteristics. However, in some cases, process quality could be characterized by a functional relationship between a response variable and one or more explanatory variables, which is referred to as a "profile." Similar to other process monitoring approaches, profile monitoring is carried out by sampling. Several sets of data points are collected to represent their relationship with a curve (profile). The main objective of profile monitoring is to monitor the stability of this curve over time.
There are different types of profiles. If a linear regression model can represent the relationship between one response variable and one explanatory variable that is a simple linear profile. As an application of simple linear profiles, Kang and Albin (2000) addressed a calibration problem in semiconductor manufacturing and monitored the relationship between measured pressure (Y) and the amount of flow (X) using profiles. Monitoring and change point estimation of simple linear profiles have been considered by some researchers, including Stover and Brill (1998), Mestek et al. (1994), Mahmoud and Woodall (2004), Wang and Tsung (2005), Gupta et al. (2006), Mahmoud et al. (2007), Zou et al. (2007), Noorossana et al. (2008), Jensen et al. (2008), Narvand et al. (2013), Niaki (2015, 2016) and Kalaei et al. (2018).
There are other more complicated types of profiles such as multiple, polynomial and nonlinear profiles that have been studied by many researchers. Several approaches to monitor multiple linear profiles have been developed by some researchers, including Mahmoud (2008), Jensen et al. (2008), Zou et al. (2007), Parker and Finley (2007) and Amiri et al. (2012). In addition, Kazemzadeh et al. (2008Kazemzadeh et al. ( , 2009 proposed several methods for monitoring polynomial profiles. Nonlinear profile monitoring through parametric and nonparametric methods and mixed linear profiles has been studied by some researchers, including Ding et al. (2006), Jeong et al. (2006), Williams et al. (2007), Moguerza et al. (2007) and Vaghefi et al. (2009).
In the case of multivariate simple linear (MSL) profiles, which are the main focus of the current paper, the term "simple" refers to the uniqueness of the explanatory variable, and the term "multivariate" refers to the multiplicity of the response variable. In such profiles, there are several response variables, each of which has a linear regression relationship with one explanatory variable. Some researchers, such as Noorossana et al. (2010), Zou et al. (2012), Ayoubi et al. (2014) and Adibi et al. (2014), have studied different aspects of multivariate profile monitoring. Noorossana et al. (2010) were the first researchers who proposed three methods, designated as MEWMA_3, MEWMA∕ 2 and MEWMA, for monitoring MSL profiles in Phase II. They evaluated the performance of these methods in detecting shifts in profile parameters under in-control and out-of-control conditions in terms of average run length (ARL). Their results showed that the MEWMA and MEWMA∕ 2 methods outperform MEWMA_3. They also used these three methods in a real case study.
Based on the literature, profile monitoring approaches are divided into two phases: Phase I and Phase II. These phases are distinguished by the difference in their goals. In Phase I, a set of historical data points is available (m samples, each based on n observations). The main goals of Phase I are evaluating process stability, recognizing and eliminating assignable causes and estimating process parameters from in-control samples. The objective of Phase I is to recognize assignable causes with high probability. The main interest in Phase II is quick detection of shifts based on the estimated parameters obtained in Phase I. Existing monitoring approaches in these two phases are dissimilar and use different evaluation metrics. In Phase I, the probability of a signal under out-of-control conditions is used to describe the ability of a control chart to detect shifts in parameters. The ARL metric and its statistical properties are applied to evaluate control chart performance in Phase II. To find out more about profile monitoring approaches in Phases I and II, see the review paper by Woodall et al. (2004) and Woodall 2007) and the book edited by Noorossana et al. (2011).
In most studies of Phase II profile monitoring, it is assumed that the in-control parameters are known. In fact, the values of profile parameters are rarely known in practical environments and should be estimated in Phase I. This assumption may affect control chart performance because of the additional variability added by estimation of parameters. Therefore, the following questions should be answered: • Does profile parameter estimation really affect the performance of Phase II control chart schemes? • What is the proper metric for measuring the effect of parameter estimation? • Which method of profile monitoring is less affected by parameter estimation?
While a substantial number of studies have been done on evaluating the effect of parameter estimation on the performance of control charts for non-profile characteristics, there are only a few studies on this topic for profile characteristics. Woodall and Montgomery (2014) discussed the field of statistical process control, stating that "There is also work needed on the effect of parameter estimation error on the Phase II performance of profile monitoring methods." Mahmoud (2012) was the first author to compare the incontrol and out-of-control performance of three well-known simple linear profile monitoring approaches that had first been proposed by Kang and Albin (2000), Kim et al. (2003) and , for use when parameters are estimated. In this study, the ARL and standard deviation of run length (SDRL) metrics are used to compare the performance of simple linear profile monitoring approaches. The results showed that using estimated profile parameters instead of known values in Phase II strongly affects the performance of all three methods under in-control and outof-control conditions in terms of both the ARL and SDRL metrics. This author also used simulated corrected limits to investigate the out-of-control performance of the monitoring approaches. Corrected limits are usually wider than control limits based on known parameters and reflect variability added to the process by parameters estimation. A smaller number of Phase I samples are needed for proper estimation when the corrected limits are applied. The simulation results showed that the method described by  has better out-of-control run length performance than other competing methods.
1 3 Mahmoud (2012) used only the ARL and SDRL metrics to compare control chart performance based on estimated parameters. However, the standard deviation of average run length (SDARL) is also important in comparison with control chart performance. When different practitioners take samples in Phase I, they may estimate different values for process parameters. Consequently, they may obtain different values for in-control ARL, adding a new source of variability to the process: practitioner-to-practitioner variability. In other words, when it is assumed that the process parameters are unknown in Phase II and should be estimated from the Phase I data set, the ARL is no longer a parameter, but becomes a random variable. The ARL curve has almost a right-skewed distribution (Jensen et al. 2006). Zhang et al. (2014) maintained that practitioner-to-practitioner variation is inevitable because different Phase I data sets are used. The SDARL is a very useful metric for measuring this variation. Researchers have suggested that the SDARL should be within 5-10% of the desired in-control ARL value. It is obvious that when the process parameters are known, the SDARL is equal to zero. Aly et al. (2015), similar to Mahmoud (2012), compared the performance of three methods of simple linear profile monitoring [the method proposed by Kang and Albin (2000), Kim et al. (2003) and  in terms of in-control AARL and SDARL, but they did not investigate the out-of-control performance of the mentioned control charts. The results of their study showed that when the parameters are estimated, the Kim et al. (2003) method generally shows better in-control performance compared to the other competing methods in terms of the SDARL. They also illustrated that if a control chart shows a particular performance in terms of the ARL, it may not show the same performance in terms of the SDARL.
The coefficient of the variation of average run length (CVARL), along with the AARL and SDARL, has also been used to evaluate the performance of multivariate adaptive EWMA control charts by Aly et al. (2016). The CVARL is calculated by the following equation: To the best of the authors' knowledge, there is no study in the literature that evaluates the effect of parameter estimation on the performance of control charts for monitoring MSL profiles. This paper can be an useful source for quality control engineers in choosing the best control chart for monitoring MSL profiles. According to the simulation results, using parameter estimates with upper control limits designed based on the known parameters can result in a significant deterioration of the chart performance. Because these estimators add extra variability in the chart control limit(s). Therefore, applying a control chart scheme which is less affected by this effect would be very constructive and leads to a huge cost saving in terms of time or expenses for any manufacturing systems. Measuring the estimation effect can be carried out by computing some metrics. In this paper, for the first time, the AARL , SDARL and CVARL are used to evaluate the in-control and out-of-control performance of control chart schemes. Note that, using different metrics such as the AARL or SDARL may lead to different results, which can lead to ambiguity in choosing the best method. In this situation, using the CVARL , which considers both the AARL and SDARL metrics, can help achieve a reliable decision and choose the best method. According to the literature, it is obvious that the large Phase I sample leads to more accurate estimates and, consequently, better Phase II performance. However, there might be situations in which collecting a large number of samples is not possible. Hence, using corrected control limits is suggested; in this procedure, a large number of m Phase I data are not required to achieve the desired incontrol ARL . Using wider control chart limits to reflect the variability of parameters estimation is the main idea of using corrected limits. In previous studies such as Mahmoud (2012), corrected limits have been obtained in order to achieve an in-control value of ARL = 200. However, in the current study, corrected limits are established in order to achieve an in-control value of AARL = 200 through simulation runs to consider practitioner-to-practitioner variability and reduce the number of Phase I samples for parameters estimation. Note that the out-of-control performance of monitoring approaches is also evaluated based on simulated corrected limits.
The rest of this paper is organized as follows. "The multivariate simple linear regression model" section contains a brief explanation of the multivariate simple linear regression model. In "Phase II monitoring methods for multivariate simple linear profiles" section, three MSL profile monitoring approaches in Phase II are presented. "The proposed approach for measuring the effect of parameter estimation on the performance of Phase II control charts" section presents a description of the procedure for evaluating the effect of parameter estimation on the performance of monitoring approaches. Then, "Comparison of control chart performance under in-control conditions" section presents the in-control performance of competing approaches in terms of the AARL , SDARL and CVARL metrics. "The proposed approach for establishing corrected limits" section presents the simulated corrected limits to achieve the desired in-control AARL . In "Comparison of control chart performance under out-of-control conditions" section, the detection performance of the control chart schemes is compared under different types of shifts. Finally, the conclusions and suggestion for further research are provided in "Conclusion and suggestions for future research" section.

The multivariate simple linear regression model
In this model, there is a linear regression relationship among several response variables and one explanatory variable in an MSL profile. Assume that m Phase I samples are available. In each sample, there are n fixed values for explanatory variable ( x ), and for each value of n, there are p corresponding values of the response variables. Therefore, for the kth sample, n observations are available as follows: where x i is ith value of the explanatory variable and y i1k , y i2k , … , y ipk are corresponding values of the response variables. The relationship among the explanatory and response variables can be represented as: or where k = y 1k , y 2k , … , y nk T is an n × p matrix of the response variables for the kth sample. Each row of k ( y ik ) is related to one of the x i values, which contains p values of the response variables. In addition, = 1 x is an n × 2 matrix of the explanatory variables in which x is a vector of x values. It is assumed that = 1 x is fixed in all sampling points. k = 1k , 2k , … , nk T is an n × p matrix of error terms for the kth sample in which each row ( ik ) corresponds to one row of the response variable matrix ( k ). Based on the assumptions of the multivariate regression model, each ik follows a multivariate normal distribution with a 1 × p mean vector of zero and a p × p covariance matrix . In fact, the elements of each row of k are dependent on each other by a multivariate normal distribution; however, each row is independent of the other rows. k = 0k , 1k T is a 2 × p matrix of known simple regression coefficients. Based on the least squares approach, the estimation of k can be calculated by the following relation: (2) Phase II monitoring methods for multivariate simple linear profiles Noorossana et al. (2010) proposed three control chart approaches for monitoring MSL profiles in Phase II. Then, they evaluated the performance of the proposed methods in terms of the ARL metric under in-control and out-of-control conditions. These three approaches are briefly discussed below.

MEWMA control chart
This method was first introduced by Lowry et al. (1992). k can be rewritten by a 1 × 2p vector, namely T k , as follows: The least squares error estimate of T k is ̂ T k , where it follows a multivariate normal distribution with mean vector of T = 01 , 02 , … , 0p , 11 , 12 , … , 1p and 2p × 2p covariance matrix ̂ . The formulas for computing the elements of ̂ were given in their paper. Finally, the z k statistic is given as follows (Noorossana et al. 2010): where z k is a 1 × 2p matrix and (0 < ≤ 1) is a smoothing parameter. It can be shown that under in-control conditions, z k follows a 2p multivariate normal distribution with a mean vector of zero and a covariance matrix z k = (2− ) ̂ . Hence, for kth sample, the MEWMA statistic is obtained by using the following equation (Noorossana et al. 2010): In this method, the chart alarms when T 2 z k > h . The value of h . is determined through the simulation to achieve a specified in-control ARL.

∕ 2 control chart
This method is an extension of the second approach proposed by Kang and Albin (2000). The vector of the average error for the kth sample is denoted by ē k = ē 1k ,ē 2k , … ,ē pk T , in It can be shown that under in-control conditions, ē k follows a p-variate normal distribution with a mean vector of zero and a covariance matrix ē = n −1 .
The MEWMA method proposed by Lowry et al. (1992) is used to monitor average error. For the kth sample, the 1 × p vector of weighted moving average errors ( z k,e ) is given by (Noorossana et al. 2010): where z 0,e is a 1 × p vector and (0 < ≤ 1) is a smoothing parameter. It can be shown that under in-control conditions, z k,e follows a p-variate normal distribution with a mean vector of zero and a covariance matrix . For the kth sample, the MEWMA statistic is obtained by (Noorossana et al. 2010): The chart signals as soon as T 2 > h e . The value of h e is determined through the simulation to achieve a specified in-control ARL. Noorossana et al. (2010) developed the method proposed by Noorossana et al. (2004) for monitoring process variability and proposed a new Chi-square statistic, 2 ik = e ik −1 e T ik , which follows a Chi-square distribution with p degrees of freedom; consequently, 2 ik follows a Chi-square distribution with np degrees of freedom. Hence, 2 np, which denotes the 1 − percentile of a Chi-square distribution with np degrees of freedom can be used as an upper control limit for this statistic.

MEWMA_3 control chart
This approach is an extension of the approach given by Kim et al. (2003) where x values are coded so that their average becomes zero. When X = 0 , the covariance between the estimated slope and intercept of the profile becomes zero. In this situation, the 1 × p vector of intercepts and 1 × p vector of slopes are independent and can be monitored separately. Then, the monitoring process of regression parameters, as well as process variability, can be carried out using three separate control charts. In this case, the relation between the explanatory and response variables for the ith observation is given by (Noorossana et al. 2010) where +xJ and J is a 1 ×p vector of 1's. In the new model, the estimation of intercepts is obtained by ̂ � 0k = ȳ .1k ,ȳ .2k , … ,ȳ .pk the kth sample; however, the estimation of slopes is the same as the estimate in the original model. When the process is in-control, ̂ . is equal to zero. Hence, separate control charts for monitoring of ′ 0 and ′ 1 can be implemented (Noorossana et al. 2010).
The main advantage of using three separate control charts is easier identification of the parameter responsible for out-of-control signals. In the proposed MEWMA chart for monitoring of intercept vector ( ̂ ′ 0k ), the variable z Ik can be computed by (Noorossana et al. 2010): where z I0 is a 1 × p vector of zeros and (0 < ≤ 1) is a smoothing parameter. It can be shown that when the process is in-control, z Ik follows a p-variate normal distribution with an average vector of zero and a known covariance matrix . Therefore, the T 2 Ik statistic for the kth sample is given as follows (Noorossana et al. 2010): The chart signals when T 2 Ik > h I where h I is determined to achieve a specified in-control ARL.
In the MEWMA chart for slope monitoring, z Sk can be calculated as follows (Noorossana et al. 2010): where z S0 is a 1 × p vector of zeros and (0 < ≤ 1) is a smoothing parameter. When the process is in-control, z Sk follows a p-variate normal distribution with a mean vector of zero and a known covariance matrix . Therefore, the MEWMA statistic for the kth sample can be defined as follows (Noorossana et al. 2010): The chart signals when T 2 Sk > h S and h S is determined such that a specified in-control ARL is obtained.
Another MEWMA control chart similar to that proposed by Crowder and Hamilton (1992) is developed for monitoring of process variability. The logarithm of the statistic (Noorossana et al. 2010): where np is the mean of a Chi-square distribution with np degrees of freedom and (0 < ≤ 1) is a smoothing parameter. In this approach, the chart signals when z Ek > h E where h E is determined in such a way that a specified in-control ARL is achieved.

The proposed approach for measuring the effect of parameter estimation on the performance of Phase II control charts
Based on the literature, it is usually assumed that the parameters of a profile (matrix B) and the covariance matrix of the response variables ( ) are known in Phase II. In the current study, it is assumed that matrix B is unknown and should be estimated through in-control Phase I samples. Now the question is whether the B estimation affects the performance of the MSL profile monitoring approaches ( MEWMA , MEWMA_3 and MEWMA∕ 2 methods) that have been developed based on known parameters, and which method is more robust to the effects of parameter estimation.
To answer these questions, a Monte Carlo simulation algorithm is proposed to evaluate the effect of parameter estimation on the performance of control chart schemes.
Note that the current study, for better comparison, uses the same multivariate profile model given by Noorossana et al. (2010): Assume that x i values are set equal to 2, 4, 6 and 8 ( X = 5 ) which are considered to be fixed in all the sampling stages, and the covariance matrix of the response variables is  Table 1. Note that Noorossana et al. (2010) obtained the upper control limits for each of the three methods just for = 0.2 . In the current study, the control limits were obtained for = 0.05, 0.1 to evaluate the effect of on the control limit values. Table 1 shows that the control limit values increase when increases. It should be noted that since the 2 statistic is not dependent on , this parameter does not affect the upper limit of the 2 control chart. 2. Generate m in-control MSL profiles based on known parameters using a multivariate normal distribution with a mean vector of zero and a covariance matrix . 3. Calculate ̂ k where k = 1, 2, … , m for each of the profiles generated in step 2, then calculate ̂= using Eq. 5, and calculate the chart statistic. Note that ̂ obtained in step 3 should be considered as the estimation of profile parameters, instead of which contains known parameters. Then, set RL = 1. 5. Compare the calculated chart statistic with the corresponding upper control limit (UCL) ( Table 1). If the chart statistic is larger than the UCL , go to step 6; otherwise, set RL = RL + 1 and go to step 4. 6. Record the RL value and go to step 4. 7. Repeat steps 4-6, 10,000 times and calculate the ARL by averaging the RL values. Then, go to step 2. 8. Repeat steps 2-7, 10,000 times to achieve 10,000 different values of the ARL . Then, calculate the AARL = Mean(ARL) , SDARL = STD(ARL) and CVARL using Eq. 1.

Comparison of control chart performance under in-control conditions
In this section, the in-control performance of the three control chart approaches for monitoring MSL profiles is compared when profile parameters are estimated using the simulation algorithm described in "The proposed approach for measuring the effect of parameter estimation on the performance of phase II control charts" section. Table 2 contains the results of the simulation study for different values of m and θ in order to compare the performance of the control chart schemes in terms of the in-control AARL, SDARL and CVARL metrics. In general, more Phase I samples lead to better estimation that is closer to the desired in-control AARL = 200 , SDARL = 0 and CVARL = 0.
Since three different metrics were used in the current study, it is better to separately compare the performance of the schemes in terms of each metric. Table 2   show that the performance of the control chart approaches under in-control conditions is strongly affected by parameter estimation. Based on the AARL metric, it can be inferred that the MEWMA∕ 2 method performs better than competing methods because of a larger AARL value in most of the cases. For instance, if = 0.2 , the AARL value of the MEWMA∕ 2 method is almost 90% of the specified in-control ARL ( ARL 0 = 200 ) using a smaller number of samples ( m = 200 ) than the other methods. Table 1 shows that the AARL value increases when the value of the smoothing parameter ( ) increases. This could be very useful in practical environments. In some industries, such as military or high-tech industries, a high number of false alarms lead to high expenses; therefore, choosing the method that has a larger in-control AARL is suggested in order to reduce the rate of false alarms. Figure 2 shows a comparison of the performance of the control chart schemes in terms of the SDARL metric for different values of m and . It is obvious that smaller values of the SDARL represent better performance of the control chart schemes. However, it is recommended that the SDARL be within 5-10% of the desired in-control ARL . Choosing the superior method in terms of the SDARL metric is not clear in this case. According to Fig. 2, there is no method that results in smaller SDARL value than the other competing methods for all the values of m. This ambiguity rises when the value of decreases. However, it can be confidently inferred that the MEWMA_3 method performs best in terms of the SDARL except for small values of m ( m = 10 ) when = 0.2 . Furthermore, the MEWMA_3 and MEWMA∕ 2 methods reached SDARL values that are within 5%-10% of the desired in-control ARL = 200 using a smaller number of Phase I samples than the MEWMA method. Now the question is: What is the best decision in such situations?
The solution we propose is using the CVARL metric, which is calculated by Eq. 1. Using this metric allows both the AARL and SDARL to be considered simultaneously in deciding which is the superior method. Aly et al. (2016) used this metric in their study on adaptive EWMA control charts. Figure 3 shows the CVARL comparison of the control chart schemes when the process is in-control. Whereas the MEWMA_3 and MEWMA∕ 2 methods both perform better than the MWEMA method, the MEWMA_3 method uniformly performs better than the other competing methods. Moreover, the performance of the MEWMA_3 method improves as the value of m increases. The proposed approach for establishing corrected limits As observed in "Comparison of control chart performance under in-control conditions" section, in the MEWMA∕ 2 method, we need at least 200 in-control Phase I samples for parameters estimation so that the AARL value is at least 90% of the specified in-control ARL 0 = 200 . Therefore, the practitioner should wait too long to collect samples. Hence, in these situations, using corrected control limits is strongly suggested. By using corrected limits which are usually wider than original ones due to the extra variability added to the process by estimators, the problem of large Phase I samples requirement for estimation can be solved. Corrected limits can also be established based on the small size of historical data set. However, it should be noted that very wide corrected limits due to very small Phase I samples can deteriorate the detection performance of Phase II control charts. To learn more about corrected limits please see Quesenberry (1993), Jones (2002), Champ et al. (2005) and Mahmoud and Maravelakis (2010).
In the current study, the corrected limits are obtained through the Monte Carlo simulation algorithm discussed in "The proposed approach for measuring the effect of parameter estimation on the performance of Phase II control charts" section for each of the profile monitoring methods to achieve AARL ≅ 200 by 10,000 simulation runs and using the number of m in-control Phase I profiles for parameter estimation. Note that in the previous studies, such as Mahmoud (2012), the corrected limits are obtained to achieve a specified incontrol ARL . However, in the current study, the corrected limits are obtained based on achieving in-control AARL in order to consider practitioner-to-practitioner variability. The results of the simulation study are shown in Table 3. The corrected limits are usually wider than the control limits derived based on known parameters (Table 1). Therefore, the control limits given in Table 1 can be used as the starting point in simulation runs. Similar to the known parameter case, corrected limits also increase when increases. Corrected limits could be used in evaluating the out-ofcontrol performance of control charts. Assume that when parameters are estimated, a shift has occurred in one of the profile parameters and the control chart has alarmed. In this situation, we cannot determine whether this alarm is due to the effect of parameter estimation or the effect of the shift in the in-control parameter. Hence, using corrected limits ensures that chart alarming occurs only because of the shift in profile parameters. Consequently, evaluating the performance of the control chart schemes under out-of-control conditions was carried out using corrected limits; the results are shown in Table 3.

Comparison of control chart performance under out-of-control conditions
Several types of shifts are considered to evaluate the outof-control performance of control chart schemes using parameter estimation, including: (1) a shift in the intercept of the first profile ( 01 ); (2) a shift in the slope of the first profile ( 11 ). To apply these shifts, we should generate an out-of-control profile based on the shifted parameters in step 4 of the simulation algorithm presented in "The proposed approach for measuring the effect of parameter estimation on the performance of Phase II control charts" section.
Note that the applied shifts in this paper are the same as the shifts applied in a study by Noorossana et al. (2010), which was based on known parameters, in order to compare the results of our study (when parameters are estimated) with the results of Noorossana et al. (2010) (when parameters are known). In addition, the corrected limits (Table 3) are used to compare the out-of-control performance of the control chart schemes. Table 4 shows the out-of-control AARL , SDARL and CVARL metrics of the control chart schemes when 01 shifts to 01 + 0 1 . In this case, the performance of the MEWMA and MEWMA∕ 2 methods is uniformly better than that of the MEWMA_3 method in terms of the AARL for all values of m. However, the performance of the MEWMA∕ 2 method is better than the MEWMA method for small shifts; for the large shifts, both methods perform similarly. On the other hand, the MEWMA method has a smaller SDARL value than the other competing methods. However, the SDARL performance of MEWMA and MEWMA∕ 2 methods are almost similar. Finally, considering the CVARL metric, showed better performance of the MEWMA method compared with the other competing methods. However, Noorossana et al. (2010) found that the MEWMA∕ 2 method performs better compared to the other competing methods in terms of outof-control ARL when the parameters are known.
The out-of-control AARL , SDARL and CVARL values when 11 shifts to 11 + 1 1 are given in Table 5. Similar to the case in which the parameters are known, the results show that the MEWMA method performs better than the other competing methods in terms of all three metrics. However, the MEWMA∕ 2 method is more capable of detecting very small shifts than the other methods in terms of the CVARL.
Based on the results obtained, it is possible to conclude that control chart performance under out-of-control conditions is strongly affected by the parameter estimation, similar to in-control conditions. When estimated parameters are used for calculating the control chart statistic, a large number of Phase I samples are needed in order to achieve the same in-control performance as when the parameters are known. On the other hand, taking more Phase I samples for the parameter estimation leads to better detection performance.
Therefore, we can say with confidence not only that the in-control and out-of-control performance of control chart schemes for monitoring MSL profiles is seriously affected by parameter estimation, but also that ignoring the variability added to the process by parameter estimation can affect choosing the superior monitoring scheme.
This could have many economic and competitive advantages in manufacturing and non-manufacturing industries because of decreasing the rate of false alarms.

Conclusion and suggestions for future research
The current study was an investigation of the effect of parameter estimation on three approaches to MSL profile monitoring. The approaches are: (1) a MEWMA control chart for monitoring profile parameters; (2) a combination of a MEWMA control chart based on the vector of residual means and a 2 chart for monitoring process variability ( MEWMA∕ 2 ); and (3) a combination of three separate MEWMA control charts ( MEWMA_3 ) for monitoring the vector of intercepts, the vector of slopes and the process variability. Since the ARL is no longer a parameter when it is assumed that the process parameters are estimated, we used three metrics, the AARL , SDARL and CVARL , which are based on the statistical properties of the ARL distribution. Our goal is to compare the methods and choose the best one, which is more robust to the effect of parameter estimation. The simulation results showed that the MEWMA∕ 2 method performs better in terms of the in-control AARL   metric and needs fewer Phase I samples to achieve 90% of the desired in-control ARL = 200 . Although it is confidently inferred that the MEWMA_3 method performs better than the other competing methods in terms of the SDARL metric when = 0.2 , the results are not the same for other values of . We recommended using the CVARL metric as the basis of the comparison in order to simultaneously consider the AARL and SDARL . The results showed that the MEWMA_3 method performs uniformly better than other approaches in terms of the CVARL , although the MEWMA∕ 2 method performs better than the MEWMA_3 method for small values of m. The performance of the MEWMA_3 method improves by increasing m. After obtaining simulated corrected limits in order to reflect the variability added to the process by parameter estimation, we investigated the out-ofcontrol performance of the control chart schemes in terms of all the metrics, considering different out-of-control scenarios. The simulation results showed that the MEWMA and MEWMA∕ 2 charts have similar out-of-control performance in most cases. However, it can be declared that the MEWMA method generally performs better than other competing methods in terms of the AARL , SDARL and CVARL for all out-of-control scenarios. Future research in this area could involve investigation of the parameter estimation effect on the in-control and outof-control performance of different monitoring approaches for other types of profiles, such as nonlinear or polynomial profiles. Also, new metrics could be used in order to better measure the effect of parameter estimation, which is very useful in deciding on superior methods.