A two-sided Bernoulli-based CUSUM control chart with autocorrelated observations
- 527 Downloads
Abstract
Usually, in monitoring a proportion p, the binary observations are considered independent; however, in many real cases, there is a continuous stream of autocorrelated binary observations in which a two-state Markov chain model is applied with first-order dependence. On the other hand, the Bernoulli CUSUM control chart which is not robust to autocorrelation can be applied two-sided control chart to able to detect either increases or decreases in the process parameter. In this paper, a two-sided Bernoulli-based CUSUM control chart is proposed based on a log-likelihood-ratio statistic using a Markov chain model and average run length relationship. The average run length relationship is set using the corresponding upper and lower Bernoulli CUSUM charts. Simulation studies show the superior performance of the proposed monitoring scheme. Numerical results show the superior performance of the proposed control chart.
Keywords
Average run length Binary data Markov chain Bernoulli CUSUM Estimating process parametersIntroduction
Reynolds and Stoumbos (2001) extended a Bernoulli CUSUM control chart to be utilized in process monitoring when there is a stream of such binary inspection data. In this regard, their control chart can be applied to show a shift in p from the in-control value p_{0} resulting in assignable causes in the process monitoring. An augment in p would indicate worsening in the performance of the considered process. On the other hand, showing a decline in p is significant for alarming-enhanced process quality. For example, consider a decrease in the value of p; in this situation, the control limits for the control chart should be recomputed to better process monitoring in the future changes.
Cumulative sum (CUSUM) control charts and their applications have been considerably discussed in the statistical literature; see, for example, Ewan and Kemp (1960), Van Dobben de Bruyn (1968), Bissell (1969), and Kemp (1971). In this respect, a general definition of the construction of one-sided and two-sided CUSUM control charts is proposed by Van Dobben de Bruyn (1968), in which the run length distribution, its parameters measure the performance of a CUSUM procedure and are applied in real cases to obtain a suitable scheme. The average run length (ARL) has most often been used to measure and compare the performance of CUSUM procedures. However, the exclusive use of the ARL has been criticized, and the use of percentage points of the run length distribution has been suggested; see, for example, Bissell (1969). In this regard, some works on CUSUM chart relate to the healthcare context, for example Zhang and Woodall (2015), in which they proposed a dynamic probability control limits for risk-adjusted Bernoulli CUSUM charts.
The properties of the one-sided CUSUM control chart have received more attention than two-sided CUSUM control chart in which two one-sided control charts monitored process simultaneously. Different expressions for the exact run length distribution and its parameters have been proposed for the one-sided CUSUM procedure by Ewan and Kemp (1960), Brook and Evans (1972), Zacks (1981), and Woodall (1983). In addition, different estimations have been presented by many authors.
Kemp (1971) proposes the ARL in the two-sided CUSUM control chart in terms of the ARL in the two-component one-sided control chart. Nadler and Robbins (1971) utilized a Wiener process to estimate the run length distribution as a special case of the two-sided control chart. More recently, Lucas and Crosier (1982) applied a Markov chain description of the two-sided CUSUM control chart to set the ARL and the run length distribution. In this paper, we present results that will allow a more accurate Markov chain approach in two-sided Bernoulli-based CUSUM control chart with autocorrelated observation.
Most of the published works on control charts for autocorrelated binary observations assume that the observations can be modeled as a two-state Markov chain in which the probability of an observation being defective depends on the value of the previous observation (first-order dependence). In this regard, see, for example, Shepherd et al. (2007), Keramatpour et al. (2013), Vakilian et al. (2015), and Ashuri and Amiri (2015), in which observations are autocorrelated according to first-order dependence. Some additional published works have considered monitoring problems more related to what is studied here. For example, Bhat and Lal (1990) considered monitoring autocorrelated binary observations when samples have a continuous stream of observations and are available from the process. Moreover, Niaki and Abbasi (2007) considered the situation in which there is autocorrelation and a defective item can have more than one defect. It is worth mentioning that when constructing control charts to monitor a process with binary observations, it is significant to explicitly account for autocorrelation when it is present. The main objective of this paper is to extend a two-sided Bernoulli-based CUSUM control chart, called the two-sided Markov binary CUSUM (MBCUSUM) chart, for monitoring a process in which the observations follow the two-state Markov chain model and are binary. We consider the situation in which a continuous stream of binary observations is available for process monitoring. It is assumed that these binary observations become available individually, so the control charts can be based on samples of n = 1. The two-sided Markov binary CUSUM (MBCUSUM) control chart is based on a log-likelihood-ratio statistic obtained from the two-state Markov chain model. This study can be considered to be an extension of the Stoumbos and Reynolds (2008) work, which extended the MBCUSUM procedure for a continuous stream of autocorrelated binary observations (for more details, see Reynolds and Stoumbos (2000).
We next propose the two-sided Bernoulli CUSUM chart by defining the two-state Markov chain model. Finally, the performance of the proposed control chart is appraised in terms of the ARL criterion.
Proposed control chart
In situations that autocorrelation is known to be present, one approach is to adjust the control limits of the traditional charts to try to produce more acceptable values for the in-control average number of observations to signal. However, we next extend a CUSUM chart when there is autoregressive (1) autocorrelation and show that this chart has better ability to detect shifts in parameter p than the other traditional charts, even with adjusted control limits. For this aim, in the next section, a two-state Markov chain model is defined. Then, the two-sided Bernoulli CUSUM chart is proposed. Finally, a two-sided MBCUSUM chart is given for autocorrelated data using assumption and definitions in these subsections.
The two-sided markov chain model
The two-sided Bernoulli cusum chart
It should be noted that 1 − \(\gamma_{1}\) and 1 − \(\gamma_{2}\) show growth in the S_{i} and T_{i} statistics, respectively, attributed to X_{i} when X_{i}= 1. In addition, we have \(\gamma_{1}\) > \(\gamma_{2}\) because p_{1} > p_{0} > p_{2}.
Hence, we determine the conditions in which Eq. (5) is an equality so that the two-sided Bernoulli CUSUM control chart performance can be derived from the ARL performance of the two one-sided control charts. Reynolds and Stoumbos (1999) detected that the ARL of the one-sided Bernoulli CUSUM control charts should be estimated partly using Markov chains or revised processes. Appling Eq. (5) as an equality could be used with the Markov chain approach since one can avoid the more awkward two-dimensional Markov chain representation of the two-sided CUSUM control chart stated by Woodall (1983). The use of Eq. (5) as an equality is also useful in simulation studies in which one wants to fix the value of ARL_{T} when maintaining the same values for ARL_{U} and ARL_{L}.
The two-sided MBCUSUM chart for autocorrelated data
Note that properties of the Bernoulli CUSUM control chart can be appraised using a small adjustment of the monitoring scheme. In this regard, let the CUSUM control statistic is a lattice random variable with values that are integer multiples of \(\frac{1}{{m^{'} }}\), in which m’ is a positive integer. This modification permits the Bernoulli CUSUM to be modeled as a Markov chain. Similarity, for the MBCUSUM control chart, we adopt the same approach and obtain an estimation MBCUSUM control chart by estimating \(L_{k}^{'}\) by a random variable where the values are integer multiples of a fixed value. The strategy applied to estimate L_{k} is to get the integer \(m^{\prime } = \text{nint}\left( {|\frac{1}{{l_{{_{00} }}^{\prime } }}|} \right),\) in which nint(·) represents the nearest integer value. Then, \(L_{k}^{'}\) is estimated using a new statistic denoted as \(L_{k}^{'*}\) for which the possible values are integer multiples of \(\frac{1}{{m^{'} }}\). Hence, we have Eq. (12) according to Mousavi and Reynolds (2009) for \(k \ge 2,\)
Performance evaluation
Not that the ARL is not an suitable performance index when comparing control charts based on various sample sizes, Hence, instead we utilize the average number of observations to signal (ANOS), considered as the expected number of observations from the start of process monitoring until an alarm is released using the control chart (Reynolds and Stoumbos 1999, 2000). When the process is in-control, the ANOS should be large and the number of false alarms should be small. Moreover, if p shifts, it needs an index of how rapidly this augment is shown.
In some control charts, such as CUSUM control charts, the control statistics may not be at their starting values when the shift in parameter occurs. Because observations are gathered accumulately in the during time. Hence, the steady state ANOS is applied based on the assumption that the distribution of the control statistic occurs is the steady-state distribution of this statistic when the increase in p, conditional on any false alarms. In this regard, consider first a process with p_{0} = .010 and p = .05 and the proposed control chart based on samples of n = 100.
ANOS and SSANOS values for Shewhart, CUSUM, and two-sided MBCUSUM charts for detecting shifts in p when p_{0} = .010 and p = 0.05
Control chart | Shewhart | CUSUM | MBCUSUM | Two-sided MBCUSUM | |||||
---|---|---|---|---|---|---|---|---|---|
n | 100 | 1 | 1 | 1 | |||||
p | p _{01} | p _{11} | p_{l} = 0.025 | p_{l} = 0.04 | p_{l} = 0.025 | p_{l} = 0.04 | p_{l} = 0.025 | p_{l} = 0.04 | |
0.01 | 0.0095 | 0.0643 | 16,956.9 | 16,977.5 | 17,046.1 | 16,850.7 | 16,914.2 | 16,501.7 | 16,417.2 |
0.015 | 0.0142 | 0.0690 | 4226.2 | 2351.4 | 3155.0 | 2200.7 | 2876.8 | 2188.1 | 2176.3 |
0.020 | 0.0190 | 0.0738 | 1678.5 | 848.3 | 1102.0 | 798.0 | 1004.6 | 781.5 | 750.6 |
0.025 | 0.0238 | 0.0738 | 870.6 | 473.3 | 559.9 | 448.1 | 515.7 | 428.4 | 419.6 |
0.030 | 0.0285 | 0.0785 | 536.6 | 322.3 | 353.0 | 306.6 | 327.9 | 354.7 | 305.3 |
0.040 | 0.0380 | 0.0880 | 281.4 | 195.2 | 195.1 | 187.1 | 183.1 | 177.5 | 172.1 |
0.050 | 0.0475 | 0.0975 | 190.3 | 139.8 | 133.4 | 134.9 | 126.1 | 130.1 | 120.3 |
0.070 | 0.0665 | 0.1165 | 125.4 | 89.1 | 81.4 | 87.3 | 77.9 | 80.9 | 73.6 |
0.100 | 0.0950 | 0.1450 | 95.6 | 57.7 | 51.3 | 57.7 | 50.1 | 51.0 | 48.3 |
0.200 | 0.1900 | 0.2400 | 70.5 | 26.7 | 23.3 | 28.3 | 23.7 | 24.3 | 20.4 |
0.300 | 0.2850 | 0.3350 | 62.7 | 17.5 | 15.3 | 19.9 | 16.3 | 15.3 | 14.3 |
0.400 | 0.3800 | 0.4300 | 58.8 | 13.1 | 11.4 | 16.0 | 13.0 | 12.1 | 11.5 |
0.500 | 0.4750 | 0.5250 | 56.5 | 10.4 | 9.1 | 13.9 | 11.1 | 10.9 | 9.8 |
0.700 | 0.6650 | 0.7150 | 53.9 | 7.4 | 6.4 | 12.3 | 9.5 | 11.8 | 9.1 |
0.900 | 0.8550 | 0.9050 | 52.5 | 5.7 | 5.0 | 12.9 | 9.4 | 10.7 | 9.0 |
h | 5 | 5.1475 | 4.1087 | 4.2899 | 5.1176 | 4.8449 | 5.7256 | ||
Number of states | 1200 | 628 | 387 | 592 | 348 | 471 | 385 |
Succinctly, as seen in this table, the two-sided MBCUSUM chart has better performance than the Bernoulli CUSUM and Shewhart control chart. In other words, the proposed monitoring procedures work well and provide appropriate ARL criteria. The results of simulation studies show that the proposed MBCUSUM control chart performs better than monitoring the autocorrelated Bernoulli observations. So we conclude that the MBCUSUM is a better choice when there is autocorrelation.
Conclusion and future researches
Sometimes, there are binary observations from a process that follow a two-state Markov chain model. In these situations, it has shown that the autocorrelation affects a deleterious on traditional procedures designed for independent observations due to many false alarms. Thus, the two-sided MBCUSUM control chart proposed here is based on a log-likelihood-ratio statistic obtained from the two-state Markov chain model. The two-sided Bernoulli-based MBCUSUM control chart can be well estimated using a Markov chain, and this allows the two-sided MBCUSUM chart to be set up to have specific desired statistical properties. For this aim, we used the general result by Megahed et al. (2011) to set sufficient conditions in which the ARL of the two-sided MBCUSUM procedure can be obtained exactly from the ARLs of the corresponding upper and lower CUSUM control charts. The simulation studies showed the satisfactory performance of the proposed control chart. Considering the other distributed observations and self-starting procedure could be considered as future researches in this context.
References
- Ashuri A, Amiri A (2015) Drift change point estimation in the rate and dependence parameters of autocorrelated Poisson count processes using MLE approach: an application to IP counts data. IJE Trans A Basics 28(3):1021–1030Google Scholar
- Bhat N, Lal R (1990) Attribute control charts for Markov dependent production processes. IIE Trans 22(1):181–188CrossRefGoogle Scholar
- Bissell AF (1969) CUSUM techniques for quality control. Appl Stat 18(1):1–30 (with discussion) CrossRefGoogle Scholar
- Brook D, Evans DA (1972) An approach to the probability distribution of CUSUM run length. Biometrika 59(1):539–549MathSciNetCrossRefGoogle Scholar
- Ewan WD, Kemp KW (1960) Sampling inspection of continuous processes with no autocorrelation between successive results. Biometrika 47(1):363–380MathSciNetCrossRefGoogle Scholar
- Kemp KW (1971) Formal expressions which can be applied to CUSUM charts. J R Stat Soc 33(5):331–360 (with discussion) MathSciNetzbMATHGoogle Scholar
- Keramatpour M, Niaki STA, Khedmati M, Soleymanian M (2013) Monitoring and change point estimation of AR (1) autocorrelated polynomial profiles. Int J Eng Trans C Asp 26(9):933–942Google Scholar
- Lucas JM, Crosier RB (1982) Fast initial response for CUSUM quality control schemes. Technometrics 24(3):199–205CrossRefGoogle Scholar
- Megahed FM, Kensel JL, Bedair K, Woodall WH (2011) A note on the ARL of two-sided Bernoulli-based CUSUM control charts. J Qual Technol 43(1):43–56CrossRefGoogle Scholar
- Mousavi S, Reynolds JR (2009) A CUSUM chart for monitoring a proportion with auto-correlated binary observations. J Qual Technol 41(4):401–425CrossRefGoogle Scholar
- Nadler J, Robbins NB (1971) Some characteristics of page’s two-sided procedure for detecting a change in a location parameter. Ann Math Stat 42(2):538–551MathSciNetCrossRefGoogle Scholar
- Niaki STA, Abbasi B (2007) On the monitoring for multi-attributes high-quality production process. Metrika 66(3):373–388MathSciNetCrossRefGoogle Scholar
- Reynolds MR, Stoumbos ZG (2001) Monitoring a proportion using CUSUM and SPRT control charts. In: Lenz HJ, Wilrich P-Th (eds) Frontiers in statistical quality control, vol 6. Springer, Heidelberg, pp 155–175CrossRefGoogle Scholar
- Reynolds MR, Stoumos ZG (1999) A CUSUM chart for monitoring a proportion when inspecting continuously. J Qual Technol 31(2):88–108Google Scholar
- Reynolds MR, Stoumos ZG (2000) A general approach to modeling CUSUM charts for a proportion. IIE Trans 32(6):515–535Google Scholar
- Shefered DK, Champ CW, Rigdan SE, Fuller HT (2007) Attribute charts for monitoring a dependent process. Qual Reliab Eng Int 23(2):341–365CrossRefGoogle Scholar
- Stoumos M, Reynolds JR (2008) Monitoring Markov dependent observations with a log-likelihood based CUSUM. Technical Report 08-3, Department of Statistics, Virginia Tech. www.stat.org.vt.edu/deptjweb-e/tech_reports/TechReport08-3.pdf
- Vakilian F, Amiri A, Sogandi F (2015) Isotonic change point estimation in the AR(1) autocorrelated simple linear profiles. Int J Eng Trans A Basics 28(7):1059–1072Google Scholar
- Van Dobben de Bruyn CS (1968) Cumulative sum tests: theory and practice, griffin’s statistical monographs and courses, 24. Griffin, LondonGoogle Scholar
- Woodall WH (1983) The distribution of the run length of one-sided CUSUM procedures for continuous random variables. Technometrics 24(6):295–301MathSciNetCrossRefGoogle Scholar
- Zacks S (1981) The probability distribution and the expected value of a stopping variable associated with one-sided CUSUM procedures for non-negative integer valued random variables. Commun Stat 10(3):2245–2258CrossRefGoogle Scholar
- Zhang X, Woodall WH (2015) Dynamic probability control limits for risk-adjusted Bernoulli CUSUM charts. Stat Med 34(25):3336–3348MathSciNetCrossRefGoogle Scholar
Copyright information
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.