Skip to main content
Log in

Application of consistency checking to evaluation of uncertainty in multiple replicate measurements

  • General Paper
  • Published:
Accreditation and Quality Assurance Aims and scope Submit manuscript

Abstract

Use of repeated measurements in quantitative chemical analysis is common but leads to the problem of how to combine the measurement values and produce a result with an uncertainty following the GUM. There is often confusion between repeated indications or observations of an input quantity, for whose uncertainty the GUM prescribes a type A evaluation, and complete measurements repeated on multiple sub-samples, as considered here. A solution for combining repeated measurement results and their individual uncertainties based on simple interval logic is proposed here. The individual measurement values and their uncertainties are compared with the calculated average value to see if this implies that another, possibly unknown, source of uncertainty is present. The model of the individual results is modified for this possible between-replicate effect so that the repeated measurements are consistent. Lack of consistency is a strong indication that the measurement is not fully under control and needs further development or investigation. This is not always possible, however and the method given here is proposed to ensure that the values of the repeated measurements agree with each other. A simple numerical example is given showing how the method can be implemented in practice.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

References

  1. Ellison SLR, Rösslein M, Williams A, Eurachem/Citac (eds) (2000) Quantifying uncertainty in analytical measurement, 2nd edn. http://www.measurementuncertainty.org/mu/QUAM2000-1.pdf

  2. European co-operation for Accreditation (1999) Expression of the uncertainty of measurement in calibration, EA, EA-4/02. http://www.european-accreditation.org

  3. International Organization for Standardization (1995) Guide to the Expression of Uncertainty in Measurement, 2nd edn. International Organization for Standardization, Geneva, ISBN 92-67-10188-9

    Google Scholar 

  4. Kessel R (2003) A novel approach to uncertainty evaluation of complex measurements in isotope chemistry, Dissertation. University of Antwerp, Antwerp

  5. Box GEP, Hunter WG, Hunter JS (1978) Statistics for experimenters. Wiley, NY, ISBN 0-471-09315-7

  6. ISO: GUIDE 35 (1989) Certification of reference materials, 2nd edn. International Organisation for Standardisation, Geneva

    Google Scholar 

  7. GUM Workbench Version 2.3.6 2005 Metrodata GmbH, Im Winkel 15-1, D-79576, Weil am Rhein, Germany. http://www.metrodata.de

  8. Kessel R, Berglund M, Taylor P, Wellum R (2000) How to treat correlation in the uncertainty budget, when combining results from different measurements, paper presented at AMCTM 2000, ISBN 981-02-4494-0

Download references

Acknowledgments

We thank Raghu Kacker (NIST) for fruitful discussions and comments.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rüdiger Kessel.

Appendices

Appendix 1: The symbols used in this paper

Y i :

Value of the measurands; variable representing the state of knowledge

u(y i ):

Standard uncertainty associated with result Y i

X i :

Input quantity; variable representing the state of knowledge

u(x i):

Standard uncertainty associated with the input quantity X i

r(x i , x j ):

Correlation coefficient between X i and X j

c i :

Concentration for replicate i (results of the measurements)

c x :

Average concentration (end result)

ε i :

Difference between single result c i and the average c x

I i :

Observed intensity (detector output) for replicate i

δc i :

Small deviation of the concentration with expectation zero

Appendix 2: Calculation of the minimum additional uncertainty for the equivalence check

In cases when a non-weighted arithmetic mean is used to combine measurement results, a general equation for the minimum additional uncertainty u(δ i) that should be added to the n replicates can be derived. One contribution Y m can be separated from the arithmetic mean.

$$ \overline Y = \frac{1} {n}\sum\limits_{i = 1}^n {Y_i } = \frac{{Y_m }} {n} + \frac{1} {n}\sum\limits_{i \ne m}^{} {Y_i } $$
(13)

The difference between the average and Y m is:

$$ \varepsilon _m = Y_m - \overline Y $$
(14)

Combining Eqs. (13) and (14) gives:

$$ \varepsilon _m = Y_m - \left[ {\frac{{Y_m }} {n} + \frac{1} {n}\sum\limits_{i \ne m}^{} {Y_i } } \right] = \frac{{n - 1}} {n} \cdot Y_m - \frac{1} {n}\sum\limits_{i \ne m}^{} {Y_i } $$
(15)

An independent uncertainty component is added to all replicates, which leads to a second difference ε * m :

$$\varepsilon ^{*}_{m} = \frac{{n - 1}}{n} \cdot {\left( {Y_{m} + \delta _{m} } \right)} - \frac{1}{n}{\sum\limits_{i \ne m}^{} {{\left( {Y_{i} + \delta _{i} } \right)} = {\left[ {\frac{{n - 1}}{n} \cdot Y_{m} - \frac{1}{n}{\sum\limits_{i \ne m}^{} {Y_{i} } }} \right]} + {\left[ {\frac{{n - 1}}{n} \cdot \delta _{m} - \frac{1}{n}{\sum\limits_{i \ne m}^{} {\delta _{i} } }} \right]}} } $$
(16)

The two terms in Eq. (16) are obviously independent and the left term is equal to difference without the additional terms. The uncertainty of ε * m can be calculated.

$$ u^2 (\varepsilon _m^* ) = u^2 (\varepsilon _m^{} ) + u^2 \left( {\frac{{n - 1}} {n} \cdot \delta _m - \frac{1} {n}\sum\limits_{i \ne m}^{} {\delta _i } } \right) $$
(17)
$$ u^2 \left( {\frac{{n - 1}} {n} \cdot \delta _m - \frac{1} {n}\sum\limits_{i \ne m}^{} {\delta _i } } \right) = \left( {\frac{{n - 1}} {n}} \right)^2 \cdot \, u^2 (\delta _m ) + \frac{1} {{n^2 }}\sum\limits_{i \ne m}^{} {u^2 (\delta _i )} $$
(18)

All uncertainties of the additional terms have the same value u(δ).

$$u^{2} {\left( {\frac{{n - 1}}{n}\delta _{m} - \frac{1}{n}{\sum\limits_{i \ne m}^{} {\delta _{i} } }} \right)} = {\left( {\frac{{n - 1}}{n}} \right)}^{2} u^{2} (\delta ) + {\left( {\frac{{n - 1}}{{n^{2} }}} \right)}u^{2} (\delta ) = \frac{{(n - 1)^{2} + n - 1}}{{n^{2} }}u^{2} (\delta ) = \frac{{n - 1}}{n}u^{2} (\delta ) $$
(19)

Combining Eqs. (17) and (19) leads to:

$$ u^2 (\varepsilon _m^* ) = u^2 (\varepsilon _m^{} ) + \frac{{n - 1}} {n} \cdot u^2 (\delta ) $$
(20)

Equation (20) solved for u(δ):

$$ \begin{gathered} u^2 (\delta ) = \frac{n} {{n - 1}} \cdot \left[ {u^2 (\varepsilon _m^* ) - u^2 (\varepsilon _m^{} )} \right] \hfill \\ u(\delta ) = \sqrt {\frac{n} {{n - 1}} \cdot \left[ {u^2 (\varepsilon _m^* ) - u^2 (\varepsilon _m^{} )} \right]} \hfill \\ \end{gathered} $$
(21)

With Eq. (21) the uncertainty value of an additional between-replicate term can be calculated. This is added to all replicates if the uncertainty of the epsilon without the term and the uncertainty of the epsilon with the term are known. The term u(ε m ) can be calculated from the equivalence check in Eq. (1) under the assumption that the check is just passed.

$$ u^2 (\varepsilon _m^* ) \ge \left( {\frac{{Y_m - \overline Y }} {k}} \right)^2 \quad ({\text{usually }}k = 2) $$
(22)

Combining Eq. (21) and (22) leads to:

$$ u\left( \delta \right) \ge \sqrt {\frac{n} {{n - 1}} \cdot \left[ {\left( {\frac{{Y_m - \overline Y }} {k}} \right)^2 - \, u^2 \left( {Y_m - \overline Y } \right)} \right]} \quad ({\text{usually }}k = 2) $$
(23)

For Y m the replicate should be selected for which ε m in respect of · u(ε m ) is maximum.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kessel, R., Berglund, M. & Wellum, R. Application of consistency checking to evaluation of uncertainty in multiple replicate measurements. Accred Qual Assur 13, 293–298 (2008). https://doi.org/10.1007/s00769-008-0382-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00769-008-0382-x

Keywords

Navigation