Abstract
On the basis of long-standing proficiency testings (PTs) for the small number of PT participants p (7 ≤ p ≤ 30), laboratory bias and uncertainty were calculated by applying inter-laboratory experimental approaches. Uncertainty was estimated in two ways, according to Eurolab TR No 1/2007 and Nordtest TR 537 (2012). In the case of 24 tested feed components (basic nutrients, macro- and microelements, undesirable elements and some feed additives including vitamins A and E, lysine, threonine, methionine and urea) in the large variety of feed samples, differences between the expanded uncertainties calculated according to Eurolab TR No 1/2007 and Nordtest TR 537 did not exceed 1.4 % for all tested feed and analytes in wide concentration ranges. In order to get a reliable evaluation of bias and uncertainty, minimum of 6 PT rounds and a sufficient number of laboratories participating (p ≥ 10) are recommended. When the above parameters are applied and the standard deviation of the bias s bias ≤ 5 %, the expression s 2bias /n can be omitted while calculating bias. Generally, both approaches fit the purpose of feed evaluation and the calculated uncertainties can be used for compliance assessment.
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
Animal feed stuff includes different and variable matrices, and the test results of feed components and their measurement uncertainties should fit the intended purpose especially when used for compliance assessment [1]. Some laboratories underestimate the levels of uncertainties of their results and report unrealistically small values of some parameters to their customers. Therefore, the predicted levels of measurement uncertainties for food and feed were established for official testing in the EU, derived from the Horwitz equation [2, 3]. One of the possible approaches to estimate measurement uncertainty in a laboratory involves combining all uncertainty components responsible for random and systematic errors affecting measurement result according to GUM [4]. The examples of calculating measurement uncertainties are given in the Eurachem/CITAC Guide [5]. One of the essential sources of uncertainty is heterogeneity of the sample materials.
However, during the routine analysis of feed materials characterized by different matrices it is usually assumed that homogeneity and stability of studied materials are acceptable. This assumption is too optimistic in the case of feed additives and also due to lack of knowledge on the long term stability of analytes. On the other hand, in order to obtain reliable values the following conditions should be fulfilled. First, the samples tested in PTs should be similar to the routine feed ones, in the scope of both feed matrices variety and tested substance contents. It is important that PTs are organized in conformity with well-recognized standards, e.g., with ISO 17043 [6]. That is why it is important to verify measurement uncertainty using experimental approaches.
The basis for the experimental approaches to assess measurement uncertainty with the use of the test results of certified reference materials (CRM) or the results of laboratory participation in proficiency tests (PTs) are presented in the Eurolab Technical Report (TR) No 1/2007 [7] and in the Nordtest Handbook [8]. These approaches, known as practical ones, were also mentioned in the latest Eurachem/CITAC Guide CG 4 [5] and in the ISO 11352:2012 standard [9]. According to the Eurachem/CITAC Guide [5], the data obtained from PTs can provide useful information for assessing measurement uncertainty in the laboratory. Moreover, PT providers can obtain better similarity of tested materials than routine samples typically analyzed in a laboratory.
Due to difficulties in accessing feed CRMs, a laboratory may use the results from participation in PTs for estimating measurement uncertainty. While evaluating the uncertainty of analyte measurement on the basis of the data from PTs, a laboratory should assess their own results as well as to verify the quality and accuracy of PTs.
The aim of this paper was to compare the measurement uncertainties of several feed components (basic nutrients, minerals, feed additives, undesired substances) calculated on the basis of experimental approaches using the PT results with those obtained according to GUM [4] and predicted uncertainties calculated from the Horwitz equation [2, 10]. In detail, the difference between the two approaches, according to Eurolab TR [7] and Nordtest TR [8], for calculation of measurement uncertainty from PTs was evaluated, especially in a small number of PT participants p (7 ≤ p ≤ 30) and the obtained uncertainty values were estimated in accordance to requirements for compliance assessment.
Materials and methods
Materials and the scope of PTs
Test materials were the feed samples analyzed in PTs, organized in the years 2004–2013 by the National Laboratory for Feeding stuffs (NLF) in the scope of a reference activity. The aim of PTs was to assess the competence of official feed supervision laboratories and to use the results of PTs for validation and accreditation of test methods. Until 2009, PTs had been prepared in conformity with the ISO/IEC 43-1 guide [11] and since 2010 in conformity with the ISO 17043 standard [6]. More than 50 samples of different feeds were analyzed, including 10 samples of feed materials, nearly 30 samples of complete feed mixtures, 5 samples of supplementary feed mixtures and 8 samples of premixtures. Moreover, NLF has participated in 10 international PT rounds organized by the reference laboratories from the EU countries in which 84 samples of feed materials, feed mixture and premixtures were tested. The scope of PTs included testing of basic nutrients (moisture, crude protein, crude fat, crude ash, crude fiber, starch and sugars), macroelements (Ca, Na, K, Cl−), microelements (Fe, Mn, Zn, Cu, Co, Se), feed additives such as amino acids (lysine, methionine, threonine) and vitamins (A and E), as well as urea and undesirable elements (Pb, Cd, As). A total number of 429 results of these tests were used in the paper for evaluation of measurement uncertainty.
The reference materials were used for measurement uncertainty calculation based on the within-laboratory experimental approach, namely certified reference material NCS ZC73013 Spinage (Beijing, China) for Co, Cd, Pb and As and reference material CS-M-2 Dried Mushroom (produced and certified by Institute of Nuclear Chemistry and Technology, Warsaw, Poland) for Se.
Procedures
Basic nutrients (moisture, crude ash, crude protein, crude fat, crude fiber, starch and sugar), urea, vitamins A and E, lysine, methionine and threonine were tested by means of official procedures given in regulation 152/2009 [12]. Macro- and microelements such as calcium, magnesium, sodium, potassium, manganese, zinc and copper were analyzed by flame atomic absorption spectrometry after adequate sample treatment according to ISO 6869 [13]. Selenium and arsenic were tested by atomic absorption spectrometry with hydride generation HGAAS according to standard methods [14, 15]. Lead, cadmium and cobalt were determined by graphite furnace atomic absorption spectrometry (GF AAS) [16].
Calculating uncertainty on the basis of PT results
It is worth noting that data from proficiency testing (PT) can provide useful information for uncertainty evaluation. It means that for methods in laboratory use for a long time, data from proficiency testing practical approach can be used for checking the estimated uncertainty with results from PT exercises for a laboratory. On the other hand, a laboratory can applied this attitude for estimation of measurement uncertainty.
Combined standard uncertainty u rel was calculated as a root sum of squares of a within-laboratory reproducibility RSD w characterizing the precision of the measurement and bias b, according to Eq. (1). The expanded uncertainty U rel was calculated with the use of coverage factor k = 2, U rel = u rel · 2.
Bias was calculated following Eq. (2) presented in the Eurolab Technical Report No 1/2007 [7]
where Δ RMSbias is the root mean square of the bias values, u PT = 1.25 s PT/√n is standard uncertainty of the assigned value calculated according to ISO 13528 [17]; s bias is standard deviation of the bias determination; n is number of PT rounds, or using Eq. (3) presented in the Nordtest Handbook [8].
The root mean square of the bias Δ RMSbias was calculated following Eq. (4)
where X 1…n is NLF results in PT rounds; X PT1…n is assigned values of PT rounds. For the reason of extended measuring ranges, relative uncertainties, biases and precision parameters (in %) are used in the paper.
Data of the within-laboratory reproducibilities RSD w, bias data s bias and results in PT rounds X 1…n were obtained by NLF. The within-laboratory reproducibilities RSD w originated from control charts. Assigned values as consensus values X PT1…n were obtained from PTs.
To assess the quality of PT precision, the Horwitz’ ratio (HorRat, H) was calculated as the quotient of s PT/σ where σ is the target standard deviation obtained from the Horwitz equation σ = 2·C −0.15 in which C is the dimensionless mass fraction (accepted values: 0.5 < H < 2) and s PT is the standard deviation from a PT [10].
On the basis of Horwitz equation, the target relative standard deviation of reproducibility RSD R was obtained and used for calculation uncertainty, including bias data from PTs. For comparison with within-laboratory reproducibilities RSD w, RSD R was recalculated to obtain target, RSD WR = 0.67·RSD R, according to Horwitz and Albert [10]. Combined standard uncertainty u rel was calculated as a root sum of squares of a target within-laboratory reproducibility RSD w and bias b obtained by laboratory using the Eurolab TR approach [7], according to Eq. (1). The expanded uncertainty U rel was calculated with the use of coverage factor k = 2 and put in the last column of Table 1.
In the case of basic nutrients, expanded uncertainties were calculated according to permitted tolerances given in the Commission Regulation (EU) No 939/2010 [18]. It was assumed that contribution homogeneity and uncertainty in permitted tolerances are the same and permitted uncertainty U prel (%) can be obtained by multiplying relative permitted tolerances by factor 0.7. Permitted uncertainties for basic nutrients U prel (%) are presented in the last column of Table 1.
Results and discussion
The results of bias and measurement uncertainty for the basic nutrients in feed are presented in Table 2. Whichever Eqs. (2) or (3) was used to determine bias, the differences between the bias results to some degree depended on the size of s bias and generally were not larger than 0.25 %. Expanded uncertainties for basic nutrients calculated on the basis of Eurolab TR [7] or Nordtest TR [8] were considerably lower than the permitted analytical tolerances (expanded uncertainties) calculated on the basis of the Regulation 939/2010 [18], indicating that both approaches fit the purpose in the frame of feed evaluation (Table 1). High HorRat value for sugar equal to 2.41 indicated low precision of PTs for this nutrient, and according to Horwitz and Albert [10] this is the example of the method-defined analyte. Precision of such methods such as titrimetric method for determination of mass fraction of sugar or gravimetric methods for determination of mass fraction of crude fiber is usually high within a single laboratory (see Table 2, sugar: low value of within-laboratory reproducibility RSD w = 1.12 %) and low among different laboratories (high value of relative standard deviation of sugar mass fraction from PTs, high HorRat value equal to 2.41). However, expanded uncertainty of the titrimetric method for determination mass fraction of sugar, obtained by two approaches, was acceptable and according to requirements [18].
In case of minerals and toxic elements, the differences between biases calculated according to Eurolab TR [7] and Nordtest TR [8] and those between the combined standard uncertainties with bias share did not exceed 0.3 % (Tables 3, 4). Both approaches fit the purpose taking into account predicted expanded uncertainties based on the Horwitz’ equation and laboratory biases (Table 1).
The results of the two methods of calculating bias and combined standard uncertainty for feed additives, amino acids and urea were similar and the differences did not exceed 0.3 % (Table 5). In the case of vitamins A and E in feed mixtures and premixtures where s bias ranged between 5.6 % and 8.6 %, the differences between the bias and uncertainty values calculated from Eqs. (2) and (3) were larger but did not exceed 1.3 %. At smaller PT precision, especially for vitamins A and E in premixtures (H from 2.09 to 2.27), the obtained biases and combined standard uncertainties were larger than for the other additives. The reason for such results may be inhomogeneity of test samples, isolated from the laboratory bulk samples before determinations. Some PT providers sent feed samples to PT participants in the same way as the samples obtained from customers, i.e., without grinding. The problem of inhomogeneity is important, especially in the case of vitamins A and E and other unstable substances which are specifically protected in feed against oxidation and other destructive factors [19]. In the case of lysine, threonine, methionine and urea, satisfactory PT precision was noted (H from 0.92 to 1.32). For methionine (Table 5), relatively high uncertainty resulted mainly from a wide range of within-laboratory reproducibility (5.37 %).
Results in Table 1 present expanded uncertainties calculated based on the data from PTs according to Eurolab TR [7] and Nordtest TR [8] in comparison with those obtained according to GUM [4] and predicted using the Horwitz equation and bias from PTs. Differences between expanded uncertainties calculated according to Eurolab TR No 1/2007 and Nordtest TR 537 did not exceed 2.6 % for all tested feed and analytes in large concentration ranges and did not exceed predicted uncertainties obtained from the Horwitz equation.
For the basic nutrients, such as crude fiber, crude fat, starch and sugars, uncertainties calculated according to GUM [4] were lower, even by a half, than those calculated on the basis of PT results. In the case of minerals analyzed by the FAAS method (Ca, Mg, Na, K, Mn, Zn and Cu), uniformity was noted for the uncertainties calculated following GUM and on the basis of PT results. It is possible to assume measurement uncertainty calculated on the basis of PT results for these elements and to use them to control the quality of the tests, e.g., following the NATA recommendations [20]. In the case of Co, Se, As, Cd and Pb measurement uncertainties were calculated on the basis of the within-laboratory experimental approach using of CRM (Table 1). They were similar to those obtained from PTs and generally smaller than those calculated according to the Horwitz equation. Measurement uncertainties for vitamins A and E in the premixtures and feed mixtures calculated on the basis of PT results were lower than those obtained using the Horwitz equation and generally fit the purpose.
Conclusions
In conclusion, the data from PTs in the scope of feed analysis can be used for estimation of laboratory bias and, on the basis of bias and within-laboratory reproducibility, measurement uncertainty can be determined. The precision of PTs can be verified against the Horwitz ratio (HorRat, H) and the satisfactory level of this parameter is in the range 0.5 < H < 2 were obtained. It is obvious that only laboratory results with z-score or zeta-score ≤2, should be used in bias calculation.
In order to obtain reliable evaluation of bias and uncertainty, a minimum of 6 PT rounds is recommended. Moreover, PTs should be characterized by accepted precision and a sufficient number of laboratories (p ≥ 10). When the above requirements are met and the standard deviation of the bias s bias ≤ 5 %, the expression s 2 bias /n can be omitted while calculating bias.
The protocol of bias and uncertainty calculation on the basis of PTs presented in the paper refers mainly to the given laboratory. The uncertainty calculated as presented in the paper can be used as a check for the uncertainty calculated according to GUM [4]. Uncertainty is useful in expressing the results for feed components or undesirable substances providing help in interpreting the results. While testing animal feed, the measurement uncertainty is used to (1) assess the maximum content of feed additives in feed mixtures, (2) estimate the share of undesirable substances in relation to the requirements defined by regulations and (3) verify the information provided on the label concerning feed additives and their permitted tolerances according to the Commission Regulation (EU) No 939/2010 [18]. The PT results of designated laboratories that can carry out the analysis of feed samples taken during official controls, using the same official feed analysis methods, can be used to create a uniform, inter-laboratory system for assessing uncertainty and interpreting tests results, useful for conformity assessment.
References
Bettencourt da Silva R, Williams A (eds) (2015) Setting and using target uncertainty in chemical measurement. In: Eurachem/CITAC Guide www.eurachem.org
Horwitz W (2003) The certainty of uncertainty. J AOAC Int 86:109–111
Report on the relationship between analytical results, measurement uncertainty, recovery factors and the provisions of EU Food and Feed legislation. http://ec.europa.eu/food/food/chemicalsafety/contaminants/report sampling_analysis_2004_en.pdf
Guide to the expression of uncertainty in measurement (GUM) (1993) ISO Geneva; also JCMG 100. http://www.bipm.org/en/publications/guides/gum
Ellison SLR, Williams A (eds) (2012) Eurachem/CITAC guide: quantifying uncertainty in analytical measurements. www.eurachem.org
EN ISO/IEC 17043:2010 Conformity assessment—General requirements for proficiency testing. CEN, Brussels
EUROLAB Technical Report 1/2007 (2007) Measurement uncertainty revisited: Alternative approaches to uncertainty evaluation Eurolab Paris. http://www.eurolab.org
Magnusson B et al (2012) Handbook for calculation of measurement uncertainty in environmental laboratories. NORDTEST Report TR 537 Edition 3.1. http://www.nordtest.info
ISO 11352:2012 Water quality—estimation of measurement uncertainty based on validation and quality control data. ISO, Geneva
Horwitz W, Albert R (2006) The Horwitz ratio (HorRat): a useful index of method performance with respect to precision. J AOAC Int 89:1095–1109
ISO/IEC Guide 43-1:1997 Proficiency testing by interlaboratory comparisons: part 1: development and operation of proficiency testing schemes. ISO, Geneva
Commission Regulation (EC) No 152/2009 of 27 January 2009 laying down the methods of sampling and analysis for the official control of feed. Official Journal of the European Union, 2009, L54, 1–130
EN ISO 6869:2000 Animal feeding stuffs—determination of the contents of calcium, copper, iron, magnesium, manganese, potassium, sodium and zinc—method using atomic absorption spectrometry. CEN, Brussels
EN 16159:2012 Animal feeding stuffs—determination of selenium by hydride generation atomic absorption spectrometry (HGAAS) after microwave digestion. CEN, Brussels
EN 16206:2012 Animal feeding stuffs—determination of arsenic by hydride generation atomic absorption spectrometry (HGAAS) after microwave pressure digestion. CEN, Brussels
EN 15550:2007 Animal feeding stuffs—determination of cadmium and lead by graphite furnace atomic absorption spectrometry (GF-AAS) after pressure digestion. CEN, Brussels
ISO 13528:2015 Statistical methods for use in proficiency testing by interlaboratory comparisons. ISO, Geneva
Commission Regulation (EC) No 939/2010 of 20 October 2010 amending Annex IV to regulation (EC) No 767/2009 on permitted tolerances for the compositional labelling of feed materials or compound feed as referred to in Article 11(5). Official Journal of the European Union, 2010, L277, 4–7
Korol W et al (2015) Uncertainty from sample preparation in the laboratory on the example of various feeds. Accred Qual Assur 20:61–66. doi:10.1007/s00769-014-1096-x
NATA Technical Note 33 (2013) Guidelines for estimating and reporting measurement uncertainty of chemical results. http://www.health.gov.au/internet/main/publishing.nsf/Content/717802D80CFD8A4ACA257BF0001BDBB7/$File/technical_note_33.pdf
Acknowledgements
The authors are grateful to Professor Dr. Joseph H. Rule from Old Dominion University (Norfolk, VA), USA, and his wife Dr. Anna M. Rule for their help with the English preparation of the manuscript.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Korol, W., Rubaj, J., Bielecka, G. et al. Criteria for using proficiency test results for estimation of measurement uncertainty: feed analysis example. Accred Qual Assur 22, 83–89 (2017). https://doi.org/10.1007/s00769-017-1252-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00769-017-1252-1