Criteria for using proficiency test results for estimation of measurement uncertainty: feed analysis example
- First Online:
- 841 Downloads
On the basis of long-standing proficiency testings (PTs) for the small number of PT participants p (7 ≤ p ≤ 30), laboratory bias and uncertainty were calculated by applying inter-laboratory experimental approaches. Uncertainty was estimated in two ways, according to Eurolab TR No 1/2007 and Nordtest TR 537 (2012). In the case of 24 tested feed components (basic nutrients, macro- and microelements, undesirable elements and some feed additives including vitamins A and E, lysine, threonine, methionine and urea) in the large variety of feed samples, differences between the expanded uncertainties calculated according to Eurolab TR No 1/2007 and Nordtest TR 537 did not exceed 1.4 % for all tested feed and analytes in wide concentration ranges. In order to get a reliable evaluation of bias and uncertainty, minimum of 6 PT rounds and a sufficient number of laboratories participating (p ≥ 10) are recommended. When the above parameters are applied and the standard deviation of the bias sbias ≤ 5 %, the expression sbias2/n can be omitted while calculating bias. Generally, both approaches fit the purpose of feed evaluation and the calculated uncertainties can be used for compliance assessment.
KeywordsFeed proficiency testing Bias Uncertainty Practical approach Within-laboratory reproducibility
Animal feed stuff includes different and variable matrices, and the test results of feed components and their measurement uncertainties should fit the intended purpose especially when used for compliance assessment . Some laboratories underestimate the levels of uncertainties of their results and report unrealistically small values of some parameters to their customers. Therefore, the predicted levels of measurement uncertainties for food and feed were established for official testing in the EU, derived from the Horwitz equation [2, 3]. One of the possible approaches to estimate measurement uncertainty in a laboratory involves combining all uncertainty components responsible for random and systematic errors affecting measurement result according to GUM . The examples of calculating measurement uncertainties are given in the Eurachem/CITAC Guide . One of the essential sources of uncertainty is heterogeneity of the sample materials.
However, during the routine analysis of feed materials characterized by different matrices it is usually assumed that homogeneity and stability of studied materials are acceptable. This assumption is too optimistic in the case of feed additives and also due to lack of knowledge on the long term stability of analytes. On the other hand, in order to obtain reliable values the following conditions should be fulfilled. First, the samples tested in PTs should be similar to the routine feed ones, in the scope of both feed matrices variety and tested substance contents. It is important that PTs are organized in conformity with well-recognized standards, e.g., with ISO 17043 . That is why it is important to verify measurement uncertainty using experimental approaches.
The basis for the experimental approaches to assess measurement uncertainty with the use of the test results of certified reference materials (CRM) or the results of laboratory participation in proficiency tests (PTs) are presented in the Eurolab Technical Report (TR) No 1/2007  and in the Nordtest Handbook . These approaches, known as practical ones, were also mentioned in the latest Eurachem/CITAC Guide CG 4  and in the ISO 11352:2012 standard . According to the Eurachem/CITAC Guide , the data obtained from PTs can provide useful information for assessing measurement uncertainty in the laboratory. Moreover, PT providers can obtain better similarity of tested materials than routine samples typically analyzed in a laboratory.
Due to difficulties in accessing feed CRMs, a laboratory may use the results from participation in PTs for estimating measurement uncertainty. While evaluating the uncertainty of analyte measurement on the basis of the data from PTs, a laboratory should assess their own results as well as to verify the quality and accuracy of PTs.
The aim of this paper was to compare the measurement uncertainties of several feed components (basic nutrients, minerals, feed additives, undesired substances) calculated on the basis of experimental approaches using the PT results with those obtained according to GUM  and predicted uncertainties calculated from the Horwitz equation [2, 10]. In detail, the difference between the two approaches, according to Eurolab TR  and Nordtest TR , for calculation of measurement uncertainty from PTs was evaluated, especially in a small number of PT participants p (7 ≤ p ≤ 30) and the obtained uncertainty values were estimated in accordance to requirements for compliance assessment.
Materials and methods
Materials and the scope of PTs
Test materials were the feed samples analyzed in PTs, organized in the years 2004–2013 by the National Laboratory for Feeding stuffs (NLF) in the scope of a reference activity. The aim of PTs was to assess the competence of official feed supervision laboratories and to use the results of PTs for validation and accreditation of test methods. Until 2009, PTs had been prepared in conformity with the ISO/IEC 43-1 guide  and since 2010 in conformity with the ISO 17043 standard . More than 50 samples of different feeds were analyzed, including 10 samples of feed materials, nearly 30 samples of complete feed mixtures, 5 samples of supplementary feed mixtures and 8 samples of premixtures. Moreover, NLF has participated in 10 international PT rounds organized by the reference laboratories from the EU countries in which 84 samples of feed materials, feed mixture and premixtures were tested. The scope of PTs included testing of basic nutrients (moisture, crude protein, crude fat, crude ash, crude fiber, starch and sugars), macroelements (Ca, Na, K, Cl−), microelements (Fe, Mn, Zn, Cu, Co, Se), feed additives such as amino acids (lysine, methionine, threonine) and vitamins (A and E), as well as urea and undesirable elements (Pb, Cd, As). A total number of 429 results of these tests were used in the paper for evaluation of measurement uncertainty.
The reference materials were used for measurement uncertainty calculation based on the within-laboratory experimental approach, namely certified reference material NCS ZC73013 Spinage (Beijing, China) for Co, Cd, Pb and As and reference material CS-M-2 Dried Mushroom (produced and certified by Institute of Nuclear Chemistry and Technology, Warsaw, Poland) for Se.
Basic nutrients (moisture, crude ash, crude protein, crude fat, crude fiber, starch and sugar), urea, vitamins A and E, lysine, methionine and threonine were tested by means of official procedures given in regulation 152/2009 . Macro- and microelements such as calcium, magnesium, sodium, potassium, manganese, zinc and copper were analyzed by flame atomic absorption spectrometry after adequate sample treatment according to ISO 6869 . Selenium and arsenic were tested by atomic absorption spectrometry with hydride generation HGAAS according to standard methods [14, 15]. Lead, cadmium and cobalt were determined by graphite furnace atomic absorption spectrometry (GF AAS) .
Calculating uncertainty on the basis of PT results
It is worth noting that data from proficiency testing (PT) can provide useful information for uncertainty evaluation. It means that for methods in laboratory use for a long time, data from proficiency testing practical approach can be used for checking the estimated uncertainty with results from PT exercises for a laboratory. On the other hand, a laboratory can applied this attitude for estimation of measurement uncertainty.
Data of the within-laboratory reproducibilities RSDw, bias data sbias and results in PT rounds X1…n were obtained by NLF. The within-laboratory reproducibilities RSDw originated from control charts. Assigned values as consensus values XPT1…n were obtained from PTs.
To assess the quality of PT precision, the Horwitz’ ratio (HorRat, H) was calculated as the quotient of sPT/σ where σ is the target standard deviation obtained from the Horwitz equation σ = 2·C−0.15 in which C is the dimensionless mass fraction (accepted values: 0.5 < H < 2) and sPT is the standard deviation from a PT .
Evaluation of the results of expanded uncertainties on the basis of the data from PTs, calculated according to GUM  and predicted using the Horwitz equation
Urel (k = 2) (GUM)
Predicted Urel (k = 2) Horwitz/Uprel
Microelements and toxic elements
Vitamin Ab (pr.)
Vitamin Ab (f.m.)
Vitamin Ec (pr.)
Vitamin Ec (f.m.)
In the case of basic nutrients, expanded uncertainties were calculated according to permitted tolerances given in the Commission Regulation (EU) No 939/2010 . It was assumed that contribution homogeneity and uncertainty in permitted tolerances are the same and permitted uncertainty Uprel (%) can be obtained by multiplying relative permitted tolerances by factor 0.7. Permitted uncertainties for basic nutrients Uprel (%) are presented in the last column of Table 1.
Results and discussion
The results of bias and measurement uncertainty for the basic nutrients in feed are presented in Table 2. Whichever Eqs. (2) or (3) was used to determine bias, the differences between the bias results to some degree depended on the size of sbias and generally were not larger than 0.25 %. Expanded uncertainties for basic nutrients calculated on the basis of Eurolab TR  or Nordtest TR  were considerably lower than the permitted analytical tolerances (expanded uncertainties) calculated on the basis of the Regulation 939/2010 , indicating that both approaches fit the purpose in the frame of feed evaluation (Table 1). High HorRat value for sugar equal to 2.41 indicated low precision of PTs for this nutrient, and according to Horwitz and Albert  this is the example of the method-defined analyte. Precision of such methods such as titrimetric method for determination of mass fraction of sugar or gravimetric methods for determination of mass fraction of crude fiber is usually high within a single laboratory (see Table 2, sugar: low value of within-laboratory reproducibility RSDw = 1.12 %) and low among different laboratories (high value of relative standard deviation of sugar mass fraction from PTs, high HorRat value equal to 2.41). However, expanded uncertainty of the titrimetric method for determination mass fraction of sugar, obtained by two approaches, was acceptable and according to requirements .
Evaluation of bias b and uncertainty u for basic nutrients in feed materials and feed mixtures on the basis of PT data and within-laboratory reproducibility
Mean value (g/kg)
Eurolab TR 
Nordtest TR 
Evaluation of bias b and uncertainty u for macroelements in feed materials and feed mixtures on the basis of PT data and within-laboratory reproducibility
Evaluation of bias b and uncertainty u for microelements and undesirable elements in feed materials, feed mixtures and premixtures (only for undesirable elements) on the basis of PT data and within-laboratory reproducibility
Mean value (mg/kg)
Eurolab TR 
Nordtest TR 
Evaluation of bias b and uncertainty u for some feed additives in feed materials, feed mixtures and premixtures on the basis of PT data and within-laboratory reproducibility
Mean value (g/kg)
Eurolab TR 
Nordtest TR 
Vit. Aa (pr.)
Vit. Aa (f.m.)
Vit. Eb (pr.)
Vit. Eb (f.m.)
Results in Table 1 present expanded uncertainties calculated based on the data from PTs according to Eurolab TR  and Nordtest TR  in comparison with those obtained according to GUM  and predicted using the Horwitz equation and bias from PTs. Differences between expanded uncertainties calculated according to Eurolab TR No 1/2007 and Nordtest TR 537 did not exceed 2.6 % for all tested feed and analytes in large concentration ranges and did not exceed predicted uncertainties obtained from the Horwitz equation.
For the basic nutrients, such as crude fiber, crude fat, starch and sugars, uncertainties calculated according to GUM  were lower, even by a half, than those calculated on the basis of PT results. In the case of minerals analyzed by the FAAS method (Ca, Mg, Na, K, Mn, Zn and Cu), uniformity was noted for the uncertainties calculated following GUM and on the basis of PT results. It is possible to assume measurement uncertainty calculated on the basis of PT results for these elements and to use them to control the quality of the tests, e.g., following the NATA recommendations . In the case of Co, Se, As, Cd and Pb measurement uncertainties were calculated on the basis of the within-laboratory experimental approach using of CRM (Table 1). They were similar to those obtained from PTs and generally smaller than those calculated according to the Horwitz equation. Measurement uncertainties for vitamins A and E in the premixtures and feed mixtures calculated on the basis of PT results were lower than those obtained using the Horwitz equation and generally fit the purpose.
In conclusion, the data from PTs in the scope of feed analysis can be used for estimation of laboratory bias and, on the basis of bias and within-laboratory reproducibility, measurement uncertainty can be determined. The precision of PTs can be verified against the Horwitz ratio (HorRat, H) and the satisfactory level of this parameter is in the range 0.5 < H < 2 were obtained. It is obvious that only laboratory results with z-score or zeta-score ≤2, should be used in bias calculation.
In order to obtain reliable evaluation of bias and uncertainty, a minimum of 6 PT rounds is recommended. Moreover, PTs should be characterized by accepted precision and a sufficient number of laboratories (p ≥ 10). When the above requirements are met and the standard deviation of the bias sbias ≤ 5 %, the expression s2bias /n can be omitted while calculating bias.
The protocol of bias and uncertainty calculation on the basis of PTs presented in the paper refers mainly to the given laboratory. The uncertainty calculated as presented in the paper can be used as a check for the uncertainty calculated according to GUM . Uncertainty is useful in expressing the results for feed components or undesirable substances providing help in interpreting the results. While testing animal feed, the measurement uncertainty is used to (1) assess the maximum content of feed additives in feed mixtures, (2) estimate the share of undesirable substances in relation to the requirements defined by regulations and (3) verify the information provided on the label concerning feed additives and their permitted tolerances according to the Commission Regulation (EU) No 939/2010 . The PT results of designated laboratories that can carry out the analysis of feed samples taken during official controls, using the same official feed analysis methods, can be used to create a uniform, inter-laboratory system for assessing uncertainty and interpreting tests results, useful for conformity assessment.
The authors are grateful to Professor Dr. Joseph H. Rule from Old Dominion University (Norfolk, VA), USA, and his wife Dr. Anna M. Rule for their help with the English preparation of the manuscript.
- 1.Bettencourt da Silva R, Williams A (eds) (2015) Setting and using target uncertainty in chemical measurement. In: Eurachem/CITAC Guide www.eurachem.org
- 2.Horwitz W (2003) The certainty of uncertainty. J AOAC Int 86:109–111Google Scholar
- 3.Report on the relationship between analytical results, measurement uncertainty, recovery factors and the provisions of EU Food and Feed legislation. http://ec.europa.eu/food/food/chemicalsafety/contaminants/report sampling_analysis_2004_en.pdf
- 4.Guide to the expression of uncertainty in measurement (GUM) (1993) ISO Geneva; also JCMG 100. http://www.bipm.org/en/publications/guides/gum
- 5.Ellison SLR, Williams A (eds) (2012) Eurachem/CITAC guide: quantifying uncertainty in analytical measurements. www.eurachem.org
- 6.EN ISO/IEC 17043:2010 Conformity assessment—General requirements for proficiency testing. CEN, BrusselsGoogle Scholar
- 7.EUROLAB Technical Report 1/2007 (2007) Measurement uncertainty revisited: Alternative approaches to uncertainty evaluation Eurolab Paris. http://www.eurolab.org
- 8.Magnusson B et al (2012) Handbook for calculation of measurement uncertainty in environmental laboratories. NORDTEST Report TR 537 Edition 3.1. http://www.nordtest.info
- 9.ISO 11352:2012 Water quality—estimation of measurement uncertainty based on validation and quality control data. ISO, GenevaGoogle Scholar
- 10.Horwitz W, Albert R (2006) The Horwitz ratio (HorRat): a useful index of method performance with respect to precision. J AOAC Int 89:1095–1109Google Scholar
- 11.ISO/IEC Guide 43-1:1997 Proficiency testing by interlaboratory comparisons: part 1: development and operation of proficiency testing schemes. ISO, GenevaGoogle Scholar
- 12.Commission Regulation (EC) No 152/2009 of 27 January 2009 laying down the methods of sampling and analysis for the official control of feed. Official Journal of the European Union, 2009, L54, 1–130Google Scholar
- 13.EN ISO 6869:2000 Animal feeding stuffs—determination of the contents of calcium, copper, iron, magnesium, manganese, potassium, sodium and zinc—method using atomic absorption spectrometry. CEN, BrusselsGoogle Scholar
- 14.EN 16159:2012 Animal feeding stuffs—determination of selenium by hydride generation atomic absorption spectrometry (HGAAS) after microwave digestion. CEN, BrusselsGoogle Scholar
- 15.EN 16206:2012 Animal feeding stuffs—determination of arsenic by hydride generation atomic absorption spectrometry (HGAAS) after microwave pressure digestion. CEN, BrusselsGoogle Scholar
- 16.EN 15550:2007 Animal feeding stuffs—determination of cadmium and lead by graphite furnace atomic absorption spectrometry (GF-AAS) after pressure digestion. CEN, BrusselsGoogle Scholar
- 17.ISO 13528:2015 Statistical methods for use in proficiency testing by interlaboratory comparisons. ISO, GenevaGoogle Scholar
- 18.Commission Regulation (EC) No 939/2010 of 20 October 2010 amending Annex IV to regulation (EC) No 767/2009 on permitted tolerances for the compositional labelling of feed materials or compound feed as referred to in Article 11(5). Official Journal of the European Union, 2010, L277, 4–7Google Scholar
- 20.NATA Technical Note 33 (2013) Guidelines for estimating and reporting measurement uncertainty of chemical results. http://www.health.gov.au/internet/main/publishing.nsf/Content/717802D80CFD8A4ACA257BF0001BDBB7/$File/technical_note_33.pdf
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.