Abstract
The ability of forensic laboratories to reliably estimate the uncertainty of their reported results is assessed by means of data from recent proficiency tests in which participants reported both their results and the associated uncertainties. Topics covered include the determination of blood alcohol, breath alcohol, and controlled substances—services commonly provided by forensic laboratories. It is seen that a statistically significant number of laboratories underestimate their own uncertainties, based on the incidence of the laboratories’ own reported coverage intervals failing to include the participant mean or assigned concentration of the test material.
References
Youden WJ (1972) Technometrics 14:1–11 (reprint of 1968 presentation)
Horwitz W, Albert A (1997) Analyst 122:615–617
Horwitz W (2003) J AOAC Int 86:109–111
Horwitz W (1998) J AOAC Int 81:785–794
Thompson M, Ellison SLR (2011) Accred Qual Assur 16:483–487. doi:10.1007/s00769-011-0803-0
http://www.ctsforensics.com/reports/main.aspx. Visited 2 Dec 2015
ISO 13528:2015(E) Statistical methods for use in proficiency testing by interlaboratory comparison. International Organization for Standardization, Geneva, Switzerland
Ellison SLR, Mathieson K (2008) Performance of uncertainty evaluation strategies in a food proficiency scheme. Accred Qual Assur 13:231–238. doi:10.1007/s00769-007-0353-7
Wernimont GT, Spendley W (1985) Use of statistics to develop and evaluate analytical methods. Arlington, Association of Official Analytical Chemists, p 11
Wallace JR (2010) Proficiency testing as a basis for estimating uncertainty of measurement: application to forensic alcohol and toxicology quantitations. J Forensic Sci 55:767–773. doi:10.1111/j.1556-4029.2010.01344.x
ISO 21748:2010 Guidance for the Use of Repeatability, Reproducibility and Trueness Estimates in Measurement Uncertainty Estimation. International Organization for Standardization (ISO), Geneva, Switzerland
Ellison SLR, Williamson A (eds) (2012) Eurachem/Citac guide: Quantifying uncertainty in analytical measurement, 3rd edn. www.eurachem.org
ISO 5725-3:1994 Accuracy (trueness and precision) of measurement methods and results, part 3. International Organization for Standardization. Geneva, Switzerland
Joint Committee for Guides in Metrology (2008) Guide to the expression of uncertainty in measurement JCGM 100:2008, section 3.4.2
Acknowledgments
The author wishes to thank CTS for providing their report in electronic format, without which this effort would have been greatly extended, and especially his wife for her encouragement and patience.
Author information
Authors and Affiliations
Corresponding author
Additional information
The opinions in this report should not be taken as the official position of the author’s employer, or of any organization to which the author belongs.
Rights and permissions
About this article
Cite this article
Wallace, J. Reliability of measurement uncertainty estimates for forensic analyses: evidence from recent proficiency tests. Accred Qual Assur 21, 211–219 (2016). https://doi.org/10.1007/s00769-016-1211-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00769-016-1211-2