Abstract
Statistical analysis has an essential role in proficiency test (PT) evaluation, especially when the distribution of results of the enumeration of microbiological bacteria is multimodal or strongly asymmetric, outliers aside. In these specific cases, the median or the robust mean of the PT results, calculated using the algorithm described in ISO 13528 Annex C, is not entirely appropriate for estimating the assigned value. A possible solution is to estimate the modes of kernel density function of data distribution and its uncertainty by using the nonparametric bootstrap technique. This method allows estimation of the sampling distribution of a statistic empirically without making assumptions about the form of the population. In the context of the PT for the enumeration of sulfite-reducing bacteria growing under anaerobic conditions organized in 2012 by QUAlity Assurance, although all participants used equivalent methods, the results showed high variability, which supported the hypothesis that two discrepant populations occurred in the test samples. When a bimodal distribution occurs, it is reasonable to suppose that at least one of the modes could be correct, but unless independent grounds for preferring one over the other are available, it is not possible to determine the assigned value and calculate the z-score. In the case of the sulfite-reducing bacteria PT, the true mode was not identified and the performance evaluation was not provided. For this reason, the PT provider (IZSVe) asked that the participants report every unusual situation for this test, should they occur during the next PTs. In this way, it may be possible to identify a plausible assigned value and its uncertainty as bootstrap mode of kernel density and standard error, respectively, and to provide the z-score as value of performance evaluation in the case of negligible uncertainty.
This is a preview of subscription content, log in via an institution to check access.
References
ISO/IEC 17025:2005 General requirements for the competence of testing and calibration laboratories
ISO/IEC 17043:2010 Conformity assessment—general requirements for proficiency testing
ISO 13528:2005 Statistical methods for use in proficiency testing by interlaboratory comparison
ISO/TS 22117:2010 Microbiology of food and animal feeding stuffs—specific requirements and guidance for proficiency testing by interlaboratory comparison
ISO 15213:2003 Microbiology of food and animal feeding stuffs—horizontal method for the enumeration of sulfite-reducing bacteria growing under anaerobic conditions
ISO 7218:2007 Microbiology of food and animal feeding stuffs—general requirement and guidance for microbiological examinations
Thompson M, Ellison SLR, Wood R (2006) The international harmonised protocol for the proficiency testing of analytical chemistry laboratories. Pure Appl Chem 78(1):145–196
Grimaldi M, Mancin M, Trevisan R, Mioni R (2009) Proficiency testing in food microbiology “AQUA”: enumeration of Staphylococcus aureus. Accred Qual Assur 14(8):503–505
Mancin M, Grimaldi M, Barco L, Trevisan R, Ruffa M, Mioni R, Ricci A (2012) Proficiency testing in food microbiology: experience from implementation of ISO/IEC 17043 and ISO/TS 22117. Accred Qual Assur 17:425–430
Analytical Methods Committee (2001) Representing data distribution with kernel density estimates. AMC Technical brief, No 4. http://www.rsc.org/images/data-distributions-kernel-density-technical-brief-4_tcm18-214836.pdf Accessed 6 May 2015
Lowthian PJ, Thompson M (2002) Bump-hunting for the proficiency tester—searching for multimodality. Analyst 127:1359–1364
Deng H, Wickham H (2011) Density estimator in R. http://vita.had.co.nz/papers/density-estimation.pdf. Accessed 6 May 2015
Parzen E (1962) On estimation of a probability density function and mode. Ann Math Stat 33(3):1065–1076
Rosenblatt M (1956) Remarks on some nonparametric estimates of a density function. Ann Math Stat 27:832–837
Hansen E (2009) Lecture notes on nonparametrics, University of Wisconsin. http://www.ssc.wisc.edu/~bhansen/718/NonParametrics1.pdf. Accessed 6 May 2015
Scott DW (2013) Kernel density estimators http://www.stat.rice.edu/~scottdw/stat550/HW/hw4/c06.pdf. Accessed 6 May 2015
Salgado-Ugarte H, P´erez-Hern´andezm A (2003) Exploring the use of variable bandwidth kernel density estimators. Stata J 3(2):133–147
Sheather SJ (2004) Density estimation. Stat Sci 19(4):588–597
Efron B, Tibshirani R (1993) An introduction to the bootstrap. Chapman & Hall, London
Analytical Methods Committee (2001) The bootstrap: a simple approach to estimating standard errors and confidence intervals when theory fails. AMC technical brief, No 8. http://www.rsc.org/images/standard-errors-technical-brief-8_tcm18-214877.pdf. Accessed 6 May 2015
Fox J, Weisberg S (2012) Bootstrapping regression models: appendix to an R companion to applied regression, second edition. http://socserv.socsci.mcmaster.ca/jfox/Books/Companion/appendix/Appendix-Bootstrapping.pdf. Accessed 6 May 2015
Davison AC, Hinkley DV (1997) Bootstrap methods and their application. Cambridge University Press, Cambridge
R Core Team (2012) R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. http://www.R-project.org/
Canty A, Ripley B (2015) Boot: Bootstrap R (S-Plus) Functions. R package version 1.3-15
Davison AC, Hinkley DV (1997) Bootstrap methods and their applications. Cambridge University Press, Cambridge. ISBN 0-521-57391-2
Acknowledgments
The authors wish to acknowledge Fabio Loriggiola for the microbiological laboratory support.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Mancin, M., Toson, M., Grimaldi, M. et al. Application of bootstrap method to evaluate bimodal data: an example of food microbiology proficiency test for sulfite-reducing anaerobes. Accred Qual Assur 20, 255–266 (2015). https://doi.org/10.1007/s00769-015-1141-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00769-015-1141-4