Skip to main content
Log in

Assessment of reproducibility and uncertainty of food microbiology methods: statistical approach of a multi-site laboratory

  • Practitioner's Report
  • Published:
Accreditation and Quality Assurance Aims and scope Submit manuscript

Abstract

The validation of food microbiology methods and assessment of measurement uncertainty are required for laboratories operating EN ISO/IEC 17025 accreditation systems. This paper aims to describes the statistical approach adopted by a multi-site laboratory to satisfy these requirements and to routinely check the performance of the methods. A validation protocol was performed, reflecting a great variability of experimental conditions, represented by the period of time during which determinations were made, the different laboratories concerned, the large number of technicians involved, the differences in the level of contamination of the matrix analyzed and the operating conditions (equipment, reagents, culture media, environmental conditions, etc.). Despite the very high variability of the experimental conditions, the values of repeatability and reproducibility obtained for the methods were lower than those stated in the respective regulations. In addition, the top-down approach adopted in this study is to be considered effective overtime and allows to randomize all variable factors, including the effects of sensitivity and specificity, in order to simulate the conditions of real reproducibility. A specific Excel spreadsheet was also developed for the routine expression of analytical results. This spreadsheet represents a very useful tool for operators to calculate and routinely check the results, as well as to assess the uncertainty of measurement. This particular quality assessment system is enabling the multi-site laboratory to implement the accuracy, reliability and comparability of the analytical results and to ensure the analytical control of data output.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

References

  1. EN ISO/IEC 17025 (1999) General requirements for the competence of testing and calibration laboratories. International Organization for Standardization, Geneva (revised 2005)

    Google Scholar 

  2. EN ISO 16140 (2003) Microbiology of food and animal feeding stuff. Protocol for the validation of alternative methods. European Committee for Standardization, International Organization for Standardization, Geneva

    Google Scholar 

  3. ISO 7218 (2007) Microbiology of food and animal feeding-stuffs. General requirements and guidance for microbiological examinations. International Organization for Standardization, Geneva

    Google Scholar 

  4. ISO/TS 19036 (2006, Amendment 2009) Microbiology of food and animal feeding-stuffs. Guidelines for the estimation of measurement uncertainty for quantitative determinations. International Organization for Standardization, Geneva, Switzerland (2006, Amendment 1 2009)

  5. EC Regulation 2073/2005 (2005) Commission regulation (EC) no. 2073/2005 of 15 November 2005 on microbiological criteria for foodstuffs. Off J Eur Union L338:1–25

    Google Scholar 

  6. ISO 4833 (2003) Microbiology of food and animal feeding stuffs. Horizontal method for enumeration of micro-organisms. Colony count technique at 30 °C. International Organization for Standardization, Geneva

    Google Scholar 

  7. ISO 6888-2 (1999, Amendment 1, 2003) Microbiology of food and animal feeding stuffs. Horizontal method for the enumeration of coagulase-positive staphylococci (Staphylococcus aureus and other species). Technique using rabbit-plasma fibrinogen agar medium, Part 2. International Organization for Standardization, Geneva

  8. EN ISO 7932 (2004) Microbiology of food and animal feeding-stuffs. Horizontal method for the enumeration of presumptive Bacillus cereus-colony-count technique at 30 °C. International Organization for Standardization, Geneva

    Google Scholar 

  9. ISO 21528-2 (2004) Microbiology of food and animal feeding stuffs. Horizontal methods for the detection and enumeration of Enterobacteriaceae. Colony-count method, Part 2. International Organization for Standardization, Geneva

    Google Scholar 

  10. EN ISO 11290-2 (1998; Amendment 1, 2004) Microbiology of food and animal feeding-stuffs. Horizontal method for the detection and enumeration of Listeria monocytogenes. Enumeration, Part 2. International Organization for Standardization, Geneva

  11. AFNOR certification. NF validation. http://www.afnor-validation.com/

  12. Linea guida per la validazione dei metodi di prova per analisi microbiologiche degli alimenti. Progetto Qualità IIZZSS, 5 aprile 2004. Available on request to qa@zsum.it

  13. Corry JE, Hedges AJ, Jarvis B (2007) Measurement uncertainty of the EU methods for microbiological examination of red meat. Food Microbiol 24:652–657

    Article  CAS  Google Scholar 

  14. EN ISO 6887-1 (1999) Microbiology of food and animal feeding stuffs—preparation of test samples, initial suspension and decimal dilutions for microbiological examination—Part 1: general rules for the preparation of the initial suspension and decimal dilutions. International Organization for Standardization, Geneva

    Google Scholar 

  15. ISO/TS 21748 (2002) Guide to the use of repeatability, reproducibility and trueness estimates in measurement uncertainty estimation dilution steps. International Organization for Standardization, Geneva

    Google Scholar 

  16. Haouet MN (2009) Spreadsheet “Expression of results in food microbiology”. http://www.izsum.it/files/Download/91/89/Mod_Q%20317%20Rev.%202%20inglese.xls

  17. Corry JE, Jarvis B, Passmore S, Hedges A (2007) A critical review of measurement uncertainty in the enumeration of food micro-organisms. Food Microbiol 24:230–253

    Article  Google Scholar 

  18. Jarvis B, Corry JE, Hedges AJ (2007) Estimates of measurement uncertainty from proficiency testing schemes, internal laboratory quality monitoring and during routine enforcement examination of foods. J Appl Microbiol 103:462–467

    Article  CAS  Google Scholar 

  19. Jarvis B, Hedges AJ, Corry JE (2007) Assessment of measurement uncertainty for quantitative methods of analysis: comparative assessment of the precision (uncertainty) of bacterial colony counts. Int J Food Microbiol 116:44–51

    Article  Google Scholar 

  20. Kelley M, DeSilva B (2007) Key elements of bio-analytical method validation for macromolecules. AAPS J 9:156–163

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to M. Naceur Haouet.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (XLS 363 kb)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Blasi, G., Petruzzelli, A., Ottaviani, D. et al. Assessment of reproducibility and uncertainty of food microbiology methods: statistical approach of a multi-site laboratory. Accred Qual Assur 18, 143–148 (2013). https://doi.org/10.1007/s00769-013-0959-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00769-013-0959-x

Keywords

Navigation