Skip to main content
Log in

The comparison of parametric and nonparametric bootstrap methods for reference interval computation in small sample size groups

  • Practitioner's Report
  • Published:
Accreditation and Quality Assurance Aims and scope Submit manuscript

Abstract

According to the IFCC, to determine the population-based reference interval (RI) of a test, 120 reference individuals are required. However, for some age groups such as newborns and preterm babies, it is difficult to obtain enough reference individuals. In this study, we consider both parametric and nonparametric bootstrap methods for estimating RIs and the associated confidence intervals (CIs) in small sample size groups. We used data from four different tests [glucose, creatinine, blood urea nitrogen (BUN), and triglycerides], each in 120 individuals, to calculate the RIs and the associated CIs using nonparametric and parametric approaches. Also for each test, we selected small groups (m = 20, 30,…, 120) from among the 120 individuals and applied parametric and nonparametric bootstrap methods. The glucose and creatinine data were normally distributed, and the parametric bootstrap method provided more precise RIs (i.e., the associated CIs were narrower). In contrast, the BUN and triglyceride data were not normally distributed, and the nonparametric bootstrap method provided better results. With the bootstrap methods, the RIs and CIs of small groups were similar to those of the 120 subjects required for the nonparametric method, with a slight loss of precision. For original data with normal or close to normal distribution, the parametric bootstrap approach should be used, instead of nonparametric methods. For original data that deviate significantly from a normal distribution, the nonparametric bootstrap should be applied. Using the bootstrap methods, fewer samples are required for computing RIs, with only a slightly increased uncertainty around the end points.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Abbreviations

RI:

Reference interval

CI:

Confidence interval

URIL:

Upper reference interval limit

LRIL:

Lower reference interval limit

BUN:

Blood Urea Nitrogen

CLSI:

Clinical and Laboratory Standards Institute

IFCC:

International Federation of Clinical Chemistry and Laboratory Medicine

ISO:

International Standardization for Organization

References

  1. Henny J (2007) Interpretation of laboratory results: the reference intervals, a necessary evil? Clin Chem Lab Med 45:939–941

    Article  CAS  Google Scholar 

  2. Solberg HE (2006) In: Burtis CA, Ashwood ER, Bruns DE (eds) Tietz textbook of clinical chemistry and molecular diagnosis, 4th edn. Elsevier Sounders, USA

    Google Scholar 

  3. Grasbeck R, Saris NE (1969) Establishment and use of normal values. Scand J Clin Lab Invest 26 Suppl:S110

  4. Henny J, Petersen PH (2004) Reference values: from philosophy to a tool for laboratory medicine. Clin Chem Lab Med 42:686–691

    Article  CAS  Google Scholar 

  5. CLSI (2008) Defining, establishing, and verifying reference intervals in the clinical laboratory. Approved guideline, 3rd edn. CLSI document C28-A3c, Clinical and Laboratory Standards Institute, Wayne

  6. Solberg HE (1993) A guide to IFCC recommendations on reference values. JIFCC 5:160–164

    Google Scholar 

  7. International Federation of Clinical Chemistry (IFCC) Panel on Theory of Reference Values, The theory of reference values (1987) Part 5. Statistical treatment of collected reference values. Determination of reference limits. J Clin Chem Clin Biochem 25:645–656

    Google Scholar 

  8. Linnet K (1987) Two-stage transformation system for normalization of reference distributions evaluated. Clin Chem 33:381–386

    CAS  Google Scholar 

  9. Horn PS, Pesce AJ, Copeland BE (1998) A robust approach to reference interval estimation and evaluation. Clin Chem 44:622–631

    CAS  Google Scholar 

  10. Linnet K (2000) Nonparametric estimation of reference intervals by simple and bootstrap-based procedures. Clin Chem 46:867–869

    CAS  Google Scholar 

  11. Wright EM, Royston P (1999) Calculating reference intervals for laboratory measurements. Stat Methods Med Res 8:93–112

    Article  CAS  Google Scholar 

  12. Harrell FE, Davis CE (1982) A new distribution-free quantile estimator. Biometrika 69:635–640

    Article  Google Scholar 

  13. Bain LJ, Engelhardt M (2000) Introduction to probability and mathematical statistics, 2nd edn. Duxbury Press, Belmont

    Google Scholar 

  14. Elveback LR, Guillier CL, Keating FR Jr (1970) Health, normality, and the ghost of Gauss. J Am Med Assoc 211:69–75

    Article  CAS  Google Scholar 

  15. Efron B, Tibshirani RJ (1994) An introduction to the bootstrap. Chapman & Hall/CRC Monographs on Statistics & Applied Probability, 1st edn. Boca Raton

  16. Davison AC, Hinkley DV (1997) Bootstrap methods and their application, Cambridge Series in Statistical and Probabilistic Mathematics, 1st edn. Cambridge University Press, New York

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Abdurrahman Coskun.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Coskun, A., Ceyhan, E., Inal, T.C. et al. The comparison of parametric and nonparametric bootstrap methods for reference interval computation in small sample size groups. Accred Qual Assur 18, 51–60 (2013). https://doi.org/10.1007/s00769-012-0948-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00769-012-0948-5

Keywords

Navigation