Abstract
We present how the repeatability and reproducibility of a measurement device can be estimated from a suitably defined hierarchical linear model. The methodology is illustrated using a collection of eight data sets which consist of the distortion product otoacoustic emission recordings collected from both ears of ten young Sprague-Dawley rats at different frequencies under eight different recording conditions. We formulate a model which extends the commonly used one-way random effects model (5) to account for an experimental setup that is more elaborated than the ones traditionally used in interlaboratory experiments. The fitted model is easily interpretable and furnishes as a by-product the frequencies at which the highest response level is achieved under the eight recording conditions. These values together with the repeatability and reproducibility limits of the protocols are crucial in contributing to the enhancement of the research capabilities on the possible causes of hearing impairment.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Brazzale AR, Salvan A, Roletti S (2004) A hierarchical modelling approach for measuring reliability of and agreement between two types of magnetic field dosimeter. J R Stat Soc Ser C Appl Stat 53: 261–278
BSI (1994a) Accuracy (trueness and precision) of measurement methods and results part 1: general principles and definitions. British Standard, London 5725–1
BSI (1994b) Accuracy (trueness and precision) of measurement methods and results part 2: basic method for the determination of repeatability and reproducibility of a standard measurement method. British Standard, London 5725–2
Davison AC (2003) Statistical models. Cambridge University Press, Cambridge
Franklin DJ, McCoy MJ, Martin GR, Lonsbury-Martin BL (1990) Test/retest reliability of distortion product and transiently evoked otoacoustic emissions. Ear Hear 13: 417–429
Goldstein H (1995) Multilevel statistical models. Halstead Press, New York
Henley CM III, Owings MH, Stagner BB, Martin GK, Lonsbury-Martin BL (1990) Postnatal development of 2f1–f2 otoacoustic emissions in pigmented rat. Hear Res 43: 141–148
JCGM (2008) International vocabulary of metrology—basic and general concepts and associated terms (VIM). JCGM 200:2008. Downloadable from http://www.bipm.org/utils/common/documents/jcgm/JCGM_200_2008.pdf
Kemp DT (1978) Stimulated acoustic emission from within the human auditory system. J Acoust Soc Am 64: 1386–1391
Khalfa S, Morlet T, Micheyl C, Morgon A, Collet L (1997) Evidence of peripheral hearing asymmetry in humans: clinical implications. Acta Oto-Laryngol 117: 192–196
Kummer P, Janssen T, Hulin P, Arnold W (2000) Optimal L(1)–L(2) primary tone level separation remains independent of test frequency in humans. Hear Res 146: 47–56
Nelder JA (1998) The selection of terms in response-surface models—How strong is the weak-heredity principle? Am Stat 52: 315–318
Parazzini M, Galloni P, Brazzale AR, Tognola G, Marino C, Ravazzani P (2006) Quantitative indices for the assessment of the repeatability of distortion product otoacoustic emissions in laboratory animals. IEEE Trans Biomed Eng 53: 1550–1556
Pinheiro JC, Bates DM (2000) Mixed-effects models in S and S-PLUS. Springer-Verlag, New York
Probst R, Lonsbury-Martin BL, Martin GK (1991) A review of otoacoustic emissions. J Acoust Soc Am 89: 2027–2067
R Development Core Team (2005) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna. ISBN: 3-900051-07-0. URL: http://www.R-project.org
Whitehead ML, McCoy MJ, Lonsbury-Martin BL, Martin GK (1995) Dependence of distortion product otoacoustic emissions on primary levels in normal and impaired ears. Part I: effects of decreasing L 2 below L 1. J Acoust Soc Am 97: 2346–2358
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by European Commission 5FP grant QLK4-CT-2001-00150 (Project GUARD, “Potential adverse effects of GSM cellular phones on hearing”, 2002–2004) and the European Project EMFnEAR “Exposure at UMTS Electromagnetic Fields: Study on Potential Adverse Effects on Hearing” (2004–2007, DG Health & Consumer Protection, Agreement Number 2004127).
Rights and permissions
About this article
Cite this article
Brazzale, A.R., Galloni, P., Parazzini, M. et al. Assessing repeatability and reproducibility using hierarchical modeling: a case-study of distortion product otoacoustic emissions. Stat Methods Appl 19, 567–585 (2010). https://doi.org/10.1007/s10260-010-0144-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10260-010-0144-x