Approximate Confidence Intervals for Estimation of Matching Error Rates of Biometric Identification Devices

  • Travis J. Atkinson
  • Michael E. Schuckers
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3087)


Assessing the matching error rates of a biometric identification devices is integral to understanding its performance. Here we propose and evaluate several methods for creating approximate confidence intervals for matching error rates. Testing of biometric identification devices is recognized as inducing intra-individual correlation. In order to estimate error rates associated with these devices, it is necessary to deal with these correlations. In this paper, we consider extensions of recent work on adjustments to confidence intervals for binomial proportions to correlated binary proportions. In particular we propose a Agresti-Coull type adjustment for estimation of a proportion. Here that proportion represents an error rate. We use an overdispersion model to account for intra-individual correlation. To evaluate this approach we simulate data from a Beta-binomial distribution and assess the coverage for nominally 95% confidence intervals.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Wayman, J.L.: Biometrics:Personal Identification in Networked Society, ch. 17. Kluwer Academic Publishers, Boston (1999)Google Scholar
  2. 2.
    Mansfield, T., Wayman, J.L.: Best practices in testing and reporting performance of biometric devices (2002), on the web at
  3. 3.
    Rood, E.P., Jain, A.K.: Biometric research agenda. Report of the NSF Workshop (2003)Google Scholar
  4. 4.
    Schuckers, M.E.: Using the beta-binomial distribution to assess performance of a biometric identification device. International Journal of Image and Graphics 3(3), 523–529 (2003)CrossRefGoogle Scholar
  5. 5.
    Schuckers, M.E.: Estimation and sample size calculations for matching performance of biometric identification devices. Center for Identification Technology Research technical report (2003)Google Scholar
  6. 6.
    Agresti, A., Coull, B.A.: Approximate is better than “exact” for interval estimation of binomial proportions. The American Statistician 52(2), 119–126 (1998)CrossRefMathSciNetGoogle Scholar
  7. 7.
    Cochran, W.G.: Sampling Techniques, 3rd edn. John Wiley & Sons, New York (1977)MATHGoogle Scholar
  8. 8.
    Lui, K.-J., Cumberland, W.G., Kuo, L.: An interval estimate for the intraclass correlation in beta-binomial sampling. Biometrika 52(2), 412–425 (1996)MATHGoogle Scholar
  9. 9.
    Schuckers, M.E., Hawley, A., Livingstone, K., Mramba, N., Knickerbocker, C.: A comparison of statistical methods for evaluating matching performance of a biometric identification device-a preliminary report. Center for Identification Technology Research technical report (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Travis J. Atkinson
    • 1
  • Michael E. Schuckers
    • 1
    • 2
  1. 1.Department of Mathematics, Computer Science and StatisticsSt. Lawrence UniversityCantonUSA
  2. 2.Center for Identification Technology Research (CITeR) 

Personalised recommendations