Reproducibility and specificity concerns associated with nucleic acid amplification tests for detecting Chlamydia trachomatis

Review

Abstract

Commercial nucleic acid amplification tests (NAATs) have become one of the most frequently used tests for detecting Chalmydia trachomatis. However, published studies have raised important concerns regarding the NAAT evaluation process in general and their reproducibility and clinical specificity in particular. This is because for many infectious diseases including chlamydia, a true gold standard simply does not exist and, as a result, estimation of test performance parameters in the absence of a gold standard is a difficult and challenging task. In this manuscript, we will attempt to address some issues pertaining to the evaluation of NAATs including NAAT reproducibility, test validity, and the manner in which positive NAAT results are confirmed. Finally, we will discuss some of the potential clinical and public health implications of testing by NAATs.

Notes

Acknowledgement

A version of this paper was posted in a non-peer reviewed website hosted by the University of Washington in June 2007. Go to http://csde.washington.edu/WHOSTI/literature_reviews/ and search for Hadgu.

Disclaimer

The views expressed in this article are those of the authors and do not necessarily reflect the views or policies of the Centers for Disease Control or the U.S. Public Health Service.

References

  1. 1.
    Campbell G (2006) The role of statistics in medical devices—the contrast with pharmaceuticals. The American Statistical Association, Biopharmaceutical Section, Biopharmaceutical Report, vol. 14, no.1Google Scholar
  2. 2.
    Castriciano S, Luinstra K, Jang D, Patel J, Mahony J, Kapala J et al (2002) Accuracy of results obtained by performing a second ligase chain reaction assay and PCR analysis on urine samples with positive or near-cutoff results in the LCx test for Chlamydia trachomatis. J Clin Microbiol 40:2632–2634. doi: 10.1128/JCM.40.7.2632-2634.2002 PubMedCrossRefGoogle Scholar
  3. 3.
    Culler EE, Caliendo MC, Nolte FS (2003) Reproducibility of positive test results in the BDProbeTec ET system for detection of Chlamydia trachomatis and Neisseria gonorrhoeae. J Clin Microbiol 41:3911–3914. doi: 10.1128/JCM.41.8.3911-3914.2003 PubMedCrossRefGoogle Scholar
  4. 4.
    Gronowski AM, Copper S, Baorto D, Murray PR (2000) Reproducibility problems with the Abbott laboratories LCx assay for C. trachomatis and N. gonorrhoeae. J Clin Microbiol 38:2416–2418PubMedGoogle Scholar
  5. 5.
    Mallinson H, Hopwood J, Mutton K (2002) Resolution of recent performance problem of Abbott LCx Chlamydia trachomatis assay. Issues of repeat testing for confirmation of Chlamydia infection. Sex Transm Infect 78:225–226. doi: 10.1136/sti.78.3.225-a PubMedCrossRefGoogle Scholar
  6. 6.
    Nordbo SA, Lund K, Skjeldestad FE (2000) Retesting and follow-up of first-catch urines from men yield variable results with three Chlamydia trachomatis nucleic acid amplification tests. APMIS 108:725–728. doi: 10.1034/j.1600-0463.2000.d01-20.x PubMedCrossRefGoogle Scholar
  7. 7.
    Schachter J, Chow MC, Howard H, Bolan J, Moncada J (2006) Detection of Chlamydia trachomatis by nucleic acid amplification testing: our evaluation suggests that CDC-recommended approaches for confirmatory testing are ill-advised. J Clin Microbiol 44:2512–2517. doi: 10.1128/JCM.02620-05 PubMedCrossRefGoogle Scholar
  8. 8.
    Abbott Laboratories (2001) Device correction memo, LCx Chlamydia trachomatis. Abbott Laboratories, Abbott Park, IllinoisGoogle Scholar
  9. 9.
    Hadgu A (1999) Discrepant analysis: a biased and an unscientific method for estimating test sensitivity and specificity. J Clin Epi 12:1231–1237. doi: 10.1016/S0895-4356(99)00101-8 CrossRefGoogle Scholar
  10. 10.
    Hadgu A (1997) Bias in the evaluation of DNA-amplification tests for detecting Chlamydia trachomatis. Stat Med 16:1391–1399PubMedCrossRefGoogle Scholar
  11. 11.
    Hadgu A, Dendukuri N, Hilden J (2005) The evaluation of nucleic acid amplification tests for detecting sexually transmitted diseases-review of the statistical and epidemiological issues. Epidemiology 16:604–612. doi: 10.1097/01.ede.0000173042.07579.17 Google Scholar
  12. 12.
    Hilden J (1997) Discrepant analysis - or behavior? Lancet 350:902. doi: 10.1016/S0140-6736(05)63264-3 PubMedCrossRefGoogle Scholar
  13. 13.
    McAdam AJ (2000) Discrepant analysis: how can we test a test? J Clin Microbiol 38:2027–2029PubMedGoogle Scholar
  14. 14.
    Miller WC (1998) Bias in discrepant analysis: when two wrongs don’t make it a right. J Clin Epi 51:219–231. doi: 10.1016/S0895-4356(97)00264-3 CrossRefGoogle Scholar
  15. 15.
    Food and Drug Administration (2003) Statistical guidelines on reporting results from studies evaluating diagnostic tests; draft guidelines and FDA reviewers. FDA, Rockville, MDGoogle Scholar
  16. 16.
    Cook RL, Hutchison SL, Ostergrrard L, Braithwaite RS, Ness RB (2005) Systematic review. Noninvasive testing for C. trachomatis and N. gonorrhoeae. Ann Intern Med 142:914–925PubMedGoogle Scholar
  17. 17.
    Hui SL, Zhou XH (1998) Evaluation of diagnostic tests without gold standards. Stat Methods Med Res 7:354–370. doi: 10.1191/096228098671192352 PubMedCrossRefGoogle Scholar
  18. 18.
    Staquet M, Rozencweig M, Lee YJ, Muggia FM (1981) Methodology for the assessment of new dichotomous diagnostic tests. J Chronic Dis 34:599–610. doi: 10.1016/0021-9681(81)90059-X PubMedCrossRefGoogle Scholar
  19. 19.
    Hadgu A (2006) Issues in Chlamydia trachomatis testing by a nucleic acid amplification tests (correspondence). J Infect Dis 193:1335–1336. doi: 10.1086/503111 PubMedCrossRefGoogle Scholar
  20. 20.
    Dendukuri N, Hadgu A, Liangliang W (2004) Modeling conditional dependence between multiple diagnostic tests: a hierarchical latent class model. Proceedings of the Joint Statistical Meetings of the American Statistical Association, pages 2526–2533, 2005Google Scholar
  21. 21.
    Rogers SM, Miller WC, Ellen JE, et al (2005) Transmissibility of Chlamydia trachomatis infections detected using nucleic acid amplification tests. The 2005 biennial meeting of the International Society for Sexually transmitted Diseases Research, Amsterdam, NetherlandsGoogle Scholar
  22. 22.
    Schllinger J, Batteiger B, Stothard D et al (2004) Transmission of Chlamydia trachomatis between heterosexual sex partners: preliminary results from genotype-specific concordance study. The 2004 national STD prevention conference program and abstract book, March 8–11, 2004, Philadelphia, PennsylvaniaGoogle Scholar
  23. 23.
    Golden MR, Whittington WL, Hansfield HH, Hughes JP, Stamm WE, Hogban M et al (2005) Effect of expedited treatment for sex partners on recurrent pr persistent gonorrhea or chlamydial infection. N Engl J Med 352:676–685. doi: 10.1056/NEJMoa041681 PubMedCrossRefGoogle Scholar
  24. 24.
    Centers for Disease Control and Prevention (2002) Screening tests to detect Chlamydia trachomatis and Neisseria gonorrhoeae Infections. MMWR 51(No. RR-15)Google Scholar
  25. 25.
    Katz AR, Effler PV, Ohye RG, Brouillett B, Lee MV, Whitcar P (2004) False-positive gonorrhea test results with a nucleic acid amplification test: the impact of low prevalence on positive predictive value. Clin Infect Dis 38:820–821. doi: 10.1086/381895 CrossRefGoogle Scholar
  26. 26.
    Brunham RC, Poubohloul B, Mak S, White R, Rekart MI (2005) The unexpected impact of Chlamydia trachomatis infection control program on susceptibility of reinfection. J Infect Dis 192:1836–1844. doi: 10.1086/497341 PubMedCrossRefGoogle Scholar
  27. 27.
    Dicker LW, Mosure DJ, Levine WC, Black CM, Berman SM (2000) Impact of switching laboratory tests on reported trends in C. trachomatis infection. Am J Epidemiol 151:430–435PubMedGoogle Scholar
  28. 28.
    Fenton K, Korovessis C, Johnson AM, McCadden A, McManus S, Wellings K et al (2001) Sexual behavior in Britain: reported sexually transmitted infections and prevalence genital Chlamydia trachomatis infection. Lancet 358:1851–1854. doi: 10.1016/S0140-6736(01)06886-6 PubMedCrossRefGoogle Scholar
  29. 29.
    Klavs I, Rodrigues LC, Wellings K, Kese D, Hayes R (2004) Prevalence of genital Chlamydia trachomatis infection in the general population of Slovenia: serious gaps in control. Sex Transm Infect 80:121–123. doi: 10.1136/sti.2003.005900 PubMedCrossRefGoogle Scholar
  30. 30.
    Chanock S, Wacholder S (2002) One gene and one outcome? No way. Trends Mol Med 8:266–269. doi: 10.1016/S1471-4914(02)02356-0 PubMedCrossRefGoogle Scholar

Copyright information

© US Government 2008

Authors and Affiliations

  1. 1.Division of STD PreventionCenters for Disease Control and PreventionAtlantaUSA

Personalised recommendations