Abstract
We retrospectively audited the performance of the commercial kit in use in our laboratory for the detection of Mycobacterium tuberculosis complex (MTBC) and found the sensitivity to be unacceptably low at 69% (52/75). We developed an in-house end-point polymerase chain reaction (PCR) detecting IS6110, an IS-like element of MTBC, and achieved a sensitivity of 90% (66/73) with the same DNA samples, re-emphasising the poor performance of the commercial kit. In order to avoid specificity issues surrounding gel-based PCR, we developed a probe-based real-time PCR assay with an internal control and achieved a sensitivity of 84%, specificity of 97% and diagnostic odds ratio (DOR) of 207. The evaluation was performed on clinically requested samples, so we expect the performance of the assay in real life to match the data from this evaluation. Centers for Disease Control and Prevention (CDC) guidelines recommending nucleic acid tests for the investigation of possible cases of tuberculosis are expected to promote the use of molecular assays. It is important that clinical laboratories do not assume that assays, in-house or commercial, will perform well or that they will continue to perform well. Audit at regular intervals is necessary to maintain confidence and to demonstrate that the assay works to specification in the real test population.
Abbreviations
- PCR:
-
Polymerase chain reaction
- MTBC:
-
Mycobacterium tuberculosis complex
- NAA:
-
Nucleic acid amplification
- TB:
-
Tuberculosis
- NTM:
-
Non-tuberculous mycobacteria
- BSC:
-
Biosafety cabinet
- PPV:
-
Positive predictive value
- NPV:
-
Negative predictive value
- DOR:
-
Diagnostic odds ratio
- CI:
-
Confidence interval
- 6FAM:
-
6-carboxyfluorescein
- BHQ:
-
Non-fluorescent “black hole” quencher
- AFB:
-
Acid-fast bacilli
References
Centers for Disease Control and Prevention (CDC) (2009) Updated guidelines for the use of nucleic acid amplification tests in the diagnosis of tuberculosis. MMWR Morb Mortal Wkly Rep 58:7–10
Sarmiento OL, Weigle KA, Alexander J, Weber DJ, Miller WC (2003) Assessment by meta-analysis of PCR for diagnosis of smear-negative pulmonary tuberculosis. J Clin Microbiol 41:3233–3240
Rychlik W (2007) OLIGO 7 Primer Analysis Software. In: Yuryev A (ed) Methods in Molecular Biology. Humana Press Inc., Totowa, NJ, pp 35–59
Thierry D, Cave MD, Eisenach KD, Crawford JT, Bates JH, Gicquel B, Guesdon JL (1990) IS6110, an IS-like element of Mycobacterium tuberculosis complex. Nucleic Acids Res 18(1):188
http://www.quantitativeskills.com/sisa/statistics/diagnos.htm. Uitenbroek, Daan G, Binomial. SISA. Accessed December 2009
Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PM (2003) The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol 56:1129–1135
Barrett A, Magee JG, Freeman R (2002) An evaluation of the BD ProbeTec ET system for the direct detection of Mycobacterium tuberculosis in respiratory samples. J Med Microbiol 51:895–898
Wang JY, Lee LN, Lai HC, Hsu HL, Jan IS, Yu CJ, Hsueh PR, Yang PC (2007) Performance assessment of the Capilia TB assay and the BD ProbeTec ET system for rapid culture confirmation of Mycobacterium tuberculosis. Diagn Microbiol Infect Dis 59:395–399
Wang JY, Lee LN, Hsu HL, Hsueh PR, Luh KT (2006) Performance assessment of the DR. MTBC Screen assay and the BD ProbeTec ET system for direct detection of Mycobacterium tuberculosis in respiratory specimens. J Clin Microbiol 44:716–719
Rimek D, Tyagi S, Kappe R (2002) Performance of an IS6110-based PCR assay and the COBAS AMPLICOR MTB PCR system for detection of Mycobacterium tuberculosis complex DNA in human lymph node samples. J Clin Microbiol 40:3089–3092
Desikan P, De S, Mishra P, Jain A, Panwalkar N, Verma M, Maudar KK (2009) Comparison of performance characteristics of automated PCR systems with culture for detection of MTB complex from clinical samples in central India. Indian J Med Microbiol 27:277–278
Michos AG, Daikos GL, Tzanetou K, Theodoridou M, Moschovi M, Nicolaidou P, Petrikkos G, Syriopoulos T, Kanavaki S, Syriopoulou VP (2006) Detection of Mycobacterium tuberculosis DNA in respiratory and nonrespiratory specimens by the Amplicor MTB PCR. Diagn Microbiol Infect Dis 54:121–126
Agasino CB, Ponce de Leon A, Jasmer RM, Small PM (1998) Epidemiology of Mycobacterium tuberculosis strains in San Francisco that do not contain IS6110. Int J Tuberc Lung Dis 2:518–520
Sun YJ, Lee AS, Ng ST, Ravindran S, Kremer K, Bellamy R, Wong SY, van Soolingen D, Supply P, Paton NI (2004) Characterization of ancestral Mycobacterium tuberculosis by multiple genetic markers and proposal of genotyping strategy. J Clin Microbiol 42:5058–5064
Greco S, Rulli M, Girardi E, Piersimoni C, Saltini C (2009) Diagnostic accuracy of in-house PCR for pulmonary tuberculosis in smear-positive patients: meta-analysis and metaregression. J Clin Microbiol 47:569–5
Acknowledgements
The work at the Tan Tock Seng Hospital (TTSH) was supported and funded by the Molecular Biology Laboratory, TTSH, and in part by the Ministry of Health’s Health Service Development Program and the National Medical Research Council, Singapore. The work at the Institute of Molecular and Cell Biology (IMCB) was, in part, supported and funded by the Biomedical Research Council, which is part of Singapore’s Agency for Science, Technology, and Research (A*STAR). We thank Yon Hui Yi from the IMCB for the expert technical assistance.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Inoue, M., Tang, W.Y., Wee, S.Y. et al. Audit and improve! Evaluation of a real-time probe-based PCR assay with internal control for the direct detection of Mycobacterium tuberculosis complex. Eur J Clin Microbiol Infect Dis 30, 131–135 (2011). https://doi.org/10.1007/s10096-010-1059-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10096-010-1059-z