Introduction

Legionella (L.) pneumophila is responsible for at least two diseases in humans: Legionnaires’ disease, which is a severe form of pneumonia clinically indistinguishable from other types of bacterial pneumonia, and Pontiac fever, which is a flu-like illness. The common term for these diseases is legionellosis. L. pneumophila lives in freshwater and moist environments and multiplies especially at temperatures between 30 and 45°C [1]. Inhalation or aspiration of contaminated water can cause legionellosis.

The laboratory diagnosis of Legionnaires’ disease has traditionally been based on detection of antibodies and on isolation of the bacteria by culture. However, antibodies are generally not detected in the acute phase of the disease and culture is insensitive and time-consuming. An early diagnosis can be achieved by detection of L. pneumophila antigen in urine [2] or by detection of DNA from the organism by polymerase chain reaction (PCR) on lower respiratory samples [3]. However, kits for detection of urinary antigen have only reliable sensitivity for L. pneumophila serogroup (sg.) 1 [2] and not the other serogroups, which may also cause severe illness. Moreover, PCR is generally not used as a routine analysis, and it is to some degree hampered by the fact that pneumonia caused by L. pneumophila often is unproductive (dry cough) especially in the acute phase and in milder cases. Diagnosis of Pontiac fever is generally dependent on serology. Due to these circumstances, serology still remains an important tool in the diagnosis of legionellosis as well as for epidemiological and outbreak studies. Although serology rarely is helpful in the acute phase of the disease, it can be used to confirm a presumptive diagnosis of legionellosis by PCR or other non-confirmatory methods.

It is important to use specific, sensitive and validated methods for a reliable diagnosis. In this study, we compare an in-house reference method (IF test) with four commercially available kits for detection of antibodies to L. pneumophila: (1) Focus Diagnostics IFA kit for Legionella pneumophila sg. 1, 2, 3, 4, 5, 6 and 8 total immunoglobulin (Ig) (IgG/IgM/IgA), (2) SERION enzyme-linked immunosorbent assay (ELISA) classic Legionella pneumophila sg. 1-7 IgM kit and sg. 1-7 IgG kit, (3) Zeus Scientific, Inc. Legionella pneumophila sg. 1-6 ELISA IgG/IgM/IgA test system kit and (4) Vircell Legionella pneumophila sg. 1-6 ELISA IgG+IgM kit. It was decided to use seropositive sera in the study to be sure that the patients were able to produce antibodies, because up to 25% of patients with culture-verified legionellosis do not develop a significant antibody level [4], and to be sure that the serum was collected at a time when the patient had seroconverted. By testing the same panels of sera in all five assays, the performance of the methods was determined with respect to sensitivity and specificity (false-positive rate) relative to an in-house IF test. The kits have all previously been validated in different combinations but not all five at the same time [57].

Materials and methods

Sera

Sera used for sensitivity test

Eighty-one IF test-positive sera from 65 patients with L. pneumophila infection confirmed by one or more of the following methods; culture by standard method, Legionella urine antigen EIA (Biotest AG, Dreieich, Germany) and/or PCR by an in-house method [8]. All the sera were sent to Statens Serum Institut, Denmark for serodiagnosis. Of the 65 patients, 51 cases had only one serum sample analysed, 13 cases had two serum samples analysed, and 1 case had four serum samples analysed. Of the 65 cases, 33 were confirmed by culture either alone or combined with either Legionella urine antigen enzyme immunosorbent assay (EIA) or PCR or both methods, 27 cases were confirmed by Legionella urine antigen EIA either alone or combined with PCR and 5 cases were only positive by PCR.

The cases confirmed by culture could be grouped according to the L. pneumophila serogroup isolated from the patient: 25 were sg. 1 cases, 5 were sg. 3 cases, 1 was a sg. 5 case and 2 were sg. 6 cases. Most of the 27 cases confirmed by Legionella urine antigen EIA were probably sg. 1 cases. For the five PCR-positive cases, the causative serogroups are unknown.

Sera used for specificity test and cross-reactions

Seventy-five sera, which had been tested positive for antibodies against bacteria other than L. pneumophila, were used (10 sera of each positive for the following bacteria: Campylobacter jejuni/coli, Helicobacter pylori, Salmonella typhimurium/enteritidis, Proteus spp., Mycoplasma pneumoniae, Chlamydia group antigen, Coxiella burnetii and 5 sera positive for Pseudomonas aeruginosa). The Pseudomonas aeruginosa sera were supplied by Rigshospitalet, Copenhagen, Denmark, and were control sera from cystic fibrosis patients without pneumonia. All the other sera were sent to Statens Serum Institut, Denmark for serodiagnosis. Sera with antibodies to Campylobacter jejuni/coli, Proteus spp., Pseudomonas aeruginosa and Coxiella burnetii were chosen as these have previously been reported to be able to cross-react with Legionella [911]. Sera with antibodies to Mycoplasma pneumoniae (all cases confirmed as Mycoplasma pneumoniae infection by PCR) and Chlamydia group antigen (three cases confirmed as Chlamydia pneumoniae infection by PCR) were selected because these bacteria can give rise to respiratory symptoms similar to legionellosis [1, 12]. Helicobacter pylori and Salmonella typhimurium/enteritidis were chosen as representatives for antibodies to other gram-negative bacteria [13]. The sera used were all positive by validated serological tests and were a mixture of high and medium high results. None of the patients, from whom the sera were collected, have been notified as cases of Legionnaires’ disease within the last 15 years, so recent Legionnaires’ disease in the patients is very unlikely; a previous Legionella infection can however (symptomatic or non-symptomatic) of course not be ruled out.

Legionella pneumophila antibody detection kits

The following four commercial kits were used: Focus Diagnostics IFA kit for Legionella pneumophila sg. 1 (single antigen) and 2-6+8 (pool) IgG/IgM/IgA (Focus Diagnostics, Inc., Cypress, CA, USA), SERION ELISA classic Legionella pneumophila 1-7 IgM kit and 1-7 IgG kit (Serion Immundiagnostica GmbH, Würzburg, Germany), Zeus Scientific, Inc. Legionella pneumophila sg. 1-6 ELISA IgG/IgM/IgA test system kit (Zeus Scientific, Inc., Raritan, NJ, USA) and Vircell Legionella pneumophila sg. 1-6 ELISA IgG+IgM kit (Vircell S.L., Santa Fe, Spain).

All tests were performed according to the manufacturer’s instructions. The results for SERION ELISA IgG and IgM kits were combined; if a serum sample was positive in one of the kits the sample was considered positive. This was done in order to be able to compare this test with the results from the other kits which all detected total immunoglobulin (IgG, IgM and IgA).

In-house indirect Legionella immunofluorescence antibody test (IF test) [14, 15]

Serial dilutions of blood samples were analysed for antibodies against L. pneumophila by indirect immunofluorescence antibody test with plate-cultured and heat-inactivated L. pneumophila sg. 1 to 6 as single antigens. Antibodies to L. pneumophila were detected with a fluorescein isothiocyanate (FITC)-conjugated rabbit anti-human total immunoglobulin (IgM, IgA and IgG). The assay is essentially the same as the well-characterised assay reported by Wilkinson et al. [15], which follows the guidelines from the Centers for Disease Control and Prevention (CDC). An Escherichia coli blocking fluid [14] was used to block cross-reacting antibodies to other gram-negative bacteria. Titres of ≥1:256 were considered positive.

Results and discussion

Four commercially available kits were compared with an in-house IF test. The results which were found equivocal were repeated, and for those still equivocal the results were excluded from the calculations, since according to the manufacturers a new sample should be requested, if a sample repeatedly is equivocal.

The results are presented in Tables 1 and 2. The Focus Diagnostics, SERION ELISA classic, Zeus Scientific, Inc. ELISA and Vircell kits were all relatively sensitive (81.5, 76.5, 68.8 and 62.5%). But both Focus Diagnostics and Zeus Scientific, Inc. ELISA kits had high false-positive rates of 16 and 29%, respectively (Table 1), which are far too high to be acceptable in a routine laboratory. The combined SERION ELISA classic kits and the Vircell both showed very low false-positive rates (5.6 and 2.7%, Table 1). The false-positive rate for the Vircell kit is consistent with previously reported results [5]. When this is compared with the in-house IF test, the Vircell kits’ false-positive percent turns out to be lower, whereas it seems that the test lacks sensitivity as it only detects 62.5% of the seropositive samples. The sera which were positive for antibodies against Pseudomonas aeruginosa, Coxiella burnetii and Campylobacter jejuni/coli showed the highest level of false-positive/cross-reactivity in the kits (Tables 1 and 2), which is consistent with previously reported results [911].

Table 1 Comparison of in-house IF test’s and commercial kits’ sensitivity and false-positive/cross-reaction. CI confidence interval
Table 2 Results from false-positive test for all kits and in-house IF test

It should be mentioned that in this evaluation of the commercial kits, the in-house IF test was chosen to be the gold standard, since all the tested samples were selected according to positivity in this assay. Due to this, the sensitivity of this in-house assay is 100%. To assure that the serum samples really are true positives, only samples from patients with legionellosis having been laboratory confirmed by at least one other test were used.

However, one should be aware that the selection of serum samples according to other criteria may change the obtained sensitivity.

The relative sensitivity of the kits was also calculated for the L. pneumophila serogroups identified by culture. The Focus Diagnostics and SERION ELISA classic kits both detected about 80% of the L. pneumophila sg. 1 positive patients, whereas the Zeus Scientific, Inc. and Vircell kits only found about 56% positive. For L. pneumophila non-sg. 1 (8 cases), the Focus Diagnostics and the SERION ELISA classic kits found 80%, the Vircell kit found 62.5% positive and Zeus Scientific, Inc. only found 33.3% positive. Taking all the tested serogroups together the Focus Diagnostics is the kit with the highest relative sensitivity (81.6%) to the different serogroups. The SERION ELISA classic kits have a total relative sensitivity of 78.9% for the four different serogroups tested. The Zeus Scientific, Inc. and Vircell ELISA kits both have low sensitivities (57.6 and 52.6%) for all of the tested serogroups, but the Zeus Scientific, Inc. especially lacks sensitivity to non-sg. 1.

This comparison of serological methods for the diagnosis of legionellosis confirms that the diagnosis cannot be based on one serum sample from the patient; a reliable diagnosis based on serology is still dependent on paired serum samples for detection of a significant change in the specific antibody level. This is due to a rather high false-positive rate in all the investigated methods. Positive antibody titres in sera from patients without legionellosis may be due to previous Legionella infections or cross-reacting antibodies. Although an assay with a false-positive rate of 2–5% (specificity of 95–98%) can be considered rather specific, the predictive value of a positive test for the assay will be as poor as approximately 50%, if the incidence of the disease among investigated patients is on the same level (2–5%), which is probably the true incidence of Legionnaires’ disease among pneumonia cases. One major disadvantage of the investigated commercial kits is that the antigens of the different serogroups are pooled; as only a significant change in the antibody level to L. pneumophila sg. 1 can be considered a verified diagnosis (WHO, EWGLI, ECDC),Footnote 1 these assays cannot be used to verify the diagnosis. As serology based on paired sera in most cases cannot be confirmed until rather late in the course of the disease it is advisable to use other diagnostic tests in combination with serology.