A protocol for a systematic review of the diagnostic accuracy of Loop-mediated-isothermal AMPlification (LAMP) in diagnosis of invasive meningococcal disease in children
Meningococcal disease (MD) is notoriously difficult to diagnose in the early stages of the illness and presents similarly to many self-limiting viral infections. This mandates a cautious approach to diagnosis and initial management of suspected MD with many children receiving precautionary broad-spectrum intravenous antibiotics. Despite this approach, some children are still diagnosed late. In the last 10 years, there have been advances in nucleic acid amplification techniques, and there is now a rapid test that can detect meningococcal DNA in under 30 min. This Loop-mediated-isothermal AMPlification (LAMP) technology may make it possible to diagnose MD at initial presentation thereby greatly improving outcomes and minimising harms through unnecessary treatment. The aim of this systematic review is to determine the diagnostic accuracy of LAMP technology in cases of suspected MD.
The review has been registered with PROSPERO [CRD42017078026].
To identify relevant studies, we will search MEDLINE, Embase, Web of Science, Scopus and The Cochrane Library. In additional, we will hand-search reference lists and grey literature including contacting the manufacturers of commercially available LAMP tests for MD for any unpublished data. Two reviewers will independently screen study eligibility and extract data. Methodological quality will be assessed, by two authors, according to the revised tool for the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2); any discrepancies will be resolved by a third author. The following test characteristics will be extracted into 2 × 2 tables for all included studies: true positives, false positives, true negatives, and false negatives. Study-specific estimates of sensitivity and specificity with 95% confidence intervals will be displayed in forest plots. To investigate heterogeneity, we will include covariates such as age, sample type, and study type into a bivariate random-effects model.
This review will help determine the diagnostic accuracy of LAMP technology in diagnosing MD from blood, CSF and throat swabs in children. The data will help to define where in the diagnostic pathway LAMP could be useful including potential as a point-of-care test for children at first presentation.
KeywordsMeningococcal Meningitis Sepsis Neisseria meningitidis Test accuracy Meta-analysis
Cerebral spinal fluid
Negative predictive value
Polymerase chain reaction
Point of care testing
Positive predictive value
Randomised control trial
Target condition being diagnosed
Despite successful vaccination programmes, meningococcal disease (MD) remains a leading infectious cause of septicaemia and death in children worldwide [1, 2, 3, 4, 5]. Early diagnosis of MD significantly improves outcomes with reduced morbidity and mortality [4, 5]. The challenge is, however, that during the prodrome invasive MD is indistinguishable from many self-limiting viral infections [4, 5, 6]. This invariably leads to a very cautious approach to the management of these children with many receiving parenteral antibiotics pending culture results . Despite this cautious approach, children are still being diagnosed late due to the difficulties in identifying those children who are infected with MD from those who have a simple viral illness [4, 7].
Over the years, a number of studies have explored the value of widely available biomarkers including the use of CRP, Procalcitonin and white cell counts in the initial diagnosis of possible MD [8, 9, 10, 11, 12]. Whilst these tests have value, none of them have the necessary diagnostic accuracy to allow them to be used as rule out tests at presentation [8, 9, 10, 11, 12].
Loop-mediated-isothermal AMPlification (LAMP) for MD is a rapid form of PCR that targets the ctrA gene sequence. The ctrA gene sequence is genetically conserved across all pathogenic (capsular) stains of the bacterium Neisseria meningitidis that is responsible for MD . This technique is faster than traditional PCR techniques and requires much simpler equipment [13, 14, 15, 16, 17]. It is possible that LAMP technology could be used as a rapid point of care test (POCT) for the early diagnosis of MD in children. This could be achieved through the rapid testing of blood samples or throat swab specimens in emergency departments, primary care facilities or pharmacies.
It is very difficult to diagnose early meningococcal disease with current guidance recommending decision-making based on the clinical presentation and laboratory results [7, 12]. Unfortunately, no single biomarker, combination of biomarkers or clinical guideline has been found to be ideal [8, 9, 10, 11, 12, 18]. This has resulted in a very cautious approach resulting in the overtreatment of many children [8, 11, 12, 14]. Despite such a cautious approach, children are still being diagnosed late .
LAMP could potentially be used at two points within existing care pathways. Firstly at presentation to identify early invasive meningococcal disease in children who present with a minor illness . Alternatively, LAMP could be used in place of the current gold standard (quantitative PCR or sterile site culture) to quickly confirm or exclude the diagnosis allowing for a more tailored treatment including early ambulation.
The development of LAMP technology for the diagnosis of early MD could therefore represent a significant breakthrough that could alter the care of thousands of children every year worldwide.
Why perform this review?
This systematic review is required because there are a growing number of individual studies that have reported on the diagnostic accuracy of LAMP technology in diagnosing MD [13, 14, 19]. These studies have used a similar approach; LAMP directed at the conserved CtrA region of the bacteria Neisseria meningitidis, but in different populations using different specimens, i.e. blood, CSF and throat swabs [13, 14, 19]. There are, to our knowledge, no existing systematic reviews. This review may help researchers and policymakers identify the most suitable sample (blood, CSF, throat swab), and it may help to determine the role of LAMP within the existing diagnostic pathway.
The objective of this systematic review is to determine the diagnostic accuracy of LAMP technology in the diagnosis of invasive meningococcal disease in children (< 18 years of age).
We will perform a literature search for relevant studies and then screen and select studies for inclusion against eligibility criteria. Data extraction will be performed in duplicate on the selected studies with meta-analysis and report writing.
We will adhere to standards of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) in reporting the findings of this review . The content of this protocol follows the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) recommendations . (Please see the Additional file 1 for the completed PRISMA-P checklist.) This review is registered with the International Prospective Register of Systematic Reviews (PROSPERO) . The registration number is [CRD42017078026].
Children < 18 years of age with suspected meningococcal disease
Loop-mediated-isothermal AMPlification for Neisseria meningitidis
Quantitative PCR and/or culture of sterile site (blood and/or CSF) specimens
True and false positives, true and false negatives
All prospective, retrospective and randomised control studies that report measures of diagnostic accuracy of Loop-mediated-isothermal AMPlification for Neisseria meningitidis
Types of studies
All prospective, retrospective and RCT studies that assess the performance of LAMP in assessing children (< 18 years of age) with potential invasive meningococcal disease will be included. There are no language restrictions.
The participants were children (< 18 years of age) with signs or symptoms of invasive meningococcal disease.
The index test being investigated is the LAMP test for meningococcal DNA. For the purpose of this protocol, this is further defined as LAMP testing specific to the ctrA gene of Neisseria meningitidis. Index testing can be performed using blood, cerebrospinal fluid and throat swabs. Commercially and non-commercially available tests will be considered.
Meningococcal infection (invasive meningococcal disease) is the target condition.
The reference standard used to confirm the presence of the target condition in this study is quantitative PCR to detect Neissseria meningitidis DNA in a sterile site sample (normally blood or CSF). A positive blood or cerebrospinal bacterial culture of Neissseria meningitidis will also be used. No other reference standard will be accepted.
Studies that only assess carriage rates in healthy children will be excluded.
Search methods for identification of studies
Electronic search strategy
An electronic search strategy has been developed in collaboration with the Queen’s University Belfast Medical Librarian (RF). To identify all prospective, retrospective and RCTs, we will search MEDLINE, Embase, Web of Science, Scopus and The Cochrane Library inclusive of Cochrane Controlled Trials Register. An example Medline search strategy is attached as Additional file 2. There are no language restrictions for this review.
Searching other resources
In addition, we will hand-search reference lists of relevant articles. A targeted grey literature search will include contacting the manufacturers of commercially available LAMP test for meningococcal disease and a search of conference abstracts.
Selection of studies
Two reviewers (TW, MDS) will independently screen the study eligibility and extract data. Screening will be a two-step process with initial title/abstract screening followed by full-text screening. Disagreements among reviewers will be resolved through consensus or third-party reviewer (DF). Reports that are duplicates or co-publications of studies will be identified. Following full-text screening, a list of excluded studies with reasons for exclusion will be provided in an appendix of the final report. We will begin with screening published and unpublished records and select those that meet the inclusion/exclusion criteria. Our search of literature will involve both primary studies and systematic reviews. The latter will be used only to identify additional primary studies.
Data extraction and management
Study characteristics: author, year of publication, country, design, sample size, clinical setting, number studied, number of drop-outs with reason, and funding source.
Population characteristics: inclusion/exclusion criteria and patient demographics such as age and gender.
LAMP testing: timing of sampling, method of sampling (e.g. throat swab, blood or CSF), time to result and commercial availability of the test.
Gold standard: Quantitative PCR (e.g.TaqMan® PCR) or sterile site bacterial culture (i.e. blood/CSF)
Outcomes: From this 2 × 2 table, we will calculate true positives, false positives, true negatives, and false negatives.
Assessment of methodological quality
The risk of bias of each article will be evaluated independently by two investigators (TW, MDS) and reported according to the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool . The most likely bias will be spectrum bias with participants not representing the population of interest. Early MD is very difficult to diagnose with typically vague and non-specific symptoms. Depending on the population, rates of MD can vary from 1 to 33% [8, 9, 10, 11, 14]. We are primarily interested in LAMP testing as an early test to identify those children who will go on to deteriorate rather than considering its use in very unwell child in whom treatment will be given irrespective of the test result. Studies that focus on very sick children or studies that have an especially high rate of MD may not reflect the target population for the routine use of this test in the future. A commentary on this potential source of bias will be included, and where possible, we will compare the performance of LAMP as a diagnostic test in both low and high prevalence populations—discussed below. Disagreements between the two investigators (TW, MDS) will be resolved by consensus or arbitration by a third party (DF).
An assessment of publication bias will not be performed. There is no evidence of publication bias in systematic reviews of diagnostic accuracy, and methods for detecting publication bias are unreliable when applied to diagnostic accuracy studies .
Statistical analyses and evidence synthesis
We will present an overview of the available studies summarised in two tables. The first table will summarise the study designs, participants, index tests details, sample types and the reference standards. The second table will summarise the details on study quality relating to QUADAS-2.
LAMP test result data will be compared to the reference test. Data for 2 × 2 tables of index test against reference standard will be extracted from each study. The true positive, true negative, false positive and false negative rate will be recorded. If these data are not provided, they will be calculated from raw data wherever possible. A summary table of evidence will be produced, and individual studies represented using forest plots displaying the sensitivity and specificity values of the LAMP test with 95% confidence intervals.
Inferred statistics: LAMP testing is binary with either a positive or negative result. There is no cutoff and the bacteria are either present or not. In the meta-analysis, we will therefore use a bivariate random-effects model with covariates such as age, sample type, disease incidence, variations in index tests and study type included to report summary statistics of sensitivity and specificity. This approach is recommended by the Cochrane collaboration and is best suited for the meta-analysis of diagnostic tests where there is no cutoff or the cutoff is very similar between studies . All analyses will be performed in duplicate by TW and MDS using SPSS 23 and STATA.
Infants (less than 1 year of age)
Pre-school children (less than 4 years)
School-age children (4–11 years)
Adolescents (11–18 years)
Sample type (throat swab, blood, CSF)
High disease prevalence
Low disease prevalence
Investigations of heterogeneity
We will investigate the heterogeneity by incorporating covariates into the random-effects models as discussed above.
Meningococcal disease is a notoriously difficult disease to diagnose in the early stages, and as such many children are treated with precautionary intravenous broad-spectrum antibiotics. Despite this approach, children are still being diagnosed late with MD. Advances in nucleic amplification technology mean that it is now possible to perform LAMP testing with results being available in under 30 min. What we do not know, however, is how these tests can be used by clinicians in real-world situations. What is the diagnostic accuracy of LAMP testing for MD and how is affected by sample type and age of the child?
By answering these questions, we will have a better understanding of where LAMP testing could fit into the current clinical pathway for the diagnosis of MD. In particular, could it be used as a rapid point of care test to diagnose early MD, or could it have role in rapidly confirming diagnosis after the administration of antibiotics? This information will be of value to policy planners and researchers in determining where in the diagnostic pathway for MD the LAMP test could be trialled.
Richard Falls (AF) QUB librarian assisted with the design of the literature searches.
TW is a doctoral fellow at Queen’s University Belfast. TWs fellowship funded by the Health and Social Care Northern Ireland Public Health Agency Research and Development Office. The funder has played no part in the conception or design of this review protocol, and they will have no involvement with the systematic review.
TW, DF, FL, BB and MDS were involved in conception and design of this review protocol. All authors have read and approved the final version of the manuscript.
Ethics approval and consent to participate
Consent for publication
All authors consent for publication.
Derek Fairley is a shareholder and non-exec Director of Hibergene.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
- 4.Meningitis Research Foundation. Meningococcal meningitis and septicaemia. 2016. https://www.meningitis.org/getmedia/cf777153-9427-4464-89e2-fb58199174b6/gp_booklet-UK-sept-16. Accessed 10 Oct 2017.Google Scholar
- 6.Waterfield T, Dyer EM, Lyttle MD. Fifteen-minute consultation: the child with a non-blanching rash Archives of Disease in Childhood - Education and Practice Published Online First: 07 March 2018. doi: https://doi.org/10.1136/archdischild-2017-313998.
- 7.NICE. Meningitis (bacterial) and meningococcal septicaemia in under 16s: recognition, diagnosis and management | Guidance and guidelines | NICE. 2015. https://www.nice.org.uk/guidance/cg102. Accessed 10 Oct 2017.
- 10.Nielsen HE, Andersen EA, Andersen J, Bottiger B, Christiansen KM, Daugbjerg P, et al. Diagnostic assessment of haemorrhagic rash and fever. Arch Dis Child. 2001;85:160–5. http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=med4&NEWS=N&AN=11466193 CrossRefPubMedPubMedCentralGoogle Scholar
- 13.McKenna JPJP, Fairley DJDJ, Shields MDMD, Cosby SLSL, Wyatt DEDE, McCaughey C, et al. Development and clinical validation of a loop-mediated isothermal amplification method for the rapid detection of Neisseria meningitidis. Diagn Microbiol Infect Dis. 2011;69:137–44. https://doi.org/10.1016/j.diagmicrobio.2010.10.008.CrossRefPubMedGoogle Scholar
- 14.Bourke TW, JP MK, Coyle PV, Shields MD, et al. Diagnostic accuracy of loop-mediated isothermal amplification as a near-patient test for meningococcal disease in children: an observational cohort study. Lancet Infect Dis. 2015;15:552–8. https://doi.org/10.1016/S1473-3099(15)70038-1.CrossRefPubMedGoogle Scholar
- 16.Takahashi H, Haga M, Sunagawa T, Saitoh T, Kitahara T, Matsumoto S, et al. Meningococcal carriage rates in healthy individuals in Japan determined using Loop-Mediated Isothermal Amplification and oral throat wash specimens. J Infect Chemother. 2016;22:501–4. https://doi.org/10.1016/j.jiac.2015.12.016.CrossRefPubMedGoogle Scholar
- 18.Bell JM, Shields M, Angus A, Dunlop K, Bourke T, Kee F, Lynn FA. Clinical and cost-effectiveness of a procalcitonin test as a prompt indicator of prodomol meningococcal disease in febrile children: cost-effectiveness analysis. Value Heal. 2013;16:A333. https://doi.org/10.1016/j.jval.2013.08.067.CrossRefGoogle Scholar
- 23.Whiting PF, Rutjes AWS, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155:529. https://doi.org/10.7326/0003-4819-155-8-201110180-00009.CrossRefPubMedGoogle Scholar
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.