Abstract
Purpose
To evaluate the accuracy and cost benefit of a rapid molecular point-of-care testing (POCT) device detecting COVID-19 within a traumatological emergency department.
Background
Despite continuous withdrawal of COVID-19 restrictions, hospitals will remain particularly vulnerable to local outbreaks which is reflected by a higher institution-specific basic reproduction rate. Patients admitted to the emergency department with unknown COVID-19 infection status due to a- or oligosymptomatic COVID-19 infection put other patients and health care workers at risk, while fast diagnosis and treatment is necessary. Delayed testing results in additional costs to the health care system.
Methods
From the 8th of April 2021 until 31st of December 2021, all patients admitted to the emergency department were tested with routine RT-PCR and rapid molecular POCT device (Abbott ID NOW™ COVID-19). COVID-19-related additional costs for patients admitted via shock room or emergency department were calculated based on internal cost allocations.
Results
1133 rapid molecular tests resulted in a sensitivity of 83.3% (95% CI 35.9–99.6%), specificity of 99.8% (95% CI 99.4–100%), a positive predictive value of 71.4% (95% CI 29–96.3%) and a negative predictive value of 99.9% (95% CI 99.5–100%) as compared to RT-PCR. Without rapid COVID-19 testing, each emergency department and shock room admission with subsequent surgery showed additional direct costs of 2631.25€, without surgery of 729.01€.
Conclusion
Although rapid molecular COVID-19 testing can initially be more expensive than RT-PCR, subsequent cost savings, improved workflows and workforce protection outweigh this effect by far. The data of this study support the use of a rapid molecular POCT device in a traumatological emergency department.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
As by March 2022, approximately 450 million cases of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection, 6 million deaths associated with the corona virus disease 2019 (COVID-19) and 10 billion administered vaccine doses have been reported to the World Health Organization [1]. Despite collective efforts, the number of new cases increased markedly during the first week of the new year with 78% and 31% in the region of the Americas and Europe, respectively [2]. Hence, organizational actions to guarantee functioning orthopaedic trauma services are needed. The aim of this study is to evaluate the clinical use of a rapid molecular point-of-care testing (POCT) device as compared to conventional reverse transcription polymerase chain reaction (RT-PCR) testing for SARS-CoV-2 detection.
The Abbott ID NOW™ COVID-19 system is a POCT device using isothermal nucleic acid amplification technology for qualitative detection of SARS-CoV-2 RNA. It amplifies the RNA-dependent RNA polymerase (RdRp) viral target gene with a claimed limit of detection (LOD) of 125 genome equivalents/ml [3]. Using an upper respiratory tract swab, positive results can be available as soon as 5 min and negative results within 13 min [4]. Although the LOD of RT-PCR is lower than that of ID NOW™, recent systematic reviews suggest that ID NOW™ is effective in identifying or excluding SARS-CoV-2 in symptomatic ambulatory populations [5]. While cost–benefit analyses of other POCT devices such as for influenza A and B have been shown to be effective and economic for clinical decision-making in an emergency department, so far, there are limited data concerning SARS-CoV-2 [6, 7]. SARS-CoV-2 antigen testing already showed major cost savings particularly due to reduced unnecessary bed blocking [8]. Hence, the aim of this study is to assess testing effectiveness of a molecular SARS-CoV-2 POCT device and to model cost-beneficial effects within an acute care trauma center.
Patients and methods
To verify the accuracy of Abbot ID NOW™ COVID-19 detection, we performed routine SARS-CoV-2 RT-PCR in addition to ID NOW™ testing from the 8th of April 2021, the day the ID NOW™ device was first implemented at the level 1 trauma center of the University Hospital Muenster, until the 31st of December 2021. During this period, 1133 ID NOW™ tests were conducted on trauma patients that met one of the following criteria: admission via shock room or admission via the regular emergency department (ED) due to the necessity of in-patient treatment or urgent surgery. All test samples were collected by trained health care professionals. Nasal swabs were collected from both nostrils, placed into swab transport solution (Sigma Transwab liquid Amies), and kept at room temperature. ID NOW™ testing was performed immediately. RT-PCR samples were transported to the virology laboratory with a maximum delay of 12 h and tested with Altona diagnostics RealStar SARS-CoV-2 RT-PCR according to the manufacturer’s instructions.
We compared the additional effort and expenses during daily procedures in the trauma department that had been necessary due to the pandemic and evaluated, how much it could be reduced due to the introduction of ID NOW™ POCT. Both scenarios, with and without ID NOW™ testing, were broken down into diagnostic and treatment steps. Material costs of COVID-19 personal protective equipment (PPE), e.g., masks, face shields, gowns, gloves, and the costs of the available COVID-19 testing strategies, according to internal cost allocation were provided by our in-house finance-controlling department. Due to the complexity of hospital billing, certain costs and efforts such as time saved, elevated cleaning costs and increased stress on employees could only be described and not expressed in total numbers.
Statistical analyses were performed using SAS software V9.4, SAS Institute Inc., Cary, NC, USA. All analyses were fully explorative and all results are interpreted accordingly. 95% Confidence intervals (95% CIs) were given by exact binominal limits.
Results
During the examined time, 1133 ID NOW™ COVID-19 tests were performed. Seven ID NOW™ tests had a positive result, of which five were verified by RT-PCR. Therefore, 2 ID NOW™ results were false-positive. 1126 ID NOW™ tests had a negative result, which was correct according to the RT-PCR test in all but one cases (Table 1). This patient with false-negative result initially showed a CT-value of 37.43 which decreased to 20.9 2 days later indicating a very early stage of infection. Overall, the analysis of 1133 patients resulted in a sensitivity of 83.33% (95% CI 35.88–99.58%), specificity of 99.82% (95% CI 99.36–99.98%), a positive predictive value of 71.43% (95% CI 29.04–96.33%), and a negative predictive value of 99.91% (95% CI 99.51–100%).
To account for possible cost savings due to the introduction of POCT device ID NOW™, additional costs for the admission via the ED or shock room were calculated as follows: internal cost allocations were provided by the controlling department of the hospital and are based on bulk orders and price levels during the study period: RT-PCR 41.10€, ID NOW™ 50.25€, PPE 4.54€ (gown 1.85€, pair of gloves 0.18€, hair net 0.06€, FFP2 face mask 0.55€, face shield 1.9€), lump sum empty containment bed in a two bedroom 710€/day, and average costs operating room (OR) per min 25€/min (Table 2). An average of 75 min post-anaesthetic care unit length of stay was calculated as basis for additional OR time, if the patient needed to remain in the OR due to undefined COID-19 status [9].
Briefly, when a patient is brought to the shock room, an interdisciplinary team, consisting of at least nine people (trauma surgeon, abdominal surgeon, anaesthesiologist, anaesthesia nurse, neurosurgeon, radiologist, radiology technician, and two nurses), must wear PPE, resulting in a total of 40.86€. Without POCT, radiological technicians (9.08€) must again wear PPE for CT scan before a nurse and physician can prepare the patient for surgery or ward, so that again protection (9.08€) is necessary. Within the OR, two surgeons, two surgery nurses, and anaesthesia team need protection during surgery (27.24€). After surgery, the post-anaesthetic care must be provided within the OR as the patient cannot be brought to the recovery room, resulting in an average cost of 25€/min, multiplied by an average length of stay of 75 min which amounts to total additional costs of 1875€. Until the RT-PCR test results show negative, the bed next to the patient must be kept empty adding another 720€. In total, using only RT-PCR a shock room admission with subsequent surgery results in additional direct costs of 2631.25€ (Fig. 1), without surgery of 729.01€ (Fig. 2). In the case of a regular admission via the emergency department, the initial team of nurse and physician needs PPE (9.08€), which is not anymore required once rapid molecular testing is conducted. In the case of surgery, the above described additional costs can be avoided, resulting in total costs of 59.33€ in the case of rapid molecular testing and 2690.58€ for RT-PCR. Without surgery, 788.34€ are calculated for patients without as opposed to 59.33€ with POCT. Consequently, a total of 2631.25€ can be saved for patients needing surgery (Fig. 3) and 729.01€ for patients not requiring surgical intervention (Fig. 4).
Discussion
The main findings of this study are that major cost savings and process improvements of trauma patients delivered to both the shock room and ED can be achieved by the POCT. Furthermore, test results confirm high sensitivity and specificity described in literature.
Numerous studies investigated the COVID-19 diagnosis agreement between ID NOW™ and RT-PCR [10,11,12,13]. A recent review published by Tu et al. including 15 studies with at least 20 subjects summarized an overall ID NOW™ sensitivity of 84% (95% CI 55–96%) [5]. With regard to their review, our work adds with 1133 patients the largest cohort to literature that has been tested with both ID NOW™ and RT-PCR. With a sensitivity of 83.33% our results confirm their findings. However, five of their included studies show a high risk of bias as they do not state patient symptoms or previous testing. During the period of this study, all patients presented to the ED or shock room were routinely tested using ID NOW™ and RT-PCR. Hence, a bias can be excluded. One patient who caused a false-negative ID NOW™ result showed no COVID symptoms at the time of admission. The RT-PCR initially revealed a CT-value of 37.43, which decreased to 20.9 2 days later. Hence, a transmissibility at the time of admission would be considered as unlikely by today’s standards [14, 15]. Out of the five patients that received a true-positive ID NOW™, two patients had a recent COVID-19 history and one patient suffered from fever and headache. Concluding, the ID NOW™ POCT device is a reliable initial screening method for emergency and shock room patients. However, patients need to be re-evaluated on a regular basis as early infections can be missed.
The main advantage of a POCT device within an emergency department is the generation of COVID-19 test results within minutes. This has not only direct financial benefits but also decreases turnaround times for diagnostics, therapy, and preparation for surgery. While cost evaluation analyses on other respiratory tract infections, such as influenza virus infection, suggest major cost savings by POCT, there is limited evidence for COVID-19 [16,17,18]. A deterministic decision-analytic model showed cost savings by a COVID-19 antigen test of 210€, mainly based on a reduction of unnecessary bed blocking [8]. We have shown that the initially more expensive ID NOW™ allows staff to save on PPE, OR time, and empty isolation beds. Other studies suggest that, if conventional laboratory testing can be provided within 6 h, the benefits of POCT might be reduced [19]. However, the setting of a traumatological emergency department requires fast diagnosis, decision-making, and in many cases surgery earlier than 6 h. Hence, a POCT device seems to be indispensable. Alternatively, antigen testing can be considered as initial screening method, but it is limited by a low sensitivity detecting mainly patients with a high viral load [20, 21]. Particularly, in an emergency department, which generates patient admissions with hospital stays for numerous days, it seems negligent to choose a test modality with limited reliability. Alternatively, Xpert Xpress (Cepheid Inc.) is a rapid RT-PCR presenting diagnostic results with similar accuracy as ID NOW™ within 30–45 min [21, 22]. The main disadvantage seems to be the prolonged testing time, which makes additional protection and precautionary measures necessary. Other authors report increased test reliability in combination with immunoglobulin G antibody tests or chest computed tomography (CT), which again increases costs and labour resources [23, 24]. Furthermore, a recent meta-analysis determining sensitivity and specificity of chest CT for COVID diagnosis shows with 87% (95% CI 85–90%) and 46% (95% CI 29–63%) inferior results [25]. Recent research also focusses on artificial intelligence driven screening based on quickly available vital signs and routine blood testing achieving only a maximum sensitivity of 84.1% and specificity of 73.3% [26]. Summarizing, rapid molecular POCT device seems to be the best available screening method with a very high specificity and acceptable sensitivity for the use in a traumatological emergency department and shock room with limited time for diagnosis and emergency treatment. The advantage of ID NOW™ is the reduced testing time. However, if used as single screening method, there is a residual risk of false-negative test results during early stages of infection. Hence, clinical suspicion, re-evaluation, and re-testing are inevitable to prevent in-hospital COVID-19 outbreaks.
The study is limited by the dynamic pandemic situation during the study time, with varying incidences and virus variants. Furthermore, workflows are described for a German hospital and might differ significantly outside Germany. Accordingly, costs calculated are based on bulk orders negotiated by the in-hospital purchasing department. Again, costs may vary internationally. Finally, many additional works steps such as post-COVID-19 room cleaning, waste, work time for putting on the PPE and personnel costs in cases of infection and quarantine are not considered within this model. Future calculations of cost-efficiency of diagnostic testing for infectious diseases with epidemic potential should combine direct costs and time to result to calculate the value-based effect expressed in euro-hours as described before for emergency room settings [27].
In the opinion of the authors, the strongest advantage of POCT ID NOW™ lies in the diagnostic speed and high specificity. Particularly, during shock room treatment, a fast exclusion of a COVID-19 infection is of utmost importance as fast therapeutic algorithms are not slowed down by protective procedures. Furthermore, early omission of PPE saves recourses and staff capacities. However, rapid RT-PCR can be considered as alternative diagnostic tool in cases of less urgent patients. For the sake of practicality, we did not implement another POCT within our ER.
In conclusion, our study adds to literature the largest cohort of patients tested with both ID NOW™ and RT-PCR, confirming a sensitivity of 83.33% and a very high specificity of 99.82%. While rapid molecular testing can initially be slightly more expensive than RT-PCR, costs and workload can greatly be reduced particularly in an ED, while workplace safety is increased. The data of this study support the use of rapid molecular POCT device within an ED.
Data availability
The datasets used and analysed during the current study are available from the corresponding author on reasonable request.
References
World Health Organization. WHO coronavirus (COVID-19) dashboard. Book World Health Organization. WHO coronavirus (COVID-19) dashboard. City. https://covid19.who.int/
Response WTE. Weekly epidemiological update on COVID-19—11 January 2022 Edition 74, 2022. https://www.who.int/publications/m/item/weekly-epidemiological-update-on-covid-19---11-january-2022
Basu A, Zinger T, Inglima K, Woo KM, Atie O, Yurasits L, See B, Aguero-Rosenfeld ME. Performance of abbott id now covid-19 rapid nucleic acid amplification test using nasopharyngeal swabs transported in viral transport media and dry nasal swabs in a New York City academic institution. J Clin Microbiol. 2020. https://doi.org/10.1128/JCM.01136-20.
Aupaix A, Lazarova E, Chemais M. A brief performance evaluation and literature review of Abbott ID Now COVID-19 rapid molecular-based test. J Virol Methods. 2021;298: 114293.
Tu YP, Iqbal J, O’Leary T. Sensitivity of ID NOW and RT-PCR for detection of SARS-CoV-2 in an ambulatory population. Elife. 2021;10: e65726, p1-23.
van der Kraan M, Hobbelink EL, Kalpoe J, Euser SM, Snijders D, Souverein D. Performance- and cost-benefit analysis of an influenza point-of-care test compared to laboratory-based multiplex RT-PCR in the emergency department. Am J Infect Control. 2021;49:1414–8.
Teoh TK, Powell J, Kelly J, McDonnell C, Whelan R, O’Connell NH, Dunne CP. Outcomes of point-of-care testing for influenza in the emergency department of a tertiary referral hospital in Ireland. J Hosp Infect. 2021;110:45–51.
Diel R, Nienhaus A. Point-of-care COVID-19 antigen testing in German emergency rooms—a cost-benefit analysis. Pulmonology. 2021;18(20):10767.
Tobi K, Tobi KU, Osazuwa MO, Eyi-Nwafor KA. Length of stay in post anaesthetic care unit at the university of Benin teaching hospital: on observation study. J Med Biomed Res. 2013;12:77–87.
Harrington A, Cox B, Snowdon J, Bakst J, Ley E, Grajales P, Maggiore J, Kahn S. Comparison of Abbott ID Now and Abbott m2000 methods for the Detection of SARS-CoV-2 from Nasopharyngeal and Nasal Swabs from symptomatic patients. J Clin Microbiol. 2020. https://doi.org/10.1128/JCM.00798-20.
Moore NM, Li H, Schejbal D, Lindsley J, Hayden MK. Comparison of two commercial molecular tests and a laboratory-developed modification of the CDC 2019-nCoV reverse transcriptase PCR assay for the detection of SARS-CoV-2. J Clin Microbiol. 2020. https://doi.org/10.1128/JCM.00938-20.
Cradic K, Lockhart M, Ozbolt P, Fatica L, Landon L, Lieber M, Yang D, Swickard J, Wongchaowart N, Fuhrman S, Antonara S. Clinical evaluation and utilization of multiple molecular in vitro diagnostic assays for the detection of sars-CoV-2. Am J Clin Pathol. 2020;154:201–7.
Burdino E, Cerutti F, Milia MG, Allice T, Gregori G, Aprà F, De Iaco F, Aluffi E, Micca G, Ghisetti V. Fast and reliable real life data on COVID-19 triaging with ID NOW. J Clin Virol Plus. 2022;2: 100065.
Bullard J, Dust K, Funk D, Strong JE, Alexander D, Garnett L, Boodman C, Bello A, Hedley A, Schiffman Z, Doan K, Bastien N, Li Y, Van Caeseele PG, Poliquin G. Predicting infectious severe acute respiratory syndrome coronavirus 2 from diagnostic samples. Clin Infect Dis. 2020;71:2663–6.
Al Bayat S, Mundodan J, Hasnain S, Sallam M, Khogali H, Ali D, Alateeg S, Osama M, Elberdiny A, Al-Romaihi H, Al-Thani MHJ. Can the cycle threshold (Ct) value of RT-PCR test for SARS CoV2 predict infectivity among close contacts? J Infect Public Health. 2021;14:1201–5.
You JHS, Tam LP, Lee NLS. Cost-effectiveness of molecular point-of-care testing for influenza viruses in elderly patients at ambulatory care setting. PLoS One. 2017;12: e0182091.
Melhuish A, Vargas-Palacios A, Yaziji N, Selfridge J, Pisavadia M, Sagoo GS, Minton J. Cost evaluation of point-of-care testing for community-acquired influenza in adults presenting to the emergency department. J Clin Virol. 2020;129: 104533.
Lingervelder D, Koffijberg H, Kusters R, IJzerman MJ. Health economic evidence of point-of-care testing: a systematic review. Pharmacoecon Open. 2021;5:157–73.
Stevenson M, Metry A, Messenger M. Modelling of hypothetical SARS-CoV-2 point-of-care tests on admission to hospital from A&E: rapid cost-effectiveness analysis. Health Technol Assess. 2021;25:1–68.
Wagenhauser I, Knies K, Rauschenberger V, Eisenmann M, McDonogh M, Petri N, Andres O, Flemming S, Gawlik M, Papsdorf M, Taurines R, Bohm H, Forster J, Weismann D, Weissbrich B, Dolken L, Liese J, Kurzai O, Vogel U, Krone M. Clinical performance evaluation of SARS-CoV-2 rapid antigen testing in point of care usage in comparison to RT-qPCR. EBioMedicine. 2021;69: 103455.
Dinnes J, Deeks JJ, Berhane S, Taylor M, Adriano A, Davenport C, Dittrich S, Emperador D, Takwoingi Y, Cunningham J, et al. Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection. Cochrane Database Syst Rev. 2021. https://doi.org/10.1002/14651858.CD013705.
Loeffelholz MJ, Alland D, Butler-Wu SM, Pandey U, Perno CF, Nava A, Carroll KC, Mostafa H, Davies E, McEwan A, Rakeman JL, Fowler RC, Pawlotsky JM, Fourati S, Banik S, Banada PP, Swaminathan S, Chakravorty S, Kwiatkowski RW, Chu VC, Kop J, Gaur R, Sin MLY, Nguyen D, Singh S, Zhang N, Persing DH. Multicenter evaluation of the Cepheid Xpert Xpress SARS-CoV-2 Test. J Clin Microbiol. 2020. https://doi.org/10.1128/JCM.00926-20.
Mori K, Imaki S, Ohyama Y, Satoh K, Abe T, Takeuchi I. Rapid screening for severe acute respiratory syndrome coronavirus 2 infection with a combined point-of-care antigen test and an immunoglobulin G antibody test. PLoS One. 2022;17: e0263327.
Kepka S, Ohana M, Severac F, Muller J, Bayle E, Ruch Y, Laugel E, Oberlin M, Solis M, Hansmann Y, Bilbault P, Fafi Kremer S. Rapid antigen test combined with chest computed tomography to rule out COVID-19 in patients admitted to the emergency department. J Clin Med. 2021;10(16):3455.
Khatami F, Saatchi M, Zadeh SST, Aghamir ZS, Shabestari AN, Reis LO, Aghamir SMK. A meta-analysis of accuracy and sensitivity of chest CT and RT-PCR in COVID-19 diagnosis. Sci Rep. 2020;10:22402.
Soltan AAS, Yang J, Pattanshetty R, Novak A, Yang Y, Rohanian O, Beer S, Soltan MA, Thickett DR, Fairhead R, Zhu T, Eyre DW, Clifton DA, Watson A, Bhargav A, Tough A, Rogers A, Shaikh A, Valensise C, Lee C, Otasowie C, Metcalfe D, Agarwal E, Zareh E, Thangaraj E, Pickles F, Kelly G, Tadikamalla G, Shaw G, Tong H, Davies H, Bahra J, Morgan J, Wilson J, Cutteridge J, O’Byrne K, Farache Trajano L, Oliver M, Pikoula M, Mendoza M, Keevil M, Faisal M, Dole N, Deal O, Conway-Jones R, Sattar S, Kundoor S, Shah S, Muthusami V. Real-world evaluation of rapid and laboratory-free COVID-19 triage for emergency care: external validation and pilot deployment of artificial intelligence driven screening. Lancet Digit Health. 2022;4(4):e266-278.
Poelman R, der Meer JV, der Spek CV, Riezebos-Brilman A, Knoester M, Leer-Buter CV, Friedrich AW, Niesters HG. Improved diagnostic policy for respiratory tract infections essential for patient management in the emergency department. Future Microbiol. 2020;15:623–32.
Funding
Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation, data collection, and analysis were performed by JSS, EJ, JK, MH, WH, and JK. The first draft of the manuscript was written by Stolberg-Stolberg and Jacob. All authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no competing interests.
Ethics approval
This is an observational study. The Research Ethics Committee of the Ärztekammer Westfalen Lippe has confirmed that no ethical approval is required.
Consent
Not applicable. Due to the retrospective study design and anonymised data, written consent to participate in the study was not necessary in accordance with the Ethics Committee of the Ärztekammer Westfalen Lippe. However, for the subsequent treatment itself, written consent was obtained from each patient.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Stolberg-Stolberg, J., Jacob, E., Kuehn, J. et al. COVID-19 rapid molecular point-of-care testing is effective and cost-beneficial for the acute care of trauma patients. Eur J Trauma Emerg Surg 49, 487–493 (2023). https://doi.org/10.1007/s00068-022-02091-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00068-022-02091-x