Abstract
Background
To date, most countries worldwide have declared that the pandemic of COVID-19 is over, while the WHO has not officially ended the COVID-19 pandemic, and China still insists on the personalized dynamic COVID-free policy. Large-scale nucleic acid testing in Chinese communities and the manual interpretation for SARS-CoV-2 nucleic acid detection results pose a huge challenge for labour, quality and turnaround time (TAT) requirements. To solve this specific issue while increase the efficiency and accuracy of interpretation, we created an autoverification and guidance system (AGS) that can automatically interpret and report the COVID-19 reverse transcriptase-polymerase chain reaction (RT-PCR) results relaying on computer-based autoverification procedure and then validated its performance in real-world environments. This would be conductive to transmission risk prediction, COVID-19 prevention and control and timely medical treatment for positive patients in the context of the predictive, preventive and personalized medicine (PPPM).
Methods
A diagnostic accuracy test was conducted with 380,693 participants from two COVID-19 test sites in China, the Hong Kong Hybribio Medical Laboratory (n = 266,035) and the mobile medical shelter at a Shanghai airport (n = 114,658). These participants underwent SARS-CoV-2 RT-PCR from March 28 to April 10, 2022. All RT-PCR results were interpreted by laboratorians and by using AGS simultaneously. Considering the manual interpretation as gold standard, the sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) and accuracy were applied to evaluate the diagnostic value of the AGS on the interpretation of RT-PCR results.
Results
Among the 266,035 samples in Hong Kong, there were 16,356 (6.15%) positive, 231,073 (86.86%) negative, 18,606 (6.99%) indefinite, 231,073 (86.86%, negative) no retest required and 34,962 (13.14%, positive and indefinite) retest required; the 114,658 samples in Shanghai consisted of 76 (0.07%) positive, 109,956 (95.90%) negative, 4626 (4.03%) indefinite, 109,956 (95.90%, negative) no retest required and 4702 (4.10%, positive and indefinite) retest required. Compared to the fashioned manual interpretation, the AGS is a procedure of high accuracy [99.96% (95%CI, 99.95–99.97%) in Hong Kong and 100% (95%CI, 100–100%) in Shanghai] with perfect sensitivity [99.98% (95%CI, 99.97–99.98%) in Hong Kong and 100% (95%CI, 100–100%) in Shanghai], specificity [99.87% (95%CI, 99.82–99.90%) in Hong Kong and 100% (95%CI, 99.92–100%) in Shanghai], PPV [99.98% (95%CI, 99.97–99.99%) in Hong Kong and 100% (95%CI, 99.99–100%) in Shanghai] and NPV [99.85% (95%CI, 99.80–99.88%) in Hong Kong and 100% (95%CI, 99.90–100%) in Shanghai]. The need for manual interpretation of total samples was dramatically reduced from 100% to 13.1% and the interpretation time fell from 53 h to 26 min in Hong Kong; while the manual interpretation of total samples was decreased from 100% to 4.1% and the interpretation time dropped from 20 h to 16 min at Shanghai.
Conclusions
The AGS is a procedure of high accuracy and significantly relieves both labour and time from the challenge of large-scale screening of SARS-CoV-2 using RT-PCR. It should be recommended as a powerful screening, diagnostic and predictive system for SARS-CoV-2 to contribute timely the ending of the COVID-19 pandemic following the concept of PPPM.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
The dynamic COVID-free policy applied by China
The coronavirus disease 2019 (COVID-19) has become the most widespread global pandemic since it was first reported on December 30, 2019 [1, 2], causing huge health and economic burden [3]. Nowadays, there is a trend to declare the ending of COVID-19 globally, while China is still pursuing the dynamic COVID-free strategy due to high population density and limited medical resources. Based on the susceptibility of COVID-19 [4], wearing a mask and presenting a negative nucleic acid testing result within 48 h are necessary when people enter public places such as airport, railway station and supermarket. Under this strict control and prevention measures, the dynamic COVID-free strategy applied by China contributes to the lowest infection and mortality rates, aligning with the concept of predictive, preventive and personalized medicine (PPPM) [5, 6].
Challenges in preventing COVID-19
The diagnosis of COVID-19 is based on the comprehensive analysis of epidemiological history, clinical manifestation, laboratory and imaging examination [7]. Among them, nucleic acid amplification test (NAAT) of SARS-CoV-2 is critically important [8, 9], and the reverse transcriptase-polymerase chain reaction (RT-PCR) test is the gold standard for the identification of SARS-CoV-2 in the specimens collected from the upper and lower respiratory tracts [10, 11], playing a vital role in the pandemic secondary prevention and control with a PPPM approach [12].
Under the dynamic COVID-free policy in China, the number of daily samples sent to a laboratory at the peak time, a period when a mass nucleic acid screening with a 100% coverage of population for several days are conducted in the residential communities, was over 10 times higher than that of the routine time, a period when only one person entering airport or railway station or person working in the industry with high risk for COVID-19 are required to do the nucleic acid testing. It poses a huge challenge for the quality and efficiency of the interpretation of the RT-PCR results. The gigantic workload is far beyond the capacity of personnel audit and thus commonly causes a delay in data reporting. However, all laboratories globally conducting nucleic acid detection of SARS-CoV-2 rely on manual interpretation of RT-PCR results presently, which is labour intensive and time-consuming and sometime fails to meet the requirements of turnaround times (TATs). Manual interpretation of RT-PCR results also demands accredited laboratorian qualified for the standardized audit procedures after training. Both false negative and false positive reports are the major challenges caused by the inconsistency of individual result’s interpretation. For example, the false negative reports of RT-PCR can lead to a wrong management of the positive cases, thus resulting in the processive spread of the pandemic [13, 14]. Moreover, the lack of standardized guidance for indefinite or suspected positive cases may also lead to extended TATs. Therefore, a paradigm change from reactive medicine to PPPM, and a more prompt and accurate diagnosis of COVID-19 is of great significance in reducing treatment delay and preventing the epidemic from spread.
An optimal autoverification to diagnose COVID-19 in the perspective of PPPM
Autoverification, based on a series of simple and complex algorithms, provides automated actions operated by a computer system to release the COVID-19 RT-PCR results. It has been shown that autoverification can reduce the bias from manual interpretation, improve the efficiency and accuracy of test results and enable laboratory technicians to pay more attention to some suspicious positive samples [15, 16]. Therefore, the popularization and application of autoverification under the personalized mass nucleic acid testing condition may be beneficial to predict the effective reproduction number at time (Rt), a measure reflecting the real-time transmissibility of an epidemic, providing strong evidence to diagnose, predict, prevent and control COVID-19 from the perspective of PPPM.
Working hypothesis
To solve these issues faced by China and to prevent COVID-19 in the framework of PPPM, we developed an autoverification and guidance system (AGS), which is able to examine the preanalytical, analytical and postanalytical data based on a unified standardized criterion. It is hypothesized that the AGS may be a more effective approach with higher accuracy in diagnosis, prediction, prevention and control COVID-19 than that of conventional manual interpretation. Then, we tested and validated the accuracy of AGS in the interpretation of COVID-19 RT-PCR results based on the tests from the Hong Kong and Shanghai cohorts.
Methods
Clinical samples
The data of 266,035 nasopharyngeal samples from Hong Kong and 114,658 oropharyngeal samples from Shanghai during the period from March 28 to April 10, 2022, were collected for the evaluation of the AGS. Hong Kong was characterized by its high positive rate of the infection (12.1%, Table 3), while Shanghai has a low positive rate of the infection (0.01%, Table 3) and high requirement for timeliness but under low quality control environment. All the tests were performed at the Hong Kong Hybribio Medical Laboratory and the Hybribio mobile medical shelter at Shanghai airport. The data were stored in the Laboratory Information System, an information management hub serving for data collection, reporting, transmission and archiving.
Design of the AGS
The flow diagram (Fig. 1) of the AGS consists of three stages for each sample testing: (1) pre-interpretation check, (2) result interpretation and guidance and (3) delta check. The design of algorithms is based on the guideline from the Clinical and Laboratory Standards Institute (CLSI) [17, 18]. Once a RT-PCR reaction finishes, the data will be stored automatically in the Laboratory Information System and exported as a new file to AGS. Then, the file is processed through the following steps shown in the flowchart (Fig. 1). The system will generate a disposal warning when a sample invalidates any one of the rules, which are set based on the specimen information and integrity, and then report the exact issues that need to be fixed by manual intervention. If the problems cannot be solved by laboratory personnel intervention, the system will advise for re-sampling and retesting.
Rules of specimen information and integrity
The recorded information of the subjects includes a unique sample identifier, a unique subject identifier, age and/or date of birth, gender, sample type, sample collection date and location. A specimen invalidating one of these rules is asked to complement the missing information and then run through the system again. Only the samples with integral information in the sealed preservation tubes are processed, otherwise re-sampling will be requested.
Rules of instrument error flags or warnings
Once an instrument error flag warning appears, a manual intervention will be required to identify the cause(s). After the problem being fixed, the samples will run through the entire process again.
Rules of quality control and internal control
Each RT-PCR test includes both negative and positive quality controls. In this study, the passed quality control algorithm and the cycle threshold (Ct) value of the internal control are in compliance with the instructions of COVID-19 RT-PCR detection kit and the policies of Hong Kong and Shanghai Centres for Disease Control [19]. After passing the rules of quality controls, the samples in the RT-PCR running will be analysed in the stage of result interpretation and guidance. The reference Ct value of the internal control for a human pharyngeal swab in this study is set between 15 and 36. Samples with the Ct value of the internal control out of this range will be classified as indefinite cases that require retest.
Rules of result interpretation and guidance
The RT-PCR test targets at two SARS-CoV-2 genomic sequences, the open reading frame1ab (ORF1ab) and gene coding for nucleocapsid protein (N) [19]. The results of the RT-PCR are classified into negative (labelled green), positive (labelled red) and indefinite (labelled yellow) after passing the rules in the pre-interpretation check stage. The whole time of AGS or laboratorians spending on interpreting all samples collected during a specific period was considered as the interpretation time. Due to the gradually decreased fatality rate of COVID-19, a less rigid prevention and control policy is launched in China. Thus, in the present study, the reference Ct value of the positive is set between 10 and 35 for both ORF1ab and N. Assessment of test results for clinical specimens passing the rule of internal control is interpreted according to the following criteria:
(1) A specimen with sigmoidal amplification curves of both ORF1ab and N, both Ct values for ORF1ab and N between 10 and 35, and the discrepancy between the Ct values of the two targeted genes ≤ 3 is regarded as a positive case.
(2) A specimen with no sigmoidal amplification curves of both ORF1ab and N, and Ct values of the two targeted genes denoted as “Undet”, i.e. undetermined, in the software interface is considered as a negative case.
(3) Samples that cannot be classified as neither negative nor positive are defined as indefinite cases, including the specimens with abnormal curve(s) of ORF1ab and/or N, the specimens with the Ct value(s) of ORF1ab and/or N out of the range of 10–35, and the specimens with the discrepancy between the Ct values of the two targeted genes > 3. The possible reasons for indefinite results and the subsequent guidance after initial RT-PCR interpretation are listed in Table 1.
Rules of delta check
As the last process of autoverification system, the delta check refers to the comparation of a specific and predefined result against a subject’s previous laboratory result(s) [18]. Delta check in AGS includes the comparison with historical results of RT-PCR testing, and the results of further COVID-19 antigen or antibody testing, which are done within 1 week of RT-PCR testing. If the comparison fails to pass the delta check in the AGS algorithm, the system gives a warning, and then a detailed description is added in the final report. The algorithm for the comparison between the RT-PCR result and an antigen test/immunoglobulin M (IgM) test/immunoglobulin G (IgG) test is shown in the Table 2.
Statistical analysis
Analysis of the data was performed using the SPSS statistics software package, version 26.0 for Microsoft Windows (SPSS Inc., Chicago, IL, USA). The interpretation of the initial RT-PCR screening results was recognized as negative, positive and indefinite. Among them, the negative cases were reported immediately, while the positive and indefinite samples were further retested by senior technicians. In order to assess the performance of the system, the interpretation outcomes were classified into two categories: no retest required (negative) and retest required (positive + indefinite). Considering the manual interpretation for COVID-19 RT-PCR as the gold standard, the sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), accuracy, 95% confidence interval (95%CI) and Cohen’s kappa of AGS were calculated using an online statistical tool [20].
Results
To assess the performance of the AGS, the initial RT-PCR results of 380,693 samples (266,035 from Hong Kong; 114,658 from Shanghai) were processed by the AGS and senior technologists simultaneously (Table 3). Without support of the AGS, all RT-PCR results needed to be read by laboratorians, i.e. a 100% manual interpretation rate. While the AGS was applied, the application of manual interpretation was reduced to 13.1%, and the total interpretation time of all the samples in the initial RT-PCR screening fell from 53 h to 26 min in Hong Kong. In the case of the mobile medical shelter in Shanghai, the manual interpretation rate of all samples was cut down to 4.1%, and the total interpretation time dropped from 20 h to 16 min. These demonstrated the advantages of the AGS in reducing manpower input and TAT.
The interpreted outcomes of the initial RT-PCR tests were classified into positive, negative and indefinite, among which positive and indefinite samples were further retested by senior technicians while the negative cases were reported immediately. Of the 266,035 nasopharyngeal samples in Hong Kong by manual audit, 16,356 (6.15%) were positive, 231,073 (86.86%) were negative, and 18,606 (6.99%) were indefinite; 231,073 (86.86%, negative) did not require to be further retested, and 34,962 (13.14%, positive and indefinite) required to be further retested; of the 114,658 oropharyngeal samples in Shanghai, 76 (0.07%) were positive, 109,956 (95.90%) were negative, and 4,626 (4.03%) were indefinite; 109,956 (95.90%, negative) did not require to be further retested, and 4702 (4.10%, positive and indefinite) required to be further retested. The comparison of results interpretation between the AGS and manual audit is listed in Table 4. The interpretation outcome was defined into “no retest required group” and “retest required group” as shown in Table 5. The AGS showed 99.98% (95%CI, 99.97–99.98%) sensitivity, 99.87% (95%CI, 99.82–99.90%) specificity, 99.98% (95%CI, 99.97–99.99%) PPV, 99.85% (95%CI, 99.80–99.88%) NPV and 99.96% (95%CI, 99.95–99.97%) accuracy, with a 0.998 Cohen’s kappa in Hong Kong; while 100% (95%CI, 100–100%) sensitivity, 100% (95%CI, 99.92–100%) specificity, 100% (95%CI, 99.99–100%) PPV, 100% (95%CI, 99.90–100%) NPV, and 100% (95%CI, 100–100%) accuracy, with a Cohen’s kappa of 1.000 at Shanghai and a P value under 0.001 (Table 6), suggesting a perfect accuracy of the AGS in the real-world application.
Discussion
RT-PCR is a critical tool in fighting against SARS-CoV-2, being the gold standard for the identification of the virus in upper and lower respiratory tract specimens [10, 11]. Identifying infected patients and separating them from uninfected people are the most efficient approaches to prevent and control the spread of SARS-CoV-2. Under the condition of mass nucleic acid screening in China, a timely, accurate and consistent RT-PCR test and subsequent accurate interpretation of the results are the basic foundation for infection diagnosis, prevention and management in a real-world setting following the concept of PPPM.
Previous studies showed that autoverification has outstanding performance in processing the multiple types of laboratory data, e.g. thalassemia gene detection [21], arterial blood gas analysis [22] and enzyme-linked immunosorbent assay (ELISA) of hepatitis B virus (HBV) serological markers [23]. The implementation of autoverification exhibits advantages in reducing error rate, saving time, decreasing manpower demand and simplifying the processing of sophisticated manual auditing [18]. In this study, the AGS we created to identify potential analytical errors and replace manual interpretation procedure shows great performance in time-efficient, labour-saving and diagnosis-precisive, being a good example of PPPM practice in pandemic control.
The asymptomatic raised greatly and only a few were transformed to confirmed cases due to the declined virulence of COVID-19, vaccine development and rapid screening [24,25,26,27]. However, China still adopts strict pandemic prevention and control. It is “a personalized issue” under “a personalized policy” at communities level, following the “dynamic COVID-free strategy” in China. Therefore, the AGS with high accuracy and efficacy is warranted to solve this specific challenge in China. This study is the first attempt to apply and assess the autoverification in Chinese large-scale COVID-19 screenings during the pandemic. The AGS conducted in this study provides a platform to rapidly distinguish negative results from the outcomes that need manual interpretation, being suitable for the dynamic COVID-free policy in China and beneficial to the secondary prevention and management of COVID-19 in PPPM approach. The computer-based immediate verification and report of negative results save a large amount of time on reporting negative cases when it compares to the manual audit mode and thus enable laboratorians to pay more attention to the cases that require retest in terms of personalized accuracy at large communities level screening which is a common challenge in PPPM practice.
The AGS is linked to the Laboratory Information System to ensure the confidentiality of data, and the computer-based autoverification algorithm guarantees excellent accuracy (99.98% in Hong Kong and 100% in Shanghai) by avoiding human errors. In the case of the results that require manual interpretation, subsequent guidance is provided by the AGS to the laboratorians. In addition, the implementation of AGS system is especially important for countries and regions with low resource settings where the expertise for manual interpretation of RT-PCR results is inadequate.
The pre-interpretation check of the AGS is implemented to warn errors during in-lab workflow, like instrument breakdown and contamination of reagents. While the process of delta check is used to further validate the accuracy of AGS by comparing the RT-PCR results with antigen or antibody testing results. Both NAAT and antigen test are intended for the detection of current infection. In contrast to NAAT that detects the existence of viral nucleic acid, the antigen test detects the nucleocapsid protein antigen of the SARS-CoV-2 in nasal swabs, nasopharyngeal swabs or saliva [8, 28]. However, the antigen test always has lower sensitivity and specificity compared to the RT-PCR test, especially in samples with low virus load [10, 11, 29]. An antibody test is intended for the detection of SARS-CoV-2 antibodies (IgG and/or IgM) in blood which can help determine a past infection [2, 8], but it may also generate false positive results for people who have received a SARS-CoV-2 vaccine [30]. Therefore, the failure of samples passing the delta check is mainly due to the samples taken from infected people in latent period and/or due to the low sensitivity of antigen or antibody tests. The diagnostic accuracy of RT-PCR of SARS-CoV-2 is further increased by retesting the samples that cannot pass the algorithm of delta check.
The operation performance of the AGS was tested in two different scenarios: the Hong Kong medical laboratory and the mobile medical shelter at Shanghai airport. The positive rate in Hong Kong was 12.1%, much higher when compared to 0.01% in Shanghai. The mobile medical shelter is usually constructed in place where is not suitable for building a permanent medical laboratory. Therefore, it is a big challenge to provide quality control on data analysis in a mobile shelter where has a high risk of low quality of sample handling and data processing. Under such conditions, the AGS was demonstrated to be a powerful tool by ensuring standardized data process with autoverification. It also showed perfect accuracy of interpretation and had considerable time efficiency to save the labour resource, meeting the testing demanding a PPPM approach in the situation of COVID-19 pandemic.
The twenty-first century witnessed the development of medical services from traditional, complementary and alternative medicine (TCAM), person-centred medicine (PCM), individualized medicine (IM), stratified medicine (SM), personalized medicine (PM) and precision medicine to PPPM [31]. PPPM combines the advantages and minimizes the disadvantages of the existing approaches and has been considered as the “medicine of the future” [5]. It has been successfully applied to non-communicable diseases including cancer [32, 33], cardiovascular diseases [34], ischemic stroke [35] and neurodegenerative diseases [36] and infectious diseases such as COVID-19 [37].
The paradigm changes from the reactive medicine to PPPM has been considered as a considerable transformation [5, 38]. Unlike the traditional manual interpretation mode, the AGS-based novel mode for COVID-19 screening and diagnosis can rapidly distinguish positive cases from mass samples and benefit to the subsequent adjustment and deployment of COVID-19 prevention and control measures under the PPPM framework. The diagnostic accuracy test indicates that the AGS with required precision is an optimal predictive and protective tool for COVID-19 to meet the “Chinese personalized COVID-free policy”. This study provides further strong supporting evidence for the application of PPPM in global COVID-19 epidemic control.
Limitation
A limitation of this study should be noted. The rules of AGS in this study were designed to the application in Hong Kong and Shanghai. When AGS is applied in other environments, whether the setting of rules and parameters can meet the requirements of the local workstation remains to be further verified. The optimal parameters of the reference Ct value ranges for quality controls, positive and negative results would be calibrated and updated based on new information and real-world clinical scenario.
Conclusions and expert recommendations
In conclusion, we created an AGS tool to automatically interpret the COVID-19 RT-PCR results and validated its efficiency in two mega cites, Hong Kong and Shanghai. Compared to conventional manual interpretation, the computer-based AGS not only shows a high accuracy but also considerably relieves both labour and time from the challenge of large-scale screening of SARS-CoV-2. This study supports the paradigm shift from reactive medicine to the proactive model of PPPM in the field of epidemiology of infectious diseases, demonstrating that the PPPM concept and strategy could be integrated into the diagnosis, prevention and intervention of global pandemic [39].
In recommendation, we provide (1) AGS as a PPPM tool which can be widely applied in clinical laboratories in the COVID-19 pandemic screening; (2) AGS would effectively facilitate the prediction of COVID-19 transmission risk by rapidly identifying and responding to the reported positive case at a real-world setting such as at densely populated cites, Hong Kong and Shanghai; (3) it also contributes to protect both the susceptive populations and infected patients with individual level of precision in the practice of PPPM; (4) AGS also has considerable time efficiency and cost effective to save the labour resource and meet the test-demanding in a real-word PPPM practice in the situation like COVID-19 pandemic.
Data availability
The dataset generated and analysed during the study are available from the corresponding author on reasonable request.
Code availability
Not applicable.
Abbreviations
- AGS :
-
Autoverification and guidance system
- CLSI :
-
Clinical and Laboratory Standards Institute
- COVID-19 :
-
Coronavirus disease 2019
- Ct :
-
Cycle threshold
- ELISA :
-
Enzyme-linked immunosorbent assay
- HBV :
-
Hepatitis B virus
- IgG :
-
Immunoglobulin G
- IgM :
-
Immunoglobulin M
- IM :
-
Individualized medicine
- N :
-
Nucleocapsid protein
- NAAT :
-
Nucleic acid amplification test
- NPV :
-
Negative predictive value
- ORF1ab :
-
Open reading frame1ab
- PCM :
-
Person-centred medicine
- PM :
-
Personalized medicine
- PPV :
-
Positive predictive value
- PPPM :
-
Predictive, preventive and personalized medicine
- Rt :
-
Effective reproduction number at time
- RT-PCR :
-
Reverse transcriptase-polymerase chain reaction
- SM :
-
Stratified medicine
- TATs :
-
Turnaround times
- TCAM :
-
Traditional, complementary and alternative medicine
- WHO :
-
World Health Organization
References
Atzrodt CL, Maknojia I, McCarthy RDP, Oldfield TM, Po J, Ta KTL, et al. A guide to COVID-19: a global pandemic caused by the novel coronavirus SARS-CoV-2. Febs j. 2020;287:3633–50. https://doi.org/10.1111/febs.15375.
Ita K. Coronavirus Disease (COVID-19): Current status and prospects for drug and vaccine development. Arch Med Res. 2021;52:15–24. https://doi.org/10.1016/j.arcmed.2020.09.010.
Awwab H, Solorzano JI, Jaisingh KC, Singireddy S, Bailey S, Dominic P. Cardiac pauses in critically ill coronavirus disease-2019 patients. Heart and Mind. 2021;5:4.
Hou H, Yang H, Liu P, Huang C, Wang M, Li Y, et al. Profile of immunoglobulin G N-glycome in COVID-19 patients: a case-control study. Front Immunol. 2021;12:748566. https://doi.org/10.3389/fimmu.2021.748566.
Golubnitschaja O, Baban B, Boniolo G, Wang W, Bubnov R, Kapalla M, et al. Medicine in the early twenty-first century: paradigm and anticipation - EPMA position paper 2016. EPMA J. 2016;7:23. https://doi.org/10.1186/s13167-016-0072-4.
Wu Z, Zhang H, Li Z, Li H, Miao X, Pan H, et al. Mutual effect of homocysteine and uric acid on arterial stiffness and cardiovascular risk in the context of predictive, preventive, and personalized medicine. EPMA J. 2022. https://doi.org/10.1007/s13167-022-00298-x.
Wang Y, Hou H, Wang W, Wang W. Combination of CT and RT-PCR in the screening or diagnosis of COVID-19. J Glob Health. 2020;10:010347. https://doi.org/10.7189/jogh.10.010347.
Goudouris ES. Laboratory diagnosis of COVID-19. J Pediatr (Rio J). 2021;97:7–12. https://doi.org/10.1016/j.jped.2020.08.001.
Yüce M, Filiztekin E, Özkaya KG. COVID-19 diagnosis -a review of current methods. Biosens Bioelectron. 2021;172:112752. https://doi.org/10.1016/j.bios.2020.112752.
Chaimayo C, Kaewnaphan B, Tanlieng N, Athipanyasilp N, Sirijatuphat R, Chayakulkeeree M, et al. Rapid SARS-CoV-2 antigen detection assay in comparison with real-time RT-PCR assay for laboratory diagnosis of COVID-19 in Thailand. Virol J. 2020;17:177. https://doi.org/10.1186/s12985-020-01452-5.
Hirotsu Y, Maejima M, Shibusawa M, Nagakubo Y, Hosaka K, Amemiya K, et al. Comparison of automated SARS-CoV-2 antigen test for COVID-19 infection with quantitative RT-PCR using 313 nasopharyngeal swabs, including from seven serially followed patients. Int J Infect Dis. 2020;99:397–402. https://doi.org/10.1016/j.ijid.2020.08.029.
Corman VM, Landt O, Kaiser M, Molenkamp R, Meijer A, Chu DK, Detection of, et al. novel coronavirus (2019-nCoV) by real-time RT-PCR. Euro Surveill. 2019;2020:25. https://doi.org/10.2807/1560-7917.Es.2020.25.3.2000045.
Dramé M, TabueTeguo M, Proye E, Hequet F, Hentzien M, Kanagaratnam L, et al. Should RT-PCR be considered a gold standard in the diagnosis of COVID-19? J Med Virol. 2020;92:2312–3. https://doi.org/10.1002/jmv.25996.
Tahamtan A, Ardebili A. Real-time RT-PCR in COVID-19 detection: issues affecting the results. Expert Rev Mol Diagn. 2020;20:453–4. https://doi.org/10.1080/14737159.2020.1757437.
Torke N, Boral L, Nguyen T, Perri A, Chakrin A. Process improvement and operational efficiency through test result autoverification. Clin Chem. 2005;51:2406–8. https://doi.org/10.1373/clinchem.2005.054395.
Li J, Cheng B, Ouyang H, Xiao T, Hu J, Cai Y. Designing and evaluating autoverification rules for thyroid function profiles and sex hormone tests. Ann Clin Biochem. 2018;55:254–63. https://doi.org/10.1177/0004563217712291.
Clinical and Laboratory Standards Institute (CLSI). Autoverification of medical laboratory results for specific disciplines. 1st ed. CLSI guideline AUTO15 (ISBN 978-1-68440-056-0 [Print]; ISBN 978-1-68440-057-7 [Electronic]). Wayne: Clinical and Laboratory Standards Institute. 2019. https://clsi.org/media/3345/auto15_sample.pdf.
Clinical and Laboratory Standards Institute (CLSI). Autoverification of clinical laboratory test results; Approved Guideline. CLSI Document AUTO10-A [ISBN 1–56238–620–4]. Wayne: Clinical and Laboratory Standards Institute. 2006. https://clsi.org/media/1342/auto10a_sample.pdf.
National Health Commission of the People’s Republic of China. Protocol for Prevention and Control of COVID-19. 6th ed. China CDC Weekly. 2020;2:321–26. https://doi.org/10.46234/ccdcw2020.082.
MedCalc Software Ltd. Diagnostic test evaluation calculator (Version 20.2). https://www.medcalc.org/calc/diagnostic_test.php. Accessed 13 Dec 2022.
Lin X, Cheng B, Cai Y, Jiao X, Yang X, Zhang Q, et al. Establishing and evaluating an auto-verification system of thalassemia gene detection results. Ann Hematol. 2019;98:1835–44. https://doi.org/10.1007/s00277-019-03656-4.
Wu J, Pan M, Ouyang H, Yang Z, Zhang Q, Cai Y. Establishing and evaluating autoverification rules with intelligent guidelines for arterial blood gas analysis in a clinical laboratory. SLAS Technol. 2018;23:631–40. https://doi.org/10.1177/2472630318775311.
Li J, Cheng B, Yang L, Zhao Y, Pan M, Zheng G, et al. Development and implementation of autoverification rules for ELISA results of HBV serological markers. J Lab Autom. 2016;21:642–51. https://doi.org/10.1177/2211068215601612.
Murray CJL. COVID-19 will continue but the end of the pandemic is near. Lancet. 2022;399:417–9. https://doi.org/10.1016/s0140-6736(22)00100-3.
Tan X, Wang W. Do not forget glycomics and theranostics for COVID-19 drug and vaccine development. OMICS. 2022;26:356–7. https://doi.org/10.1089/omi.2022.0052.
Wang W. Glycomedicine: the current state of the art. Engineering. 2022. https://doi.org/10.1016/j.eng.2022.03.009.
Wang X, Zhong Z, Wang W. COVID-19 and preparing planetary health for future ecological crises: hopes from glycomics for vaccine innovation. OMICS. 2021;25:234–41. https://doi.org/10.1089/omi.2021.0011.
Centers for Disease Control and Prevention (CDC). Guidance for Antigen testing for SARS-CoV-2 for healthcare providers testing individuals in the community. 2022. https://www.cdc.gov/coronavirus/2019-ncov/lab/resources/antigen-tests-guidelines.html.
Nagura-Ikeda M, Imai K, Tabata S, Miyoshi K, Murahara N, Mizuno T, et al. Clinical evaluation of self-collected saliva by quantitative reverse transcription-PCR (RT-qPCR), direct RT-qPCR, reverse transcription-loop-mediated isothermal amplification, and a rapid antigen test to diagnose COVID-19. J Clin Microbiol. 2020;58:e01438–20. https://doi.org/10.1128/jcm.01438-20.
West R, Kobokovich A, Connell N, Gronvall GK. COVID-19 antibody tests: a valuable public health tool with limited relevance to individuals. Trends Microbiol. 2021;29:214–23. https://doi.org/10.1016/j.tim.2020.11.002.
Wang W, Yan Y, Guo Z, Hou H, Garcia M, Tan X, et al. All around suboptimal health — a joint position paper of the Suboptimal Health Study Consortium and European Association for Predictive. EPMA J. 2021. https://doi.org/10.1007/s13167-021-00253-2.
Cox TR, Rumney RMH, Schoof EM, Perryman L, Høye AM, Agrawal A, et al. The hypoxic cancer secretome induces pre-metastatic bone lesions through lysyl oxidase. Nature. 2015;522:106–10. https://doi.org/10.1038/nature14492.
Grech G, Zhan X, Yoo BC, Bubnov R, Hagan S, Danesi R, et al. EPMA position paper in cancer: current overview and future perspectives. EPMA J. 2015;6:9. https://doi.org/10.1186/s13167-015-0030-6.
Helms TM, Duong G, Zippel-Schultz B, Tilz RR, Kuck KH, Karle CA. Prediction and personalised treatment of atrial fibrillation-stroke prevention: consolidated position paper of CVD professionals. EPMA J. 2014;5:15. https://doi.org/10.1186/1878-5085-5-15.
Zheng Y, Guo Z, Zhang Y, Shang J, Yu L, Fu P, et al. Rapid triage for ischemic stroke: a machine learning-driven approach in the context of predictive, preventive and personalised medicine. EPMA J. 2022;13:285–98. https://doi.org/10.1007/s13167-022-00283-4.
Sinnecker T, Kuchling J, Dusek P, Dörr J, Niendorf T, Paul F, et al. Ultrahigh field MRI in clinical neuroimmunology: a potential contribution to improved diagnostics and personalised disease management. EPMA J. 2015;6:16. https://doi.org/10.1186/s13167-015-0038-y.
Chaari L, Golubnitschaja O. Covid-19 pandemic by the “real-time” monitoring: the Tunisian case and lessons for global epidemics in the context of 3PM strategies. EPMA J. 2020;11:133–8. https://doi.org/10.1007/s13167-020-00207-0.
Golubnitschaja O, Kinkorova J, Costigliola V. Predictive, preventive and personalised medicine as the hardcore of ‘Horizon 2020’: EPMA position paper. EPMA J. 2014;5:6. https://doi.org/10.1186/1878-5085-5-6.
Tragni V, Preziusi F, Laera L, Onofrio A, Mercurio I, Todisco S, et al. Modeling SARS-CoV-2 spike/ACE2 protein-protein interactions for predicting the binding affinity of new spike variants for ACE2, and novel ACE2 structurally related human protein targets, for COVID-19 handling in the 3PM context. EPMA J. 2022;13:149–75. https://doi.org/10.1007/s13167-021-00267-w.
Funding
This study was supported by Special Major Application Research Project for COVID-19 Prevention and Control in Universities, Department of Education of Guangdong, Provincial Program of Innovation and Strengthening School, Guangdong, China (Grant number: 2020KZDZX1093) and Special Project for COVID-19 Prevention and Treatment of Shantou Science and Technology Bureau, Guangdong, China (Grant number: 2020–1-61).
Author information
Authors and Affiliations
Contributions
YC, LX and XT conceived and designed the study. ML and CT drafted the manuscript. SQ, ZL, FX, WL, YZ and AX contributed to data collection. CT applied and obtained permission from the ethics committee and performed the statistical analysis. ML, CT, ZW and XT revised the manuscript. The corresponding authors attest that all listed authors meet authorship criteria.
Corresponding authors
Ethics declarations
Ethics approval
This study was approved by the Human Medical Ethics Committee of the First Affiliated Hospital of Shantou University Medical College (No. B-2022–049), and it was registered in the Chinese Clinical Trial Registry (No. ChiCTR2200059709).
Consent to participate
Owing to the retrospective design of the study, informed consent was waived by the institutional review board, because all identifying details of the participants were removed before computational analysis.
Consent for publication
All authors have approved the manuscript and agreed with submission to EPMA J.
Competing interest
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Cai, Y., Liu, M., Wu, Z. et al. Diagnostic accuracy of autoverification and guidance system for COVID-19 RT-PCR results. EPMA Journal 14, 119–129 (2023). https://doi.org/10.1007/s13167-022-00310-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13167-022-00310-4