key: cord-0827671-lmscnmn7 authors: Van, Dr. Jean-Claude Nguyen; Gerlier, Camille; Pilmis, Benoît; Mizrahi, Assaf; de Ponfilly, Gauthier Péan; Khaterchi, Amir; Enouf, Vincent; Ganansia, Olivier; Monnier, Alban Le title: Prospective evaluation of ID NOW COVID-19 assay used as point-of-care test in an Emergency Department date: 2021-10-30 journal: J Clin Virol DOI: 10.1016/j.jcv.2021.105021 sha: 81ece69cf2a05e37c513b48dbe429d83debdc2c7 doc_id: 827671 cord_uid: lmscnmn7 BACKGROUND: Rapid testing for COVID-19 has been clearly identified as an essential component of the strategy to control the SARS-CoV-2 epidemic, worldwide. The ID NOW COVID-19 assay is a simple, user-friendly, rapid molecular biology test based on nicking and extension amplification reaction (NEAR). OBJECTIVES: The aim of this study was to evaluate the ID NOW COVID-19 assay when used as a point-of-care test (POCT) in our Emergency Department (ED). TYPE OF STUDY: This prospective study enrolled 395 consecutive patients; paired nasopharyngeal swabs were collected from each study participant. The first swab was tested with the ID NOW COVID-19 assay at the point-of-care by ED nurses. The second swab was diluted in viral transport medium (VTM) and sent to the clinical microbiology department for analysis by both the RT-PCR Simplexa test COVID-19 Direct assay as the study reference method, and the ID NOW COVID-19 assay performed in the laboratory. RESULTS: Nasopharyngeal swabs directly tested with the ID NOW COVID-19 assay yielded a sensitivity, specificity, PPV and NPV of 98.0%, 97.5%, 96.2% and 98.7%, respectively, in comparison with the RT-PCR study reference assay. When the ID NOW COVID-19 assay was performed in the laboratory using the VTM samples, the sensitivity decreased to 62.5% and the NPV to 79.7%. Three false negative test results were reported with the ID NOW COVID-19 assay when performed using undiluted swabs directly in the ED; these results were obtained from patients with elevated CT values (>30). CONCLUSION: We demonstrated that the ID NOW COVID-19 assay, performed as a point of care test in the ED using dry swabs, provides a rapid and reliable alternative to laboratory-based RT-PCR methods Coronavirus disease 2019 , caused by SARS-CoV-2, first appeared in China and then spread worldwide [1] . The primary goal of the epidemic containment of COVID-19 is to reduce the infection transmission in the population by reducing the number of susceptible persons or by reducing the basic reproductive number (R0). To date, the reference testing method is the real-time reverse transcriptase-PCR (RT-PCR) similar to that developed for the diagnosis of SARS-CoV in early 2000s [2] . However, due to the rapid spreading of the SARS-CoV-2 pandemic and the limited capacities of molecular testing at the laboratory level, the concept of molecular testing in point-of-care setting such as in an Emergency Department (ED) appears to be useful to manage suspected infection cases. Indeed, the urgent need for increased testing for COVID-19 has been clearly identified as an essential component of the strategy to control the epidemic, worldwide. The ID NOW COVID-19 assay is a simple, userfriendly, rapid molecular biology test and do not required specific equipment molecular biology, allowing point-of-care testing. This molecular isothermal assay is based on nicking enzyme amplification reaction (NEAR) technology that targets the RdRP gene [3, 4] with a manufacturer's claimed limit of detection (LOD) of 125 genome equivalents/mL. Results are provided in approximately 15 min, including upfront 3 minutes of sample elution buffer warm-up time. The assay run time on the ID NOW platform was within 2 to 5 min for a positive call in the early callout mode as opposed to less than 13 min on the full-callout mode for a negative result. To date, the reported analytical performance of the ID NOW COVID-19 test in the literature reviewed has been variable [5] [6] [7] . This could be related to the conditions under which the samples were collected. The manufacturer's instructions state that this test is valid only on direct swab and not after discharged in viral transport medium (VTM) [3] . The objective of this work was first to evaluate the analytical performances of the ID NOW COVID-19 assay performed by ED nurses in point-of-care in comparison with the reference test RT-PCR Simplexa COVID-19 Direct assay (DiaSorin) currently in use in our laboratory. The second objective was to evaluate the effect of the transport medium VTM on the performance of the test. This prospective study was conducted between October 22 and December 22, 2020 in the ED of Groupe Hospitalier Paris Saint-Joseph, France. Consecutive adults presenting with clinical suspicion of COVID-19 assessed by the attending emergency physician and submitted to diagnostic tests for SARS-CoV-2 were eligible. The main clinical and laboratory data were collected in an electronic Case Report Form (e-CRF). All adult patients consenting to the participation in the study and to the use of biological samples were included. Patients were excluded when samples missed or inadequate. Paired nasopharyngeal swabs were collected with a flexible nasopharyngeal flocked swabs from patients having a clinical suspicion of COVID-19 by the attending nurse in the ED. Swabs were sent to the microbiology laboratory without prior assignment to either technique. The lack of identification of the order of collection and the size of the study ensures that the swabs were randomly distributed. -One swab was directly used for the ID NOW COVID-19 assay in point-of-care test by ED trained nurses, previously trained and certified for use it. Training on the use of ID NOW was provided by qualified experts. Proficiency tests were conducted with ED nurses prior to study initiation. Testing was conducted according to instructions for use for ID NOW. -The second swab collected, was then discharged in 3-ml viral transport medium (VTM) (Labo Moderne, Gennevilliers, France) and sent to the central microbiology laboratory for analysis. Specimens were stored at 4°C up to a day, if all testing could not be completed on the same day. In case of discrepancies, samples were aliquoted and frozen at -80°C for confirmatory testing. The ID NOW COVID-19 assay (Abbott, Chicago, Il, USA) is an isothermal nucleic acid amplification-based. The assay was performed directly from the dry swab in the ED or by transferring 200 microliters of VTM to elution buffer in the sample base and then mixed for 10 seconds per instructions for use at the microbiology laboratory. The Simplexa COVID-19 direct assay (Diasorin, Saluggia, Italy) was chosen as RT-PCR reference test and was performed with the DiaSorin LIAISON® MDX according to the manufacturer's instructions for use. A 50-μl volume of Simplexa COVID-19 Direct kit reaction mix (MOL415 0) was added to the "R" well of the 8-well direct amplification disc followed by addition of 50 μl of non extracted nasopharyngeal swab sample to the "SAMPLE" well. In case of discrepancy, a control was performed using an aliquot from VTM previously stored at −80 °C for quantitative RT-PCR following the protocol established by the National Reference Center for Respiratory Viruses (NRC) at Institut Pasteur, Paris, France [8, 9] The percentages were calculated based on documented data (missing data were excluded from the percentages). Inter-group comparisons were made using the Mann-Whitney test for quantitative variables and the Fisher exact test for qualitative variables. Statistical analysis was done with StatView software (version 5.0). All tests were two-tailed and p values less than 0.05 (calculated by c test, Student's t test, or Mann-Whitney test) were considered significant. This study followed the Standards for Reporting Diagnostic Accuracy study (STARD) guidelines and was previously approved by the local clinical ethic committee board N° IRB 2020-A02758-31. Informed oral consent for participation was obtained from each participant, in accordance with French law. A total of 406 patients were enrolled in the study, mean age was 71 years and M/F sex ratio = 1.12. Among them, 11 were secondary excluded due to a lack of adequate specimen samples ( Figure 1 : Study Flow Chart). A total of 395 patients were eligible for study inclusion. Among these, 154 patients (39%) were diagnosed with SARS-CoV-2 infection (Figure 1 ). POCT in the ED with nasopharyngeal swabs directly tested using the ID NOW COVID-19 assay showed sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of 98.0%, 97.5%, 96.2% and 98.7%, respectively. When the ID NOW COVID-19 assay was performed in the laboratory from the swab previously discharged in VTM, the sensitivity dropped to 62.5% and the NPV to 79.7% (Table 1) . Three false negative test results were reported with the ID NOW COVID-19 assay when performed using undiluted swabs directly in the ED; these results were obtained from patients with elevated C T values (>30). Six false positive results were observed with ID NOW COVID-19 assay performed in emergency department and no false positive results were reported in microbiology laboratory testing. We observed nine discrepancies between the results with the ID NOW COVID-19 assay performed directly in the ED and the RT-PCR method by Simplexa at the central laboratory (Table 1 ). An aliquot from VTM were sent to the National Reference Center for respiratory Heterogeneity of viral load between the two swabs may also explain these discrepancies. Among the six false-positive swabs, we were also able to make two observations: known previous SARS-CoV-2 infections (n=3) and early forms of SARS-CoV-2 infections (n=3). Among the three patients with a history of COVID-19, two had been hospitalized for reasons unrelated to and distant from COVID-19 (8 weeks and 8 months after). The third had been hospitalized three weeks after the diagnosis of COVID-19 for an episode of dyspnea. Thoracic angioscanner found minimal (10-25%) sequential lung damage with no pulmonary embolism. After investigation, we have no confirmation by a follow-up of the detection of SARS-CoV-2 for the 3 patients concerned but we have the clinico-scannographic confirmation during the hospitalization with oxygen-requirement, typical symptoms and evocative CTscan. Simplexa, and NRC Pasteur RT-PCR controls showed negative results which may be explained by heterogeneity of loading between the first and second nasal swab. Among the three patients with no history of COVID-19, timing context and associated symptoms were consistent with frequent modes of COVID-19 disclosure in the elderly: fall, anorexia, weakness and delirium. The discrepancy could probably result from the lower quality of the second swab, which remains an invasive sample. We hypothesize that these cases were SARS-CoV-2 infections not detected by the RT-PCR controls because of a viral load defect on the second swab. Nevertheless, given the lack of evidence to specifically identify that these cases were early SARS-CoV-2 infections, other hypotheses could explain the false positives, notably cross-contamination and assay specificity issues. Rapid and accurate detection of SARS-CoV-2 is essential to ensure early and appropriate patient management, outbreak containment, and to better follow the global epidemiology of the virus. Laboratory testing is mainly based on amplification and detection of viral gene sequences in upper respiratory tract specimens. The results of these analyses are often lengthy (1-4 hours) and difficult to manage with a large flow of patients in the ED and lead to a risk of overcrowding in these units. As reported by Alter et al. [10] and our team [11] , point-of-care test (POCT) instruments in ED produce lab results with rapid turnaround times. This study demonstrated that the detection of SARS-CoV-2 using rapid isothermal nucleid acid amplification assay performed by nurses directly at the emergency room, 24 hours-a-day, 7 daysa-week was both feasible and reliable. The sensitivity and specificity of the ID NOW system for the detection of SARS-CoV-2 was higher than 98% even when performed by a trained professional (in this case a nurse) without direct laboratory supervision. Less than 3.8%of tests failed were observed during this study. As reported by Kanwar et al. [12] , the invalid rate is an important consideration when selecting an assay for clinical use. Our experience with the ID NOW platform for the diagnosis of seasonal influenza showed satisfactory results [13] which allowed implementation POCT in our ED [11] . This experience has enabled the rapid implementation of a POCT's strategy in ED for the diagnosis of COVID-19. We have to keep in mind that identification of the virus is only a part of clinical diagnosis and management. Although our results are important, further studies are necessary to assess the clinical impact of ID NOW COVID-19 assay at triage in order to evaluate its effect on decisionmaking and the prescription of complementary examinations. POCT is only useful if it has an impact on treatment or healthcare organization. Some studies conducted during influenza outbreaks have shown a positive impact on medical costs [14, 15] , rapid antiviral treatment [16] and reduced length of stay [11] , especially for patients with a negative result, highlighting the importance of tests that have a high negative predictive value. However, we demonstrated the significant decrease in sensitivity of the ID NOW COVID-19 assay when performed using diluted swabs in VTM. Thus, we strongly recommend to perform immediately the test on fresh swab only. Dilution of the nasopharyngeal swab specimen in VTM below the lower limit of detection for the assay increases the risk of false negative results. This probably explains the better sensitivity of the test that we find compared to the results described by Mitchell et al. [17] . Similarly, it is interesting to note that in the study by Basu et al. [18] 101 paired nasal samples were tested on direct swabs and VTM transport medium. Fifteen samples were positive with the Cepheid GeneXpert test and only 10 samples were positive by the Abbott ID NOW test [19] . Thus 5/15 were false negatives. However, it is important to emphasize that in this study the 5 negative samples had high Ct values >33 and even very high Ct values for 3 samples (>40 on one of two nucleic acid targets). The clinical significance of these very low viral load levels is largely unknown. Nevertheless, as reported by Basu et al. ID NOW COVID-19 assay has some utility as a rapid rule-in test for samples at high viral load [18] . Furthermore, Abbott claim a sensitivity of 125 copies /ml for the ID NOW assay [3, 4] . However the evaluation by Department of Health Social & Care (DHSC) showed the assay starts to drop out at PCR Ct >30 values in comparison with reference quantitative PCR assays [20] . The publication by Zhen et al [7] reported a LOD for the Abbott ID NOW assay of 20,000 copies /ml. Discordant samples in this study negative by the Abbott ID NOW assay and positive by the reference RT-PCR method had RT-PCR Ct values between 30 and 38. Based on this, it seems unlikely the claimed LOD by Abbott of 125 copies /ml is correct. Data published by Abbott also indicate poorer sensitivity at higher comparative PCR Ct values >33. In the case of invalid or negative result with clinical signs suggestive of SARS-CoV-2 infection, the physician should perform an RT-PCR confirmatory test. However, once the swab is discharged into the sample receiver, if the result is invalid, it is no longer usable for central laboratory test. As described by Mitchell et al. [17] the potential for error and cross contamination from the multiple cartridge transfers and manipulations and possible biosafety concerns while swirling the swab to resuspend material are contingencies that the operator should be cautioned about during training. Nevertheless, no cross-contamination was observed in Mitchell's study, nor any false positives (100% specificity). Therefore, for the 6 false positive samples, the hypothesis of a viral load defect on the second swab is the most plausible. This is supported by the fact that no false positives were observed on the viral transport medium VTM by both the IDNOW microbiology test and the Simplexa RT-PCR. Our study has several limitations. First, the ID NOW COVID-19 assay itself has only one target, the RdRP gene. To date, the published isothermal amplification technology tests did not evaluate SARS-CoV-2 using two target genes [21] . Second, this work was conducted during an epidemic peak and so the results should be viewed in the context of the conditions during such a period. Positive predictive values decrease when tests are performed with a lower prevalence of the disease, thus the results cannot be extrapolated to a lower prevalence period. Third, this study was conducted on the relatively small number of samples in a single care center setting. Therefore, the results may be specific to the population of this center and may not be applicable to another patient group such as children for example. Use of rapid diagnostic test at triage in other care settings would depend on the organization of each ED and, importantly, on the availability of compliant and trained staff. With large numbers of patients being admitted to hospital, putting tremendous pressure on health care systems, there is an urgent demand for a user friendly, rapid, simple and sensitive POCT assay. Such tests could be used at hospitals to facilitate faster detection of SARS-CoV-2, which can reduce or avoid further spread and ensure appropriate patient management. This is the first prospective evaluation of ID NOW COVID-19 assay in "real life" in ED and we showed ID NOW COVID-19 assay used as POCT in an ED setting provides a rapid and reliable alternative to laboratory-based RT-PCR methods. The authors would like to thank the Emergency Department team and especially Anne Boureau, Aurélie Lebigre, Trinidad Rodriguez, Bernadette Gauchet-Jegier, Mélanie Luce for the coordination within the ward and all ED nurses to have done all samples. Special thanks to Tanguy Robardet and Salim Kahlat for technical support and the contribution of Olivier Billuart as data manager. China Novel Coronavirus Investigating and Research Team, A Novel Coronavirus from Patients with Pneumonia in China Real-time reverse transcription-polymerase chain reaction assay for SARS-associated coronavirus ID Now COVID-19 package insert Isothermal SARS-CoV-2 Diagnostics: Tools for Enabling Distributed Pandemic Testing as a Means of Supporting Safe Reopenings Comparison of Abbott ID Now and Abbott m2000 Methods for the Detection of SARS-CoV-2 from Nasopharyngeal and Nasal Swabs from Symptomatic Patients Comparison of Abbott ID Now, DiaSorin Simplexa, and CDC FDA Emergency Use Authorization Methods for the Detection of SARS-CoV-2 from Nasopharyngeal and Nasal Swabs from Individuals Diagnosed with COVID-19 Clinical Evaluation of Three Sampleto-Answer Platforms for Detection of SARS-CoV-2 Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR Protocol: Real-time RT-PCR assays for the detection of SARS-CoV-2 Point-of-Care Testing for the Emergency Department Patient: Quantity and Quality of the Available Evidence Implementation of Alere i Influenza A & B point of care test for the diagnosis of influenza in an ED Comparison of the ID Now Influenza A & B 2, Cobas Influenza A/B, and Xpert Xpress Flu Point-of-Care Nucleic Acid Amplification Tests for Influenza A/B Virus Detection in Children Prospective evaluation of the Alere i Influenza A&B nucleic acid amplification versus Xpert Flu/RSV Economic and operational impact of an improved pathway using rapid molecular diagnostic testing for patients with influenza-like illness in a German emergency department Clinical decision making in the emergency department setting using rapid PCR: Results of the CLADE study group Implementation of influenza point-of-care testing and patient cohorting during a high-incidence season: a retrospective analysis of impact on infection prevention and control and clinical outcomes Evaluation of the COVID19 ID NOW EUA assay Performance of Abbott ID Now COVID-19 Rapid Nucleic Acid Amplification Test Using Nasopharyngeal Swabs Transported in Viral Transport Media and Dry Nasal Swabs in a New York City Academic Institution Performance of the rapid Nucleic Acid Amplification by Abbott ID NOW COVID-19 in nasopharyngeal swabs transported in viral media and dry nasal swabs Technical Validation of Abbott ID Now COVID-19 Infection Diagnosis: Potential Impact of Isothermal Amplification Technology to Reduce Community Transmission of SARS-CoV-2 We are also grateful to the members of Clinical Research: Center: Estelle Plan, Julien Fournier, Dr Nesrine Ben Nasr, Dr Hélène Beaussier and Prof. Gilles Chatellier.We thank Dr Gregory Destras at the Lyon National Reference Center for Respiratory Viruses (France) for helpful discussion.We have no conflicts of interest to declare.