key: cord-0716242-wmxw9e0c authors: Mitchell, Stephanie L.; George, Kirsten St. title: Evaluation of the COVID19 ID NOW EUA Assay date: 2020-05-15 journal: J Clin Virol DOI: 10.1016/j.jcv.2020.104429 sha: 0c85a27a7c98663a3aa076dd1fca866803fcfce7 doc_id: 716242 cord_uid: wmxw9e0c • ID NOW EUA SARS-CoV-2 assay had an overall agreement of 78.7% when compared to the standard of care reference methods. • ID NOW had a sensitivity of 71.7% and specificity of 100%. • All the false-negative results occurred with weakly positive samples, with reference method C(T) values ≥35.  All the false-negative results occurred with weakly positive samples, with reference method CT values ≥35. The SARS-CoV-2 pandemic caused a major surge in the diagnostic capacity needed for adequate response efforts. Many commercial companies have developed diagnostic assays that are available for clinical testing in the USA, if authorized through the FDA's emergency use authorization (EUA) process. While most of the SARS-CoV-2 EUA assays for molecular detection must be performed in moderate-to high-complexity clinical laboratories, a few are authorized as point-of-care devices, such as the Abbott ID NOW. In addition to clinical laboratories, this assay can be performed by trained non-laboratory personnel in patient care settings such an Emergency Departments, physician's offices or pharmacies, potentially bringing diagnostic testing for SARS-CoV-2 closer to the patient (1). Among the marketing information for this new assay, potential advantages include its reported sensitivity (stated limit of detection (LOD) of 125 genome equivalents/ml) and run time (detection of SARS-CoV-2 RNA as early as five minutes and a negative result in thirteen minutes). Also, the ID NOW may provide rapid molecular results either from direct testing of nasopharyngeal, nasal, or oropharyngeal swabs or testing of the viral transport media (VTM) from swabs placed in this fluid after collection (2) . To date, reported performance of the ID NOW SARS-CoV-2 assay in the peer-reviewed literature has been variable. the ID NOW as compared to an LDT reference method, ranging from 75-87% (3) (4) (5) (6) . Given the potential advantages of this device over more traditional format molecular tests such as real-time RT-PCR, a small evaluation of the ID NOW COVID-19 test was conducted at two laboratories to assess its performance. Residual positive and negative nasopharyngeal patient samples collected in VTM were tested using the ID NOW EUA assay. Samples had been stored at -80℃ prior to testing. Results from the ID NOW assay were compared to the original results from either the CDC EUA or the New York EUA assays, which served as the reference methods. Positive and negative samples were alternated to assess for potential carry-over contamination of either the patient sample or amplicon. Precision was assessed by running one strongly positive, one moderately positive and one negative sample in triplicate. At both facilities, the work was conducted inside a Class II biosafety cabinet (BSC) by certified laboratory personnel. In total 46 positive and 15 negatives were tested for a total of 61 samples. Overall agreement of the ID NOW with the reference method was 48/61 (78.7%). Specificity was 100% (15/15). However, sensitivity was 71.7% (33/46) with the ID NOW producing false negative results in 13 of the 46 positive samples tested. Notably, all false-negative results corresponded to those samples that were weakly positive, with a cycle threshold (CT) values between 35-40 for all targets ( Figure 1 ). This suggests that the ID NOW has acceptable performance for strongly or moderately positive samples but may lack sensitivity when the sample contains low amount of viral RNA. Importantly, in a review of more than 5,000 positive SARS-CoV-2 results at Wadsworth, 18% of the tests had After this evaluation was performed, a notice was issued by the manufacturer, stating that samples collected in VTM were no longer acceptable for the ID NOW COVID-19 EUA assay, citing lower sensitivity for these specimens (7), which was also observed in our study. While removing this specimen type is an important step to reducing false-negative results, this now presents a challenge to both laboratories and patient care settings in verifying assay performance prior to implementation (8) . Given that only the direct swab is acceptable, verification cannot be performed using residual or contrived samples that are readily available and commonly used for this purpose. Notably, the direct swab positive control included with the assay does not contain SARS-CoV-2 material and therefore cannot be used for either a target amplification control or for assay verification. There were other challenges and considerations observed during the evaluation period. The test procedure requires multiple cartridge transfers and manipulations, which may be challenging for personnel not familiar with or accustomed to adhering to molecular techniques. Manipulations also have the potential to cause contamination of the device and the operation environment. While no cross-contamination was observed during the evaluation period, frequent ID NOW COVID-19 Instructions for Use Clinical Evaluation of Three Sample-To-Answer Platforms for the Detection of SARS-CoV-2" Comparison of Abbott ID NOW and Abbott m2000 methods for the detection of SARS-Cov-2 from nasopharyngeal and nasal swabs from symptomatic patients Comparison of Abbott ID NOW, DiaSorin Simplexa and CDC FDA EUA methods for the detection of SARS-CoV-2 from nasopharyngeal and nasal swabs from individuals diagnosed with COVID-19 Five-Minute Point-of-Care Testing for SARS-CoV-2: Not There Yet Verification procedure for commercial tests with Emergency Use Authorization for the detection of SARS-CoV-2