key: cord-0970711-al3ft41m authors: Kilic, Abdullah; Hiestand, Brian; Palavecino, Elizabeth title: Evaluation of Performance of the BD Veritor SARS-CoV-2 Chromatographic Immunoassay Test in Patients with Symptoms of COVID-19 date: 2021-04-20 journal: J Clin Microbiol DOI: 10.1128/jcm.00260-21 sha: 58a1f5319ac78aa49e8bda7af2b9e3bec0328c8d doc_id: 970711 cord_uid: al3ft41m Severe acute respiratory coronavirus 2 (SARS-CoV-2) was first detected as the causative agent for an outbreak of viral pneumonia in 2019 in Wuhan, China.…. the same encounter. Nasal samples for the antigen test were collected using flocked swabs (Becton, Dickinson, Sparks, MD, USA) and tested at the site of collection within 1 h of collection according to the manufacturer's instructions (7) . Briefly, the swabs were added to extraction buffer tubes and mixed for at least 15 to 30 s. The extraction buffer/specimen mixture was then added to the sample well of the test cartridge to initiate the testing. After the assays proceeded for 15 min, the test cartridges were inserted into the Veritor analyzer to obtain results. For each patient tested by the Veritor antigen test, a nasopharyngeal sample was obtained at the same time, placed in 3 ml of viral transport medium (Remel, Lenexa, KS, USA), and submitted for RT-PCR testing using the Simplexa COVID-19 Direct EUA RT-PCR (Diasorin Molecular LLC, Cypress, CA, USA). The Simplexa COVID-19 direct assay targets two regions within the SARS-CoV-2 genome, the S gene encoding the spike protein (SP) and the ORF1ab genes encoding well-conserved nonstructural proteins of SARS-CoV-2. This assay was performed according to the manufacturer's instructions (3) . After swirling, the swab was discarded and 50 ml of sample and 50 ml of reaction mix were separately loaded into direct real-time PCR amplification-disc wells. The disc was then loaded onto the LIAISON MDX instrument (DiaSorin Molecular) and allowed to react for a 75-minute run. Extraction and amplification controls were used to detect PCR failure and/or inhibition. Positive-and negative-control samples were included in each run. After the assay's completion, the instrument's software (LIAISON MDX Studio-SW Version 2.1.0.4) automatically calculated and displayed results. Samples with median threshold cycle (C T ) values of ,40 (for one or both targets) were reported as positive for SARS-CoV-2. Sensitivity, specificity, and likelihood ratios were calculated along with the 95% confidence intervals (95% CI). Cycle times for each target sequence were examined and found to be nonparametric. Therefore, Wilcoxon rank sum testing was used to compare cycle times for S gene and ORF1ab targets between Simplexa RT-PCR positive/the Veritor test positive and Simplexa RT-PCR positive/the Veritor test negative samples. We held P , 0.05 to represent a statistically significant difference. As the sample size was fixed due to clinically available specimens, formal sample size calculations were not performed. Statistics were calculated with Stata 11.2. Table 1 provides the comparative test results for antigen and RT-PCR testing for the 1,384 paired samples. Overall concordance was seen in 1,330/1,384 specimens (96.1%, 95% CI 95.0 to 97.1%). Utilizing Simplexa RT-PCR testing as the reference method, the Veritor antigen test sensitivity was 66.4% (95% CI 57.0 to 74.9%) and specificity was 98.8% (95% CI 98.1 to 99.3%). The likelihood ratio negative for the antigen test was 0.34 (95% CI 0.26 to 0.44) and the likelihood ratio positive was 56.1 (95% CI 33.4 to 94.3). Using Simplexa RT-PCR as a reference standard, the sample prevalence of disease was 116/1,384 (8.4%, 95% CI 7.0 to 10.0%). The C T value of the Simplexa RT-PCR among the 77 concordant positive samples was 19.1 for the S gene target (range: 10.6 to 33.1) and 19.8 for the ORF1ab target (range: 11.2 to 33.7), whereas the median C T for the 39 discordant (positive by the Simplexa RT-PCR and negative by the Veritor test) was 24.5 for the S gene target (range: 11.9 to 33.5) and 24.9 for the ORF1ab target (range: 11.2 to 32.8) (Fig. 1) . For both the S gene and the ORFlab targets, these differences in Simplexa RT-PCR cycle (6), consistent with results obtained in the current study. However, our study results showed a lower sensitivity than that reported by the manufacturer (66.4% versus 84%, respectively), probably due to differences in patient populations and different local prevalence rates (8.4% prevalence in our study versus 15.1% prevalence for Young et al. [6] and 13.7% prevalence for the Veritor validation study by the manufacturer [7] ). It should be noted that most of the rapid antigen tests for detecting COVID-19 evaluated have demonstrated a lack of sensitivity, with reported sensitivities ranging from 30.2 to 93.9% (8) (9) (10) (11) (12) (13) . The analytical performance of rapid antigen tests depends on the viral load of the samples (12) . When we compared the concordant and discordant results between the Veritor antigen test and the Simplexa RT-PCR, the samples negative by antigen tests but positive by RT-PCR had higher C T values, indicating a lower viral load. These results suggest that the Veritor test might not detect SARS-CoV-2 in samples with low viral RNA, although the range of C T values overlapped with the range observed in positive samples (Fig. 1) . One of the limitations of this study is that different sample types were used, i.e., nasal swab for the antigen test and nasopharyngeal swab for the RT-PCR. This difference may also contribute to the lower sensitivity observed with the antigen test. However, in each case, the used sample types were those recommended for each test by the manufacturer and validated by our laboratory. In addition, the manufacturer also used nasal swabs compared to nasopharyngeal swabs for the RT-PCR for their validation data in the EUA submission to the FDA. Therefore, our study is comparable to that reported by the manufacturer to assess the clinical performance of the antigen test. Overall, the Veritor test is rapid, easy to use, and can be performed as a POCT by nonlaboratory personnel, but requires a reader that needs to be replaced after 3,000 tests. In our institution, the average TAT is 29 min for the Veritor antigen test and 9 h for the Simplexa RT-PCR. The difference in TAT is because the antigen test is performed at the site of collection throughout our health care system, while the samples for Simplexa RT-PCR are sent to the laboratory for batched testing on first and second shift only. Our findings demonstrate that the lower sensitivity of the Veritor test compared to RT-PCR led to false-negative results in 39 patients and therefore negative results in symptomatic patients require confirmation by RT-PCR where available. Furthermore, despite the high specificity of the antigen test (98.8%) found in this study and high pretest probability (exposure plus symptoms) of patients tested, 15 patients had a false-positive antigen result. This rate may be acceptable in outpatient settings where the patient with a positive result would be told to self-isolate, but could be too high for patients that will be admitted, as they could potentially be admitted to a COVID unit unnecessarily. The need for confirmation of negative results in symptomatic patients reduces the clinical utility of this test, particularly in areas of low prevalence. But the high overall correlation of test results (96.1%) for symptomatic patients suggests that this antigen test can be a useful tool in areas where RT-PCR is not available or the TAT of RT-PCR is prolonged, especially given its rapid TAT and the possibility of its use in POCT locations. WHO announces COVID-19 outbreak a pandemic. WHO Regional Office for Europe Clinical evaluation of self-collected saliva by quantitative reverse transcription-PCR (RT-qPCR), direct RT-qPCR, reverse transcription-loop-mediated isothermal amplification, and a rapid antigen test to diagnose COVID-19 Rapid and sensitive detection of SARS-CoV-2 RNA using the Simplexa COVID-19 direct assay Evaluation of rapid antigen test for detection of SARS-CoV-2 virus Centers for Disease Control and Prevention. 2020. Interim guidance for antigen testing for SARS-CoV-2. CDC Clinical evaluation of BD Veritor SARS-CoV-2 point-of-care test performance compared to PCR-based testing and versus the Sofia 2 SARS antigen point-of-care test BD Veritor System for Rapid Detection of SARS-CoV-2, package insert EB Urgent need of rapid tests for SARS CoV-2 antigen detection: evaluation of the SD-Biosensor antigen test for SARS-CoV-2 Evaluation of the Panbio Covid-19 rapid antigen detection test device for the screening of patients with Covid-19 Performance of a novel diagnostic assay for rapid SARS-CoV-2 antigen detection in nasopharynx samples Evaluation of a novel antigen-based rapid detection test for the diagnosis of SARS-CoV-2 in respiratory samples Low performance of rapid antigen detection test as frontline testing for COVID-19 diagnosis Evaluation of Abbott BinaxNOW rapid antigen test for SARS-CoV-2 infection at two community-based testing sites-Pima County We declare no competing interests.