key: cord-0973971-0vaywsyd
authors: Cento, Valeria; Renica, Silvia; Matarazzo, Elisa; Antonello, Maria; Colagrossi, Luna; Di Ruscio, Federica; Pani, Arianna; Fanti, Diana; Vismara, Chiara; Puoti, Massimo; Scaglione, Francesco; Perno, Carlo Federico; Alteri, Claudia
title: Frontline Screening for SARS-CoV-2 Infection at Emergency Department Admission by Third Generation Rapid Antigen Test: Can We Spare RT-qPCR?
date: 2021-05-01
journal: Viruses
DOI: 10.3390/v13050818
sha: 79054cee179fe7e1a6d513bdc535664d5cdb237b
doc_id: 973971
cord_uid: 0vaywsyd

To complement RT-qPCR testing for diagnosis of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infections, many countries have introduced the use of rapid antigen tests. As they generally display lower real-life performances than expected, their correct positioning as frontline screening is still controversial. Despite the lack of data from daily clinical use, third generation microfluidic assays (such as the LumiraDx SARS-CoV-2 Ag test) have recently been suggested to have similar performances to RT-qPCR and have been proposed as alternative diagnostic tools. By analyzing 960 nasopharyngeal swabs from 960 subjects at the emergency department admissions of a tertiary COVID-19 hospital, LumiraDx assay demonstrated a specificity of 97% (95% CI: 96–98), and a sensitivity of 85% (95% CI: 82–89) in comparison with RT-qPCR, which increases to 91% (95% CI: 86–95) for samples with a cycle threshold ≤ 29. Fifty false-negative LumiraDx-results were confirmed by direct quantification of genomic SARS-CoV-2 RNA through droplet-digital PCR (median (IQR) load = 5880 (1657–41,440) copies/mL). Subgenomic N and E RNAs were detected in 52% (n = 26) and 56% (n = 28) of them, respectively, supporting the presence of active viral replication. Overall, the LumiraDx test complies with the minimum performance requirements of the WHO. Yet, the risk of a misrecognition of patients with active COVID-19 persists, and the need for confirmatory RT-qPCR should not be amended.

The effective large-scale infection prevention and control strategy of the Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) pandemic relies on a timely and accurate diagnosis of the Coronavirus Disease 2019 (COVID- 19) , to be able to promptly identify positive cases and halt transmission. The gold standard for this definition is the positivity to real-time polymerase chain reaction (RT-qPCR), providing sensitive and reliable results. However, the high number of daily requests and the concomitant logistical and supply chain issues have led to such an increase in turnaround time as to become Viruses 2021, 13, 818 2 of 9 incompatible with the needs of an effective large-scale screening strategy. To complement RT-qPCR testing, many countries have introduced in their diagnostic routine the use of rapid antigen tests [1] [2] [3] [4] [5] [6] [7] , designed to detect the presence of a viral antigen (usually the nucleocapsid, N). Antigen tests are inexpensive and easy to use, even in point-of-care (POC) scenarios, but with the drawback of a diagnostic sensitivity generally lower than that of RT-qPCR, as they provide reliable results only in the presence of high viral loads (≥100,000 copies/mL), and during the first few days since symptom onset [8] [9] [10] [11] [12] [13] [14] . As a consequence, their correct positioning as frontline screening tests is still controversial.

The WHO, CDC, and ECDC provided specific guidance for the use of rapid antigen test, recommending its use in some settings while underlying the need for a subsequent confirmation of their results by RT-qPCR [8, 15, 16] . According to the national indications for the case definition of COVID-19 in Italy [3] , however, the third generation antigen-detecting tests are considered equivalent to RT-qPCR in terms of performance, and confirmation of their result is not mandatory. At present, however, there are no clinical practice data to support this conclusion, nor the actual ability of these rapid tests to identify potentially contagious individuals.

With this study we aimed to evaluate the concordance between the third generation LumiraDx SARS-CoV-2 Ag test and RT-qPCR at the emergency department (ED) admissions of a tertiary COVID-19 reference hospital. As the antigen test was introduced in our hospital routine to detect and isolate COVID-19 cases within the triage, we focused on the frequency and significance of discordant antigen-negative but RT-qPCR positive results. The direct quantification of SARS-CoV-2 load and subgenomic mRNA (sgmRNA), used as a marker for actively replicating virus [17] , was used to investigate the hypothesis that the negativity of the antigen test in presence of a positive RT-PCR result would represent a condition of poor viral replication and, consequently, infectivity.

The study was conducted between 21 October 2020 and 9 December 2020 at ASST Grande Ospedale Metropolitano Niguarda. During the selected period, two simultaneous nasopharyngeal swabs (COPAN NP FLOQSwabs ® ; Copan Diagnostics, CA, USA) were collected by trained medical personnel from all subjects who presented themselves at the ED of the hospital with suspected COVID-19 symptoms, or who were in progress to be admitted to hospital care for any other reason.

All nasopharyngeal swabs were immediately tested upon collection for SARS-CoV-2 by the third generation LumiraDx SARS-CoV-2 Ag test (LumiraDx, UK) and the RT-qPCR (Simplexa™ COVID-19 Direct Kit, DiaSorin; negative threshold ≥ 40 cycles). Residual samples were stored at −80 • C. Demographic and clinical data were obtained retrospectively by pseudonymized electronic medical records by confirmed COVID-19 cases. The severity of the disease was classified in line with the WHO scale [18] . A total of 1146 third-generation antigenic LumiraDx test and 1146 RT-qPCR were performed on coupled nasopharyngeal swabs sampled; 186 samples were excluded due to previous inclusion of the same patient, leaving 960 coupled RT-qPCR and antigenic POC-test results from 960 patients for final analysis (Supplementary Figure S1 ).

In discordant cases (positive at RT-qPCR and negative at antigenic LumiraDx test, +/− discordant), SARS-CoV-2 genomic RNA load was assessed by a QX200™ Droplet Digital™ PCR System (ddPCR, Bio-Rad Laboratories, Inc.) on residual nasopharyngeal samples, as described previously [19] . Primers and probes for the detection of subgenomic mRNA (sgmRNA) were designed to include a forward primer targeting the leader sequence, and reverse primers and probes targeting the first 160 nucleotides of the envelope and nucleocapsid coding region of SARS-CoV-2. In particular, SARS-CoV-2 sgmRNA were quantified using ddPCR adapted assays targeting the nucleocapsid (N) sgRNA (Forward: 5 - CCAACCAACTTTCGATCTCTT-3 , Reverse: 5 -GTGAACCAAGACGCAGTATTAT-3 , and FAM Probe: 5 -TGGAGAACGCAG-TGGGGCGCG-3 ) and the envelope (E) sgmRNA (Forward: 5 -CGATCTCTT-GTAGATCTGTTCTC-3 , Reverse: 5 -ATATTGCAGCAGTACGCACACA-3 , and HEX Probe: 5 -ACACTAGCCATCCTTACTGCGCTTCG-3 ) [17, 20] . The cycling conditions were: 45 • C (60 min), 95 • C (10 min), 40 cycles of 95 • C (30 s) and 58 • C (1 min), 98 • C (10 min), and 4 • C (∞). SARS-CoV-2 quantification was finally expressed in number copies/mL of swab.

To define the performance of LumiraDx test, sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) were assessed against the RT-qPCR, considered as the gold standard for SARS-CoV-2 testing. A univariate and multivariate logistic regression analyses were also performed in order to define factors associated with the presence of SARS-CoV-2 sgmRNAs used as a marker for actively replicating virus in the subset of discordant cases. Analyses were performed using IBM®SPSS®Statistics version 26 (SPS S.r.l., Bologna, Italy).

Five hundred fifty-five of the 960 patients enrolled in the study were male (57.8%) with a median age of 66 (interquartile range, IQR: 45-79) years (Table 1) . Three hundred forty-seven (36.1%) individuals were determined to be SARS-CoV-2 infected by RT-qPCR testing. Clinical information related to COVID-19 were retrieved for a subset of 176 SARS-CoV-2 positive individuals. Among them, 46 (26.1%) and 13 (7.4%) were affected by a critical and severe form of COVID-19, respectively (Table 1) . 

The According to Ct, the LumiraDx test has a sensitivity of 91% (86-95%) for samples with Ct ≤ 29 (n = 139), and of 34% (21-46%) for samples with Ct > 29 (n = 59) ( Table 2) .

Among the 176 patients whose classification of COVID-19 manifestation was retrieved, LumiraDx failed to detect SARS-CoV-2 in 46 individuals (26.1%) ( 

As stated before, the LumiraDx test failed to detect SARS-CoV-2 in 50 RT-qPCR-positive samples. Direct quantification of genomic SARS-CoV-2 load by ddPCR revealed the presence of SARS-CoV-2 RNA in all the 50 RT-qPCR-positive/antigen-negative samples, with a median (IQR) load of 5880 (1657-41,440) copies/mL (range: 32.7-1,000,000 copies/mL), confirming the RT-qPCR result (Figure 1 ). Nine of them had a viral load ≥ 100,000 copies/mL, thus above the threshold that would ensure SARS-CoV-2 detection by LumiraDx. In addition, ddPCR demonstrated the production of sgmRNA for the N-antigen in 26/50 samples (52.0%), and for the E-antigen [17] in 28/50 (56.0%), with a median (IQR) sgmRNA load of 809 (203-7409) copies/mL, and 665 (284-9100) copies/mL, respectively ( Figure 2 ). copies/mL, thus above the threshold that would ensure SARS-CoV-2 detection by Lu miraDx. In addition, ddPCR demonstrated the production of sgmRNA for the N-antige in 26/50 samples (52.0%), and for the E-antigen [17] in 28/50 (56.0%), with a median (IQR sgmRNA load of 809 (203-7409) copies/mL, and 665 (284-9100) copies/mL, respectivel ( Figure 2 ). Moreover, in order to define factors associated with the presence of sgmRNA in these 50 RT-qPCR-positive/antigen-negative samples and thus to clarify the role of these replicative intermediates, we performed a multivariate logistic regression analysis shown in Supplementary Table S1 . By this analysis, the presence of sgmRNAs was dependent on the presence of higher viral loads in nasopharyngeal swabs, but not by the timing of testing after symptom onset (at least in the time frame of 1-10 days), and severity of COVID-19 presentation [18], thus suggesting that these clinical parameters might not be sufficient in discriminating individuals at lower risk of viral infectivity and transmission [21] . Even if the presence of sgmRNAs is dependent on the presence of higher viral loads in nasopharyngeal swabs (Supplementary Materials Table S1 ), sgmRNAs were detected in more than half (56.0%; 23/41) of samples with a genomic RNA load of <100,000 copies/mL, supporting the presence of a potentially replicating and infecting virus even in a subset of samples with lower viral load.

Thanks to the reduced turnaround time, cost, and expertise required for execution, rapid antigen tests are believed to provide added value in the patient triage process in healthcare settings, or where it is necessary to take prompt public health measures. A number of commercial rapid antigen tests have been licensed to be used in clinical practice [22] , but data on their on-field performance are extremely scarce and heterogeneous. Previous studies have indeed reported a broad spectrum of sensitivity for rapid antigen tests when compared to RT-qPCR (22-100%) [10] [11] [12] 14, [23] [24] [25] [26] . Owing to the unavoidable heterogeneity of the field studies on rapid antigen tests, their performance results are frequently lower than those reported by the manufacturers [10] [11] [12] 14, [23] [24] [25] [26] .

To the best of our knowledge, this is the first report on the use of a third generation microfluidic immunofluorescence-based antigen test as a frontline screening tool, in association with RT-qPCR, at ED admission in a real-life hospital setting. Even if the 85% sensitivity here reported is far lower than the 97.6% sensitivity described by the manufacturer [27] , the LumiraDX test meets the WHO minimum performance requirements for rapid antigen tests in terms of sensitivity (85% vs. ≥80% recommended), and specificity (97.0% vs. ≥97% recommended) [14] , but falls short of the ECDC 90% sensitivity requirement [8] . In a recent comparative study evaluating the performances of four different rapid antigen tests against RT-qPCR and cell culture infectivity on 100 samples collected during a random screening within shared living facilities, the LumiraDx assay demonstrated a sensitivity of 50% [14] . The sensitivity we found in hospital triage screening against RT-qPCR (85.0%) is therefore superior to this estimate, probably due to optimization of the performance setting (ED admission, with a high prevalence of symptomatic subjects), high local incidence of SARS-CoV-2 infection (RT-qPCR positivity rate ≥ 20% over a median (IQR) of 1689 (841-2063) RT-qPCR performed daily), and sample size (960 subjects), in full compliance with WHO and ECDC indications on the use of rapid antigen tests [8, 15] .

We demonstrated a 7.0% discordance between the LumiraDx antigen and RT-qPCR results, with 5.8% being false-negative results. The direct quantification of SARS-CoV-2 genomic RNA by ddPCR in the 50 samples with discordant antigen-negative and RT-PCR positive results confirmed this false-negative rate. This antigen POC test is able to detect SARS-CoV-2 with a sensitivity of 91% in nasopharyngeal swabs characterized by Ct ≤ 29, but the sensitivity declines substantially when the viral load decreased to Ct values over 30 (34%) and may miss the opportunity to detect later and mild infections.

Our study also demonstrated that the LumiraDx antigen test may fail to detect SARS-CoV-2 in a number of samples with high levels of nasopharyngeal viral-shedding and evidence of replicative intermediates. The presence of these sgmRNA suggests the effective production of the SARS-CoV-2 proteins, including the N-antigen targeted by LumiraDx test, and provided a proof-of-concept that a negative result of the LumiraDx assay does not exclude the presence of a likely replicating and infecting virus, even in recently symptomatic subjects. Indeed, the role of these sgmRNA has been investigated in several papers, all demonstrating a good agreement between virus culture and sgmRNA detection [17, [28] [29] [30] . Specimens positive for sgmRNA, especially those collected within 8 days of symptom onset, more frequently yield positive virus isolation [17, [28] [29] [30] , thus suggesting the role of sgmRNA as a marker of a live, potentially replicating and thus likely transmissible virus [31] [32] [33] [34] . Further research is needed to define if the quantitative sgmRNA estimation (and not only the sgmRNA qualitative detection) may serve as a more accurate marker to predict a viable and transmissible virus.

This study has some limitations. Because of the retrospective nature and size of the included population from hospital clinical practice in a situation of high prevalence of SARS-CoV-2 infection, we could not estimate COVID-19 symptoms, type and duration, and disease severity for all subjects, but only for the 176 RT-PCR confirmed COVID-19 cases. This affects the possibility to assess the efficiency of the antigenic POC test in detecting SARS-CoV-2 in infected but asymptomatic individuals. We are not able to assess the detection efficiency of potential N SARS-CoV-2 variants, or if the discordant results can be affected by N single nucleotide polymorphisms.

Overall, the LumiraDx test complies with the minimum performance requirements of the WHO and has the potential to perform better than previous generations of rapid antigen tests. This test can also offer some undoubted advantages respect to RT-qPCR, like rapid turnaround time, low cost, and easy use without the need for a microbiological laboratory. All these characteristics make antigenic tests suitable for large-scale mass testing, and for SARS-CoV-2 containment strategies integrating social distancing, masks usage, serial antigen screenings, and contact tracing. However, when used as frontline screening for SARS-CoV-2 infection, the risk of a misrecognition of patients with active COVID-19 still exist, and the need for confirmatory RT-qPCR in symptomatic subjects who test antigen-negative should not be amended.

Supplementary Materials: The following are available online at https://www.mdpi.com/article/ 10.3390/v13050818/s1, Figure S1 : Selection criteria for the 960 swab samples included in the study andconcordance between RT-qPCR and LumiraDx, Table S1 : Factors associated with the presence of SARS-CoV-2 subgenomic RNAs.

Author Contributions: Conceptualization, V.C., C.V. and C.A.; methodology, V.C., C.V., D.F. and C.A.; software, C.A.; validation, C.V., M.P., F.S., C.F.P. and C.A.; formal analysis, V.C. and C.A.; investigation, S.R., E.M., M.A., L.C., F.D.R. and A.P.; resources, C.V., F.S. and C.F.P.; data curation, S.R. and E.M.; writing-original draft preparation, V.C. and C.A.; writing-review and editing, V.C. and C.A.; supervision, F.S., C.F.P. and C.A.; project administration, V.C., C.V. and C.A. funding acquisition, C.V., F.S. and C.F.P. All authors have read and agreed to the published version of the manuscript.

Funding: This research received no external funding.

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee Milano Area 3 (protocol code 664-17112020, October 2020).

Informed consent was obtained from all subjects involved in the study.

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to inclusion of clinical and demographic characteristics of patients.

Österreichische Teststrategie SARS-CoV-2; Bundesministerium für Soziales

Revue Rapide sur les Tests de Détection Antigénique du Virus SARS-CoV-2: HAS

Aggiornamento della Definizione di Caso COVID-19 e Strategie di Testing

Advies Antigeen(snel)testen: Government of the Netherlands

Nationale Teststrategie SARS-CoV-2; RKI

Estratégia Nacional de Testes para SARS-CoV-2; Governo da República Portuguesa-Ministério da Saúde

CMMID COVID-19 Working Group

The impact of population-wide rapid antigen testing on SARS-CoV-2 prevalence in Slovakia

Options for the Use of Rapid Antigen Tests for COVID-19 in the EU/EEA and the UK. 2020

Performance of a Point-of-Care Test for the Rapid Detection of SARS-CoV-2 Antigen. Microorganisms

Evaluation of a Rapid Diagnostic Assay for Detection of SARS-CoV-2 Antigen in Nasopharyngeal Swabs

Low performance of rapid antigen detection test as frontline testing for COVID-19 diagnosis

Panbio antigen rapid test is reliable to diagnose SARS-CoV-2 infection in the first 7 days after the onset of symptoms

A rapid, high-sensitivity SARS-CoV-2 nucleocapsid immunoassay to aid diagnosis of acute COVID-19 at the point of care

The Comparative Clinical Performance of Four SARS-CoV-2 Rapid Antigen Tests and Their Correlation to Infectivity In Vitro

Coronavirus disease (COVID-19) Pandemic-Emergency Use Listing Procedure (EUL) Open for In Vitro Diagnostics

Interim Guidance for Rapid Antigen Testing for SARS-CoV-2

Virological assessment of hospitalized patients with COVID-2019

Detection and quantification of SARS-CoV-2 by droplet digital PCR in real-time PCR negative nasopharyngeal swabs from suspected COVID-19 patients

Assessment of SARS-CoV-2 RNA Test Results Among Patients Who Recovered From COVID-19 With Prior Negative Results

Long-term SARS-CoV-2 RNA shedding and its temporal association to IgG seropositivity

Analytical sensitivity and clinical sensitivity of the three rapid antigen detection kits for detection of SARS-CoV-2 virus

Urgent need of rapid tests for SARS CoV-2 antigen detection: Evaluation of the SD-Biosensor antigen test for SARS-CoV-2

Evaluation of a novel antigen-based rapid detection test for the diagnosis of SARS-CoV-2 in respiratory samples

Evaluation of a SARS-CoV-2 rapid antigen test: Potential to help reduce community spread?

SARS-CoV-2 Ag Test Specifications

SARS-CoV-2 Virus Culture and Subgenomic RNA for Respiratory Specimens from Patients with Mild Coronavirus Disease

Epidemiologic characteristics associated with SARS-CoV-2 antigen-based test results, rRT-PCR cycle threshold values, subgenomic RNA, and viral culture results from university testing

Viral RNA load as determined by cell culture as a management tool for discharge of SARS-CoV-2 patients from infectious disease wards

Evaluation of the mRNA-1273 Vaccine against SARS-CoV-2 in Nonhuman Primates

ChAdOx1 nCoV-19 vaccine prevents SARS-CoV-2 pneumonia in rhesus macaques

DNA vaccine protection against SARS-CoV-2 in rhesus macaques

Continuous and Discontinuous RNA Synthesis in Coronaviruses

The authors declare no conflict of interest.Viruses 2021, 13, 818