key: cord-0691806-yv8h4rdl
authors: Ferté, Thomas; Ramel, Viviane; Cazanave, Charles; Lafon, Marie-Edith; Bébéar, Cécile; Malvy, Denis; Georges-Walryck, Agnès; Dehail, Patrick
title: Accuracy of COVID-19 rapid antigenic tests compared to RT-PCR in a student population: the StudyCov study
date: 2021-06-05
journal: J Clin Virol
DOI: 10.1016/j.jcv.2021.104878
sha: 405435c7e1c11817afdfcb61a78283933e5fec58
doc_id: 691806
cord_uid: yv8h4rdl

OBJECTIVE: There is a lack of data evaluating performance of antigenic test (AT) for SARS-CoV-2 diagnosis (Ag-RDT) in clinical practice, especially in asymptomatic subjects. The main objective of this study was to evaluate the diagnostic performance of AT compared to Reverse Transcription Polymerase Chain Reaction (RT-PCR) for SARS-CoV-2 diagnosis. METHODS: StudyCov is a monocentric cross-sectional study. A SARS-CoV-2 screening facility was set up in the Bordeaux University health campus from October 28(th) to November 20(th) 2020. Students willing to have a RT-PCR test (ARGENE SARS-CoV-2 R-GENE, BioMérieux, France) for SARS-CoV-2 diagnosis were also offered the Abbott Panbio™ SARS-CoV-2 antigenic rapid test. All participants attending the screening facility with an AT in addition to RT-PCR and having signed an informed consent were included in the study. The main objective was to assess performance of AT as compared with RT-PCR in the recruited population. Secondary objectives dealt with the analysis of the main objective stratified by current symptoms and risk exposure. A sensitivity analysis with different RT-PCR cycle thresholds was included. RESULTS: RT-PCR and AT results were available for 692 subjects. Overall sensitivity and specificity of AT tests were respectively 63.5% (95% confidence interval (CI): 49.0 – 76.4) and 100% (95% CI: 99.4 – 100). In the asymptomatic sub-group, they were respectively 35.0% (95% CI: 15.4% - 59.2%) and 100% (95% CI: 99.3 - 100). CONCLUSIONS: This study shows the poor sensitivity of AT in asymptomatic subjects, specificity being however excellent. The performance results fall below the World Health Organization recommendation of 80% sensitivity and question using AT in general population, especially when asymptomatic.

StudyCov is a monocentric cross-sectional study. A SARS-CoV-2 screening facility was set up in the Bordeaux University health campus from October 28 th to November 20 th 2020. Students willing to have a RT-PCR test (ARGENE SARS-CoV-2 R-GENE, BioMérieux, France) for SARS-CoV-2 diagnosis were also offered the Abbott Panbio™ SARS-CoV-2 antigenic rapid test. All participants attending the screening facility with an AT in addition to RT-PCR and having signed an informed consent were included in the study. The main objective was to assess performance of AT as compared with RT-PCR in the recruited population. Secondary objectives dealt with the analysis of the main objective stratified by current symptoms and risk exposure. A sensitivity analysis with different RT-PCR cycle thresholds was included.

RT-PCR and AT results were available for 692 subjects. Overall sensitivity and specificity of AT tests were respectively 63.5% (95% confidence interval (CI): 49.0 -76.4) and 100% (95% CI: 99.4 -100). In the asymptomatic sub-group, they were respectively 35.0% (95% CI: 15.4% -59.2%) and 100% (95% CI: 99. 3 -100) .

This study shows the poor sensitivity of AT in asymptomatic subjects, specificity being however excellent. The performance results fall below the World Health Organization recommendation of 80% sensitivity and question using AT in general population, especially when asymptomatic.

Rapid identification of SARS-CoV-2 cases is a cornerstone in the management of the COVID-19 pandemic. Reverse Transcriptase Polymerase Chain Reaction (RT-PCR) is the reference test for SARS-CoV-2 diagnosis. In addition, various antigenic tests (AT) have been developed. They provide test results in about 15 minutes, which is much shorter than for RT-PCR tests.

Some studies have compared both RT-PCR and AT performances. Regulatory health agencies performed meta-analyses of the latter in order to establish testing recommendations [1] [2] [3] [4] .

Concerning AT, the Haute Autorité de Santé (HAS) -the French National Authority for Healthconcluded to an homogeneous good specificity of 98.7% (95% confidence interval (95% CI):

97.3 -99.4). However, sensitivity was extremely heterogeneous, from 17 to 97%, depending on the study and the targeted population, with a pooled sensitivity of 90% (95% CI: 73 -96) [4] . Therefore, the World Health Organization (WHO) recommended a minimum sensitivity of 80% and a minimum specificity of 97% for AT effective use [3] . However, to date, few studies have been performed in the general population and in asymptomatic people. This is of concern as some countries are promoting the use of AT without solid knowledge about their actual performance [4] [5] [6] [7] .

From October 28 th to November 20 th 2020, a screening center has been operated in the Bordeaux University health campus (France). Students willing to be tested for SARS-CoV-2 by RT-PCR were also offered AT. The objective of this cross-sectional study was to assess the diagnosis performance of a nasopharyngeal antigenic rapid test compared to RT-PCR in this population of students and in the subgroup of asymptomatic subjects.

This study is a monocentric diagnosis cross-sectional retrospective study. All participants older than 18 years and tested with both AT and RT-PCR at the screening facility of the Bordeaux University health campus were included in the study. The index test was the nasopharyngeal Abbott Panbio™ SARS-CoV-2 Ag rapid test. The reference test was the RT-PCR of N and RdRp genes (ARGENE SARS-CoV-2 R-GENE, BioMérieux, France) with a maximum cycle threshold (Ct) of 45, the current standard of care in the Bordeaux University Hospital. Nasopharyngeal samplings for both tests were performed simultaneously, in each nostril. AT and RT-PCR readings were blinded to each other thanks to different logistic tracks. Testing and reading were performed by trained teams and the reading was carried out by a single reader following the manufacturer's instructions.

The main objective was sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) of AT compared to RT-PCR in the whole study population. RT-PCR was considered positive when both nucleocapsid (N) and RNA-dependent RNA polymerase (RdRp) genes were detected. Secondary objectives were performances of AT compared to RT-PCR stratified by current symptoms and risk situation exposure (over the previous week). Risk situation exposure was defined as attending a party, practicing team sports or having contact with another person outside home without a mask over the previous week. Sensitivity analysis with different RT-PCR Ct was included. We also compared the Ct of N and RdRp SARS-CoV-2 gene amplifications among subjects with a positive SARS-CoV-2 RT-PCR test stratified by AT results and current symptoms.

Subjects with missing RT-PCR or AT results were excluded from the analysis. Sensitivity, specificity, PPV and NPV confidence intervals were computed using the exact binomial method.

Ct values for N and RdRp viral genes were compared using Wilcoxon ranked test. Analyses were performed using R v4.0.0 and the epiR package [8] .

Subjects' characteristics are described in Table 1 when considering asymptomatic patients exposed to a risk situation. Figure 1 shows the association between AT result, current symptoms and Ct. ** : Missing RT-PCR for 6 patients, of which 3 also missed AT.

Both PCR and antigenic test were available for 688 patients.

Overall AT sensitivity for subjects exposed to a risk situation and sensitivity among asymptomatic exposed to a risk situation were, respectively, 67.6% (95% CI: 49.5 -82.6) and

36.4% (95% CI:10.9 -69.2). When considering RT-PCR as positive if both genes were detected, one of which with a Ct ≤ 30 they were respectively 81.5% (95% CI: 61.9 -93.7) and 44.4%

(95% CI: 13.7 -78.8).

In this cohort of 692 subjects, 52 had a positive RT-PCR, 47 of which were considered likely contagious (i.e 2 genes detected, one of which with a Ct ≤ 33) [9, 10] . Using AT instead of RT-PCR, 19 (36.5%) subjects would have been missed, including 14 considered likely contagious.

Among the 20 asymptomatic RT-PCR positive students, 17 were considered likely contagious.

Using AT instead of RT-PCR, 13 (65%) subjects would have been missed, including 10 considered likely contagious. 

This study highlights that AT lack sensitivity compared to RT-PCR in the context of SARS-CoV-2 diagnosis and screening. For the asymptomatic sub-group, two thirds of SARS-CoV-2 cases would be considered negative by AT even among the likely contagious ones. However, there was no false-positive in this study thus making AT reliable when positive. False negative in the asymptomatic people might be explained by high Ct, as shown in figure 1 .

Few studies comparing AT and RT-PCR have been conducted in the general population and in asymptomatic subjects. The Abbot BinaxNOX TM was compared to RT-PCR in a walk-up population: 84% were asymptomatic and 3% had a positive RT-PCR [11] . Sensitivity and specificity were respectively 93.3% (95% CI: 68.1-99.8%) and 99.9% (95% CI: 99.4-99.9%) for a Ct < 30 case definition. Compared to our study, the swab was done in both nostrils for both tests, the population was older and the AT was different. Those differences might partly explain the performance differences. Another study compared Panbio TM SARS-CoV-2 AG Rapid Test

Device with RT-PCR for emergency units-referred patients, 72.1% of which were asymptomatic [12] . Sensitivity was 73.3 % (95% IC: 62.2-83.8%) which is consistent with our results.

This study is one of the first studies focusing on asymptomatic subjects. The reference test is the one used in the standard of care and both RT-PCR and AT evaluations were done blinded to each other.

As it is a retrospective study, extensive data about subjects' characteristics such as comorbidities were not available. Included subjects are exclusively healthcare students which is

StudyCov highlights lack of antigenic tests sensitivity in a student population and in a field setting for the use of AT: it falls far below the WHO performance recommendations of a minimum sensitivity of 80% [3]. It suggests the need for contextualizing AT use and its higher relevance for symptomatic cases. More studies are needed to find out if those findings are replicable in different populations. Meanwhile, this study should help to reevaluate testing policies. OTHER INFORMATION StudyCov was conducted by the Bordeaux University Hospital, the Agence régionale de santé Nouvelle-Aquitaine (Regional Health Agency of Nouvelle-Aquitaine) and Bordeaux University without any specific funds

TRANSPARENCY DECLARATION Conflict of interest: Pr. Dehail reports personal fees from Allergan, outside the submitted work. assistance. In addition, we thank Bordeaux University hospital and the Agence régionale de santé

Methodology Viviane Ramel : Methodology, Writing -Original Draft

Interim guidance on the use of rapid antigen detection tests for the identification of SARS-CoV-2 infection

Information for Laboratories about Coronavirus (COVID-19)

Antigen-detection in the diagnosis of SARS-CoV-2 infection using rapid immunoassays 2020

Revue rapide sur les tests de détection antigénique du virus SARS-CoV

European Center for Disease Prevention and Control. Options for the use of rapid antigen tests for COVID-19 in the EU/EEA and the UK

Covid-19: Estratégia Nacional de Testes para SARS-CoV-2 -INSA 2020

Clinical Management of Patients with COVID-19: A guide for front-line healthcare workers (Version 2.1) 2020

epiR: An R package for the analysis of epidemiological data. R Package Version

Avis du 25 septembre 2020 de la Société Française de Microbiologie (SFM) relatif à l'interprétation de la valeur de Ct (estimation de la charge virale) obtenue en cas de RT-PCR SARS-CoV-2 positive sur les prélèvements cliniques réalisés à des fins diagnostiques ou de dépistage Version 4 _ 14/01

Viral RNA load as determined by cell culture as a management tool for discharge of SARS-CoV-2 patients from infectious disease wards

Performance characteristics of a rapid SARS-CoV-2 antigen detection assay at a public plaza testing site in San Francisco

Panbio antigen rapid test is reliable to diagnose SARS-CoV-2 infection in the first 7 days after the onset of symptoms

We thank Elena Charpentier, Moufid Hajjar, Laurent Malato and Rodolphe Thiébaut for their help. We thank the Bordeaux University Health Science College medical students and staff for

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.