key: cord-0710488-8tkyzhde
authors: Navero-Castillejos, Jessica; Casals-Pascual, Climent; Narváez, Sofía; Cuesta, Genoveva; Hurtado, Juan Carlos; Fernandez, Mariana; Navarro, Mireia; Peiró-Mestres, Aida; Lasheras, Ma Victoria; Rodriguez, Patricia; Pulgarín, Andrea; Marcos, Ma Ángeles; Vila, Jordi; Martínez, Miguel Julián
title: Diagnostic Performance of Six Rapid Antigen Tests for SARS-CoV-2
date: 2022-03-16
journal: Microbiol Spectr
DOI: 10.1128/spectrum.02351-21
sha: 7596ec5c77d5323f52f05644267cd24812f0039f
doc_id: 710488
cord_uid: 8tkyzhde

Microbiological diagnosis of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has been a challenge. Although real-time reverse transcription PCR (RT-PCR) represents the gold standard method, strategies that allow rapid and simple diagnosis are necessary for the early identification of cases. In this study, we evaluated the diagnostic performance of six different commercial rapid antigen tests (Coronavirus antigen [Ag] rapid test cassette [Healgen Scientific, Houston, TX, USA], COVID-19 Ag FIA [Vircell, SD Biosensor Inc., Gyeonggi-do, Republic of Korea], Clinitest rapid COVID-19 antigen test [Siemens, Healthineers, Erlangen, Germany], SARS-CoV-2 rapid antigen test [SD Biosensor; Roche Diagnostics, Basel, Switzerland], Panbio COVID-19 Ag rapid test device [Abbott, Chicago, IL, USA], and SARS-CoV-2 test [MonLab, Barcelona, Spain]) in 130 nasopharyngeal swab samples tested previously by RT-PCR. The overall sensitivity of the rapid tests ranged from 65% to 79%, and the specificity was 100% for all of them. The sensitivity was higher for those samples with RT-PCR cycle threshold (C(T)) values below 25 and those from patients presenting within the first week of symptoms. The Siemens test showed the highest sensitivity for patients with high viral loads while the Vircell test performed better than the rest for C(T) values of ≥25. IMPORTANCE The rapid detection of people infected with SARS-CoV-2 is essential for a correct and effective control of the disease it causes. This process must be sensitive, fast, and simple, and it must be possible to carry out in any type of health center. Rapid antigen tests are the answer to this need. Knowing its ability to detect the virus in different stages of the disease is essential for a correct diagnosis, which is why this study has been carried out to evaluate the sensitivity and specificity of 6 different antigens tests in nasopharyngeal smear samples.

IMPORTANCE The rapid detection of people infected with SARS-CoV-2 is essential for a correct and effective control of the disease it causes. This process must be sensitive, fast, and simple, and it must be possible to carry out in any type of health center. Rapid antigen tests are the answer to this need. Knowing its ability to detect the virus in different stages of the disease is essential for a correct diagnosis, which is why this study has been carried out to evaluate the sensitivity and specificity of 6 different antigens tests in nasopharyngeal smear samples.

KEYWORDS SARS-CoV-2, rapid antigen test, diagnosis T he severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic has been a challenge not only for infection surveillance but also for diagnosis. Since December 2020, it has caused more than 258 million cases and over 5.17 million deaths worldwide (1) . Although vaccination is greatly effective, the rapid identification of cases and patient isolation remain crucial strategies in terms of infection control. In this context, real-time reverse transcription-PCR (RT-PCR) represents the gold standard diagnostic method for SARS-CoV-2 infections. However, RT-PCR assays are time consuming, are expensive, and require trained personnel. Thus, this type of diagnosis is not feasible in some health centers (2, 3) . In such cases, simple and rapid strategies for SARS-CoV-2 detection, like antigen-detecting rapid diagnostic tests, offer a suitable alternative for the early diagnosis and control of the infection. The direct qualitative detection of the viral nucleocapsid protein in nasopharyngeal swabs can be performed using lateral flow tests (LFTs) with a turnaround times of 15 to 30 min. Several of these than 15% of the samples with C T values of $25. The Siemens RAT showed the highest sensitivity for high viral load samples (98%), whereas the Vircell RAT was the test detecting more samples with C T values of $25 (36%).

The sensitivity of the RATs fluctuated according to the days of the onset of the symptoms (Fig. 1B) . The sensitivity in samples with #7 days of symptomatology was around 88%, and the Siemens test showed the best results (95%). However, when the days of the onset were .7, the sensitivities were reduced drastically to values between 37% (MonLab) and 68% (Vircell). Only 7 samples were obtained from asymptomatic patients and 12 from patients without any information about the onset of symptoms. In these cases, they were better detected when the C T values were lower than 25 (data not shown).

Negative predictive value and positive predictive value. As the samples selected had a high percentage of positive results (62%), we calculated the posttest positive and negative predictive values (PPVs and NPVs, respectively) at different disease prevalences that were representative values of those reported during the pandemic in our setting, namely, 1%, 5%, 10%, 15%, and 20% (Table S1 ). Because of the high specificity presented by the antigen tests in this work, the PPV of all of them was 100% under all the conditions evaluated.

The NPV varied according to the sensitivity presented by the test and the disease prevalence. Nevertheless, although in a prevalence of the 20%, the NPV was lower than that in the other situations, it was still higher than 90%. With a disease prevalence of less than 10%, the NPV showed by the different kits exceeded the 95%, approaching 100% in the case of the 1%. The accuracy for the different prevalence values showed a value greater than 90% in all the kits evaluated. The tests with the best values in terms of PPV, NPV, and accuracy were those of Siemens and Vircell, according to their higher sensitivities.

This study compared the effectiveness of 6 rapid antigen tests, 1 of them automatic, to detect SARS-CoV-2 infections. This rapid screening procedure is now used widely in health centers to screen incoming tourists or to grant access to a wide array of cultural events, where there is a significant risk of virus transmission.

In previous studies, rapid antigen tests have presented a great sensitivity regardless of the symptomatology, and they were found to be more effective in patients with a high viral load (C T of , 25) (5-9). Under these conditions, the sensitivity of the evaluated tests in this work was also more than 90% (except in MonLab assay, which was 89.5%) and the specificity was 100%. The best results were observed with the Siemens assay (98.2%). While these values correspond with the same ones obtained by Merino-Amador et al. (9) , they found a higher sensitivity in patients with a C T of .25 (28.1% versus 13% in our case). Several studies have also evaluated the Panbio COVID-19 antigen (Ag) rapid test obtaining sensitivities ranging between 80% to 90% which increased above 95% when the C T value was lower than 25 (7, 10, 11) . Although we observed a slightly low overall sensitivity (70%) like that obtained by Andreani et al. (12) , this finding was in line with our results. Despite that high sensitivities of the Roche SARS-CoV-2 rapid antigen test were first described in samples with a C T of ,30 (13), the results obtained in our comparison were more similar with those observed recently (i.e., 95% to 100% only for C T values of ,25) (5, 14) . Another study by Favresse et al. reported for the first time the effectiveness of the Healgen rapid test for SARS-CoV-2 diagnosis (5). In their work, they observed a sensitivity around 76% which increased to 96.6% in samples with a C T under 25. These results were supported by later studies that also indicated a lower specificity with respect to other antigen tests (80% to 88%) (10, 15, 16) . Even though in our study this test showed a lower sensitivity (66.7% and 91%, respectively), the specificity was 100% in all cases. Of note, our study is the first to evaluate the MonLab tests. When the viral load decreased with C T values above 25, no test presented a sensitivity greater than 15% except the Vircell automatic reader, which detected 36.4% of the samples with C T values of $25. The automatic reading of the fluorescent signal can be more sensitive than visual inspection of some of the RATs, which may account for the higher sensitivity of the Vircell assay for samples with a low viral load (17, 18) .

Currently, there is no consensus on the influence of the presence or absence of symptoms on the sensitivity of the antigen tests. While several studies show that the sensitivity of RATs decreases in asymptomatic cases (8, 13, 19, 20) , it is unclear if it is related to the viral load, since other studies have reported that the viral load might be similar in symptomatic and asymptomatic infections (21, 22) .

However, it has been reported that in symptomatic patients, the viral load tends to decline over time (23, 24) . In our study, we observed that in samples collected within the first week of the onset of clinical symptoms, the sensitivity ranged from 79% to 95% but decreased to 45% when the sampling took place after 7 days, except for the Vircell antigen test (68%). This finding has been reported previously in the literature (6, 9, 11, 17, 25) .

Despite the low effectiveness presented by the RATs in patients with more than 7 days of symptoms or low viral load, the high sensitivity shown in acute infections with significant viral loads (C T of , 25 or #7 days of onset) makes them a good tool to identify highly infectious patients. This result is relevant in terms of infection control, given that it has been reported that a small proportion of patients with very high viral loads might be responsible for the transmission of a great proportion of SARS-CoV-2 infections (26) (27) (28) .

Patients and sample selection. The study was conducted between November 2020 and January 2021. The specimens were nasopharyngeal swabs (NPSs) collected in 3 mL of VTM (Quimigen, Spain) from patients with suspected COVID-19 infections or from people who had been in contact with confirmed cases. All patients were attended in our hospital or associated primary health centers. We selected a panel of 130 samples tested previously by standard RT-PCR methods; 80 samples were positive and 50 were negative. All 130 samples corresponded to individual patients and were stored at 280°C until testing. The RT-PCR cycle threshold (C T ) values and the time elapsed (in days) between the onset of symptoms and sample collection were recorded. This study received a waiver from the Clinical Research Ethics Committee of the Hospital Clinic of Barcelona.

Molecular diagnosis. SARS-CoV-2 molecular diagnosis of NPSs was performed using the Xpress SARS-CoV-2 (GeneXpert, Cepheid, USA) or the TaqPath COVID-19 RT-PCR kit (ThermoFisher Scientific, Waltham, MA).

Rapid antigen tests. The following six RATs were evaluated in this study: Coronavirus Ag rapid test cassette (Healgen Scientific, Houston, TX, USA), COVID-19 Ag FIA (Vircell, SD Biosensor Inc., Gyeonggi-do, Republic of Korea), Clinitest rapid COVID-19 antigen test (Siemens, Healthineers, Erlangen, Germany), SARS-CoV-2 rapid antigen test (SD Biosensor, Roche Diagnostics, Basel, Switzerland), Panbio COVID-19 Ag rapid test device (Abbott, Chicago, IL, USA), and SARS-CoV-2 test (MonLab, Barcelona, Spain). Samples in VTM were mixed with the corresponding buffer in a 1:1 proportion, they were loaded into the devices, and the tests were performed and interpreted following the manufacturer's instructions. After 15 min, the results were read manually except with COVID-19 FIA (Vircell, SD Biosensor) which required an automatic reader. All tests were carried out under biosafety conditions. Samples were thawed once and tested by all six RATs.

Clinical data and statistical analysis. The presence or absence of symptoms, the days after the onset of symptoms and sample collection, and the SARS-CoV-2 RT-PCR C T value were retrieved from the hospital's medical and laboratory records. In this study, the C T value corresponding to the N gene was used to compare the sensitivity of the antigen tests in different C T ranges of the RT-PCR. Rapid antigen diagnostic tests were evaluated for their sensitivity (S) and specificity (Sp) using RT-PCR as a reference. The overall S and Sp were calculated, as well as the performance of the tests depending on the RT-PCR C T value (,25 and $25) and at different time after the onset of symptoms (#7 and .7 days). Negative predictive value (NPV), positive predictive value (PPV), and accuracy were calculated for different prevalences of the disease. The statistical parameters were calculated using the MedCalc platform (https:// www.medcalc.org/calc/diagnostic_test.php, accessed August 2021). The accuracy of the tests (overall probability that a patient is correctly classified) was defined as follows: sensitivity  prevalence 1 specificity  (1 2 prevalence).

Supplemental material is available online only. SUPPLEMENTAL FILE 1, PDF file, 0.04 MB. We declare no conflict of interest.

WHO. 2020. WHO Coronavirus (COVID-19) dashboard. WHO

Adeli K, and the IFCC Taskforce on COVID-19. 2020. IFCC interim guidelines on serological testing of antibodies against SARS-CoV-2

Interim guidelines for COVID-19 antibody testing

SARS-CoV-2 diagnostics pipeline

Head-to-head comparison of rapid and automated antigen detection tests for the diagnosis of SARS-CoV-2 infection

Diagnostic performance of CerTest and Panbio antigen rapid diagnostic tests to diagnose SARS-CoV-2 infection

Panbio COVID-19 validation group. 2021. Multicenter evaluation of the Panbio COVID-19 rapid antigendetection test for the diagnosis of SARS-CoV-2 infection

Point-of-care evaluation of a rapid antigen test (CLINITEST rapid COVID-19 antigen test) for diagnosis of SARS-CoV-2 infection in symptomatic and asymptomatic individuals

Clinitest rapid COVID-19 antigen test for the diagnosis of SARS-CoV-2 infection: a multicenter evaluation study

SARS-CoV-2 rapid antigen test: high sensitivity to detect infectious virus

Field evaluation of a rapid antigen test (Panbio TM COVID-19 Ag Rapid Test Device) for COVID-19 diagnosis in primary healthcare centres

Evaluation of six commercial SARS-CoV-2 rapid antigen tests in nasopharyngeal swabs: better knowledge for better patient management?

Comparison of the SARS-CoV-2 rapid antigen test to the real star SARS-CoV-2 RT PCR kit

Clinical assessment of the Roche SARS-CoV-2 rapid antigen test

Evaluation of two rapid antigenic tests for the detection of SARS-CoV-2 in nasopharyngeal swabs

Comparison of seven commercial SARS-CoV-2 rapid point-of-care antigen tests: a single-centre laboratory evaluation study

Evaluation of two fluorescence immunoassays for the rapid detection of SARS-CoV-2 antigen-new tool to detect infective COVID-19 patients

Comparative performance of SARS-CoV-2 lateral flow antigen tests and association with detection of infectious virus in clinical specimens: a single-centre laboratory evaluation study

Evaluation of a rapid antigen test (PanbioTM COVID-19 Ag rapid test device) for SARS-CoV-2 detection in asymptomatic close contacts of COVID-19 patients

Evaluation of the Panbio COVID-19 rapid antigen detection test device for the screening of patients with COVID-19

SARS-CoV-2 viral load in upper respiratory specimens of infected patients

Duration of infectiousness and correlation with RT-PCR cycle threshold values in cases of COVID-19

SARS-CoV-2 detection, viral load and infectivity over the course of an infection

Diagnostic performance of rapid antigen test for COVID-19 and the effect of viral load, sampling time, subject's clinical and laboratory parameters on test accuracy

A SARS-CoV-2 nucleocapsid variant that affects antigen test performance

Estimating infectiousness throughout SARS-CoV-2 infection course

Transmission of COVID-19 in 282 clusters in Catalonia, Spain: a cohort study

Just 2% of SARS-CoV-2-positive individuals carry 90% of the virus circulating in communities