key: cord-1008687-et3rkraa
authors: Murillo-Zamora, Efrén; Trujillo, Xóchitl; Huerta, Miguel; Ríos-Silva, Mónica; Mendoza-Cano, Oliver
title: Performance of Antigen-Based Testing as Frontline Diagnosis of Symptomatic COVID-19
date: 2021-08-21
journal: Medicina (Kaunas)
DOI: 10.3390/medicina57080852
sha: 773ce6fb8b4022d72fc22ba992b8a21f78a28ca9
doc_id: 1008687
cord_uid: et3rkraa

Background and Objectives: To evaluate the performance of antigen-based detection tests as the frontline diagnosis of coronavirus disease 2019 (COVID-19). Materials and Methods: We conducted a nationwide retrospective cohort study in Mexico. A cross-sectional analysis of a cohort study was conducted in Mexico and data from 15,408 suspected (all of them symptomatic) cases of COVID-19 were analyzed. The results of antigen-based tests were compared with those obtained by molecular (polymerase chain reaction-based) assays. Results: The antigen-based tests showed sensitivity below 50% and high specificity in all the analyzed age groups. The highest Youden index (J) was observed among adults aged 25–44 years old (45.5, 95% CI 43.7–47.3). Conclusions: We documented the poor performance of serologic techniques as frontline diagnosis of symptomatic COVID-19 and inaccurate results may impact negatively on pandemic progression.

The burden of the coronavirus disease 2019 (COVID-19) caused by severe acute respiratory syndrome Coronavirus 2 (SARS-CoV-2) has been high in Mexico. By the end of January 2021, about 1.8 million laboratory-confirmed cases of COVID-19 had been registered together with 150 thousand associated deaths [1] .

Since the beginning of the pandemic, nucleic acid amplification tests (NAATs) had been used for the clinical diagnosis of COVID-19 in Mexican public healthcare settings. However, given that specialized laboratory techniques are required, clinical samples are commonly shipped to centralized facilities, causing delays in result reporting and lowering the impact of clinical decision-making and transmission interruption [2] .

Antigen-based tests are immunoassays that represent an inexpensive and easy-to-use alternative in COVID-19 diagnosis and were widely implemented in December 2020 in the public healthcare system of Mexico. By the end of the first trimester of 2021, 12 commercial tests had been approved to be used in the Mexican territory: SARS-CoV-2 Antigen Assay Kit (Zybio Inc., Shenzhen, China); Panbio™ COVID-19 Ag Rapid Test Device (Nasal; Abbott Laboratories, Chicago, IL, USA); ECOTEST COVID-19 Antigen Rapid Test Device (Assure Tech (Hangzhou) Co., Hangzhou, China); 2019-NCoV Antigen Test Kit (Genrui Biotech Inc., Shenzhen, China); COVI-STIX™ COVID-19 Virus Rapid Antigen Detection Test (ZhengZhou Fortune Bioscience Co., Zhengzhou, China); COVID-19 Antigen Rapid Test Cassette (Hangzhou Clongene Biotech Co., Yuhang, China); CerTest SARS-CoV-2 Ag Test (Certest Biotec SL., Zaragoza, Spain); GeneFinder™ COVID-19 Ag Rapid Test (Osang Healthcare Co., Anyangcheondong-ro, Anyang, Korea); SARS-CoV-2 Antigen Test Kit (Genrui Biotech Inc., Shenzhen, China); SARS-CoV2 Antigen Rapid Test System (Monocent Inc., Chatsworth, CA, USA); SARS-CoV-2 Rapid Antigen Test (SD BioSensor Inc., Suwon, Korea); STANDARD™ Q COVID-19 Ag Test (SD BioSensor Inc., Suwon, Korea); Panbio™ COVID-19 Ag Rapid Test Device (Abbott Rapid Diagnostics Jena GmbH, Jena, Germany); and Sofia2 SARS Antigen FIA (Quidel Corporation, San Diego, CA, USA) [3] .

We aimed to assess the performance of rapid antigen detection tests as the frontline diagnosis of COVID-19 in comparison to molecular techniques in a real-world scenario.

We conducted a cross-sectional analysis of a cohort study that took place in Mexico. Patients fulfilling suspected COVID-19 criteria and disease onset from December 2020 to January 2021, and in whom antigen-based detection tests and NAATs (reverse transcriptionpolymerase chain reaction, RT-PCR) were performed in nasopharyngeal swab specimens, were analyzed. Only symptomatic patients were eligible. Subjects with 2 or more days elapsed between both clinical specimens being taken were excluded. A wider description of research methods from the follow-up study was previously published [4, 5] .

The molecular assays were carried out by using the SuperScript III Platinum One-step RT-PCR System (Invitrogen, Carlsbad, CA, USA; catalog: 12574035) in the 7500 Fast Real-Time PCR System (Applied Biosystems, Foster City, CA, USA). The employed tests were any of the kits approved to be used in Mexico, since we were unable to identify which of them was used in each enrolled patient.

The performance of the antigen-based test was evaluated in terms of sensitivity, specificity, accuracy, and positive and negative likelihood ratio (LR+/−). Age-stratified (0-13; 14-17; 18-24; 25-44; 45-79 and 80 years or above) estimators were obtained. Area Under Receiver Operating Characteristic curves (AUROCs), Youden's index (J), and 95% confidence intervals (CI) were also computed. The analytical procedure was performed by using the Stata Statistical Software: Release 15 (StataCorp LLC; College Station, TX, USA). This study was approved by the Local Ethics in Health Research Committee (601) of the Mexican Institute of Social Security (R-2021-601-022).

Data from 15,408 individuals were analyzed. A total of 49.5% of participants were female and their mean age (±standard deviation) was 47.2 ± 18.5 years. The mean days elapsed from symptoms onset to clinical sampling were 3.4 ± 1.3 and 3.3 ± 1.3 for RT-PCR and antigen-based testing, respectively. From patients with a positive RT-PCR (n = 8653), 3937 and 4710 had positive and negative antigen-based results, respectively. Additionally, among patients with a negative molecular-based result (n = 6755), 297 had a positive antigen-based result and the rest of them also were discarded by rapid testing.

The performance estimates are presented in Table 1 . The sensitivity of rapid tests in diagnosing COVID-19 was low, and the mean estimate was 45.5% (95% CI 44.7-46.3%); it was lower among children (35.9%, 95% CI 30.9-40.9%) and teenagers (37.1%, 95% CI 27.2-47.4%) when compared with older patients. The age-stratified specificity went from 94.5 (95% CI 94.0-95.0, 45-79 years old) to 99.3 (97.6-99.8, 0-13 years old). 

During the COVID-19 pandemic, antigen-based testing has played a major role in limiting viral pathogen spread and medical management of infected patients. However, our findings suggest that about 6 out of 10 patients with SARS-CoV-2 infection may have a negative antigen-based test result. Inaccurate results may negatively impact on clinical management of patients and favor viral spread.

The overall sensitivity from our study was higher than estimated in a previously published study that took place in Belgium (45.5% vs. 30.2%, p = 0.002) [6] . The authors from the European study do not specify if asymptomatic patients were screened and if that occurred and given that we only analyzed patients with suggestive symptoms of COVID-19, it may partially explain these discrepant findings.

Factors affecting SARS-CoV-2 testing are numerous and include, among others, the viral load and integrity of specimen collection and handling. In our analysis, the test sensitivity among children (35.9, 95% CI 30.9-40.9) and teenagers (37.1, 95% CI 27.2-47.4) was below the mean; we hypothesize that a higher rate of imperfectly generated specimens among younger subjects may at least partially account for the bias observed. Users should follow the manufacturer's instructions, as well as state and local guidance, for when and how often to perform testing on control specimens [7] .

We were unable to determine which specific diagnostic kit was used in each participant and that represents a limitation of our analysis. According to normative standards, the rapid-antigen tests authorized to be employed in the diagnosis of COVID-19 in healthcare settings from Mexico must have sensitivity and specificity above 80% and 97%, as corresponding [8] .

Antigen-based tests are relevant to reduce the COVID-19 pandemic's progression. However, their performance in the study sample was below the desired standard, mainly in terms of sensitivity. Efforts focusing on assuring the quality of clinical samplings and their handling are needed to provide an accurate and opportune diagnosis of SARS-CoV-2 infection. 

De-identified data were analyzed and the informed consent to participate was waived.

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

The authors declare no conflict of interest.

COVID-19 in Mexico: General Data

SARS-CoV-2 Antigen Detecting Rapid Diagnostic Test Implementation Projects

List of Useful Antigenic Tests for SARS-CoV-2 during the COVID-19 Contingency in Mexico

Predictors of laboratory-positive COVID-19 in children and teenagers

Survival in adult inpatients with COVID-19

Low performance of rapid antigen detection test as frontline testing for COVID-19 diagnosis

Centers for Disease Control and Prevention. Interim Guidance for Antigen Testing for SARS-CoV-2

General Directorate of Epidemiology. Statement on the Use of Tests for Detection of SARS-CoV-2 Antigen in Mexico